SMT-COMP 2019

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Papers
Benchmark Submission
Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Previous Competitions

SMT-LIB

QF_ABV (Challenge Track (non-incremental))

Competition results for the QF_ABV division in the Challenge Track (non-incremental).

Page generated on 2019-07-23 17:57:29 +0000

Benchmarks: 7
Time Limit: 43200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BoolectorBoolectorBoolector Poolector

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Boolector 0 7 258.318 258.3377000 0
Poolector 0 7 970.72 270.96577000 0
Yices 2.6.2 0 7 4255.126 4255.69777000 0
Z3n 0 5 151567.622 151576.4255022 0
2018-Boolectorn 0 1 106.1 107.15711060 0
CVC4 0 0 302255.1 302400.200077 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Boolector 0 7 258.318 258.3377000 0
Poolector 0 7 970.72 270.96577000 0
Yices 2.6.2 0 7 4255.126 4255.69777000 0
Z3n 0 5 151572.322 151576.2255022 0
2018-Boolectorn 0 1 106.1 107.15711060 0
CVC4 0 0 302306.4 302400.000077 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Boolector 0 7 258.318 258.3377000 0
Poolector 0 7 970.72 270.96577000 0
Yices 2.6.2 0 7 4255.126 4255.69777000 0
Z3n 0 5 151572.322 151576.2255022 0
2018-Boolectorn 0 1 106.1 107.15711060 0
CVC4 0 0 302306.4 302400.000077 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-Boolectorn 0 0 0.0 0.000070 0
Boolector 0 0 0.0 0.000070 0
CVC4 0 0 0.0 0.000077 0
Poolector 0 0 0.0 0.000070 0
Yices 2.6.2 0 0 0.0 0.000070 0
Z3n 0 0 0.0 0.000072 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Poolector 0 4 313.123 144.97244033 0
Boolector 0 3 143.778 143.78133044 0
2018-Boolectorn 0 0 37.269 38.32200071 0
CVC4 0 0 168.0 168.000077 0
Yices 2.6.2 0 0 168.0 168.000077 0
Z3n 0 0 168.0 168.000077 0

n Non-competing.