SMT-COMP 2019

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Papers
Benchmark Submission
Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Previous Competitions

SMT-LIB

QF_FP (Single Query Track)

Competition results for the QF_FP division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 248
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
Par4Par4Par4 Par4 COLIBRI

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 202 129791.892 116901.241202105974646 0
COLIBRI 0 196 128008.372 128018.17319699975252 0
CVC4 0 180 196158.121 196169.985180100806868 0
2018-COLIBRIn 0 175 167501.338 167509.63417587887365 0
Z3n 0 160 282048.777 282089.20716083778888 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 209 146680.232 111333.5892091091003939 0
COLIBRI 0 196 128015.342 128016.20319699975252 0
CVC4 0 180 196176.551 196166.875180100806868 0
2018-COLIBRIn 0 175 167509.698 167506.95417587887365 0
Z3n 0 160 282074.257 282084.97716083778888 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 109 55783.662 36213.378109109013939 0
CVC4 0 100 62274.455 62262.227100100014868 0
COLIBRI 0 99 51216.296 51216.7889999014952 0
2018-COLIBRIn 0 87 67402.009 67403.1628787016165 0
Z3n 0 83 124323.789 124330.0068383016588 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 100 50096.57 34320.211100010014839 0
COLIBRI 0 97 35999.046 35999.4159709715152 0
2018-COLIBRIn 0 88 59307.689 59303.7928808816065 0
CVC4 0 80 93102.096 93104.6488008016868 0
Z3n 0 77 116950.468 116954.9717707717188 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
COLIBRI 0 179 2131.288 2132.03717993866969 0
Par4 0 169 3177.462 2356.89416987827979 0
2018-COLIBRIn 0 154 2626.921 2623.41415480749488 0
CVC4 0 113 3913.072 3898.9221136449135135 0
Z3n 0 43 5217.086 5217.113432419205205 0

n Non-competing.