SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Previous Competitions
SMT-LIB

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UFBV (Single Query Track)

Competition results for the UFBV division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 72
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
Par4Par4Par4 Par4 Par4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-Z3n 0 51 50431.347 50438.5145118332121 0
Par4 0 51 50462.304 50436.8255118332121 0
Z3n 0 49 55227.572 55235.0864918312323 0
CVC4 0 28 83785.668 84651.656280284434 0
UltimateEliminator+MathSAT-5.5.4 0 6 8922.591 8777.058606663 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 51 50462.304 50436.8255118332121 0
2018-Z3n 0 51 50437.577 50437.5845118332121 0
Z3n 0 49 55234.202 55234.2064918312323 0
CVC4 0 28 84631.488 84649.986280284434 0
UltimateEliminator+MathSAT-5.5.4 0 6 8922.591 8777.058606663 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 18 1.212 2.77181805421 0
2018-Z3n 0 18 3.013 3.014181805421 0
Z3n 0 18 3.038 3.041181805423 0
UltimateEliminator+MathSAT-5.5.4 0 0 1256.42 1199.581000723 0
CVC4 0 0 21602.308 21602.3020007234 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 33 61.092 34.055330333921 0
2018-Z3n 0 33 34.564 34.57330333921 0
Z3n 0 31 4831.164 4831.165310314123 0
CVC4 0 28 12629.179 12647.683280284434 0
UltimateEliminator+MathSAT-5.5.4 0 6 115.396 80.93606663 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 51 566.304 540.8255118332121 0
2018-Z3n 0 51 541.577 541.5845118332121 0
Z3n 0 49 586.202 586.2064918312323 0
CVC4 0 13 1281.207 1281.209130135949 0
UltimateEliminator+MathSAT-5.5.4 0 6 441.096 334.576606666 0

n Non-competing.