SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_ABVFP (Single Query Track)

Competition results for the QF_ABVFP division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 500
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla-fixedn 0 499 4265.161 4260.9024999340611 0
Bitwuzla 0 499 4266.55 4267.8474999340611 0
MathSAT5n 0 493 12917.083 12899.5684939340077 0
CVC4 0 489 18463.334 18439.394489894001111 0
COLIBRI 0 406 26246.007 26188.408406833239420 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla-fixedn 0 499 4265.551 4260.7924999340611 0
Bitwuzla 0 499 4266.9 4267.8174999340611 0
MathSAT5n 0 493 12919.533 12899.2784939340077 0
CVC4 0 489 18466.244 18438.744489894001111 0
COLIBRI 0 406 26247.187 26187.668406833239420 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla-fixedn 0 93 239.038 239.148939304071 0
Bitwuzla 0 93 241.17 241.197939304071 0
MathSAT5n 0 93 1237.198 1231.695939304077 0
CVC4 0 89 5613.321 5613.4818989041111 0
COLIBRI 0 83 3787.881 3784.618383041720 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla-fixedn 0 406 2826.513 2821.6444060406941 0
Bitwuzla 0 406 2825.73 2826.624060406941 0
MathSAT5n 0 400 10482.335 10467.58440004001007 0
CVC4 0 400 11652.923 11625.264400040010011 0
COLIBRI 0 323 21529.53 21473.239323032317720 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 487 876.742 876.915487913961313 0
Bitwuzla-fixedn 0 487 883.833 878.67487913961313 0
MathSAT5n 0 471 2104.035 2083.028471853862929 0
CVC4 0 460 2286.992 2258.707460833774040 0
COLIBRI 0 400 1395.61 1384.4494008231810027 0

n Non-competing.