SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_ABVFP (Single Query Track)

Competition results for the QF_ABVFP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 600
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 600 2151.74 2131.77560010449600 0
MathSATn 0 595 12888.664 12815.64759510449155 0
2021-cvc5n 0 593 19333.196 19232.77559310249177 0
cvc5 0 591 21914.657 21817.59559110248999 0
z3-4.8.17n 0 555 93363.834 93313.9675551014544544 0
COLIBRI 0 495 41261.919 41243.6584959639910530 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 6002151.742131.77560010449600 0
MathSATn 0 59512889.37412815.35759510449155 0
2021-cvc5n 0 59319334.40619232.35559310249177 0
cvc5 0 59121917.11721817.01559110248999 0
z3-4.8.17n 0 55593372.63493311.9075551014544544 0
COLIBRI 0 49541261.91941243.6584959639910530 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla 0 104146.167146.244104104004960 0
MathSATn 0 104792.027789.155104104004965 0
2021-cvc5n 0 1022886.4812872.306102102024967 0
cvc5 0 1023567.1263547.969102102024969 0
z3-4.8.17n 0 1018588.5288590.0221011010349644 0
COLIBRI 0 963797.1923794.79396960849630 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla 0 4962005.5731985.531496049601040 0
MathSATn 0 49112097.34712026.201491049151045 0
2021-cvc5n 0 49116447.92516360.049491049151047 0
cvc5 0 48918349.99218269.046489048971049 0
z3-4.8.17n 0 45484784.10584721.88545404544210444 0
COLIBRI 0 39937464.72737448.86539903999710430 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 5861029.0661008.945861034831414 0
MathSATn 0 5692627.8582594.718569994703131 0
2021-cvc5n 0 5084334.0694230.9135081004089292 0
cvc5 0 4914531.9274470.21249185406109109 0
COLIBRI 0 4882611.9922593.3724889439411238 0
z3-4.8.17n 0 3357859.6467856.57533574261265265 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.