SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_BVFPLRA (Single Query Track)

Competition results for the QF_BVFPLRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 69
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla cvc5 Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 62 10814.904 10813.04762362677 0
cvc5 0 62 15529.117 15530.99362352777 0
2021-cvc5n 0 61 15342.338 15344.12761352688 0
z3-4.8.17n 0 58 19662.083 19664.5775835231110 0
MathSATn 0 56 20223.042 20226.1525635211313 0
COLIBRI 0 49 10867.767 10867.791492524209 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 6210816.26410812.79762362677 0
cvc5 0 6215529.73715530.77362352777 0
2021-cvc5n 0 6115342.97815343.70761352688 0
z3-4.8.17n 0 5819662.83319664.1975835231110 0
MathSATn 0 5620224.31220225.4525635211313 0
COLIBRI 0 4910867.76710867.791492524209 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla 0 36407.572403.826363600337 0
z3-4.8.17n 0 351022.4571022.6113535013310 0
2021-cvc5n 0 351546.9041546.921353501338 0
cvc5 0 351713.9891714.033353501337 0
MathSATn 0 352585.1682585.5013535013313 0
COLIBRI 0 252436.7932436.8182525011339 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 2713815.74713816.74270276367 0
Bitwuzla 0 2610408.69310408.971260267367 0
2021-cvc5n 0 2613796.07313796.786260267368 0
COLIBRI 0 248430.9758430.973240249369 0
z3-4.8.17n 0 2318640.37718641.58723023103610 0
MathSATn 0 2117639.14517639.9521021123613 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 51540.962537.1185134171818 0
COLIBRI 0 49283.767283.791492524209 0
2021-cvc5n 0 46749.399749.4084630162323 0
cvc5 0 42749.401749.4324228142727 0
MathSATn 0 41786.724786.7424127142828 0
z3-4.8.17n 0 40896.888896.8424027132929 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.