SMT-COMP 2024

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

SMT-COMP 2024

BV (Single Query Track)

Competition results for the BV logic in the Single Query Track.

Results were generated on 2024-07-08

Benchmarks: 1040
Time Limit: 1200 seconds
Memory Limit: 20480 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24 seconds Performance (parallel)
cvc5cvc5Bitwuzlacvc5YicesQS

Sequential Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
cvc5095234135.38318534238.613579952235717880771
YicesQS089416485.2999116582.79221389423066414601332
Bitwuzla084813189.16629113278.62791184824460419201820
Z3-alpha080013804.17936613886.402258800214586240011510
SMTInterpol0272431.290472254.902194272027276801800

Parallel Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
cvc5095234135.38318534238.613579952235717880771
YicesQS089416485.2999116582.79221389423066414601332
Bitwuzla084813189.16629113278.62791184824460419201820
Z3-alpha080013804.17936613886.402258800214586240011510
SMTInterpol0272431.290472254.902194272027276801800

SAT Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
Bitwuzla02444999.3367455025.433477244244021775130
cvc5023518070.84341818098.655476235235030775211
YicesQS02306743.5023546769.231988230230035775270
Z3-alpha02141388.5950241410.403782214214051775297
SMTInterpol0000000265775880

UNSAT Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
cvc5071716064.53976716139.958104717071740283380
YicesQS06649741.7975569813.560224664066493283882
Bitwuzla06048189.8295478253.19443460406041532831510
Z3-alpha058612415.58434212475.9984765860586171283750
SMTInterpol0272431.290472254.9021942720272485283840

24 seconds Performance Performance

SolverError ScoreCorrect ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeoutMemout
YicesQS0851389.561676479.6979558512096421017900
Bitwuzla0789735.11764815.8790837892235661024100
Z3-alpha0759771.711674848.1613517592085518919200
cvc50758900.167619976.1595847581316271027200
SMTInterpol0271339.968374181.61275271027151725200