SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

UFBV (Single Query Track)

Competition results for the UFBV logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 143
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 101 50625.789 50633.69110132694239 0
cvc5 0 94 41789.721 42831.2019418764918 0
Bitwuzla 0 94 60435.682 60443.7949417774949 0
2021-cvc5n 0 80 49022.629 56060.791803776329 0
UltimateEliminator+MathSAT 0 6 12668.442 12146.8886061374 4

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 10150631.62950631.94110132694239 0
cvc5 0 9442365.06142830.2019418764918 0
Bitwuzla 0 9460441.32260441.5449417774949 0
2021-cvc5n 0 8055726.55656059.221803776329 0
UltimateEliminator+MathSAT 0 612668.44212146.8886061374 4

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
z3-4.8.17n 0 324930.7754930.74632320410739 0
cvc5 0 1811842.04812083.54181801810718 0
Bitwuzla 0 1722839.5322839.537171701910749 0
2021-cvc5n 0 324679.27124870.7233303310729 0
UltimateEliminator+MathSAT 0 02885.972732.433000361074 4

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2021-cvc5n 0 7710024.82910073.5467707795729 0
Bitwuzla 0 7712401.79212402.0077707795749 0
cvc5 0 769504.6359641.05876076105718 0
z3-4.8.17n 0 6920500.85420501.19569069175739 0
UltimateEliminator+MathSAT 0 64315.6714037.06860680574 4

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 961305.9831305.8349631654747 0
Bitwuzla 0 901398.0571398.0929017735353 0
cvc5 0 602139.392121.784601598383 0
2021-cvc5n 0 592146.1532146.158590598484 0
UltimateEliminator+MathSAT 0 51243.8916.9450513811 4

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.