SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_AUFBV (Single Query Track)

Competition results for the QF_AUFBV logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 38
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla Yices2

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla Fixedn 0 33 2473.644 2474.40933171655 0
Bitwuzla 0 33 2474.619 2475.21533171655 0
Yices2 0 27 2527.759 2528.1812713141111 0
Z3-Owl Fixedn 0 20 3428.861 3428.657207131818 0
2022-Bitwuzlan 0 19 411.792 411.82819109194 0
cvc5 0 12 70.146 70.14712482626 0
UltimateIntBlastingWrapper+SMTInterpol 2 6 330.107 161.7076243226 0
Z3-Owl 6 25 1934.103 1934.628251411137 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla Fixedn 0 332473.6442474.40933171655 0
Bitwuzla 0 332474.6192475.21533171655 0
Yices2 0 272527.7592528.1812713141111 0
Z3-Owl Fixedn 0 203428.8613428.657207131818 0
2022-Bitwuzlan 0 19411.792411.82819109194 0
cvc5 0 1270.14670.14712482626 0
UltimateIntBlastingWrapper+SMTInterpol 2 6330.107161.7076243225 0
Z3-Owl 6 251934.1031934.628251411137 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla 0 171901.871902.393171700215 0
Bitwuzla Fixedn 0 171907.6581908.207171700215 0
Yices2 0 132378.1982378.611313042111 0
2022-Bitwuzlan 0 10369.653369.684101007214 0
Z3-Owl Fixedn 0 72157.8232158.373770102118 0
cvc5 0 424.27724.282440132126 0
UltimateIntBlastingWrapper+SMTInterpol 2 2215.687130.919220152125 0
Z3-Owl 6 141023.5251023.716141403217 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla Fixedn 0 16565.987566.202160161215 0
Bitwuzla 0 16572.749572.822160161215 0
Yices2 0 14149.562149.5711401432111 0
Z3-Owl Fixedn 0 131271.0381270.2841301342118 0
Z3-Owl 0 11910.577910.912110116217 0
2022-Bitwuzlan 0 942.13942.1449098214 0
cvc5 0 845.86945.86580892126 0
UltimateIntBlastingWrapper+SMTInterpol 0 4114.4230.788404132125 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices2 0 2031.50631.522208121818 0
Bitwuzla 0 1660.62160.62816792222 0
Bitwuzla Fixedn 0 1661.20561.22716792222 0
2022-Bitwuzlan 0 1518.94818.9491578238 0
cvc5 0 1132.27332.27411472727 0
Z3-Owl Fixedn 0 852.14551.1078263030 0
UltimateIntBlastingWrapper+SMTInterpol 0 5167.17949.3755143331 0
Z3-Owl 3 1049.88250.09510462825 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.