SMT-COMP 2025

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

SMT-COMP 2025

QF_AUFBV (Single Query Track)

Competition results for the QF_AUFBV logic in the Single Query Track. Chart

Results were generated on 2025-08-11

Benchmarks: 75
Time Limit: 1200 seconds
Memory Limit: 30720 GB

Winners

Sequential Performance Parallel Performance SAT Performance (parallel) UNSAT Performance (parallel) 24 seconds Performance (parallel)
Bitwuzla Bitwuzla Bitwuzla Yices2 Yices2

Sequential Performance Performance

Solver Error Score Correct Score CPU Time Score Wall Time Score Solved Solved SAT Solved UNSAT Unsolved Abstained Timeout Memout
Bitwuzla 0 65 1684.02 1692.45 65 25 40 10 0 10 0
Yices2 0 61 3257.47 3265.48 61 21 40 14 0 13 1
Z3-Owl 0 56
(base +3)
4259.51 4267.19 56 16 40 19 0 12 4
cvc5 0 43 350.23 355.52 43 12 31 32 0 26 4
SMTInterpol 0 30 1472.77 1270.82 30 4 26 45 0 30 0
Z3-Owl-base n 0 53 4222.47 4229.50 53 15 38 22 0 19 3
(base +/- n): for derived solvers: increment over base solver
n: non-competing solver

Parallel Performance Performance

Solver Error Score Correct Score CPU Time Score Wall Time Score Solved Solved SAT Solved UNSAT Unsolved Abstained Timeout Memout
Bitwuzla 0 65 1684.02 1692.45 65 25 40 10 0 10 0
Yices2 0 61 3257.47 3265.48 61 21 40 14 0 13 1
Z3-Owl 0 56
(base +3)
4259.51 4267.19 56 16 40 19 0 12 4
cvc5 0 43 350.23 355.52 43 12 31 32 0 26 4
SMTInterpol 0 30 1472.77 1270.82 30 4 26 45 0 30 0
Z3-Owl-base n 0 53 4222.47 4229.50 53 15 38 22 0 19 3
(base +/- n): for derived solvers: increment over base solver
n: non-competing solver

SAT Performance Performance

Solver Error Score Correct Score CPU Time Score Wall Time Score Solved Solved SAT Solved UNSAT Unsolved Abstained Timeout Memout
Bitwuzla 0 25 668.67 671.94 25 25 0 0 50 0 0
Yices2 0 21 2855.67 2858.65 21 21 0 4 50 3 1
Z3-Owl 0 16
(base +1)
2837.21 2839.65 16 16 0 9 50 8 1
cvc5 0 12 331.71 333.24 12 12 0 13 50 10 2
SMTInterpol 0 4 1183.80 1111.98 4 4 0 21 50 12 0
Z3-Owl-base n 0 15 2192.06 2194.21 15 15 0 10 50 10 0
(base +/- n): for derived solvers: increment over base solver
n: non-competing solver

UNSAT Performance Performance

Solver Error Score Correct Score CPU Time Score Wall Time Score Solved Solved SAT Solved UNSAT Unsolved Abstained Timeout Memout
Yices2 0 40 401.80 406.83 40 0 40 6 29 6 0
Bitwuzla 0 40 1015.35 1020.52 40 0 40 6 29 6 0
Z3-Owl 0 40
(base +2)
1422.30 1427.54 40 0 40 6 29 4 2
cvc5 0 31 18.53 22.28 31 0 31 15 29 12 2
SMTInterpol 0 26 288.96 158.85 26 0 26 20 29 18 0
Z3-Owl-base n 0 38 2030.40 2035.29 38 0 38 8 29 8 0
(base +/- n): for derived solvers: increment over base solver
n: non-competing solver

24 seconds Performance Performance

Solver Error Score Correct Score CPU Time Score Wall Time Score Solved Solved SAT Solved UNSAT Unsolved Abstained Timeout Memout
Yices2 0 54 48.40 55.13 54 16 38 0 21 0 0
Bitwuzla 0 53 113.52 120.13 53 16 37 0 22 0 0
cvc5 0 42 48.19 53.31 42 11 31 2 31 0 0
Z3-Owl 0 39
(base -3)
166.72 171.66 39 9 30 0 36 0 0
SMTInterpol 0 27 174.80 66.65 27 2 25 6 42 0 0
Z3-Owl-base n 0 42 73.67 78.85 42 9 33 0 33 0 0
(base +/- n): for derived solvers: increment over base solver
n: non-competing solver