The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_LIRA logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 7
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Yices2 | Yices2 | Yices2 | Yices2 | Yices2 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 6 | 48.42 | 49.14 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-alpha2 ne | 0 | 6 (base +0) | 57.73 | 58.46 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| z3-BooledASS ne | 0 | 6 (base +0) | 58.82 | 59.56 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-alpha2-debug n | 0 | 6 | 79.15 | 74.15 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-GEX ne | 0 | 6 (base +0) | 80.39 | 81.15 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| cvc5 | 0 | 5 | 10.36 | 10.96 | 5 | 1 | 4 | 2 | 0 | 2 | 0 |
| cvc5-cvc5-xyz ne | 0 | 5 (base +0) | 15.28 | 15.90 | 5 | 1 | 4 | 2 | 0 | 2 | 0 |
| SMTInterpol | 0 | 4 | 165.03 | 96.49 | 4 | 1 | 3 | 3 | 0 | 0 | 0 |
| Z3-alpha2-base n | 0 | 6 | 56.50 | 57.25 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| z3-BooledASS-base n | 0 | 6 | 57.51 | 58.28 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-GEX-base n | 0 | 6 | 75.24 | 75.99 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 5 | 15.21 | 15.85 | 5 | 1 | 4 | 2 | 0 | 2 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 6 | 48.42 | 49.14 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-alpha2 ne | 0 | 6 (base +0) | 57.73 | 58.46 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| z3-BooledASS ne | 0 | 6 (base +0) | 58.82 | 59.56 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-alpha2-debug n | 0 | 6 | 79.15 | 74.15 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-GEX ne | 0 | 6 (base +0) | 80.39 | 81.15 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| cvc5 | 0 | 5 | 10.36 | 10.96 | 5 | 1 | 4 | 2 | 0 | 2 | 0 |
| cvc5-cvc5-xyz ne | 0 | 5 (base +0) | 15.28 | 15.90 | 5 | 1 | 4 | 2 | 0 | 2 | 0 |
| SMTInterpol | 0 | 4 | 165.03 | 96.49 | 4 | 1 | 3 | 3 | 0 | 0 | 0 |
| Z3-alpha2-base n | 0 | 6 | 56.50 | 57.25 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| z3-BooledASS-base n | 0 | 6 | 57.51 | 58.28 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| Z3-GEX-base n | 0 | 6 | 75.24 | 75.99 | 6 | 1 | 5 | 1 | 0 | 1 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 5 | 15.21 | 15.85 | 5 | 1 | 4 | 2 | 0 | 2 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 1 | 0.20 | 0.31 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| Z3-alpha2 ne | 0 | 1 (base +0) | 1.55 | 1.68 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| z3-BooledASS ne | 0 | 1 (base +0) | 1.60 | 1.72 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| Z3-GEX ne | 0 | 1 (base +0) | 2.18 | 2.32 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| cvc5 | 0 | 1 | 2.42 | 2.54 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1 (base +0) | 2.79 | 2.92 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 1 | 5.31 | 4.50 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| SMTInterpol | 0 | 1 | 18.17 | 8.13 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| Z3-alpha2-base n | 0 | 1 | 1.57 | 1.69 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| z3-BooledASS-base n | 0 | 1 | 1.59 | 1.72 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| Z3-GEX-base n | 0 | 1 | 2.23 | 2.35 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1 | 2.75 | 2.88 | 1 | 1 | 0 | 0 | 6 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 5 | 48.22 | 48.83 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| Z3-alpha2 ne | 0 | 5 (base +0) | 56.17 | 56.78 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| z3-BooledASS ne | 0 | 5 (base +0) | 57.22 | 57.84 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 5 | 73.84 | 69.65 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| Z3-GEX ne | 0 | 5 (base +0) | 78.21 | 78.83 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| cvc5 | 0 | 4 | 7.94 | 8.42 | 4 | 0 | 4 | 1 | 2 | 1 | 0 |
| cvc5-cvc5-xyz ne | 0 | 4 (base +0) | 12.49 | 12.98 | 4 | 0 | 4 | 1 | 2 | 1 | 0 |
| SMTInterpol | 0 | 3 | 146.86 | 88.35 | 3 | 0 | 3 | 2 | 2 | 0 | 0 |
| Z3-alpha2-base n | 0 | 5 | 54.94 | 55.57 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| z3-BooledASS-base n | 0 | 5 | 55.92 | 56.56 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| Z3-GEX-base n | 0 | 5 | 73.01 | 73.64 | 5 | 0 | 5 | 0 | 2 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 4 | 12.46 | 12.96 | 4 | 0 | 4 | 1 | 2 | 1 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 5 | 0.98 | 1.57 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| Z3-alpha2 ne | 0 | 5 (base +0) | 5.22 | 5.82 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| z3-BooledASS ne | 0 | 5 (base +0) | 5.44 | 6.04 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| Z3-GEX ne | 0 | 5 (base +0) | 7.54 | 8.16 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| cvc5 | 0 | 5 | 10.36 | 10.96 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 5 (base +0) | 15.28 | 15.90 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 5 | 24.44 | 20.28 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| SMTInterpol | 0 | 3 | 36.74 | 15.55 | 3 | 1 | 2 | 0 | 4 | 0 | 0 |
| Z3-alpha2-base n | 0 | 5 | 5.21 | 5.83 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| z3-BooledASS-base n | 0 | 5 | 5.41 | 6.04 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| Z3-GEX-base n | 0 | 5 | 7.66 | 8.28 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 5 | 15.21 | 15.85 | 5 | 1 | 4 | 0 | 2 | 0 | 0 |