The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the NRA logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 99
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| SMT-RAT | SMT-RAT | SMT-RAT | SMT-RAT | SMT-RAT |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SMT-RAT | 0 | 96 | 20.07 | 32.02 | 96 | 4 | 92 | 3 | 0 | 3 | 0 |
| Z3-alpha2 | 0 | 96 (base +2) | 972.41 | 935.89 | 96 | 4 | 92 | 3 | 0 | 3 | 0 |
| Z3-alpha2-debug n | 0 | 96 | 1185.35 | 1055.99 | 96 | 4 | 92 | 3 | 0 | 3 | 0 |
| Z3-GEX | 0 | 95 (base +2) | 34.65 | 35.70 | 95 | 3 | 92 | 4 | 0 | 4 | 0 |
| z3-BooledASS ne | 0 | 93 (base +0) | 16.54 | 27.95 | 93 | 3 | 90 | 6 | 0 | 6 | 0 |
| YicesQS | 0 | 91 | 331.83 | 343.04 | 91 | 3 | 88 | 8 | 0 | 8 | 0 |
| cvc5 | 0 | 88 | 2209.47 | 2220.59 | 88 | 4 | 84 | 11 | 0 | 11 | 0 |
| cvc5-cvc5-xyz ne | 0 | 88 (base +0) | 2209.74 | 2220.75 | 88 | 4 | 84 | 11 | 0 | 11 | 0 |
| SMTInterpol | 0 | 40 | 28.18 | 22.13 | 40 | 1 | 39 | 59 | 0 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 12 | 54.68 | 25.31 | 12 | 1 | 11 | 87 | 0 | 48 | 0 |
| Z3-alpha2-base n | 0 | 94 | 638.10 | 649.77 | 94 | 4 | 90 | 5 | 0 | 5 | 0 |
| z3-BooledASS-base n | 0 | 93 | 16.71 | 28.16 | 93 | 3 | 90 | 6 | 0 | 6 | 0 |
| Z3-GEX-base n | 0 | 93 | 22.01 | 33.69 | 93 | 3 | 90 | 6 | 0 | 6 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 88 | 2210.07 | 2221.09 | 88 | 4 | 84 | 11 | 0 | 11 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SMT-RAT | 0 | 96 | 20.07 | 32.02 | 96 | 4 | 92 | 3 | 0 | 3 | 0 |
| Z3-alpha2 | 0 | 96 (base +2) | 972.41 | 935.89 | 96 | 4 | 92 | 3 | 0 | 3 | 0 |
| Z3-alpha2-debug n | 0 | 96 | 1185.35 | 1055.99 | 96 | 4 | 92 | 3 | 0 | 3 | 0 |
| Z3-GEX | 0 | 95 (base +2) | 34.65 | 35.70 | 95 | 3 | 92 | 4 | 0 | 4 | 0 |
| z3-BooledASS ne | 0 | 93 (base +0) | 16.54 | 27.95 | 93 | 3 | 90 | 6 | 0 | 6 | 0 |
| YicesQS | 0 | 91 | 331.83 | 343.04 | 91 | 3 | 88 | 8 | 0 | 8 | 0 |
| cvc5 | 0 | 88 | 2209.47 | 2220.59 | 88 | 4 | 84 | 11 | 0 | 11 | 0 |
| cvc5-cvc5-xyz ne | 0 | 88 (base +0) | 2209.74 | 2220.75 | 88 | 4 | 84 | 11 | 0 | 11 | 0 |
| SMTInterpol | 0 | 40 | 28.18 | 22.13 | 40 | 1 | 39 | 59 | 0 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 12 | 54.68 | 25.31 | 12 | 1 | 11 | 87 | 0 | 48 | 0 |
| Z3-alpha2-base n | 0 | 94 | 638.10 | 649.77 | 94 | 4 | 90 | 5 | 0 | 5 | 0 |
| z3-BooledASS-base n | 0 | 93 | 16.71 | 28.16 | 93 | 3 | 90 | 6 | 0 | 6 | 0 |
| Z3-GEX-base n | 0 | 93 | 22.01 | 33.69 | 93 | 3 | 90 | 6 | 0 | 6 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 88 | 2210.07 | 2221.09 | 88 | 4 | 84 | 11 | 0 | 11 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SMT-RAT | 0 | 4 | 4.28 | 4.77 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| cvc5 | 0 | 4 | 301.41 | 301.93 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| cvc5-cvc5-xyz ne | 0 | 4 (base +0) | 301.48 | 301.99 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| Z3-alpha2 ne | 0 | 4 (base +0) | 638.29 | 636.79 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| Z3-alpha2-debug n | 0 | 4 | 655.16 | 649.80 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| z3-BooledASS ne | 0 | 3 (base +0) | 0.52 | 0.88 | 3 | 3 | 0 | 2 | 94 | 2 | 0 |
| YicesQS | 0 | 3 | 0.55 | 0.93 | 3 | 3 | 0 | 2 | 94 | 2 | 0 |
| Z3-GEX ne | 0 | 3 (base +0) | 0.69 | 1.05 | 3 | 3 | 0 | 2 | 94 | 2 | 0 |
| SMTInterpol | 0 | 1 | 0.50 | 0.47 | 1 | 1 | 0 | 4 | 94 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 1 | 3.99 | 1.87 | 1 | 1 | 0 | 4 | 94 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 4 | 301.45 | 301.95 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| Z3-alpha2-base n | 0 | 4 | 622.35 | 622.89 | 4 | 4 | 0 | 1 | 94 | 1 | 0 |
| Z3-GEX-base n | 0 | 3 | 0.50 | 0.89 | 3 | 3 | 0 | 2 | 94 | 2 | 0 |
| z3-BooledASS-base n | 0 | 3 | 0.54 | 0.92 | 3 | 3 | 0 | 2 | 94 | 2 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SMT-RAT | 0 | 92 | 15.79 | 27.25 | 92 | 0 | 92 | 1 | 6 | 1 | 0 |
| Z3-GEX | 0 | 92 (base +2) | 33.96 | 34.65 | 92 | 0 | 92 | 1 | 6 | 1 | 0 |
| Z3-alpha2 | 0 | 92 (base +2) | 334.12 | 299.10 | 92 | 0 | 92 | 1 | 6 | 1 | 0 |
| Z3-alpha2-debug n | 0 | 92 | 530.18 | 406.18 | 92 | 0 | 92 | 1 | 6 | 1 | 0 |
| z3-BooledASS ne | 0 | 90 (base +0) | 16.02 | 27.07 | 90 | 0 | 90 | 3 | 6 | 3 | 0 |
| YicesQS | 0 | 88 | 331.28 | 342.11 | 88 | 0 | 88 | 5 | 6 | 5 | 0 |
| cvc5 | 0 | 84 | 1908.06 | 1918.66 | 84 | 0 | 84 | 9 | 6 | 9 | 0 |
| cvc5-cvc5-xyz ne | 0 | 84 (base +0) | 1908.26 | 1918.76 | 84 | 0 | 84 | 9 | 6 | 9 | 0 |
| SMTInterpol | 0 | 39 | 27.67 | 21.66 | 39 | 0 | 39 | 54 | 6 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 11 | 50.69 | 23.44 | 11 | 0 | 11 | 82 | 6 | 48 | 0 |
| Z3-alpha2-base n | 0 | 90 | 15.75 | 26.88 | 90 | 0 | 90 | 3 | 6 | 3 | 0 |
| z3-BooledASS-base n | 0 | 90 | 16.18 | 27.24 | 90 | 0 | 90 | 3 | 6 | 3 | 0 |
| Z3-GEX-base n | 0 | 90 | 21.52 | 32.80 | 90 | 0 | 90 | 3 | 6 | 3 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 84 | 1908.62 | 1919.14 | 84 | 0 | 84 | 9 | 6 | 9 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SMT-RAT | 0 | 96 | 20.07 | 32.02 | 96 | 4 | 92 | 0 | 3 | 0 | 0 |
| Z3-GEX ne | 0 | 95 (base +2) | 34.65 | 35.70 | 95 | 3 | 92 | 0 | 4 | 0 | 0 |
| Z3-alpha2 ne | 0 | 95 (base +2) | 345.01 | 308.84 | 95 | 3 | 92 | 0 | 4 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 95 | 547.43 | 419.38 | 95 | 3 | 92 | 0 | 4 | 0 | 0 |
| z3-BooledASS ne | 0 | 93 (base +0) | 16.54 | 27.95 | 93 | 3 | 90 | 0 | 6 | 0 | 0 |
| YicesQS | 0 | 90 | 17.50 | 28.56 | 90 | 3 | 87 | 0 | 9 | 0 | 0 |
| cvc5 | 0 | 81 | 15.86 | 25.97 | 81 | 3 | 78 | 0 | 18 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 81 (base +0) | 16.25 | 26.25 | 81 | 3 | 78 | 0 | 18 | 0 | 0 |
| SMTInterpol | 0 | 40 | 28.18 | 22.13 | 40 | 1 | 39 | 59 | 0 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 12 | 54.68 | 25.31 | 12 | 1 | 11 | 38 | 49 | 0 | 0 |
| Z3-alpha2-base n | 0 | 93 | 16.28 | 27.80 | 93 | 3 | 90 | 0 | 6 | 0 | 0 |
| z3-BooledASS-base n | 0 | 93 | 16.71 | 28.16 | 93 | 3 | 90 | 0 | 6 | 0 | 0 |
| Z3-GEX-base n | 0 | 93 | 22.01 | 33.69 | 93 | 3 | 90 | 0 | 6 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 81 | 16.54 | 26.55 | 81 | 3 | 78 | 0 | 18 | 0 | 0 |