The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the NIA logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 254
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Z3-alpha2 | Z3-GEX | cvc5 | Z3-alpha2 | Z3-GEX |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-alpha2 | 0 | 238 (base +15) | 3138.10 | 3047.78 | 238 | 77 | 161 | 16 | 0 | 16 | 0 |
| Z3-alpha2-debug n | 0 | 238 | 3640.51 | 3319.94 | 238 | 77 | 161 | 16 | 0 | 16 | 0 |
| Z3-GEX | 0 | 235 (base +12) | 670.08 | 257.36 | 238 | 79 | 159 | 16 | 0 | 16 | 0 |
| cvc5 | 0 | 231 | 23062.53 | 23093.31 | 231 | 80 | 151 | 23 | 0 | 23 | 0 |
| cvc5-cvc5-xyz ne | 0 | 230 (base +0) | 22276.21 | 22306.37 | 230 | 80 | 150 | 24 | 0 | 24 | 0 |
| z3-BooledASS ne | 0 | 227 (base +0) | 495.84 | 523.80 | 227 | 76 | 151 | 27 | 0 | 26 | 0 |
| Amaya | 0 | 208 | 540.85 | 570.65 | 208 | 53 | 155 | 46 | 0 | 5 | 0 |
| UltimateEliminator+MathSAT | 0 | 141 | 807.36 | 433.67 | 141 | 47 | 94 | 113 | 0 | 35 | 0 |
| YicesQS | 0 | 123 | 1768.95 | 1783.80 | 123 | 77 | 46 | 131 | 0 | 131 | 0 |
| SMTInterpol | 0 | 20 | 42.69 | 25.87 | 20 | 13 | 7 | 234 | 0 | 1 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 230 | 22276.54 | 22306.87 | 230 | 80 | 150 | 24 | 0 | 24 | 0 |
| z3-BooledASS-base n | 0 | 227 | 499.31 | 527.30 | 227 | 76 | 151 | 27 | 0 | 26 | 0 |
| Z3-alpha2-base n | 0 | 223 | 867.53 | 895.26 | 223 | 74 | 149 | 31 | 0 | 28 | 0 |
| Z3-GEX-base n | 0 | 223 | 1102.79 | 1130.69 | 223 | 73 | 150 | 31 | 0 | 27 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-GEX | 0 | 238 (base +15) | 8961.10 | 2572.61 | 238 | 79 | 159 | 16 | 0 | 16 | 0 |
| Z3-alpha2 | 0 | 238 (base +15) | 3138.10 | 3047.78 | 238 | 77 | 161 | 16 | 0 | 16 | 0 |
| Z3-alpha2-debug n | 0 | 238 | 3640.51 | 3319.94 | 238 | 77 | 161 | 16 | 0 | 16 | 0 |
| cvc5 | 0 | 231 | 23062.53 | 23093.31 | 231 | 80 | 151 | 23 | 0 | 23 | 0 |
| cvc5-cvc5-xyz ne | 0 | 230 (base +0) | 22276.21 | 22306.37 | 230 | 80 | 150 | 24 | 0 | 24 | 0 |
| z3-BooledASS ne | 0 | 227 (base +0) | 495.84 | 523.80 | 227 | 76 | 151 | 27 | 0 | 26 | 0 |
| Amaya | 0 | 208 | 540.85 | 570.65 | 208 | 53 | 155 | 46 | 0 | 5 | 0 |
| UltimateEliminator+MathSAT | 0 | 141 | 807.36 | 433.67 | 141 | 47 | 94 | 113 | 0 | 35 | 0 |
| YicesQS | 0 | 123 | 1768.95 | 1783.80 | 123 | 77 | 46 | 131 | 0 | 131 | 0 |
| SMTInterpol | 0 | 20 | 42.69 | 25.87 | 20 | 13 | 7 | 234 | 0 | 1 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 230 | 22276.54 | 22306.87 | 230 | 80 | 150 | 24 | 0 | 24 | 0 |
| z3-BooledASS-base n | 0 | 227 | 499.31 | 527.30 | 227 | 76 | 151 | 27 | 0 | 26 | 0 |
| Z3-alpha2-base n | 0 | 223 | 867.53 | 895.26 | 223 | 74 | 149 | 31 | 0 | 28 | 0 |
| Z3-GEX-base n | 0 | 223 | 1102.79 | 1130.69 | 223 | 73 | 150 | 31 | 0 | 27 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 | 0 | 80 | 916.20 | 926.35 | 80 | 80 | 0 | 2 | 172 | 2 | 0 |
| cvc5-cvc5-xyz ne | 0 | 80 (base +0) | 917.06 | 927.02 | 80 | 80 | 0 | 2 | 172 | 2 | 0 |
| Z3-GEX | 0 | 79 (base +6) | 3256.27 | 1096.84 | 79 | 79 | 0 | 3 | 172 | 3 | 0 |
| YicesQS | 0 | 77 | 1223.22 | 1232.55 | 77 | 77 | 0 | 5 | 172 | 5 | 0 |
| Z3-alpha2 | 0 | 77 (base +3) | 1317.22 | 1287.92 | 77 | 77 | 0 | 5 | 172 | 5 | 0 |
| Z3-alpha2-debug n | 0 | 77 | 1481.21 | 1377.46 | 77 | 77 | 0 | 5 | 172 | 5 | 0 |
| z3-BooledASS ne | 0 | 76 (base +0) | 84.33 | 93.63 | 76 | 76 | 0 | 6 | 172 | 6 | 0 |
| Amaya | 0 | 53 | 274.39 | 282.29 | 53 | 53 | 0 | 29 | 172 | 1 | 0 |
| UltimateEliminator+MathSAT | 0 | 47 | 354.36 | 229.90 | 47 | 47 | 0 | 35 | 172 | 14 | 0 |
| SMTInterpol | 0 | 13 | 23.10 | 12.49 | 13 | 13 | 0 | 69 | 172 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 80 | 917.16 | 927.07 | 80 | 80 | 0 | 2 | 172 | 2 | 0 |
| z3-BooledASS-base n | 0 | 76 | 84.19 | 93.59 | 76 | 76 | 0 | 6 | 172 | 6 | 0 |
| Z3-alpha2-base n | 0 | 74 | 489.30 | 498.57 | 74 | 74 | 0 | 8 | 172 | 8 | 0 |
| Z3-GEX-base n | 0 | 73 | 169.68 | 178.76 | 73 | 73 | 0 | 9 | 172 | 8 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-alpha2 | 0 | 161 (base +12) | 1820.88 | 1759.86 | 161 | 0 | 161 | 10 | 83 | 10 | 0 |
| Z3-alpha2-debug n | 0 | 161 | 2159.30 | 1942.48 | 161 | 0 | 161 | 10 | 83 | 10 | 0 |
| Z3-GEX | 0 | 159 (base +9) | 5704.84 | 1475.78 | 159 | 0 | 159 | 12 | 83 | 12 | 0 |
| Amaya | 0 | 155 | 266.46 | 288.37 | 155 | 0 | 155 | 16 | 83 | 4 | 0 |
| z3-BooledASS ne | 0 | 151 (base +0) | 411.50 | 430.17 | 151 | 0 | 151 | 20 | 83 | 19 | 0 |
| cvc5 | 0 | 151 | 22146.33 | 22166.96 | 151 | 0 | 151 | 20 | 83 | 20 | 0 |
| cvc5-cvc5-xyz ne | 0 | 150 (base +0) | 21359.15 | 21379.35 | 150 | 0 | 150 | 21 | 83 | 21 | 0 |
| UltimateEliminator+MathSAT | 0 | 94 | 453.00 | 203.78 | 94 | 0 | 94 | 77 | 83 | 21 | 0 |
| YicesQS | 0 | 46 | 545.73 | 551.25 | 46 | 0 | 46 | 125 | 83 | 125 | 0 |
| SMTInterpol | 0 | 7 | 19.59 | 13.38 | 7 | 0 | 7 | 164 | 83 | 1 | 0 |
| z3-BooledASS-base n | 0 | 151 | 415.11 | 433.71 | 151 | 0 | 151 | 20 | 83 | 19 | 0 |
| Z3-GEX-base n | 0 | 150 | 933.11 | 951.93 | 150 | 0 | 150 | 21 | 83 | 18 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 150 | 21359.37 | 21379.80 | 150 | 0 | 150 | 21 | 83 | 21 | 0 |
| Z3-alpha2-base n | 0 | 149 | 378.23 | 396.69 | 149 | 0 | 149 | 22 | 83 | 19 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-GEX | 0 | 233 (base +18) | 246.21 | 130.19 | 233 | 77 | 156 | 0 | 21 | 0 | 0 |
| Z3-alpha2 ne | 0 | 232 (base +15) | 998.09 | 909.96 | 232 | 75 | 157 | 0 | 22 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 232 | 1491.31 | 1178.63 | 232 | 75 | 157 | 0 | 22 | 0 | 0 |
| z3-BooledASS ne | 0 | 221 (base +0) | 279.79 | 306.98 | 221 | 76 | 145 | 1 | 32 | 0 | 0 |
| Amaya | 0 | 207 | 445.59 | 475.26 | 207 | 52 | 155 | 36 | 11 | 0 | 0 |
| cvc5 | 0 | 153 | 37.74 | 56.82 | 153 | 78 | 75 | 0 | 101 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 153 (base +0) | 44.51 | 63.37 | 153 | 78 | 75 | 0 | 101 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 140 | 673.29 | 302.32 | 140 | 46 | 94 | 75 | 39 | 0 | 0 |
| YicesQS | 0 | 109 | 57.79 | 71.23 | 109 | 70 | 39 | 0 | 145 | 0 | 0 |
| SMTInterpol | 0 | 20 | 42.69 | 25.87 | 20 | 13 | 7 | 229 | 5 | 0 | 0 |
| z3-BooledASS-base n | 0 | 221 | 280.90 | 308.14 | 221 | 76 | 145 | 1 | 32 | 0 | 0 |
| Z3-alpha2-base n | 0 | 217 | 265.44 | 292.39 | 217 | 71 | 146 | 3 | 34 | 0 | 0 |
| Z3-GEX-base n | 0 | 215 | 219.47 | 246.28 | 215 | 70 | 145 | 1 | 38 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 153 | 44.45 | 63.24 | 153 | 78 | 75 | 0 | 101 | 0 | 0 |