The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_NonLinearIntArith division in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 2857
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Z3-alpha2 | Z3-alpha2 | Z3-Z3++ | Z3-alpha2 | Z3-alpha2 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-alpha2 | 0 | 2408 (base +216) | 63970.57 | 63868.14 | 2408 | 1577 | 831 | 449 | 0 | 439 | 0 |
| Z3-Z3++ | 0 | 2408 (base +197) | 98561.95 | 98867.97 | 2408 | 1630 | 778 | 447 | 2 | 429 | 0 |
| Z3-alpha2-debug n | 0 | 2404 | 69535.93 | 67131.18 | 2405 | 1577 | 828 | 452 | 0 | 442 | 0 |
| Z3-GEX | 0 | 2327 (base +61) | 83037.53 | 24559.04 | 2359 | 1566 | 793 | 498 | 0 | 452 | 0 |
| Yices2 | 0 | 2145 | 17196.83 | 17463.10 | 2145 | 1469 | 676 | 712 | 0 | 703 | 0 |
| cvc5 | 0 | 2001 | 386705.93 | 386990.97 | 2001 | 1400 | 601 | 856 | 0 | 847 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1989 (base +9) | 395969.61 | 396252.11 | 1989 | 1395 | 594 | 868 | 0 | 859 | 0 |
| Z3-siri ne | 0 | 1951 (base -319) | 18351.19 | 18595.32 | 1951 | 1234 | 717 | 906 | 0 | 629 | 0 |
| z3-BooledASS ne | 0 | 1408 (base -865) | 37616.11 | 37792.15 | 1408 | 968 | 440 | 1449 | 0 | 577 | 0 |
| Xolver | 0 | 1335 | 57252.30 | 57427.83 | 1335 | 1278 | 57 | 1522 | 0 | 1496 | 0 |
| SMTInterpol | 0 | 23 | 73.19 | 37.25 | 23 | 3 | 20 | 2834 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 2273 | 47240.54 | 47525.35 | 2273 | 1466 | 807 | 584 | 0 | 564 | 0 |
| Z3-siri-base n | 0 | 2270 | 55006.58 | 55293.81 | 2270 | 1472 | 798 | 587 | 0 | 545 | 0 |
| Z3-GEX-base n | 0 | 2266 | 56274.34 | 56562.13 | 2266 | 1467 | 799 | 591 | 0 | 545 | 0 |
| Z3-Z3++-base n | 0 | 2211 | 106184.70 | 106470.90 | 2211 | 1522 | 689 | 644 | 2 | 634 | 0 |
| Z3-alpha2-base n | 0 | 2192 | 44565.83 | 44842.00 | 2192 | 1414 | 778 | 665 | 0 | 550 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1980 | 388267.39 | 388550.17 | 1980 | 1385 | 595 | 877 | 0 | 868 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-alpha2 | 0 | 2408 (base +216) | 63970.57 | 63868.14 | 2408 | 1577 | 831 | 449 | 0 | 439 | 0 |
| Z3-Z3++ | 0 | 2408 (base +197) | 98561.95 | 98867.97 | 2408 | 1630 | 778 | 447 | 2 | 429 | 0 |
| Z3-alpha2-debug n | 0 | 2405 | 70737.07 | 68330.97 | 2405 | 1577 | 828 | 452 | 0 | 442 | 0 |
| Z3-GEX | 0 | 2359 (base +93) | 161847.20 | 45941.75 | 2359 | 1566 | 793 | 498 | 0 | 452 | 0 |
| Yices2 | 0 | 2145 | 17196.83 | 17463.10 | 2145 | 1469 | 676 | 712 | 0 | 703 | 0 |
| cvc5 | 0 | 2001 | 386705.93 | 386990.97 | 2001 | 1400 | 601 | 856 | 0 | 847 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1989 (base +9) | 395969.61 | 396252.11 | 1989 | 1395 | 594 | 868 | 0 | 859 | 0 |
| Z3-siri ne | 0 | 1951 (base -319) | 18351.19 | 18595.32 | 1951 | 1234 | 717 | 906 | 0 | 629 | 0 |
| z3-BooledASS ne | 0 | 1408 (base -865) | 37616.11 | 37792.15 | 1408 | 968 | 440 | 1449 | 0 | 577 | 0 |
| Xolver | 0 | 1335 | 57252.30 | 57427.83 | 1335 | 1278 | 57 | 1522 | 0 | 1496 | 0 |
| SMTInterpol | 0 | 23 | 73.19 | 37.25 | 23 | 3 | 20 | 2834 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 2273 | 47240.54 | 47525.35 | 2273 | 1466 | 807 | 584 | 0 | 564 | 0 |
| Z3-siri-base n | 0 | 2270 | 55006.58 | 55293.81 | 2270 | 1472 | 798 | 587 | 0 | 545 | 0 |
| Z3-GEX-base n | 0 | 2266 | 56274.34 | 56562.13 | 2266 | 1467 | 799 | 591 | 0 | 545 | 0 |
| Z3-Z3++-base n | 0 | 2211 | 106184.70 | 106470.90 | 2211 | 1522 | 689 | 644 | 2 | 634 | 0 |
| Z3-alpha2-base n | 0 | 2192 | 44565.83 | 44842.00 | 2192 | 1414 | 778 | 665 | 0 | 550 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1980 | 388267.39 | 388550.17 | 1980 | 1385 | 595 | 877 | 0 | 868 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Z3++ | 0 | 1630 (base +108) | 36707.02 | 36911.82 | 1630 | 1630 | 0 | 34 | 1193 | 21 | 0 |
| Z3-alpha2 | 0 | 1577 (base +163) | 47598.83 | 47528.05 | 1577 | 1577 | 0 | 87 | 1193 | 77 | 0 |
| Z3-alpha2-debug n | 0 | 1577 | 52685.40 | 51102.42 | 1577 | 1577 | 0 | 87 | 1193 | 77 | 0 |
| Z3-GEX | 0 | 1566 (base +99) | 84036.62 | 25464.15 | 1566 | 1566 | 0 | 98 | 1193 | 76 | 0 |
| Yices2 | 0 | 1469 | 11517.89 | 11700.50 | 1469 | 1469 | 0 | 195 | 1193 | 186 | 0 |
| cvc5 | 0 | 1400 | 366436.72 | 366645.58 | 1400 | 1400 | 0 | 264 | 1193 | 255 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1395 (base +10) | 376666.17 | 376874.06 | 1395 | 1395 | 0 | 269 | 1193 | 260 | 0 |
| Xolver | 0 | 1278 | 49779.31 | 49946.99 | 1278 | 1278 | 0 | 386 | 1193 | 367 | 0 |
| Z3-siri ne | 0 | 1234 (base -238) | 8189.07 | 8342.93 | 1234 | 1234 | 0 | 430 | 1193 | 208 | 0 |
| z3-BooledASS ne | 0 | 968 (base -498) | 32611.30 | 32732.94 | 968 | 968 | 0 | 696 | 1193 | 191 | 0 |
| SMTInterpol | 0 | 3 | 9.02 | 3.63 | 3 | 3 | 0 | 1661 | 1193 | 0 | 0 |
| Z3-Z3++-base n | 0 | 1522 | 71654.45 | 71851.85 | 1522 | 1522 | 0 | 142 | 1193 | 133 | 0 |
| Z3-siri-base n | 0 | 1472 | 36340.50 | 36526.64 | 1472 | 1472 | 0 | 192 | 1193 | 170 | 0 |
| Z3-GEX-base n | 0 | 1467 | 35030.92 | 35216.96 | 1467 | 1467 | 0 | 197 | 1193 | 174 | 0 |
| z3-BooledASS-base n | 0 | 1466 | 37360.30 | 37544.66 | 1466 | 1466 | 0 | 198 | 1193 | 178 | 0 |
| Z3-alpha2-base n | 0 | 1414 | 34412.13 | 34590.80 | 1414 | 1414 | 0 | 250 | 1193 | 184 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1385 | 368500.70 | 368708.02 | 1385 | 1385 | 0 | 279 | 1193 | 270 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-alpha2 | 0 | 831 (base +53) | 16371.74 | 16340.09 | 831 | 0 | 831 | 56 | 1970 | 56 | 0 |
| Z3-alpha2-debug n | 0 | 828 | 18051.66 | 17228.55 | 828 | 0 | 828 | 59 | 1970 | 59 | 0 |
| Z3-GEX ne | 0 | 793 (base -6) | 77810.58 | 20477.60 | 793 | 0 | 793 | 94 | 1970 | 83 | 0 |
| Z3-Z3++ | 0 | 778 (base +89) | 61854.93 | 61956.16 | 778 | 0 | 778 | 107 | 1972 | 107 | 0 |
| Z3-siri ne | 0 | 717 (base -81) | 10162.13 | 10252.39 | 717 | 0 | 717 | 170 | 1970 | 139 | 0 |
| Yices2 | 0 | 676 | 5678.94 | 5762.60 | 676 | 0 | 676 | 211 | 1970 | 211 | 0 |
| cvc5 | 0 | 601 | 20269.21 | 20345.39 | 601 | 0 | 601 | 286 | 1970 | 286 | 0 |
| cvc5-cvc5-xyz ne | 0 | 594 (base -1) | 19303.43 | 19378.05 | 594 | 0 | 594 | 293 | 1970 | 293 | 0 |
| z3-BooledASS ne | 0 | 440 (base -367) | 5004.81 | 5059.20 | 440 | 0 | 440 | 447 | 1970 | 80 | 0 |
| Xolver | 0 | 57 | 7472.98 | 7480.84 | 57 | 0 | 57 | 830 | 1970 | 823 | 0 |
| SMTInterpol | 0 | 20 | 64.17 | 33.62 | 20 | 0 | 20 | 867 | 1970 | 0 | 0 |
| z3-BooledASS-base n | 0 | 807 | 9880.24 | 9980.69 | 807 | 0 | 807 | 80 | 1970 | 80 | 0 |
| Z3-GEX-base n | 0 | 799 | 21243.42 | 21345.17 | 799 | 0 | 799 | 88 | 1970 | 88 | 0 |
| Z3-siri-base n | 0 | 798 | 18666.08 | 18767.17 | 798 | 0 | 798 | 89 | 1970 | 89 | 0 |
| Z3-alpha2-base n | 0 | 778 | 10153.70 | 10251.20 | 778 | 0 | 778 | 109 | 1970 | 86 | 0 |
| Z3-Z3++-base n | 0 | 689 | 34530.25 | 34619.05 | 689 | 0 | 689 | 196 | 1972 | 196 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 595 | 19766.70 | 19842.15 | 595 | 0 | 595 | 292 | 1970 | 292 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-GEX ne | 0 | 2141 (base +139) | 19865.71 | 7041.98 | 2141 | 1443 | 698 | 13 | 703 | 0 | 0 |
| Z3-alpha2 | 0 | 2100 (base +137) | 8527.00 | 8565.91 | 2100 | 1365 | 735 | 9 | 748 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 2080 | 15568.17 | 13621.21 | 2080 | 1349 | 731 | 9 | 768 | 0 | 0 |
| Yices2 | 0 | 2025 | 4571.88 | 4821.93 | 2025 | 1391 | 634 | 9 | 823 | 0 | 0 |
| Z3-Z3++ ne | 0 | 1844 (base +167) | 6062.41 | 6290.89 | 1844 | 1408 | 436 | 9 | 1004 | 0 | 0 |
| Z3-siri ne | 0 | 1828 (base -174) | 4372.65 | 4600.25 | 1828 | 1182 | 646 | 141 | 888 | 0 | 0 |
| z3-BooledASS ne | 0 | 1223 (base -818) | 4282.32 | 4432.40 | 1223 | 812 | 411 | 818 | 816 | 0 | 0 |
| cvc5 | 0 | 1160 | 2907.57 | 3050.40 | 1160 | 628 | 532 | 9 | 1688 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1129 (base -3) | 2957.57 | 3096.40 | 1129 | 605 | 524 | 9 | 1719 | 0 | 0 |
| Xolver | 0 | 885 | 4741.99 | 4853.68 | 885 | 870 | 15 | 3 | 1969 | 0 | 0 |
| SMTInterpol | 0 | 23 | 73.19 | 37.25 | 23 | 3 | 20 | 2821 | 13 | 0 | 0 |
| z3-BooledASS-base n | 0 | 2041 | 5940.96 | 6193.27 | 2041 | 1284 | 757 | 18 | 798 | 0 | 0 |
| Z3-GEX-base n | 0 | 2002 | 7363.41 | 7613.03 | 2002 | 1299 | 703 | 9 | 846 | 0 | 0 |
| Z3-siri-base n | 0 | 2002 | 7432.05 | 7681.40 | 2002 | 1307 | 695 | 9 | 846 | 0 | 0 |
| Z3-alpha2-base n | 0 | 1963 | 5725.25 | 5969.08 | 1963 | 1244 | 719 | 109 | 785 | 0 | 0 |
| Z3-Z3++-base n | 0 | 1677 | 6771.08 | 6981.06 | 1677 | 1156 | 521 | 9 | 1171 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1132 | 3030.38 | 3170.29 | 1132 | 605 | 527 | 9 | 1716 | 0 | 0 |