The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_NIA logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 2855
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Z3-Z3++ | Z3-Z3++ | Z3-Z3++ | Z3-alpha2 | Z3-alpha2 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Z3++ | 0 | 2408 (base +197) | 98561.95 | 98867.97 | 2408 | 1630 | 778 | 447 | 0 | 429 | 0 |
| Z3-alpha2 | 0 | 2407 (base +216) | 63966.76 | 63864.21 | 2407 | 1577 | 830 | 448 | 0 | 438 | 0 |
| Z3-alpha2-debug n | 0 | 2403 | 69528.24 | 67124.33 | 2404 | 1577 | 827 | 451 | 0 | 441 | 0 |
| Z3-GEX | 0 | 2326 (base +61) | 83033.74 | 24555.12 | 2358 | 1566 | 792 | 497 | 0 | 451 | 0 |
| Yices2 | 0 | 2145 | 17196.83 | 17463.10 | 2145 | 1469 | 676 | 710 | 0 | 701 | 0 |
| cvc5 | 0 | 2001 | 386705.93 | 386990.97 | 2001 | 1400 | 601 | 854 | 0 | 845 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1989 (base +9) | 395969.61 | 396252.11 | 1989 | 1395 | 594 | 866 | 0 | 857 | 0 |
| Z3-siri ne | 0 | 1950 (base -319) | 18347.43 | 18591.43 | 1950 | 1234 | 716 | 905 | 0 | 628 | 0 |
| z3-BooledASS ne | 0 | 1407 (base -865) | 37612.23 | 37788.16 | 1407 | 968 | 439 | 1448 | 0 | 576 | 0 |
| Xolver | 0 | 1333 | 57236.93 | 57412.21 | 1333 | 1278 | 55 | 1522 | 0 | 1496 | 0 |
| SMTInterpol | 0 | 23 | 73.19 | 37.25 | 23 | 3 | 20 | 2832 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 2272 | 47236.74 | 47521.41 | 2272 | 1466 | 806 | 583 | 0 | 563 | 0 |
| Z3-siri-base n | 0 | 2269 | 55002.84 | 55289.93 | 2269 | 1472 | 797 | 586 | 0 | 544 | 0 |
| Z3-GEX-base n | 0 | 2265 | 56270.59 | 56558.26 | 2265 | 1467 | 798 | 590 | 0 | 544 | 0 |
| Z3-Z3++-base n | 0 | 2211 | 106184.70 | 106470.90 | 2211 | 1522 | 689 | 644 | 0 | 634 | 0 |
| Z3-alpha2-base n | 0 | 2191 | 44562.03 | 44838.07 | 2191 | 1414 | 777 | 664 | 0 | 549 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1980 | 388267.39 | 388550.17 | 1980 | 1385 | 595 | 875 | 0 | 866 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Z3++ | 0 | 2408 (base +197) | 98561.95 | 98867.97 | 2408 | 1630 | 778 | 447 | 0 | 429 | 0 |
| Z3-alpha2 | 0 | 2407 (base +216) | 63966.76 | 63864.21 | 2407 | 1577 | 830 | 448 | 0 | 438 | 0 |
| Z3-alpha2-debug n | 0 | 2404 | 70729.38 | 68324.11 | 2404 | 1577 | 827 | 451 | 0 | 441 | 0 |
| Z3-GEX | 0 | 2358 (base +93) | 161843.41 | 45937.83 | 2358 | 1566 | 792 | 497 | 0 | 451 | 0 |
| Yices2 | 0 | 2145 | 17196.83 | 17463.10 | 2145 | 1469 | 676 | 710 | 0 | 701 | 0 |
| cvc5 | 0 | 2001 | 386705.93 | 386990.97 | 2001 | 1400 | 601 | 854 | 0 | 845 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1989 (base +9) | 395969.61 | 396252.11 | 1989 | 1395 | 594 | 866 | 0 | 857 | 0 |
| Z3-siri ne | 0 | 1950 (base -319) | 18347.43 | 18591.43 | 1950 | 1234 | 716 | 905 | 0 | 628 | 0 |
| z3-BooledASS ne | 0 | 1407 (base -865) | 37612.23 | 37788.16 | 1407 | 968 | 439 | 1448 | 0 | 576 | 0 |
| Xolver | 0 | 1333 | 57236.93 | 57412.21 | 1333 | 1278 | 55 | 1522 | 0 | 1496 | 0 |
| SMTInterpol | 0 | 23 | 73.19 | 37.25 | 23 | 3 | 20 | 2832 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 2272 | 47236.74 | 47521.41 | 2272 | 1466 | 806 | 583 | 0 | 563 | 0 |
| Z3-siri-base n | 0 | 2269 | 55002.84 | 55289.93 | 2269 | 1472 | 797 | 586 | 0 | 544 | 0 |
| Z3-GEX-base n | 0 | 2265 | 56270.59 | 56558.26 | 2265 | 1467 | 798 | 590 | 0 | 544 | 0 |
| Z3-Z3++-base n | 0 | 2211 | 106184.70 | 106470.90 | 2211 | 1522 | 689 | 644 | 0 | 634 | 0 |
| Z3-alpha2-base n | 0 | 2191 | 44562.03 | 44838.07 | 2191 | 1414 | 777 | 664 | 0 | 549 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1980 | 388267.39 | 388550.17 | 1980 | 1385 | 595 | 875 | 0 | 866 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Z3++ | 0 | 1630 (base +108) | 36707.02 | 36911.82 | 1630 | 1630 | 0 | 34 | 1191 | 21 | 0 |
| Z3-alpha2 | 0 | 1577 (base +163) | 47598.83 | 47528.05 | 1577 | 1577 | 0 | 87 | 1191 | 77 | 0 |
| Z3-alpha2-debug n | 0 | 1577 | 52685.40 | 51102.42 | 1577 | 1577 | 0 | 87 | 1191 | 77 | 0 |
| Z3-GEX | 0 | 1566 (base +99) | 84036.62 | 25464.15 | 1566 | 1566 | 0 | 98 | 1191 | 76 | 0 |
| Yices2 | 0 | 1469 | 11517.89 | 11700.50 | 1469 | 1469 | 0 | 195 | 1191 | 186 | 0 |
| cvc5 | 0 | 1400 | 366436.72 | 366645.58 | 1400 | 1400 | 0 | 264 | 1191 | 255 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1395 (base +10) | 376666.17 | 376874.06 | 1395 | 1395 | 0 | 269 | 1191 | 260 | 0 |
| Xolver | 0 | 1278 | 49779.31 | 49946.99 | 1278 | 1278 | 0 | 386 | 1191 | 367 | 0 |
| Z3-siri ne | 0 | 1234 (base -238) | 8189.07 | 8342.93 | 1234 | 1234 | 0 | 430 | 1191 | 208 | 0 |
| z3-BooledASS ne | 0 | 968 (base -498) | 32611.30 | 32732.94 | 968 | 968 | 0 | 696 | 1191 | 191 | 0 |
| SMTInterpol | 0 | 3 | 9.02 | 3.63 | 3 | 3 | 0 | 1661 | 1191 | 0 | 0 |
| Z3-Z3++-base n | 0 | 1522 | 71654.45 | 71851.85 | 1522 | 1522 | 0 | 142 | 1191 | 133 | 0 |
| Z3-siri-base n | 0 | 1472 | 36340.50 | 36526.64 | 1472 | 1472 | 0 | 192 | 1191 | 170 | 0 |
| Z3-GEX-base n | 0 | 1467 | 35030.92 | 35216.96 | 1467 | 1467 | 0 | 197 | 1191 | 174 | 0 |
| z3-BooledASS-base n | 0 | 1466 | 37360.30 | 37544.66 | 1466 | 1466 | 0 | 198 | 1191 | 178 | 0 |
| Z3-alpha2-base n | 0 | 1414 | 34412.13 | 34590.80 | 1414 | 1414 | 0 | 250 | 1191 | 184 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1385 | 368500.70 | 368708.02 | 1385 | 1385 | 0 | 279 | 1191 | 270 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-alpha2 | 0 | 830 (base +53) | 16367.93 | 16336.16 | 830 | 0 | 830 | 55 | 1970 | 55 | 0 |
| Z3-alpha2-debug n | 0 | 827 | 18043.98 | 17221.69 | 827 | 0 | 827 | 58 | 1970 | 58 | 0 |
| Z3-GEX ne | 0 | 792 (base -6) | 77806.78 | 20473.68 | 792 | 0 | 792 | 93 | 1970 | 82 | 0 |
| Z3-Z3++ | 0 | 778 (base +89) | 61854.93 | 61956.16 | 778 | 0 | 778 | 107 | 1970 | 107 | 0 |
| Z3-siri ne | 0 | 716 (base -81) | 10158.36 | 10248.49 | 716 | 0 | 716 | 169 | 1970 | 138 | 0 |
| Yices2 | 0 | 676 | 5678.94 | 5762.60 | 676 | 0 | 676 | 209 | 1970 | 209 | 0 |
| cvc5 | 0 | 601 | 20269.21 | 20345.39 | 601 | 0 | 601 | 284 | 1970 | 284 | 0 |
| cvc5-cvc5-xyz ne | 0 | 594 (base -1) | 19303.43 | 19378.05 | 594 | 0 | 594 | 291 | 1970 | 291 | 0 |
| z3-BooledASS ne | 0 | 439 (base -367) | 5000.94 | 5055.21 | 439 | 0 | 439 | 446 | 1970 | 79 | 0 |
| Xolver | 0 | 55 | 7457.62 | 7465.22 | 55 | 0 | 55 | 830 | 1970 | 823 | 0 |
| SMTInterpol | 0 | 20 | 64.17 | 33.62 | 20 | 0 | 20 | 865 | 1970 | 0 | 0 |
| z3-BooledASS-base n | 0 | 806 | 9876.44 | 9976.76 | 806 | 0 | 806 | 79 | 1970 | 79 | 0 |
| Z3-GEX-base n | 0 | 798 | 21239.67 | 21341.30 | 798 | 0 | 798 | 87 | 1970 | 87 | 0 |
| Z3-siri-base n | 0 | 797 | 18662.34 | 18763.29 | 797 | 0 | 797 | 88 | 1970 | 88 | 0 |
| Z3-alpha2-base n | 0 | 777 | 10149.90 | 10247.26 | 777 | 0 | 777 | 108 | 1970 | 85 | 0 |
| Z3-Z3++-base n | 0 | 689 | 34530.25 | 34619.05 | 689 | 0 | 689 | 196 | 1970 | 196 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 595 | 19766.70 | 19842.15 | 595 | 0 | 595 | 290 | 1970 | 290 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-GEX ne | 0 | 2140 (base +139) | 19861.91 | 7038.06 | 2140 | 1443 | 697 | 13 | 702 | 0 | 0 |
| Z3-alpha2 | 0 | 2099 (base +137) | 8523.19 | 8561.98 | 2099 | 1365 | 734 | 9 | 747 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 2079 | 15560.48 | 13614.36 | 2079 | 1349 | 730 | 9 | 767 | 0 | 0 |
| Yices2 | 0 | 2025 | 4571.88 | 4821.93 | 2025 | 1391 | 634 | 9 | 821 | 0 | 0 |
| Z3-Z3++ ne | 0 | 1844 (base +167) | 6062.41 | 6290.89 | 1844 | 1408 | 436 | 9 | 1002 | 0 | 0 |
| Z3-siri ne | 0 | 1827 (base -174) | 4368.89 | 4596.36 | 1827 | 1182 | 645 | 141 | 887 | 0 | 0 |
| z3-BooledASS ne | 0 | 1222 (base -818) | 4278.45 | 4428.41 | 1222 | 812 | 410 | 818 | 815 | 0 | 0 |
| cvc5 | 0 | 1160 | 2907.57 | 3050.40 | 1160 | 628 | 532 | 9 | 1686 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1129 (base -3) | 2957.57 | 3096.40 | 1129 | 605 | 524 | 9 | 1717 | 0 | 0 |
| Xolver | 0 | 883 | 4726.62 | 4838.05 | 883 | 870 | 13 | 3 | 1969 | 0 | 0 |
| SMTInterpol | 0 | 23 | 73.19 | 37.25 | 23 | 3 | 20 | 2821 | 11 | 0 | 0 |
| z3-BooledASS-base n | 0 | 2040 | 5937.16 | 6189.34 | 2040 | 1284 | 756 | 18 | 797 | 0 | 0 |
| Z3-GEX-base n | 0 | 2001 | 7359.66 | 7609.15 | 2001 | 1299 | 702 | 9 | 845 | 0 | 0 |
| Z3-siri-base n | 0 | 2001 | 7428.31 | 7677.53 | 2001 | 1307 | 694 | 9 | 845 | 0 | 0 |
| Z3-alpha2-base n | 0 | 1962 | 5721.45 | 5965.15 | 1962 | 1244 | 718 | 109 | 784 | 0 | 0 |
| Z3-Z3++-base n | 0 | 1677 | 6771.08 | 6981.06 | 1677 | 1156 | 521 | 9 | 1169 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1132 | 3030.38 | 3170.29 | 1132 | 605 | 527 | 9 | 1714 | 0 | 0 |