The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_Datatypes division in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 544
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| cvc5-cvc5-xyz | cvc5-cvc5-xyz | cvc5 | Z3-Z3++ | SMTInterpol |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz | 0 | 398 (base +55) | 91890.89 | 91947.93 | 398 | 128 | 270 | 146 | 0 | 146 | 0 |
| Z3-Z3++ | 0 | 336 (base +118) | 5871.21 | 5913.35 | 336 | 56 | 280 | 8 | 200 | 8 | 0 |
| cvc5 | 0 | 334 | 79751.94 | 79800.97 | 334 | 128 | 206 | 210 | 0 | 210 | 0 |
| Z3-alpha2 | 0 | 324 (base +31) | 68023.94 | 67891.72 | 324 | 49 | 275 | 220 | 0 | 220 | 0 |
| Z3-alpha2-debug n | 0 | 321 | 65162.10 | 64728.79 | 321 | 48 | 273 | 223 | 0 | 223 | 0 |
| z3-BooledASS ne | 0 | 293 (base +1) | 61391.13 | 61432.25 | 293 | 21 | 272 | 251 | 0 | 251 | 0 |
| SMTInterpol | 0 | 186 | 18631.32 | 13103.03 | 191 | 43 | 148 | 353 | 0 | 315 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 343 | 84451.22 | 84501.58 | 343 | 128 | 215 | 201 | 0 | 201 | 0 |
| Z3-alpha2-base n | 0 | 293 | 61708.83 | 61750.62 | 293 | 22 | 271 | 251 | 0 | 251 | 0 |
| z3-BooledASS-base n | 0 | 292 | 60780.43 | 60829.28 | 292 | 21 | 271 | 252 | 0 | 252 | 0 |
| Z3-Z3++-base n | 0 | 218 | 54252.40 | 54284.55 | 218 | 27 | 191 | 126 | 200 | 126 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz | 0 | 398 (base +55) | 91890.89 | 91947.93 | 398 | 128 | 270 | 146 | 0 | 146 | 0 |
| Z3-Z3++ | 0 | 336 (base +118) | 5871.21 | 5913.35 | 336 | 56 | 280 | 8 | 200 | 8 | 0 |
| cvc5 | 0 | 334 | 79751.94 | 79800.97 | 334 | 128 | 206 | 210 | 0 | 210 | 0 |
| Z3-alpha2 | 0 | 324 (base +31) | 68023.94 | 67891.72 | 324 | 49 | 275 | 220 | 0 | 220 | 0 |
| Z3-alpha2-debug n | 0 | 321 | 65162.10 | 64728.79 | 321 | 48 | 273 | 223 | 0 | 223 | 0 |
| z3-BooledASS ne | 0 | 293 (base +1) | 61391.13 | 61432.25 | 293 | 21 | 272 | 251 | 0 | 251 | 0 |
| SMTInterpol | 0 | 191 | 25585.73 | 17435.47 | 191 | 43 | 148 | 353 | 0 | 315 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 343 | 84451.22 | 84501.58 | 343 | 128 | 215 | 201 | 0 | 201 | 0 |
| Z3-alpha2-base n | 0 | 293 | 61708.83 | 61750.62 | 293 | 22 | 271 | 251 | 0 | 251 | 0 |
| z3-BooledASS-base n | 0 | 292 | 60780.43 | 60829.28 | 292 | 21 | 271 | 252 | 0 | 252 | 0 |
| Z3-Z3++-base n | 0 | 218 | 54252.40 | 54284.55 | 218 | 27 | 191 | 126 | 200 | 126 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 128 (base +0) | 16088.69 | 16106.03 | 128 | 128 | 0 | 28 | 388 | 28 | 0 |
| cvc5 | 0 | 128 | 16528.72 | 16546.59 | 128 | 128 | 0 | 28 | 388 | 28 | 0 |
| Z3-Z3++ | 0 | 56 (base +29) | 285.90 | 292.86 | 56 | 56 | 0 | 0 | 488 | 0 | 0 |
| Z3-alpha2 | 0 | 49 (base +27) | 9445.82 | 9425.42 | 49 | 49 | 0 | 107 | 388 | 107 | 0 |
| Z3-alpha2-debug n | 0 | 48 | 8359.92 | 8294.50 | 48 | 48 | 0 | 108 | 388 | 108 | 0 |
| SMTInterpol | 0 | 43 | 8562.73 | 7991.08 | 43 | 43 | 0 | 113 | 388 | 113 | 0 |
| z3-BooledASS ne | 0 | 21 (base +0) | 9220.22 | 9223.68 | 21 | 21 | 0 | 135 | 388 | 135 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 128 | 16485.47 | 16503.24 | 128 | 128 | 0 | 28 | 388 | 28 | 0 |
| Z3-Z3++-base n | 0 | 27 | 10020.68 | 10025.17 | 27 | 27 | 0 | 29 | 488 | 29 | 0 |
| Z3-alpha2-base n | 0 | 22 | 10335.32 | 10338.99 | 22 | 22 | 0 | 134 | 388 | 134 | 0 |
| z3-BooledASS-base n | 0 | 21 | 9248.03 | 9252.26 | 21 | 21 | 0 | 135 | 388 | 135 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Z3++ | 0 | 280 (base +89) | 5585.30 | 5620.49 | 280 | 0 | 280 | 0 | 264 | 0 | 0 |
| Z3-alpha2 ne | 0 | 275 (base +4) | 58578.12 | 58466.30 | 275 | 0 | 275 | 105 | 164 | 105 | 0 |
| Z3-alpha2-debug n | 0 | 273 | 56802.18 | 56434.29 | 273 | 0 | 273 | 107 | 164 | 107 | 0 |
| z3-BooledASS ne | 0 | 272 (base +1) | 52170.91 | 52208.58 | 272 | 0 | 272 | 108 | 164 | 108 | 0 |
| cvc5-cvc5-xyz | 0 | 270 (base +55) | 75802.20 | 75841.90 | 270 | 0 | 270 | 110 | 164 | 110 | 0 |
| cvc5 | 0 | 206 | 63223.23 | 63254.38 | 206 | 0 | 206 | 174 | 164 | 174 | 0 |
| SMTInterpol | 0 | 148 | 17023.01 | 9444.39 | 148 | 0 | 148 | 232 | 164 | 194 | 0 |
| Z3-alpha2-base n | 0 | 271 | 51373.50 | 51411.64 | 271 | 0 | 271 | 109 | 164 | 109 | 0 |
| z3-BooledASS-base n | 0 | 271 | 51532.40 | 51577.01 | 271 | 0 | 271 | 109 | 164 | 109 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 215 | 67965.75 | 67998.34 | 215 | 0 | 215 | 165 | 164 | 165 | 0 |
| Z3-Z3++-base n | 0 | 191 | 44231.72 | 44259.38 | 191 | 0 | 191 | 89 | 264 | 89 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Z3++ ne | 0 | 306 (base +216) | 1291.60 | 1329.57 | 306 | 56 | 250 | 0 | 238 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 131 (base +35) | 678.98 | 695.10 | 131 | 28 | 103 | 0 | 413 | 0 | 0 |
| SMTInterpol | 0 | 119 | 1015.78 | 484.87 | 119 | 17 | 102 | 0 | 425 | 0 | 0 |
| Z3-alpha2 ne | 0 | 109 (base +15) | 875.40 | 829.65 | 109 | 19 | 90 | 0 | 435 | 0 | 0 |
| Z3-alpha2-debug n | 0 | 109 | 1109.67 | 961.21 | 109 | 19 | 90 | 0 | 435 | 0 | 0 |
| z3-BooledASS ne | 0 | 95 (base +0) | 375.33 | 386.90 | 95 | 4 | 91 | 0 | 449 | 0 | 0 |
| cvc5 | 0 | 95 | 444.59 | 456.37 | 95 | 27 | 68 | 0 | 449 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 96 | 463.85 | 475.79 | 96 | 27 | 69 | 0 | 448 | 0 | 0 |
| z3-BooledASS-base n | 0 | 95 | 380.23 | 394.15 | 95 | 4 | 91 | 0 | 449 | 0 | 0 |
| Z3-alpha2-base n | 0 | 94 | 354.26 | 365.86 | 94 | 4 | 90 | 0 | 450 | 0 | 0 |
| Z3-Z3++-base n | 0 | 90 | 213.81 | 225.03 | 90 | 5 | 85 | 0 | 454 | 0 | 0 |