The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_AX logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Yices2 | Yices2 | Yices2 | Yices2 | Yices2 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 300 | 45.97 | 83.16 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| z3-BooledASS ne | 0 | 300 (base +0) | 56.60 | 93.34 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 300 (base +0) | 99.50 | 136.33 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5 | 0 | 300 | 100.50 | 137.82 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT | 0 | 300 | 132.25 | 169.48 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT-SMTS-seq ne | 0 | 300 (base +0) | 187.46 | 221.19 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| SMTInterpol | 0 | 300 | 584.30 | 292.48 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 300 | 56.91 | 93.75 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 300 | 99.10 | 136.24 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT-SMTS-seq-base n | 0 | 300 | 133.88 | 170.91 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 300 | 45.97 | 83.16 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| z3-BooledASS ne | 0 | 300 (base +0) | 56.60 | 93.34 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 300 (base +0) | 99.50 | 136.33 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5 | 0 | 300 | 100.50 | 137.82 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT | 0 | 300 | 132.25 | 169.48 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT-SMTS-seq ne | 0 | 300 (base +0) | 187.46 | 221.19 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| SMTInterpol | 0 | 300 | 584.30 | 292.48 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 300 | 56.91 | 93.75 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 300 | 99.10 | 136.24 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT-SMTS-seq-base n | 0 | 300 | 133.88 | 170.91 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 142 | 21.20 | 38.75 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| z3-BooledASS ne | 0 | 142 (base +0) | 24.48 | 41.83 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 142 (base +0) | 26.16 | 43.65 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| cvc5 | 0 | 142 | 26.42 | 44.15 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| OpenSMT | 0 | 142 | 31.95 | 49.62 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| OpenSMT-SMTS-seq ne | 0 | 142 (base +0) | 47.95 | 64.34 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| SMTInterpol | 0 | 142 | 127.42 | 82.33 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| z3-BooledASS-base n | 0 | 142 | 24.50 | 41.91 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 142 | 26.23 | 43.84 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| OpenSMT-SMTS-seq-base n | 0 | 142 | 32.10 | 49.61 | 142 | 142 | 0 | 0 | 158 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 158 | 24.77 | 44.41 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| z3-BooledASS ne | 0 | 158 (base +0) | 32.12 | 51.51 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 158 (base +0) | 73.34 | 92.68 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| cvc5 | 0 | 158 | 74.08 | 93.67 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| OpenSMT | 0 | 158 | 100.30 | 119.86 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| OpenSMT-SMTS-seq ne | 0 | 158 (base +0) | 139.52 | 156.85 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| SMTInterpol | 0 | 158 | 456.88 | 210.15 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| z3-BooledASS-base n | 0 | 158 | 32.41 | 51.84 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 158 | 72.87 | 92.40 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| OpenSMT-SMTS-seq-base n | 0 | 158 | 101.78 | 121.30 | 158 | 0 | 158 | 0 | 142 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Yices2 | 0 | 300 | 45.97 | 83.16 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| z3-BooledASS ne | 0 | 300 (base +0) | 56.60 | 93.34 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 300 (base +0) | 99.50 | 136.33 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5 | 0 | 300 | 100.50 | 137.82 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT | 0 | 300 | 132.25 | 169.48 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| SMTInterpol | 0 | 300 | 584.30 | 292.48 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT-SMTS-seq ne | 0 | 299 (base -1) | 148.22 | 182.51 | 299 | 142 | 157 | 0 | 1 | 0 | 0 |
| z3-BooledASS-base n | 0 | 300 | 56.91 | 93.75 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 300 | 99.10 | 136.24 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |
| OpenSMT-SMTS-seq-base n | 0 | 300 | 133.88 | 170.91 | 300 | 142 | 158 | 0 | 0 | 0 | 0 |