The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the AUFLIA logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 731
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| cvc5 | cvc5 | cvc5 | cvc5-cvc5-xyz | cvc5 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 621 (base +2) | 16684.49 | 16762.36 | 621 | 91 | 530 | 110 | 0 | 104 | 0 |
| cvc5 | 0 | 619 | 15514.57 | 15591.84 | 619 | 91 | 528 | 112 | 0 | 106 | 0 |
| z3-BooledASS ne | 0 | 571 (base -2) | 2583.88 | 2654.35 | 571 | 89 | 482 | 160 | 0 | 146 | 0 |
| SMTInterpol | 0 | 479 | 6949.32 | 5137.31 | 480 | 44 | 436 | 251 | 0 | 150 | 0 |
| UltimateEliminator+MathSAT | 0 | 36 | 163.76 | 74.46 | 36 | 9 | 27 | 695 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 619 | 15530.45 | 15608.24 | 619 | 91 | 528 | 112 | 0 | 106 | 0 |
| z3-BooledASS-base n | 0 | 573 | 2884.86 | 2955.48 | 573 | 89 | 484 | 158 | 0 | 140 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 621 (base +2) | 16684.49 | 16762.36 | 621 | 91 | 530 | 110 | 0 | 104 | 0 |
| cvc5 | 0 | 619 | 15514.57 | 15591.84 | 619 | 91 | 528 | 112 | 0 | 106 | 0 |
| z3-BooledASS ne | 0 | 571 (base -2) | 2583.88 | 2654.35 | 571 | 89 | 482 | 160 | 0 | 146 | 0 |
| SMTInterpol | 0 | 480 | 8226.05 | 6003.85 | 480 | 44 | 436 | 251 | 0 | 150 | 0 |
| UltimateEliminator+MathSAT | 0 | 36 | 163.76 | 74.46 | 36 | 9 | 27 | 695 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 619 | 15530.45 | 15608.24 | 619 | 91 | 528 | 112 | 0 | 106 | 0 |
| z3-BooledASS-base n | 0 | 573 | 2884.86 | 2955.48 | 573 | 89 | 484 | 158 | 0 | 140 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 91 (base +0) | 10048.37 | 10060.14 | 91 | 91 | 0 | 7 | 633 | 2 | 0 |
| cvc5 | 0 | 91 | 10331.59 | 10343.33 | 91 | 91 | 0 | 7 | 633 | 2 | 0 |
| z3-BooledASS ne | 0 | 89 (base +0) | 40.44 | 51.46 | 89 | 89 | 0 | 9 | 633 | 5 | 0 |
| SMTInterpol | 0 | 44 | 22.41 | 21.12 | 44 | 44 | 0 | 54 | 633 | 12 | 0 |
| UltimateEliminator+MathSAT | 0 | 9 | 38.71 | 18.05 | 9 | 9 | 0 | 89 | 633 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 91 | 10343.49 | 10355.42 | 91 | 91 | 0 | 7 | 633 | 2 | 0 |
| z3-BooledASS-base n | 0 | 89 | 39.95 | 50.83 | 89 | 89 | 0 | 9 | 633 | 5 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz | 0 | 530 (base +2) | 6636.12 | 6702.22 | 530 | 0 | 530 | 8 | 193 | 8 | 0 |
| cvc5 | 0 | 528 | 5182.98 | 5248.51 | 528 | 0 | 528 | 10 | 193 | 10 | 0 |
| z3-BooledASS ne | 0 | 482 (base -2) | 2543.44 | 2602.89 | 482 | 0 | 482 | 56 | 193 | 51 | 0 |
| SMTInterpol | 0 | 436 | 8203.64 | 5982.73 | 436 | 0 | 436 | 102 | 193 | 70 | 0 |
| UltimateEliminator+MathSAT | 0 | 27 | 125.04 | 56.40 | 27 | 0 | 27 | 511 | 193 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 528 | 5186.96 | 5252.82 | 528 | 0 | 528 | 10 | 193 | 10 | 0 |
| z3-BooledASS-base n | 0 | 484 | 2844.91 | 2904.65 | 484 | 0 | 484 | 54 | 193 | 49 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| z3-BooledASS ne | 0 | 558 (base -2) | 188.29 | 256.94 | 558 | 89 | 469 | 14 | 159 | 0 | 0 |
| cvc5 | 0 | 550 | 189.32 | 257.00 | 550 | 63 | 487 | 3 | 178 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 550 (base +0) | 193.55 | 261.36 | 550 | 63 | 487 | 3 | 178 | 0 | 0 |
| SMTInterpol | 0 | 451 | 1523.14 | 747.98 | 451 | 44 | 407 | 57 | 223 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 36 | 163.76 | 74.46 | 36 | 9 | 27 | 694 | 1 | 0 | 0 |
| z3-BooledASS-base n | 0 | 560 | 222.42 | 291.18 | 560 | 89 | 471 | 13 | 158 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 550 | 195.25 | 263.27 | 550 | 63 | 487 | 3 | 178 | 0 | 0 |