The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the AUFLIRA logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 736
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| cvc5 | cvc5 | - | cvc5-cvc5-xyz | cvc5 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 694 (base +1) | 2324.18 | 2410.69 | 694 | 0 | 694 | 42 | 0 | 42 | 0 |
| cvc5 | 0 | 693 | 2689.25 | 2775.30 | 693 | 0 | 693 | 43 | 0 | 43 | 0 |
| z3-BooledASS ne | 0 | 677 (base +0) | 2247.16 | 2330.82 | 677 | 16 | 661 | 59 | 0 | 57 | 0 |
| SMTInterpol | 0 | 525 | 5095.10 | 4185.45 | 526 | 0 | 526 | 210 | 0 | 160 | 0 |
| UltimateEliminator+MathSAT | 0 | 3 | 15.68 | 6.76 | 3 | 0 | 3 | 733 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 693 | 2694.50 | 2780.96 | 693 | 0 | 693 | 43 | 0 | 43 | 0 |
| z3-BooledASS-base n | 0 | 677 | 2255.76 | 2339.14 | 677 | 16 | 661 | 59 | 0 | 49 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 694 (base +1) | 2324.18 | 2410.69 | 694 | 0 | 694 | 42 | 0 | 42 | 0 |
| cvc5 | 0 | 693 | 2689.25 | 2775.30 | 693 | 0 | 693 | 43 | 0 | 43 | 0 |
| z3-BooledASS ne | 0 | 677 (base +0) | 2247.16 | 2330.82 | 677 | 16 | 661 | 59 | 0 | 57 | 0 |
| SMTInterpol | 0 | 526 | 6672.73 | 5207.04 | 526 | 0 | 526 | 210 | 0 | 160 | 0 |
| UltimateEliminator+MathSAT | 0 | 3 | 15.68 | 6.76 | 3 | 0 | 3 | 733 | 0 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 693 | 2694.50 | 2780.96 | 693 | 0 | 693 | 43 | 0 | 43 | 0 |
| z3-BooledASS-base n | 0 | 677 | 2255.76 | 2339.14 | 677 | 16 | 661 | 59 | 0 | 49 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| z3-BooledASS ne | 0 | 16 (base +0) | 1393.03 | 1395.20 | 16 | 16 | 0 | 0 | 720 | 0 | 0 |
| SMTInterpol | 0 | 0 | 0.00 | 0.00 | 0 | 0 | 0 | 16 | 720 | 16 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.00 | 0.00 | 0 | 0 | 0 | 16 | 720 | 0 | 0 |
| cvc5 | 0 | 0 | 0.00 | 0.00 | 0 | 0 | 0 | 16 | 720 | 16 | 0 |
| cvc5-cvc5-xyz ne | 0 | 0 (base +0) | 0.00 | 0.00 | 0 | 0 | 0 | 16 | 720 | 16 | 0 |
| z3-BooledASS-base n | 0 | 16 | 1398.27 | 1400.41 | 16 | 16 | 0 | 0 | 720 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 0 | 0.00 | 0.00 | 0 | 0 | 0 | 16 | 720 | 16 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz | 0 | 694 (base +1) | 2324.18 | 2410.69 | 694 | 0 | 694 | 0 | 42 | 0 | 0 |
| cvc5 | 0 | 693 | 2689.25 | 2775.30 | 693 | 0 | 693 | 1 | 42 | 1 | 0 |
| z3-BooledASS ne | 0 | 661 (base +0) | 854.13 | 935.62 | 661 | 0 | 661 | 33 | 42 | 33 | 0 |
| SMTInterpol | 0 | 526 | 6672.73 | 5207.04 | 526 | 0 | 526 | 168 | 42 | 118 | 0 |
| UltimateEliminator+MathSAT | 0 | 3 | 15.68 | 6.76 | 3 | 0 | 3 | 691 | 42 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 693 | 2694.50 | 2780.96 | 693 | 0 | 693 | 1 | 42 | 1 | 0 |
| z3-BooledASS-base n | 0 | 661 | 857.49 | 938.73 | 661 | 0 | 661 | 33 | 42 | 29 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| z3-BooledASS ne | 0 | 669 (base +0) | 293.42 | 375.86 | 669 | 12 | 657 | 0 | 67 | 0 | 0 |
| cvc5 | 0 | 666 | 127.29 | 209.83 | 666 | 0 | 666 | 0 | 70 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 666 (base +0) | 128.54 | 211.39 | 666 | 0 | 666 | 0 | 70 | 0 | 0 |
| SMTInterpol | 0 | 509 | 714.38 | 414.10 | 509 | 0 | 509 | 0 | 227 | 0 | 0 |
| UltimateEliminator+MathSAT | 0 | 3 | 15.68 | 6.76 | 3 | 0 | 3 | 733 | 0 | 0 | 0 |
| z3-BooledASS-base n | 0 | 669 | 292.16 | 374.33 | 669 | 12 | 657 | 0 | 67 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 666 | 129.21 | 212.00 | 666 | 0 | 666 | 0 | 70 | 0 | 0 |