The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_AX logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 279 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| Yices2 | Yices2 | Yices2 | Yices2 | Yices2 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| 2022-Yices2n | 0 | 279 | 5.653 | 6.23 | 279 | 98 | 181 | 0 | 0 | 0 |
| Yices2 | 0 | 279 | 5.682 | 6.368 | 279 | 98 | 181 | 0 | 0 | 0 |
| cvc5 | 0 | 279 | 207.395 | 204.353 | 279 | 98 | 181 | 0 | 0 | 0 |
| OpenSMT | 0 | 279 | 367.552 | 367.679 | 279 | 98 | 181 | 0 | 0 | 0 |
| SMTInterpol | 0 | 279 | 886.921 | 345.795 | 279 | 98 | 181 | 0 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| 2022-Yices2n | 0 | 279 | 5.653 | 6.23 | 279 | 98 | 181 | 0 | 0 | 0 |
| Yices2 | 0 | 279 | 5.682 | 6.368 | 279 | 98 | 181 | 0 | 0 | 0 |
| cvc5 | 0 | 279 | 207.395 | 204.353 | 279 | 98 | 181 | 0 | 0 | 0 |
| SMTInterpol | 0 | 279 | 886.921 | 345.795 | 279 | 98 | 181 | 0 | 0 | 0 |
| OpenSMT | 0 | 279 | 367.552 | 367.679 | 279 | 98 | 181 | 0 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2022-Yices2n | 0 | 98 | 0.766 | 1.12 | 98 | 98 | 0 | 0 | 181 | 0 | 0 |
| Yices2 | 0 | 98 | 0.778 | 1.188 | 98 | 98 | 0 | 0 | 181 | 0 | 0 |
| cvc5 | 0 | 98 | 14.221 | 14.206 | 98 | 98 | 0 | 0 | 181 | 0 | 0 |
| OpenSMT | 0 | 98 | 22.763 | 22.803 | 98 | 98 | 0 | 0 | 181 | 0 | 0 |
| SMTInterpol | 0 | 98 | 140.152 | 62.246 | 98 | 98 | 0 | 0 | 181 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2022-Yices2n | 0 | 181 | 4.886 | 5.11 | 181 | 0 | 181 | 0 | 98 | 0 | 0 |
| Yices2 | 0 | 181 | 4.904 | 5.179 | 181 | 0 | 181 | 0 | 98 | 0 | 0 |
| cvc5 | 0 | 181 | 193.175 | 190.147 | 181 | 0 | 181 | 0 | 98 | 0 | 0 |
| SMTInterpol | 0 | 181 | 746.769 | 283.549 | 181 | 0 | 181 | 0 | 98 | 0 | 0 |
| OpenSMT | 0 | 181 | 344.788 | 344.876 | 181 | 0 | 181 | 0 | 98 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| 2022-Yices2n | 0 | 279 | 5.653 | 6.23 | 279 | 98 | 181 | 0 | 0 | 0 |
| Yices2 | 0 | 279 | 5.682 | 6.368 | 279 | 98 | 181 | 0 | 0 | 0 |
| SMTInterpol | 0 | 279 | 886.921 | 345.795 | 279 | 98 | 181 | 0 | 0 | 0 |
| cvc5 | 0 | 277 | 143.168 | 140.11 | 277 | 98 | 179 | 2 | 2 | 0 |
| OpenSMT | 0 | 277 | 297.361 | 297.474 | 277 | 98 | 179 | 2 | 2 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.