The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_DT logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 201 Time Limit: 1200 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
cvc5 | cvc5 | cvc5 | cvc5 | SMTInterpol |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
2022-z3-4.8.17n | 0 | 103 | 54329.683 | 54335.169 | 103 | 41 | 62 | 98 | 98 | 0 |
cvc5 | 0 | 86 | 45760.349 | 45768.208 | 86 | 25 | 61 | 115 | 115 | 0 |
SMTInterpol | 0 | 29 | 11629.946 | 9699.692 | 29 | 19 | 10 | 172 | 172 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
2022-z3-4.8.17n | 0 | 103 | 54329.683 | 54335.169 | 103 | 41 | 62 | 98 | 98 | 0 |
cvc5 | 0 | 86 | 45760.349 | 45768.208 | 86 | 25 | 61 | 115 | 115 | 0 |
SMTInterpol | 0 | 38 | 27398.116 | 18770.7 | 38 | 19 | 19 | 163 | 163 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
2022-z3-4.8.17n | 0 | 41 | 23076.742 | 23079.023 | 41 | 41 | 0 | 59 | 101 | 98 | 0 |
cvc5 | 0 | 25 | 13167.831 | 13171.518 | 25 | 25 | 0 | 75 | 101 | 115 | 0 |
SMTInterpol | 0 | 19 | 6737.127 | 6414.322 | 19 | 19 | 0 | 81 | 101 | 163 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
2022-z3-4.8.17n | 0 | 62 | 31252.941 | 31256.146 | 62 | 0 | 62 | 39 | 100 | 98 | 0 |
cvc5 | 0 | 61 | 32592.518 | 32596.69 | 61 | 0 | 61 | 40 | 100 | 115 | 0 |
SMTInterpol | 0 | 19 | 20660.989 | 12356.378 | 19 | 0 | 19 | 82 | 100 | 163 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTInterpol | 0 | 6 | 148.94 | 86.111 | 6 | 5 | 1 | 195 | 195 | 0 |
2022-z3-4.8.17n | 0 | 2 | 21.188 | 21.186 | 2 | 0 | 2 | 199 | 199 | 0 |
cvc5 | 0 | 1 | 16.418 | 16.419 | 1 | 0 | 1 | 200 | 200 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.