The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_RDL logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 247 Time Limit: 1200 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
Yices2 | Yices2 | Yices2 | Yices2 | Yices2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Yices2 | 0 | 214 | 3501.757 | 3502.136 | 214 | 106 | 108 | 33 | 33 | 0 |
2022-Yices2n | 0 | 214 | 3540.854 | 3540.488 | 214 | 106 | 108 | 33 | 33 | 0 |
2021-Yices2n | 0 | 214 | 3567.438 | 3567.937 | 214 | 106 | 108 | 33 | 33 | 0 |
cvc5 | 0 | 211 | 7333.958 | 7335.132 | 211 | 103 | 108 | 36 | 36 | 0 |
OpenSMT | 0 | 192 | 16704.85 | 16701.784 | 192 | 99 | 93 | 55 | 55 | 0 |
SMTInterpol | 0 | 178 | 12073.787 | 9034.341 | 178 | 98 | 80 | 69 | 69 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Yices2 | 0 | 214 | 3501.757 | 3502.136 | 214 | 106 | 108 | 33 | 33 | 0 |
2022-Yices2n | 0 | 214 | 3540.854 | 3540.488 | 214 | 106 | 108 | 33 | 33 | 0 |
2021-Yices2n | 0 | 214 | 3567.438 | 3567.937 | 214 | 106 | 108 | 33 | 33 | 0 |
cvc5 | 0 | 211 | 7333.958 | 7335.132 | 211 | 103 | 108 | 36 | 36 | 0 |
OpenSMT | 0 | 192 | 16704.85 | 16701.784 | 192 | 99 | 93 | 55 | 55 | 0 |
SMTInterpol | 0 | 179 | 13693.827 | 10055.661 | 179 | 98 | 81 | 68 | 68 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Yices2 | 0 | 106 | 1766.95 | 1767.091 | 106 | 106 | 0 | 0 | 141 | 33 | 0 |
2022-Yices2n | 0 | 106 | 1785.685 | 1785.822 | 106 | 106 | 0 | 0 | 141 | 33 | 0 |
2021-Yices2n | 0 | 106 | 1795.042 | 1795.279 | 106 | 106 | 0 | 0 | 141 | 33 | 0 |
cvc5 | 0 | 103 | 3273.951 | 3274.421 | 103 | 103 | 0 | 3 | 141 | 36 | 0 |
OpenSMT | 0 | 99 | 8230.463 | 8226.505 | 99 | 99 | 0 | 7 | 141 | 55 | 0 |
SMTInterpol | 0 | 98 | 5541.209 | 4637.738 | 98 | 98 | 0 | 8 | 141 | 68 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Yices2 | 0 | 108 | 1734.807 | 1735.045 | 108 | 0 | 108 | 1 | 138 | 33 | 0 |
2022-Yices2n | 0 | 108 | 1755.169 | 1754.666 | 108 | 0 | 108 | 1 | 138 | 33 | 0 |
2021-Yices2n | 0 | 108 | 1772.396 | 1772.659 | 108 | 0 | 108 | 1 | 138 | 33 | 0 |
cvc5 | 0 | 108 | 4060.007 | 4060.71 | 108 | 0 | 108 | 1 | 138 | 36 | 0 |
OpenSMT | 0 | 93 | 8474.387 | 8475.279 | 93 | 0 | 93 | 16 | 138 | 55 | 0 |
SMTInterpol | 0 | 81 | 8152.619 | 5417.923 | 81 | 0 | 81 | 28 | 138 | 68 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Yices2 | 0 | 193 | 345.539 | 345.655 | 193 | 99 | 94 | 54 | 54 | 0 |
2022-Yices2n | 0 | 193 | 349.486 | 348.859 | 193 | 99 | 94 | 54 | 54 | 0 |
2021-Yices2n | 0 | 192 | 325.495 | 325.61 | 192 | 99 | 93 | 55 | 55 | 0 |
cvc5 | 0 | 164 | 650.082 | 650.243 | 164 | 83 | 81 | 83 | 83 | 0 |
OpenSMT | 0 | 142 | 391.368 | 386.578 | 142 | 77 | 65 | 105 | 105 | 0 |
SMTInterpol | 0 | 125 | 1474.121 | 681.698 | 125 | 71 | 54 | 122 | 122 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.