The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the BVFPLRA logic in the Single Query Track.
Page generated on 2021-07-18 17:29:05 +0000
Benchmarks: 185 Time Limit: 1200 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 96 | 66061.983 | 66071.193 | 96 | 91 | 5 | 89 | 55 | 0 |
2020-CVC4n | 0 | 92 | 66024.663 | 66037.656 | 92 | 87 | 5 | 93 | 55 | 0 |
UltimateEliminator+MathSAT | 0 | 38 | 1315.147 | 967.172 | 38 | 33 | 5 | 147 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 96 | 66069.493 | 66069.453 | 96 | 91 | 5 | 89 | 55 | 0 |
2020-CVC4n | 0 | 92 | 66035.193 | 66035.176 | 92 | 87 | 5 | 93 | 55 | 0 |
UltimateEliminator+MathSAT | 0 | 38 | 1315.147 | 967.172 | 38 | 33 | 5 | 147 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 91 | 6040.729 | 6040.694 | 91 | 91 | 0 | 6 | 88 | 55 | 0 |
2020-CVC4n | 0 | 87 | 6019.154 | 6019.141 | 87 | 87 | 0 | 10 | 88 | 55 | 0 |
UltimateEliminator+MathSAT | 0 | 33 | 695.794 | 517.082 | 33 | 33 | 0 | 64 | 88 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
2020-CVC4n | 0 | 5 | 7.909 | 7.908 | 5 | 0 | 5 | 0 | 180 | 55 | 0 |
cvc5 | 0 | 5 | 18.732 | 18.735 | 5 | 0 | 5 | 0 | 180 | 55 | 0 |
UltimateEliminator+MathSAT | 0 | 5 | 48.285 | 37.366 | 5 | 0 | 5 | 0 | 180 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 96 | 1389.493 | 1389.453 | 96 | 91 | 5 | 89 | 55 | 0 |
2020-CVC4n | 0 | 92 | 1355.193 | 1355.176 | 92 | 87 | 5 | 93 | 55 | 0 |
UltimateEliminator+MathSAT | 0 | 38 | 1290.979 | 948.772 | 38 | 33 | 5 | 147 | 3 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.