The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the ABVFPLRA logic in the Single Query Track.
Page generated on 2021-07-18 17:29:04 +0000
Benchmarks: 75 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 | 0 | 22 | 53358.92 | 54343.984 | 22 | 18 | 4 | 53 | 45 | 0 |
| cvc5 - fixedn | 0 | 22 | 54269.656 | 54342.892 | 22 | 18 | 4 | 53 | 45 | 0 |
| 2020-CVC4n | 0 | 20 | 14017.358 | 14019.597 | 20 | 18 | 2 | 55 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 10 | 1654.83 | 1518.186 | 10 | 10 | 0 | 65 | 0 | 1 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 - fixedn | 0 | 22 | 54336.686 | 54340.942 | 22 | 18 | 4 | 53 | 45 | 0 |
| cvc5 | 0 | 22 | 54336.832 | 54341.734 | 22 | 18 | 4 | 53 | 45 | 0 |
| 2020-CVC4n | 0 | 20 | 14019.048 | 14019.247 | 20 | 18 | 2 | 55 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 10 | 1654.83 | 1518.186 | 10 | 10 | 0 | 65 | 0 | 1 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 - fixedn | 0 | 18 | 1.692 | 1.682 | 18 | 18 | 0 | 0 | 57 | 45 | 0 |
| cvc5 | 0 | 18 | 1.75 | 1.745 | 18 | 18 | 0 | 0 | 57 | 45 | 0 |
| 2020-CVC4n | 0 | 18 | 2.577 | 2.58 | 18 | 18 | 0 | 0 | 57 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 10 | 165.735 | 113.543 | 10 | 10 | 0 | 8 | 57 | 0 | 1 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 - fixedn | 0 | 4 | 26.651 | 26.663 | 4 | 0 | 4 | 0 | 71 | 45 | 0 |
| cvc5 | 0 | 4 | 26.699 | 26.699 | 4 | 0 | 4 | 0 | 71 | 45 | 0 |
| 2020-CVC4n | 0 | 2 | 10.658 | 10.658 | 2 | 0 | 2 | 2 | 71 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 18.11 | 12.573 | 0 | 0 | 0 | 4 | 71 | 0 | 1 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 - fixedn | 0 | 21 | 1130.692 | 1130.677 | 21 | 18 | 3 | 54 | 47 | 0 |
| cvc5 | 0 | 21 | 1130.771 | 1131.251 | 21 | 18 | 3 | 54 | 47 | 0 |
| 2020-CVC4n | 0 | 20 | 328.833 | 328.825 | 20 | 18 | 2 | 55 | 13 | 0 |
| UltimateEliminator+MathSAT | 0 | 10 | 478.83 | 342.186 | 10 | 10 | 0 | 65 | 0 | 1 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.