The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the ABVFP division in the Single Query Track.
Page generated on 2020-07-04 11:46:58 +0000
Benchmarks: 30 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| CVC4 | CVC4 | CVC4 | CVC4 | CVC4 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| CVC4 | 0 | 15 | 13645.288 | 13647.657 | 15 | 13 | 2 | 15 | 11 | 0 | |
| 2018-CVC4n | 0 | 15 | 13710.212 | 13712.736 | 15 | 13 | 2 | 15 | 10 | 0 | |
| UltimateEliminator+MathSAT | 0 | 10 | 101.942 | 71.843 | 10 | 10 | 0 | 20 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| CVC4 | 0 | 15 | 13647.258 | 13647.247 | 15 | 13 | 2 | 15 | 11 | 0 | |
| 2018-CVC4n | 0 | 15 | 13712.072 | 13712.266 | 15 | 13 | 2 | 15 | 10 | 0 | |
| UltimateEliminator+MathSAT | 0 | 10 | 101.942 | 71.843 | 10 | 10 | 0 | 20 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| CVC4 | 0 | 13 | 3.246 | 3.242 | 13 | 13 | 0 | 17 | 11 | 0 |
| 2018-CVC4n | 0 | 13 | 3.626 | 3.623 | 13 | 13 | 0 | 17 | 10 | 0 |
| UltimateEliminator+MathSAT | 0 | 10 | 46.535 | 32.608 | 10 | 10 | 0 | 20 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| 2018-CVC4n | 0 | 2 | 0.144 | 0.144 | 2 | 0 | 2 | 28 | 10 | 0 |
| CVC4 | 0 | 2 | 0.276 | 0.275 | 2 | 0 | 2 | 28 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 6.538 | 4.597 | 0 | 0 | 0 | 30 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| CVC4 | 0 | 15 | 291.992 | 291.987 | 15 | 13 | 2 | 15 | 12 | 0 | |
| 2018-CVC4n | 0 | 15 | 311.042 | 311.045 | 15 | 13 | 2 | 15 | 12 | 0 | |
| UltimateEliminator+MathSAT | 0 | 10 | 101.942 | 71.843 | 10 | 10 | 0 | 20 | 0 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.