The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Equality division in the Cloud Track.
Page generated on 2022-08-10 14:49:53 +0000
Benchmarks: 79 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 28 | 51547.513 | 28 | 10 | 18 | 51 | 0 | 0 | 0 |
| cvc5-cloud | 6 | 2 | 92514.701 | 2 | 0 | 2 | 77 | 0 | 0 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 10 | 5424.143 | 10 | 10 | 0 | 0 | 69 | 0 | 0 |
| cvc5-cloud | 0 | 0 | 12000.0 | 0 | 0 | 0 | 10 | 69 | 0 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 18 | 2923.37 | 18 | 0 | 18 | 1 | 60 | 0 | 0 |
| cvc5-cloud | 6 | 2 | 20514.701 | 2 | 0 | 2 | 17 | 60 | 0 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 8 | 1511.926 | 8 | 1 | 7 | 71 | 0 | 57 | 0 |
| cvc5-cloud | 0 | 1 | 1890.464 | 1 | 0 | 1 | 78 | 0 | 78 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.