The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Equality division in the Cloud Track.
Page generated on 2021-07-18 17:32:03 +0000
Benchmarks: 32 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 15 | 25283.889 | 15 | 8 | 7 | 17 | 0 | 17 | 0 |
| Par4n | 0 | 2 | 17564.043 | 2 | 1 | 1 | 14 | 16 | 14 | 0 |
| cvc5-gg | 0 | 2 | 30004.151 | 2 | 0 | 2 | 30 | 0 | 25 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 8 | 5905.365 | 8 | 8 | 0 | 1 | 23 | 17 | 0 |
| Par4n | 0 | 1 | 4173.407 | 1 | 1 | 0 | 3 | 28 | 14 | 0 |
| cvc5-gg | 0 | 0 | 7200.0 | 0 | 0 | 0 | 9 | 23 | 25 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 7 | 2578.524 | 7 | 0 | 7 | 2 | 23 | 17 | 0 |
| cvc5-gg | 0 | 2 | 8404.151 | 2 | 0 | 2 | 7 | 23 | 25 | 0 |
| Par4n | 0 | 1 | 3790.636 | 1 | 0 | 1 | 3 | 28 | 14 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Vampire | 0 | 7 | 676.26 | 7 | 2 | 5 | 25 | 0 | 25 | 0 |
| cvc5-gg | 0 | 2 | 604.151 | 2 | 0 | 2 | 30 | 0 | 25 | 0 |
| Par4n | 0 | 0 | 384.0 | 0 | 0 | 0 | 16 | 16 | 16 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.