The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Equality division in the Cloud Track.
Page generated on 2023-07-06 16:06:19 +0000
Benchmarks: 136 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 40 | 12529.452 | 40 | 19 | 21 | 96 | 0 | 0 | 0 |
Vampire | 3 | 52 | 14032.694 | 52 | 25 | 27 | 84 | 0 | 0 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Vampire | 0 | 25 | 7906.277 | 25 | 25 | 0 | 8 | 103 | 0 | 0 |
cvc5 | 0 | 19 | 9135.325 | 19 | 19 | 0 | 14 | 103 | 0 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 21 | 3394.127 | 21 | 0 | 21 | 14 | 101 | 0 | 0 |
Vampire | 3 | 27 | 6126.417 | 27 | 0 | 27 | 8 | 101 | 0 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 9 | 83.711 | 9 | 1 | 8 | 127 | 0 | 118 | 0 |
Vampire | 0 | 0 | 0.0 | 0 | 0 | 0 | 136 | 0 | 136 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.