The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Equality+NonLinearArith division in the Parallel Track.
Page generated on 2021-07-18 17:32:11 +0000
Benchmarks: 71 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics:
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5-gg | 0 | 12 | 5227.884 | 12 | 0 | 12 | 59 | 0 | 4 | 0 |
Vampire | 0 | 9 | 78300.964 | 9 | 0 | 9 | 62 | 0 | 62 | 0 |
Par4n | 0 | 0 | 40800.0 | 0 | 0 | 0 | 34 | 37 | 34 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5-gg | 0 | 0 | 0.0 | 0 | 0 | 0 | 0 | 71 | 4 | 0 |
Par4n | 0 | 0 | 0.0 | 0 | 0 | 0 | 0 | 71 | 34 | 0 |
Vampire | 0 | 0 | 0.0 | 0 | 0 | 0 | 0 | 71 | 62 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5-gg | 0 | 12 | 1627.884 | 12 | 0 | 12 | 12 | 47 | 4 | 0 |
Vampire | 0 | 9 | 21900.964 | 9 | 0 | 9 | 15 | 47 | 62 | 0 |
Par4n | 0 | 0 | 19200.0 | 0 | 0 | 0 | 16 | 55 | 34 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5-gg | 0 | 10 | 171.398 | 10 | 0 | 10 | 61 | 0 | 6 | 0 |
Vampire | 0 | 1 | 1683.09 | 1 | 0 | 1 | 70 | 0 | 70 | 0 |
Par4n | 0 | 0 | 816.0 | 0 | 0 | 0 | 34 | 37 | 34 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.