The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Equality+NonLinearArith division in the Cloud Track.
Page generated on 2021-07-18 17:32:03 +0000
Benchmarks: 67 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics:
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Vampire | 0 | 18 | 62420.782 | 18 | 0 | 18 | 46 | 3 | 46 | 0 |
cvc5-gg | 0 | 10 | 21627.611 | 10 | 0 | 10 | 57 | 0 | 18 | 0 |
Par4n | 0 | 0 | 37200.0 | 0 | 0 | 0 | 31 | 36 | 31 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5-gg | 0 | 0 | 0.0 | 0 | 0 | 0 | 0 | 67 | 18 | 0 |
Par4n | 0 | 0 | 0.0 | 0 | 0 | 0 | 0 | 67 | 31 | 0 |
Vampire | 0 | 0 | 0.0 | 0 | 0 | 0 | 0 | 67 | 46 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Vampire | 0 | 18 | 20420.782 | 18 | 0 | 18 | 11 | 38 | 46 | 0 |
cvc5-gg | 0 | 10 | 9627.611 | 10 | 0 | 10 | 19 | 38 | 18 | 0 |
Par4n | 0 | 0 | 21600.0 | 0 | 0 | 0 | 18 | 49 | 31 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5-gg | 0 | 10 | 459.611 | 10 | 0 | 10 | 57 | 0 | 18 | 0 |
Vampire | 0 | 1 | 1516.013 | 1 | 0 | 1 | 63 | 3 | 63 | 0 |
Par4n | 0 | 0 | 744.0 | 0 | 0 | 0 | 31 | 36 | 31 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.