The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Arith division in the Unsat Core Track.
Page generated on 2021-07-18 17:31:25 +0000
Benchmarks: 229 Time Limit: 1200 seconds Memory Limit: 60 GB
Logics:| Sequential Performance | Parallel Performance |
|---|---|
| cvc5-uc | cvc5-uc |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| 2020-CVC4-ucn | 0 | 9 | 11.551 | 11.605 | 0 | 0 | |
| z3n | 0 | 9 | 1672.3 | 1673.027 | 1 | 0 | |
| cvc5-uc | 0 | 8 | 1212.898 | 1213.156 | 1 | 0 | |
| Vampire | 0 | 1 | 12689.251 | 12472.019 | 10 | 0 | |
| SMTInterpol-remus | 0 | 0 | 23522.649 | 23177.762 | 15 | 0 | |
| SMTInterpol | 0 | 0 | 23525.891 | 23181.932 | 15 | 0 | |
| UltimateEliminator+MathSAT | 1 | 4 | 18036.807 | 16938.1 | 12 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| 2020-CVC4-ucn | 0 | 9 | 11.551 | 11.605 | 0 | 0 | |
| z3n | 0 | 9 | 1672.34 | 1672.977 | 1 | 0 | |
| cvc5-uc | 0 | 8 | 1213.138 | 1213.136 | 1 | 0 | |
| Vampire | 0 | 1 | 13410.561 | 12471.969 | 10 | 0 | |
| SMTInterpol-remus | 0 | 0 | 23522.649 | 23177.762 | 15 | 0 | |
| SMTInterpol | 0 | 0 | 23525.891 | 23181.932 | 15 | 0 | |
| UltimateEliminator+MathSAT | 1 | 4 | 18036.807 | 16938.1 | 12 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.