The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the AUFLIRA division in the Unsat Core Track.
Page generated on 2019-07-23 17:57:45 +0000
Benchmarks: 9885 Time Limit: 2400 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance |
|---|---|
| CVC4-uc | CVC4-uc |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| 2018-CVC4 (unsat core)n | 0 | 179280 | 193056.757 | 193080.779 | 80 | 0 | |
| CVC4-uc | 0 | 179276 | 191712.601 | 191737.587 | 79 | 0 | |
| Z3n | 0 | 178986 | 25633.985 | 25636.482 | 3 | 5 | |
| UltimateEliminator+Yices-2.6.1 | 0 | 0 | 117755.761 | 105108.15 | 34 | 0 | |
| UltimateEliminator+MathSAT-5.5.4 | 0 | 0 | 118470.059 | 106302.911 | 34 | 0 | |
| UltimateEliminator+SMTInterpol | 0 | 0 | 118561.663 | 104430.018 | 34 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| 2018-CVC4 (unsat core)n | 0 | 179280 | 193078.357 | 193077.469 | 80 | 0 | |
| CVC4-uc | 0 | 179276 | 191735.211 | 191733.727 | 79 | 0 | |
| Z3n | 0 | 178986 | 25635.785 | 25636.272 | 3 | 5 | |
| UltimateEliminator+SMTInterpol | 0 | 0 | 118561.663 | 104430.018 | 34 | 0 | |
| UltimateEliminator+Yices-2.6.1 | 0 | 0 | 117755.761 | 105108.15 | 34 | 0 | |
| UltimateEliminator+MathSAT-5.5.4 | 0 | 0 | 118470.059 | 106302.911 | 34 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.