The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_UF division in the Unsat Core Track.
Page generated on 2020-07-04 11:49:33 +0000
Benchmarks: 1644 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance |
|---|---|
| SMTInterpol | SMTInterpol |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| SMTInterpol-fixedn | 0 | 215386 | 11536.215 | 6655.905 | 0 | 0 | |
| SMTInterpol | 0 | 215366 | 11540.921 | 6636.559 | 0 | 0 | |
| z3n | 0 | 215351 | 3394.389 | 3381.79 | 0 | 0 | |
| Yices2-fixedn | 0 | 213972 | 2044.95 | 2045.234 | 0 | 0 | |
| Yices2 | 0 | 213972 | 2056.252 | 2063.955 | 0 | 0 | |
| CVC4-uc | 0 | 213115 | 3152.264 | 3137.16 | 0 | 0 | |
| MathSAT5n | 8* | 193215 | 1406.564 | 1353.152 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| SMTInterpol-fixedn | 0 | 215386 | 11536.215 | 6655.905 | 0 | 0 | |
| SMTInterpol | 0 | 215366 | 11540.921 | 6636.559 | 0 | 0 | |
| z3n | 0 | 215351 | 3394.389 | 3381.79 | 0 | 0 | |
| Yices2-fixedn | 0 | 213972 | 2044.95 | 2045.234 | 0 | 0 | |
| Yices2 | 0 | 213972 | 2056.252 | 2063.955 | 0 | 0 | |
| CVC4-uc | 0 | 213115 | 3152.264 | 3137.16 | 0 | 0 | |
| MathSAT5n | 8* | 193215 | 1406.564 | 1353.152 | 0 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.
* The error score is caused by MathSAT using the wrong names in the unsat core output (syntactic problems). It does not indicate an unsoundness.