The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_BV division in the Unsat Core Track.
Page generated on 2020-07-04 11:49:33 +0000
Benchmarks: 2119 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance |
|---|---|
| Bitwuzla | Bitwuzla |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| Bitwuzla-fixedn | 0 | 1435217 | 177595.695 | 177535.357 | 100 | 0 | |
| Bitwuzla | 0 | 1435217 | 177678.254 | 177644.93 | 99 | 0 | |
| Yices2-fixedn | 0 | 1420381 | 244479.393 | 244421.686 | 189 | 0 | |
| Yices2 | 0 | 1420381 | 244631.208 | 244646.16 | 189 | 0 | |
| CVC4-uc | 0 | 1190503 | 1098979.969 | 1099096.115 | 801 | 0 | |
| z3n | 0 | 1187885 | 1095466.207 | 1095383.88 | 814 | 0 | |
| MathSAT5n | 0 | 0 | 285.525 | 286.018 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|
| Bitwuzla-fixedn | 0 | 1435217 | 177602.435 | 177532.027 | 100 | 0 | |
| Bitwuzla | 0 | 1435217 | 177686.714 | 177641.85 | 99 | 0 | |
| Yices2-fixedn | 0 | 1420381 | 244499.083 | 244413.936 | 189 | 0 | |
| Yices2 | 0 | 1420381 | 244651.498 | 244640.32 | 189 | 0 | |
| CVC4-uc | 0 | 1190503 | 1099137.889 | 1099061.265 | 801 | 0 | |
| z3n | 0 | 1187885 | 1095565.777 | 1095353.25 | 814 | 0 | |
| MathSAT5n | 0 | 0 | 285.525 | 286.018 | 0 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.