The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the BVFPLRA logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 266 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| Bitwuzla | Bitwuzla | Bitwuzla | Bitwuzla | Bitwuzla |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla | 0 | 257 | 65.463 | 65.511 | 257 | 233 | 24 | 9 | 9 | 0 |
| Bitwuzla Fixedn | 0 | 257 | 66.664 | 65.17 | 257 | 233 | 24 | 9 | 9 | 0 |
| 2022-Bitwuzlan | 0 | 172 | 498.928 | 498.997 | 172 | 148 | 24 | 94 | 91 | 0 |
| cvc5 | 0 | 133 | 164.515 | 158.489 | 133 | 109 | 24 | 133 | 101 | 0 |
| UltimateEliminator+MathSAT | 0 | 74 | 615.038 | 457.934 | 74 | 52 | 22 | 192 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla Fixedn | 0 | 257 | 66.664 | 65.17 | 257 | 233 | 24 | 9 | 9 | 0 |
| Bitwuzla | 0 | 257 | 65.463 | 65.511 | 257 | 233 | 24 | 9 | 9 | 0 |
| 2022-Bitwuzlan | 0 | 172 | 498.928 | 498.997 | 172 | 148 | 24 | 94 | 91 | 0 |
| cvc5 | 0 | 133 | 164.515 | 158.489 | 133 | 109 | 24 | 133 | 101 | 0 |
| UltimateEliminator+MathSAT | 0 | 74 | 615.038 | 457.934 | 74 | 52 | 22 | 192 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla Fixedn | 0 | 233 | 61.374 | 59.877 | 233 | 233 | 0 | 0 | 33 | 9 | 0 |
| Bitwuzla | 0 | 233 | 60.106 | 60.146 | 233 | 233 | 0 | 0 | 33 | 9 | 0 |
| 2022-Bitwuzlan | 0 | 148 | 494.4 | 494.465 | 148 | 148 | 0 | 85 | 33 | 91 | 0 |
| cvc5 | 0 | 109 | 98.984 | 96.35 | 109 | 109 | 0 | 124 | 33 | 101 | 0 |
| UltimateEliminator+MathSAT | 0 | 52 | 473.036 | 363.94 | 52 | 52 | 0 | 181 | 33 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2022-Bitwuzlan | 0 | 24 | 4.528 | 4.532 | 24 | 0 | 24 | 0 | 242 | 91 | 0 |
| Bitwuzla Fixedn | 0 | 24 | 5.29 | 5.293 | 24 | 0 | 24 | 0 | 242 | 9 | 0 |
| Bitwuzla | 0 | 24 | 5.357 | 5.365 | 24 | 0 | 24 | 0 | 242 | 9 | 0 |
| cvc5 | 0 | 24 | 65.531 | 62.139 | 24 | 0 | 24 | 0 | 242 | 101 | 0 |
| UltimateEliminator+MathSAT | 0 | 22 | 142.002 | 93.995 | 22 | 0 | 22 | 2 | 242 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla Fixedn | 0 | 257 | 66.664 | 65.17 | 257 | 233 | 24 | 9 | 9 | 0 |
| Bitwuzla | 0 | 257 | 65.463 | 65.511 | 257 | 233 | 24 | 9 | 9 | 0 |
| 2022-Bitwuzlan | 0 | 171 | 51.051 | 51.109 | 171 | 147 | 24 | 95 | 92 | 0 |
| cvc5 | 0 | 133 | 164.515 | 158.489 | 133 | 109 | 24 | 133 | 101 | 0 |
| UltimateEliminator+MathSAT | 0 | 74 | 615.038 | 457.934 | 74 | 52 | 22 | 192 | 2 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.