The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the AUFBV logic in the Single Query Track.
Page generated on 2023-07-06 16:04:53 +0000
Benchmarks: 761 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| Bitwuzla | Bitwuzla | Bitwuzla | Bitwuzla | Bitwuzla |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla | 0 | 504 | 33946.779 | 33903.748 | 504 | 155 | 349 | 257 | 246 | 0 |
| Bitwuzla Fixedn | 0 | 504 | 34366.792 | 34286.111 | 504 | 155 | 349 | 257 | 246 | 0 |
| 2022-z3-4.8.17n | 0 | 207 | 20354.27 | 20342.232 | 207 | 81 | 126 | 554 | 488 | 7 |
| cvc5 | 0 | 186 | 32753.365 | 34416.057 | 186 | 10 | 176 | 575 | 485 | 0 |
| UltimateIntBlastingWrapper+SMTInterpol | 0 | 7 | 1353.061 | 1149.311 | 7 | 0 | 7 | 754 | 198 | 0 |
| UltimateEliminator+MathSAT | 0 | 6 | 1162.63 | 1057.648 | 6 | 0 | 6 | 755 | 258 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla | 0 | 504 | 33946.779 | 33903.748 | 504 | 155 | 349 | 257 | 246 | 0 |
| Bitwuzla Fixedn | 0 | 504 | 34366.792 | 34286.111 | 504 | 155 | 349 | 257 | 246 | 0 |
| 2022-z3-4.8.17n | 0 | 207 | 20354.27 | 20342.232 | 207 | 81 | 126 | 554 | 488 | 7 |
| cvc5 | 0 | 186 | 32753.365 | 34416.057 | 186 | 10 | 176 | 575 | 485 | 0 |
| UltimateIntBlastingWrapper+SMTInterpol | 0 | 7 | 1353.061 | 1149.311 | 7 | 0 | 7 | 754 | 196 | 0 |
| UltimateEliminator+MathSAT | 0 | 6 | 1162.63 | 1057.648 | 6 | 0 | 6 | 755 | 257 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla | 0 | 155 | 6515.862 | 6515.152 | 155 | 155 | 0 | 1 | 605 | 246 | 0 |
| Bitwuzla Fixedn | 0 | 155 | 6555.292 | 6524.776 | 155 | 155 | 0 | 1 | 605 | 246 | 0 |
| 2022-z3-4.8.17n | 0 | 81 | 4780.202 | 4765.777 | 81 | 81 | 0 | 75 | 605 | 488 | 7 |
| cvc5 | 0 | 10 | 2597.525 | 2653.316 | 10 | 10 | 0 | 146 | 605 | 485 | 0 |
| UltimateIntBlastingWrapper+SMTInterpol | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 156 | 605 | 196 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 156 | 605 | 257 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla | 0 | 349 | 27430.917 | 27388.596 | 349 | 0 | 349 | 11 | 401 | 246 | 0 |
| Bitwuzla Fixedn | 0 | 349 | 27811.5 | 27761.335 | 349 | 0 | 349 | 11 | 401 | 246 | 0 |
| cvc5 | 0 | 176 | 30155.84 | 31762.741 | 176 | 0 | 176 | 184 | 401 | 485 | 0 |
| 2022-z3-4.8.17n | 0 | 126 | 15574.068 | 15576.455 | 126 | 0 | 126 | 234 | 401 | 488 | 7 |
| UltimateIntBlastingWrapper+SMTInterpol | 0 | 7 | 1353.061 | 1149.311 | 7 | 0 | 7 | 353 | 401 | 196 | 0 |
| UltimateEliminator+MathSAT | 0 | 6 | 1162.63 | 1057.648 | 6 | 0 | 6 | 354 | 401 | 257 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla Fixedn | 0 | 350 | 1367.418 | 1363.352 | 350 | 119 | 231 | 411 | 407 | 0 |
| Bitwuzla | 0 | 350 | 1369.672 | 1363.803 | 350 | 119 | 231 | 411 | 407 | 0 |
| 2022-z3-4.8.17n | 0 | 138 | 553.236 | 538.232 | 138 | 64 | 74 | 623 | 611 | 7 |
| cvc5 | 0 | 125 | 465.24 | 462.711 | 125 | 2 | 123 | 636 | 625 | 0 |
| UltimateEliminator+MathSAT | 0 | 4 | 80.048 | 38.926 | 4 | 0 | 4 | 757 | 298 | 0 |
| UltimateIntBlastingWrapper+SMTInterpol | 0 | 2 | 35.67 | 11.756 | 2 | 0 | 2 | 759 | 277 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.