ABV (Single Query Track)
Competition results for the ABV
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 2487
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 837 | 5468.84902 | 5553.55471 | 837 | 327 | 510 | 1650 | 0 | 646 | 0 |
| SMTInterpol | 0 | 391 | 5946.971617 | 5066.294443 | 391 | 45 | 346 | 2096 | 0 | 233 | 0 |
| Bitwuzla | 0 | 207 | 256.915585 | 277.711484 | 207 | 182 | 25 | 2280 | 0 | 81 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 837 | 5468.84902 | 5553.55471 | 837 | 327 | 510 | 1650 | 0 | 646 | 0 |
| SMTInterpol | 0 | 391 | 5946.971617 | 5066.294443 | 391 | 45 | 346 | 2096 | 0 | 233 | 0 |
| Bitwuzla | 0 | 207 | 256.915585 | 277.711484 | 207 | 182 | 25 | 2280 | 0 | 81 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 327 | 2649.230248 | 2682.443941 | 327 | 327 | 0 | 116 | 2044 | 8 | 0 |
| Bitwuzla | 0 | 182 | 24.486972 | 42.678729 | 182 | 182 | 0 | 261 | 2044 | 28 | 0 |
| SMTInterpol | 0 | 45 | 33.139743 | 24.358256 | 45 | 45 | 0 | 398 | 2044 | 4 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 510 | 2819.618771 | 2871.110768 | 510 | 0 | 510 | 18 | 1959 | 18 | 0 |
| SMTInterpol | 0 | 346 | 5913.831874 | 5041.936188 | 346 | 0 | 346 | 182 | 1959 | 20 | 0 |
| Bitwuzla | 0 | 25 | 232.428613 | 235.032755 | 25 | 0 | 25 | 503 | 1959 | 7 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 786 | 923.520916 | 1002.125078 | 786 | 294 | 492 | 108 | 1593 | 0 | 0 |
| SMTInterpol | 0 | 370 | 461.807427 | 296.36679 | 370 | 45 | 325 | 1741 | 376 | 0 | 0 |
| Bitwuzla | 0 | 206 | 27.957387 | 48.549983 | 206 | 182 | 24 | 2192 | 89 | 0 | 0 |