AUFDTLIA (Single Query Track)
Competition results for the AUFDTLIA
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 293 | 21717.334318 | 21750.686701 | 293 | 78 | 215 | 7 | 0 | 7 | 0 |
| SMTInterpol | 0 | 197 | 1815.026416 | 1076.729933 | 198 | 1 | 197 | 102 | 0 | 25 | 0 |
| iProver v3.9 | 0 | 176 | 16477.06004 | 4461.185709 | 189 | 0 | 189 | 111 | 0 | 105 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 293 | 21717.334318 | 21750.686701 | 293 | 78 | 215 | 7 | 0 | 7 | 0 |
| SMTInterpol | 0 | 198 | 3071.904128 | 2152.995686 | 198 | 1 | 197 | 102 | 0 | 25 | 0 |
| iProver v3.9 | 0 | 189 | 44761.106275 | 11651.241148 | 189 | 0 | 189 | 111 | 0 | 105 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 78 | 21637.025765 | 21648.857364 | 78 | 78 | 0 | 0 | 222 | 0 | 0 |
| SMTInterpol | 0 | 1 | 0.67928 | 0.521879 | 1 | 1 | 0 | 77 | 222 | 18 | 0 |
| iProver v3.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 78 | 222 | 78 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 215 | 80.308553 | 101.829337 | 215 | 0 | 215 | 1 | 84 | 1 | 0 |
| SMTInterpol | 0 | 197 | 3071.224848 | 2152.473807 | 197 | 0 | 197 | 19 | 84 | 1 | 0 |
| iProver v3.9 | 0 | 189 | 44761.106275 | 11651.241148 | 189 | 0 | 189 | 27 | 84 | 21 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 251 | 91.980501 | 117.050245 | 251 | 36 | 215 | 0 | 49 | 0 | 0 |
| SMTInterpol | 0 | 189 | 1002.735663 | 409.953048 | 189 | 1 | 188 | 70 | 41 | 0 | 0 |
| iProver v3.9 | 0 | 124 | 1145.480832 | 397.360535 | 124 | 0 | 124 | 0 | 176 | 0 | 0 |