ALIA (Single Query Track)
Competition results for the ALIA
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 1537
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | iProver v3.9 | SMTInterpol | iProver v3.9 | cvc5 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 287 | 19149.69453 | 19182.829869 | 287 | 15 | 272 | 1250 | 0 | 648 | 0 |
| iProver v3.9 | 0 | 261 | 23142.538719 | 6265.234667 | 298 | 0 | 298 | 1239 | 0 | 1224 | 0 |
| SMTInterpol | 0 | 225 | 12425.678625 | 9512.884473 | 225 | 20 | 205 | 1312 | 0 | 426 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| iProver v3.9 | 0 | 298 | 125167.172953 | 32147.732087 | 298 | 0 | 298 | 1239 | 0 | 1224 | 0 |
| cvc5 | 0 | 287 | 19149.69453 | 19182.829869 | 287 | 15 | 272 | 1250 | 0 | 648 | 0 |
| SMTInterpol | 0 | 225 | 12425.678625 | 9512.884473 | 225 | 20 | 205 | 1312 | 0 | 426 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| SMTInterpol | 0 | 20 | 16.303007 | 11.061912 | 20 | 20 | 0 | 4 | 1513 | 1 | 0 |
| cvc5 | 0 | 15 | 2414.563586 | 2416.793708 | 15 | 15 | 0 | 9 | 1513 | 2 | 0 |
| iProver v3.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 24 | 1513 | 24 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| iProver v3.9 | 0 | 298 | 125167.172953 | 32147.732087 | 298 | 0 | 298 | 68 | 1171 | 68 | 0 |
| cvc5 | 0 | 272 | 16735.130944 | 16766.036162 | 272 | 0 | 272 | 94 | 1171 | 74 | 0 |
| SMTInterpol | 0 | 205 | 12409.375618 | 9501.822561 | 205 | 0 | 205 | 161 | 1171 | 98 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 221 | 125.420503 | 147.704682 | 221 | 7 | 214 | 373 | 943 | 0 | 0 |
| SMTInterpol | 0 | 178 | 572.236167 | 322.25114 | 178 | 20 | 158 | 797 | 562 | 0 | 0 |
| iProver v3.9 | 0 | 168 | 2296.223261 | 728.722699 | 168 | 0 | 168 | 11 | 1358 | 0 | 0 |