AUFLIRA (Single Query Track)
Competition results for the AUFLIRA
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 1683
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | cvc5 | - | cvc5 | cvc5 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1569 | 6094.594165 | 6252.744156 | 1569 | 0 | 1569 | 114 | 0 | 109 | 0 |
| iProver v3.9 | 0 | 1345 | 58632.194905 | 16175.091525 | 1431 | 0 | 1431 | 252 | 0 | 252 | 0 |
| SMTInterpol | 0 | 1066 | 50880.201609 | 38781.720166 | 1078 | 0 | 1078 | 605 | 0 | 453 | 24 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1569 | 6094.594165 | 6252.744156 | 1569 | 0 | 1569 | 114 | 0 | 109 | 0 |
| iProver v3.9 | 0 | 1431 | 305033.801288 | 78746.631449 | 1431 | 0 | 1431 | 252 | 0 | 252 | 0 |
| SMTInterpol | 0 | 1078 | 69232.331113 | 50688.093581 | 1078 | 0 | 1078 | 605 | 0 | 453 | 24 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| SMTInterpol | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 49 | 1634 | 49 | 0 |
| cvc5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 49 | 1634 | 45 | 0 |
| iProver v3.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 49 | 1634 | 49 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1569 | 6094.594165 | 6252.744156 | 1569 | 0 | 1569 | 0 | 114 | 0 | 0 |
| iProver v3.9 | 0 | 1431 | 305033.801288 | 78746.631449 | 1431 | 0 | 1431 | 138 | 114 | 138 | 0 |
| SMTInterpol | 0 | 1078 | 69232.331113 | 50688.093581 | 1078 | 0 | 1078 | 491 | 114 | 349 | 18 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1508 | 301.03018 | 451.721886 | 1508 | 0 | 1508 | 0 | 175 | 0 | 0 |
| iProver v3.9 | 0 | 1168 | 9592.097429 | 3250.690574 | 1168 | 0 | 1168 | 0 | 515 | 0 | 0 |
| SMTInterpol | 0 | 927 | 6371.296884 | 3890.946181 | 927 | 0 | 927 | 0 | 756 | 0 | 0 |