AUFLIA (Single Query Track)
Competition results for the AUFLIA
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 1663
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1425 | 26721.418771 | 26868.862749 | 1425 | 161 | 1264 | 238 | 0 | 223 | 0 |
| iProver v3.9 | 0 | 1236 | 24873.441949 | 7305.036218 | 1251 | 0 | 1251 | 412 | 0 | 329 | 0 |
| SMTInterpol | 0 | 1113 | 26295.465581 | 22101.496303 | 1113 | 85 | 1028 | 550 | 0 | 407 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1425 | 26721.418771 | 26868.862749 | 1425 | 161 | 1264 | 238 | 0 | 223 | 0 |
| iProver v3.9 | 0 | 1251 | 57652.353301 | 15630.664812 | 1251 | 0 | 1251 | 412 | 0 | 329 | 0 |
| SMTInterpol | 0 | 1113 | 26295.465581 | 22101.496303 | 1113 | 85 | 1028 | 550 | 0 | 407 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 161 | 14881.108377 | 14899.578744 | 161 | 161 | 0 | 2 | 1500 | 2 | 0 |
| SMTInterpol | 0 | 85 | 46.552168 | 39.690058 | 85 | 85 | 0 | 78 | 1500 | 16 | 0 |
| iProver v3.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 163 | 1500 | 82 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1264 | 11840.310394 | 11969.284005 | 1264 | 0 | 1264 | 29 | 370 | 29 | 0 |
| iProver v3.9 | 0 | 1251 | 57652.353301 | 15630.664812 | 1251 | 0 | 1251 | 42 | 370 | 42 | 0 |
| SMTInterpol | 0 | 1028 | 26248.913413 | 22061.806245 | 1028 | 0 | 1028 | 265 | 370 | 226 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 1269 | 338.231288 | 465.193966 | 1269 | 111 | 1158 | 10 | 384 | 0 | 0 |
| iProver v3.9 | 0 | 1152 | 5887.976972 | 2269.923494 | 1152 | 0 | 1152 | 68 | 443 | 0 | 0 |
| SMTInterpol | 0 | 1036 | 3642.557181 | 1669.35228 | 1036 | 85 | 951 | 89 | 538 | 0 | 0 |