UFIDL (Single Query Track)
Competition results for the UFIDL
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 20
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | cvc5 | SMTInterpol | cvc5 | cvc5 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 10 | 542.773077 | 543.801952 | 10 | 1 | 9 | 10 | 0 | 8 | 0 |
| SMTInterpol | 0 | 8 | 198.428904 | 106.632575 | 8 | 1 | 7 | 12 | 0 | 5 | 2 |
| iProver v3.9 | 0 | 7 | 1085.581715 | 286.142689 | 7 | 0 | 7 | 13 | 0 | 11 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 10 | 542.773077 | 543.801952 | 10 | 1 | 9 | 10 | 0 | 8 | 0 |
| SMTInterpol | 0 | 8 | 198.428904 | 106.632575 | 8 | 1 | 7 | 12 | 0 | 5 | 2 |
| iProver v3.9 | 0 | 7 | 1085.581715 | 286.142689 | 7 | 0 | 7 | 13 | 0 | 11 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| SMTInterpol | 0 | 1 | 0.699671 | 0.516325 | 1 | 1 | 0 | 2 | 17 | 0 | 1 |
| cvc5 | 0 | 1 | 540.549987 | 540.682029 | 1 | 1 | 0 | 2 | 17 | 0 | 0 |
| iProver v3.9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 17 | 1 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 9 | 2.22309 | 3.119923 | 9 | 0 | 9 | 0 | 11 | 0 | 0 |
| SMTInterpol | 0 | 7 | 197.729234 | 106.11625 | 7 | 0 | 7 | 2 | 11 | 2 | 0 |
| iProver v3.9 | 0 | 7 | 1085.581715 | 286.142689 | 7 | 0 | 7 | 2 | 11 | 2 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 9 | 2.22309 | 3.119923 | 9 | 0 | 9 | 2 | 9 | 0 | 0 |
| SMTInterpol | 0 | 6 | 112.583147 | 54.980404 | 6 | 1 | 5 | 5 | 9 | 0 | 0 |
| iProver v3.9 | 0 | 4 | 53.074616 | 16.519714 | 4 | 0 | 4 | 2 | 14 | 0 | 0 |