QF_IDL (Cloud Track)
Competition results for the QF_IDL
logic
in the Cloud Track.
Results were generated on 2024-07-08
Benchmarks: 196
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| - | Z3-Parti-Z3++ | SMTS | Z3-Parti-Z3++ | Z3-Parti-Z3++ |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Z3-Parti-Z3++ | 0 | 20 | 0 | 11531.616 | 20 | 7 | 13 | 176 | 0 | 0 | 0 |
| SMTS | 0 | 19 | 0 | 4107.888 | 19 | 13 | 6 | 177 | 0 | 0 | 0 |
| cvc5-cloud | 0 | 8 | 0 | 3778.252 | 8 | 2 | 6 | 188 | 0 | 0 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| SMTS | 0 | 13 | 0 | 2449.319 | 13 | 13 | 0 | 70 | 113 | 0 | 0 |
| Z3-Parti-Z3++ | 0 | 7 | 0 | 3621.381 | 7 | 7 | 0 | 76 | 113 | 0 | 0 |
| cvc5-cloud | 0 | 2 | 0 | 737.964 | 2 | 2 | 0 | 81 | 113 | 0 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Z3-Parti-Z3++ | 0 | 13 | 0 | 7910.235 | 13 | 0 | 13 | 48 | 135 | 0 | 0 |
| SMTS | 0 | 6 | 0 | 1658.569 | 6 | 0 | 6 | 55 | 135 | 0 | 0 |
| cvc5-cloud | 0 | 6 | 0 | 3040.288 | 6 | 0 | 6 | 55 | 135 | 0 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Z3-Parti-Z3++ | 0 | 2 | 0 | 40.729 | 2 | 2 | 0 | 134 | 60 | 0 | 0 |
| SMTS | 0 | 1 | 0 | 7.856 | 1 | 1 | 0 | 134 | 61 | 0 | 0 |
| cvc5-cloud | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 134 | 62 | 0 | 0 |