QF_IDL (Unsat Core Track)
Competition results for the QF_IDL
logic
in the Unsat Core Track.
Results were generated on 2024-07-08
Benchmarks: 100
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| cvc5 | cvc5 | - | cvc5 | SMTInterpol |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 443191 | 6771.314638 | 6774.346735 | 18 | 0 | 18 | 82 | 0 | 82 | 0 |
| SMTInterpol | 0 | 404397 | 5619.319782 | 2514.131875 | 17 | 0 | 17 | 83 | 0 | 83 | 0 |
| OpenSMT | 0 | 57508 | 3935.38957 | 3936.579624 | 6 | 0 | 6 | 94 | 0 | 94 | 0 |
| Yices2 | 0 | 47207 | 6116.159974 | 6118.72627 | 9 | 0 | 9 | 91 | 0 | 91 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 443191 | 6771.314638 | 6774.346735 | 18 | 0 | 18 | 82 | 0 | 82 | 0 |
| SMTInterpol | 0 | 405278 | 7000.395177 | 3135.458975 | 17 | 0 | 17 | 83 | 0 | 83 | 0 |
| OpenSMT | 0 | 57508 | 3935.38957 | 3936.579624 | 6 | 0 | 6 | 94 | 0 | 94 | 0 |
| Yices2 | 0 | 47207 | 6116.159974 | 6118.72627 | 9 | 0 | 9 | 91 | 0 | 91 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 443191 | 6771.314638 | 6774.346735 | 18 | 0 | 18 | 82 | 0 | 82 | 0 |
| SMTInterpol | 0 | 405278 | 7000.395177 | 3135.458975 | 17 | 0 | 17 | 83 | 0 | 83 | 0 |
| OpenSMT | 0 | 57508 | 3935.38957 | 3936.579624 | 6 | 0 | 6 | 94 | 0 | 94 | 0 |
| Yices2 | 0 | 47207 | 6116.159974 | 6118.72627 | 9 | 0 | 9 | 91 | 0 | 91 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| SMTInterpol | 0 | 56653 | 96.590437 | 34.531976 | 5 | 0 | 5 | 0 | 95 | 0 | 0 |
| cvc5 | 0 | 19376 | 5.847071 | 5.948347 | 1 | 0 | 1 | 0 | 99 | 0 | 0 |
| OpenSMT | 0 | 19282 | 6.409897 | 6.512614 | 1 | 0 | 1 | 0 | 99 | 0 | 0 |