QF_UFIDL (Model Validation Track)
Competition results for the QF_UFIDL
logic
in the Model Validation Track.
Results were generated on 2024-07-08
Benchmarks: 206
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| winner_seq | winner_par | winner_sat | winner_unsat | winner_24s |
|---|
| OpenSMT | OpenSMT | OpenSMT | - | OpenSMT |
Sequential Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 201 | 8703.408557 | 8725.489914 | 201 | 201 | 0 | 5 | 0 | 5 | 0 |
| cvc5 | 0 | 178 | 26043.152881 | 26065.165564 | 178 | 178 | 0 | 28 | 0 | 28 | 0 |
| SMTInterpol | 0 | 177 | 23556.162365 | 11336.324354 | 182 | 182 | 0 | 24 | 0 | 24 | 0 |
| Yices2 | 0 | 142 | 14321.42599 | 14338.487797 | 142 | 142 | 0 | 64 | 0 | 64 | 0 |
Parallel Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 201 | 8703.408557 | 8725.489914 | 201 | 201 | 0 | 5 | 0 | 5 | 0 |
| SMTInterpol | 0 | 182 | 32661.464273 | 15531.217813 | 182 | 182 | 0 | 24 | 0 | 24 | 0 |
| cvc5 | 0 | 178 | 26043.152881 | 26065.165564 | 178 | 178 | 0 | 28 | 0 | 28 | 0 |
| Yices2 | 0 | 142 | 14321.42599 | 14338.487797 | 142 | 142 | 0 | 64 | 0 | 64 | 0 |
SAT Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 201 | 8703.408557 | 8725.489914 | 201 | 201 | 0 | 5 | 0 | 5 | 0 |
| SMTInterpol | 0 | 182 | 32661.464273 | 15531.217813 | 182 | 182 | 0 | 24 | 0 | 24 | 0 |
| cvc5 | 0 | 178 | 26043.152881 | 26065.165564 | 178 | 178 | 0 | 28 | 0 | 28 | 0 |
| Yices2 | 0 | 142 | 14321.42599 | 14338.487797 | 142 | 142 | 0 | 64 | 0 | 64 | 0 |
24 seconds Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| OpenSMT | 0 | 153 | 495.861243 | 511.250952 | 153 | 153 | 0 | 0 | 53 | 0 | 0 |
| SMTInterpol | 0 | 129 | 1400.184953 | 481.493826 | 129 | 129 | 0 | 0 | 77 | 0 | 0 |
| Yices2 | 0 | 109 | 56.600097 | 67.524245 | 109 | 109 | 0 | 0 | 97 | 0 | 0 |
| cvc5 | 0 | 107 | 72.413757 | 83.122387 | 107 | 107 | 0 | 0 | 99 | 0 | 0 |