QF_FP (Single Query Track)
Competition results for the QF_FP
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 275
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| Bitwuzla | Bitwuzla | cvc5 | Bitwuzla | COLIBRI |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Bitwuzla | 0 | 252 | 12354.085611 | 12381.819706 | 252 | 136 | 116 | 23 | 0 | 23 | 0 |
| cvc5 | 0 | 232 | 19396.330595 | 19423.516298 | 232 | 142 | 90 | 43 | 0 | 43 | 0 |
| COLIBRI | 0 | 229 | 2340.989554 | 2365.247409 | 229 | 131 | 98 | 46 | 0 | 46 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Bitwuzla | 0 | 252 | 12354.085611 | 12381.819706 | 252 | 136 | 116 | 23 | 0 | 23 | 0 |
| cvc5 | 0 | 232 | 19396.330595 | 19423.516298 | 232 | 142 | 90 | 43 | 0 | 43 | 0 |
| COLIBRI | 0 | 229 | 2340.989554 | 2365.247409 | 229 | 131 | 98 | 46 | 0 | 46 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| cvc5 | 0 | 142 | 6985.625025 | 7001.378136 | 142 | 142 | 0 | 4 | 129 | 4 | 0 |
| Bitwuzla | 0 | 136 | 4712.75789 | 4727.416087 | 136 | 136 | 0 | 10 | 129 | 10 | 0 |
| COLIBRI | 0 | 131 | 2067.574207 | 2081.439096 | 131 | 131 | 0 | 15 | 129 | 15 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Bitwuzla | 0 | 116 | 7641.327721 | 7654.403619 | 116 | 0 | 116 | 3 | 156 | 3 | 0 |
| COLIBRI | 0 | 98 | 273.415348 | 283.808313 | 98 | 0 | 98 | 21 | 156 | 21 | 0 |
| cvc5 | 0 | 90 | 12410.70557 | 12422.138162 | 90 | 0 | 90 | 29 | 156 | 29 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| COLIBRI | 0 | 217 | 470.740278 | 493.470719 | 217 | 120 | 97 | 0 | 58 | 0 | 0 |
| Bitwuzla | 0 | 195 | 745.955704 | 765.680401 | 195 | 106 | 89 | 0 | 80 | 0 | 0 |
| cvc5 | 0 | 155 | 931.07318 | 946.776732 | 155 | 96 | 59 | 0 | 120 | 0 | 0 |