The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_FP logic in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 275
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Bitwuzla | Bitwuzla | cvc5 | Bitwuzla | COLIBRI |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| bitwuzla-dandelion n | 0 | 256 (base +0) | 15795.06 | 15829.01 | 256 | 140 | 116 | 19 | 0 | 19 | 0 |
| Bitwuzla | 0 | 255 | 14222.61 | 14257.00 | 255 | 137 | 118 | 20 | 0 | 20 | 0 |
| COLIBRI | 0 | 239 | 3199.57 | 3229.39 | 239 | 135 | 104 | 36 | 0 | 36 | 0 |
| cvc5 | 0 | 232 | 21184.05 | 21215.12 | 232 | 140 | 92 | 43 | 0 | 43 | 0 |
| cvc5-cvc5-xyz ne | 0 | 232 (base +1) | 21226.50 | 21257.51 | 232 | 140 | 92 | 43 | 0 | 43 | 0 |
| colibri2 | 0 | 200 | 6648.83 | 6674.07 | 200 | 119 | 81 | 75 | 0 | 9 | 0 |
| z3-BooledASS ne | 0 | 3 (base -157) | 14.20 | 14.58 | 3 | 0 | 3 | 272 | 0 | 94 | 0 |
| bitwuzla-dandelion-base n | 0 | 256 | 14968.12 | 15001.76 | 256 | 139 | 117 | 19 | 0 | 19 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 231 | 20052.56 | 20083.40 | 231 | 139 | 92 | 44 | 0 | 44 | 0 |
| z3-BooledASS-base n | 0 | 160 | 22265.51 | 22287.42 | 160 | 93 | 67 | 115 | 0 | 84 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| bitwuzla-dandelion n | 0 | 256 (base +0) | 15795.06 | 15829.01 | 256 | 140 | 116 | 19 | 0 | 19 | 0 |
| Bitwuzla | 0 | 255 | 14222.61 | 14257.00 | 255 | 137 | 118 | 20 | 0 | 20 | 0 |
| COLIBRI | 0 | 239 | 3199.57 | 3229.39 | 239 | 135 | 104 | 36 | 0 | 36 | 0 |
| cvc5 | 0 | 232 | 21184.05 | 21215.12 | 232 | 140 | 92 | 43 | 0 | 43 | 0 |
| cvc5-cvc5-xyz ne | 0 | 232 (base +1) | 21226.50 | 21257.51 | 232 | 140 | 92 | 43 | 0 | 43 | 0 |
| colibri2 | 0 | 200 | 6648.83 | 6674.07 | 200 | 119 | 81 | 75 | 0 | 9 | 0 |
| z3-BooledASS ne | 0 | 3 (base -157) | 14.20 | 14.58 | 3 | 0 | 3 | 272 | 0 | 94 | 0 |
| bitwuzla-dandelion-base n | 0 | 256 | 14968.12 | 15001.76 | 256 | 139 | 117 | 19 | 0 | 19 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 231 | 20052.56 | 20083.40 | 231 | 139 | 92 | 44 | 0 | 44 | 0 |
| z3-BooledASS-base n | 0 | 160 | 22265.51 | 22287.42 | 160 | 93 | 67 | 115 | 0 | 84 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5-cvc5-xyz ne | 0 | 140 (base +1) | 7255.20 | 7273.35 | 140 | 140 | 0 | 3 | 132 | 3 | 0 |
| cvc5 | 0 | 140 | 7263.63 | 7281.77 | 140 | 140 | 0 | 3 | 132 | 3 | 0 |
| bitwuzla-dandelion n | 0 | 140 (base +1) | 8084.62 | 8103.22 | 140 | 140 | 0 | 3 | 132 | 3 | 0 |
| Bitwuzla | 0 | 137 | 5310.93 | 5329.17 | 137 | 137 | 0 | 6 | 132 | 6 | 0 |
| COLIBRI | 0 | 135 | 2179.66 | 2196.53 | 135 | 135 | 0 | 8 | 132 | 8 | 0 |
| colibri2 | 0 | 119 | 5840.52 | 5855.70 | 119 | 119 | 0 | 24 | 132 | 6 | 0 |
| z3-BooledASS ne | 0 | 0 (base -93) | 0.00 | 0.00 | 0 | 0 | 0 | 143 | 132 | 35 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 139 | 6054.34 | 6072.23 | 139 | 139 | 0 | 4 | 132 | 4 | 0 |
| bitwuzla-dandelion-base n | 0 | 139 | 6747.62 | 6765.72 | 139 | 139 | 0 | 4 | 132 | 4 | 0 |
| z3-BooledASS-base n | 0 | 93 | 12202.24 | 12214.96 | 93 | 93 | 0 | 50 | 132 | 31 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Bitwuzla | 0 | 118 | 8911.68 | 8927.83 | 118 | 0 | 118 | 6 | 151 | 6 | 0 |
| bitwuzla-dandelion n | 0 | 116 (base -1) | 7710.44 | 7725.80 | 116 | 0 | 116 | 8 | 151 | 8 | 0 |
| COLIBRI | 0 | 102 | 825.13 | 837.80 | 102 | 0 | 102 | 22 | 151 | 22 | 0 |
| cvc5 | 0 | 92 | 13920.42 | 13933.35 | 92 | 0 | 92 | 32 | 151 | 32 | 0 |
| cvc5-cvc5-xyz ne | 0 | 92 (base +0) | 13971.30 | 13984.16 | 92 | 0 | 92 | 32 | 151 | 32 | 0 |
| colibri2 | 0 | 81 | 808.31 | 818.37 | 81 | 0 | 81 | 43 | 151 | 1 | 0 |
| z3-BooledASS ne | 0 | 3 (base -64) | 14.20 | 14.58 | 3 | 0 | 3 | 121 | 151 | 55 | 0 |
| bitwuzla-dandelion-base n | 0 | 117 | 8220.51 | 8236.03 | 117 | 0 | 117 | 7 | 151 | 7 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 92 | 13998.23 | 14011.17 | 92 | 0 | 92 | 32 | 151 | 32 | 0 |
| z3-BooledASS-base n | 0 | 67 | 10063.27 | 10072.46 | 67 | 0 | 67 | 57 | 151 | 49 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| COLIBRI | 0 | 220 | 480.29 | 507.42 | 220 | 122 | 98 | 0 | 55 | 0 | 0 |
| Bitwuzla | 0 | 193 | 681.33 | 705.36 | 193 | 105 | 88 | 0 | 82 | 0 | 0 |
| bitwuzla-dandelion n | 0 | 190 (base -6) | 633.35 | 657.19 | 190 | 104 | 86 | 0 | 85 | 0 | 0 |
| colibri2 | 0 | 174 | 231.72 | 253.19 | 174 | 104 | 70 | 62 | 39 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 164 (base +0) | 770.92 | 791.23 | 164 | 103 | 61 | 0 | 111 | 0 | 0 |
| cvc5 | 0 | 164 | 771.61 | 791.95 | 164 | 103 | 61 | 0 | 111 | 0 | 0 |
| z3-BooledASS ne | 0 | 3 (base -70) | 14.20 | 14.58 | 3 | 0 | 3 | 68 | 204 | 0 | 0 |
| bitwuzla-dandelion-base n | 0 | 196 | 742.74 | 767.17 | 196 | 106 | 90 | 0 | 79 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 164 | 773.29 | 793.73 | 164 | 103 | 61 | 0 | 111 | 0 | 0 |
| z3-BooledASS-base n | 0 | 73 | 528.07 | 537.19 | 73 | 52 | 21 | 0 | 202 | 0 | 0 |