QF_AUFBV (Single Query Track)
Competition results for the QF_AUFBV
logic
in the Single Query Track.
Results were generated on 2024-07-08
Benchmarks: 75
Time Limit: 1200 seconds
Memory Limit: 20480 GB
Winners
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|
| Bitwuzla | Bitwuzla | Bitwuzla | Z3-alpha | Yices2 |
Sequential Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Bitwuzla | 0 | 64 | 1835.197422 | 1842.352718 | 64 | 24 | 40 | 11 | 0 | 10 | 1 |
| Yices2 | 0 | 58 | 1349.428477 | 1355.468835 | 58 | 20 | 38 | 17 | 0 | 16 | 1 |
| Z3-alpha | 0 | 58 | 4022.188195 | 4028.882456 | 58 | 16 | 42 | 17 | 0 | 15 | 2 |
| cvc5 | 0 | 43 | 233.657764 | 238.057488 | 43 | 12 | 31 | 32 | 0 | 28 | 4 |
| SMTInterpol | 0 | 29 | 830.355043 | 593.58524 | 29 | 3 | 26 | 46 | 0 | 34 | 0 |
Parallel Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Bitwuzla | 0 | 64 | 1835.197422 | 1842.352718 | 64 | 24 | 40 | 11 | 0 | 10 | 1 |
| Yices2 | 0 | 58 | 1349.428477 | 1355.468835 | 58 | 20 | 38 | 17 | 0 | 16 | 1 |
| Z3-alpha | 0 | 58 | 4022.188195 | 4028.882456 | 58 | 16 | 42 | 17 | 0 | 15 | 2 |
| cvc5 | 0 | 43 | 233.657764 | 238.057488 | 43 | 12 | 31 | 32 | 0 | 28 | 4 |
| SMTInterpol | 0 | 29 | 830.355043 | 593.58524 | 29 | 3 | 26 | 46 | 0 | 34 | 0 |
SAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Bitwuzla | 0 | 24 | 725.05504 | 727.705696 | 24 | 24 | 0 | 1 | 50 | 0 | 1 |
| Yices2 | 0 | 20 | 980.395474 | 982.507039 | 20 | 20 | 0 | 5 | 50 | 4 | 1 |
| Z3-alpha | 0 | 16 | 1759.741941 | 1761.55265 | 16 | 16 | 0 | 9 | 50 | 9 | 0 |
| cvc5 | 0 | 12 | 192.753662 | 194.055138 | 12 | 12 | 0 | 13 | 50 | 12 | 1 |
| SMTInterpol | 0 | 3 | 429.265503 | 380.644555 | 3 | 3 | 0 | 22 | 50 | 15 | 0 |
UNSAT Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Z3-alpha | 0 | 42 | 2262.446254 | 2267.329806 | 42 | 0 | 42 | 4 | 29 | 3 | 1 |
| Bitwuzla | 0 | 40 | 1110.142382 | 1114.647022 | 40 | 0 | 40 | 6 | 29 | 6 | 0 |
| Yices2 | 0 | 38 | 369.033003 | 372.961796 | 38 | 0 | 38 | 8 | 29 | 8 | 0 |
| cvc5 | 0 | 31 | 40.904102 | 44.002351 | 31 | 0 | 31 | 15 | 29 | 12 | 3 |
| SMTInterpol | 0 | 26 | 401.089541 | 212.940685 | 26 | 0 | 26 | 20 | 29 | 19 | 0 |
24 seconds Performance Performance
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|
| Yices2 | 0 | 51 | 31.65862 | 36.760602 | 51 | 16 | 35 | 0 | 24 | 0 | 0 |
| Bitwuzla | 0 | 50 | 96.340113 | 101.384037 | 50 | 15 | 35 | 0 | 25 | 0 | 0 |
| Z3-alpha | 0 | 49 | 96.582971 | 101.498809 | 49 | 14 | 35 | 0 | 26 | 0 | 0 |
| cvc5 | 0 | 41 | 44.877578 | 48.978231 | 41 | 11 | 30 | 0 | 34 | 0 | 0 |
| SMTInterpol | 0 | 26 | 239.698973 | 92.79586 | 26 | 2 | 24 | 6 | 43 | 0 | 0 |