The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_Strings division in the Single Query Track. Chart
Results were generated on 2026-07-25
Benchmarks: 7633
Time Limit: 1200 seconds
Memory Limit: 30720 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
|---|---|---|---|---|
| Z3-Noodler | Z3-Noodler | Z3-Noodler | Z3-Noodler | Z3-Noodler |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Noodler | 0 | 7225 (base +2272) | 5670.08 | 6571.96 | 7225 | 4005 | 3220 | 408 | 0 | 22 | 0 |
| OSTRICH | 0 | 6951 | 90423.74 | 91289.66 | 6951 | 3838 | 3113 | 682 | 0 | 682 | 0 |
| cvc5 | 0 | 5299 | 141852.09 | 142524.83 | 5299 | 3403 | 1896 | 2334 | 0 | 2308 | 0 |
| cvc5-cvc5-xyz ne | 0 | 5287 (base -5) | 135401.18 | 136067.24 | 5287 | 3381 | 1906 | 2346 | 0 | 2313 | 0 |
| Z3-GEX ne | 0 | 5127 (base +27) | 61673.29 | 26065.09 | 5146 | 3304 | 1842 | 2487 | 0 | 898 | 0 |
| z3-BooledASS ne | 0 | 4977 (base +0) | 56828.98 | 57445.19 | 4977 | 3146 | 1831 | 2656 | 0 | 1090 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 5292 | 142944.82 | 143614.96 | 5292 | 3396 | 1896 | 2341 | 0 | 2308 | 0 |
| Z3-GEX-base n | 0 | 5100 | 60009.95 | 60651.25 | 5100 | 3268 | 1832 | 2533 | 0 | 963 | 0 |
| z3-BooledASS-base n | 0 | 4977 | 56309.83 | 56926.33 | 4977 | 3146 | 1831 | 2656 | 0 | 1090 | 0 |
| Z3-Noodler-base n | 0 | 4953 | 69712.55 | 70335.38 | 4953 | 3122 | 1831 | 2680 | 0 | 1110 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Noodler | 0 | 7225 (base +2272) | 5670.08 | 6571.96 | 7225 | 4005 | 3220 | 408 | 0 | 22 | 0 |
| OSTRICH | 0 | 6951 | 90423.74 | 91289.66 | 6951 | 3838 | 3113 | 682 | 0 | 682 | 0 |
| cvc5 | 0 | 5299 | 141852.09 | 142524.83 | 5299 | 3403 | 1896 | 2334 | 0 | 2308 | 0 |
| cvc5-cvc5-xyz ne | 0 | 5287 (base -5) | 135401.18 | 136067.24 | 5287 | 3381 | 1906 | 2346 | 0 | 2313 | 0 |
| Z3-GEX ne | 0 | 5146 (base +46) | 114236.48 | 39865.32 | 5146 | 3304 | 1842 | 2487 | 0 | 898 | 0 |
| z3-BooledASS ne | 0 | 4977 (base +0) | 56828.98 | 57445.19 | 4977 | 3146 | 1831 | 2656 | 0 | 1090 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 5292 | 142944.82 | 143614.96 | 5292 | 3396 | 1896 | 2341 | 0 | 2308 | 0 |
| Z3-GEX-base n | 0 | 5100 | 60009.95 | 60651.25 | 5100 | 3268 | 1832 | 2533 | 0 | 963 | 0 |
| z3-BooledASS-base n | 0 | 4977 | 56309.83 | 56926.33 | 4977 | 3146 | 1831 | 2656 | 0 | 1090 | 0 |
| Z3-Noodler-base n | 0 | 4953 | 69712.55 | 70335.38 | 4953 | 3122 | 1831 | 2680 | 0 | 1110 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Noodler | 0 | 4005 (base +883) | 3839.12 | 4338.20 | 4005 | 4005 | 0 | 15 | 3613 | 15 | 0 |
| OSTRICH | 0 | 3838 | 79839.17 | 80320.06 | 3838 | 3838 | 0 | 182 | 3613 | 182 | 0 |
| cvc5 | 0 | 3403 | 113733.03 | 114165.41 | 3403 | 3403 | 0 | 617 | 3613 | 591 | 0 |
| cvc5-cvc5-xyz ne | 0 | 3381 (base -15) | 111429.21 | 111856.19 | 3381 | 3381 | 0 | 639 | 3613 | 606 | 0 |
| Z3-GEX ne | 0 | 3304 (base +36) | 105986.78 | 34732.05 | 3304 | 3304 | 0 | 716 | 3613 | 287 | 0 |
| z3-BooledASS ne | 0 | 3146 (base +0) | 52906.76 | 53297.90 | 3146 | 3146 | 0 | 874 | 3613 | 468 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 3396 | 114112.90 | 114544.02 | 3396 | 3396 | 0 | 624 | 3613 | 591 | 0 |
| Z3-GEX-base n | 0 | 3268 | 57543.75 | 57955.81 | 3268 | 3268 | 0 | 752 | 3613 | 342 | 0 |
| z3-BooledASS-base n | 0 | 3146 | 52419.99 | 52810.98 | 3146 | 3146 | 0 | 874 | 3613 | 468 | 0 |
| Z3-Noodler-base n | 0 | 3122 | 65729.68 | 66123.89 | 3122 | 3122 | 0 | 898 | 3613 | 488 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Noodler | 0 | 3220 (base +1389) | 1830.96 | 2233.76 | 3220 | 0 | 3220 | 6 | 4407 | 5 | 0 |
| OSTRICH | 0 | 3113 | 10584.56 | 10969.60 | 3113 | 0 | 3113 | 113 | 4407 | 113 | 0 |
| cvc5-cvc5-xyz ne | 0 | 1906 (base +10) | 23971.97 | 24211.05 | 1906 | 0 | 1906 | 1320 | 4407 | 1320 | 0 |
| cvc5 | 0 | 1896 | 28119.06 | 28359.42 | 1896 | 0 | 1896 | 1330 | 4407 | 1330 | 0 |
| Z3-GEX ne | 0 | 1842 (base +10) | 8249.70 | 5133.27 | 1842 | 0 | 1842 | 1384 | 4407 | 610 | 0 |
| z3-BooledASS ne | 0 | 1831 (base +0) | 3922.22 | 4147.29 | 1831 | 0 | 1831 | 1395 | 4407 | 621 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 1896 | 28831.91 | 29070.94 | 1896 | 0 | 1896 | 1330 | 4407 | 1330 | 0 |
| Z3-GEX-base n | 0 | 1832 | 2466.20 | 2695.44 | 1832 | 0 | 1832 | 1394 | 4407 | 620 | 0 |
| z3-BooledASS-base n | 0 | 1831 | 3889.84 | 4115.35 | 1831 | 0 | 1831 | 1395 | 4407 | 621 | 0 |
| Z3-Noodler-base n | 0 | 1831 | 3982.87 | 4211.49 | 1831 | 0 | 1831 | 1395 | 4407 | 621 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Z3-Noodler | 0 | 7201 (base +2531) | 2819.07 | 3717.58 | 7201 | 3996 | 3205 | 386 | 46 | 0 | 0 |
| OSTRICH | 0 | 6403 | 9331.48 | 10114.42 | 6403 | 3324 | 3079 | 0 | 1230 | 0 | 0 |
| Z3-GEX ne | 0 | 4934 (base +140) | 19464.71 | 8783.49 | 4934 | 3134 | 1800 | 1566 | 1133 | 0 | 0 |
| cvc5 | 0 | 4834 | 3240.59 | 3842.62 | 4834 | 3031 | 1803 | 26 | 2773 | 0 | 0 |
| cvc5-cvc5-xyz ne | 0 | 4830 (base +2) | 3328.17 | 3924.65 | 4830 | 3018 | 1812 | 26 | 2777 | 0 | 0 |
| z3-BooledASS ne | 0 | 4720 (base +0) | 5493.04 | 6072.70 | 4720 | 2912 | 1808 | 1566 | 1347 | 0 | 0 |
| cvc5-cvc5-xyz-base n | 0 | 4828 | 3282.21 | 3880.75 | 4828 | 3025 | 1803 | 26 | 2779 | 0 | 0 |
| Z3-GEX-base n | 0 | 4794 | 5478.07 | 6075.62 | 4794 | 2973 | 1821 | 1570 | 1269 | 0 | 0 |
| z3-BooledASS-base n | 0 | 4720 | 5464.05 | 6044.17 | 4720 | 2913 | 1807 | 1566 | 1347 | 0 | 0 |
| Z3-Noodler-base n | 0 | 4670 | 5187.71 | 5768.74 | 4670 | 2860 | 1810 | 1569 | 1394 | 0 | 0 |