The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_LIA logic in the Single Query Track. Chart
Results were generated on 2025-08-11
Benchmarks: 4825
Time Limit: 1200 seconds
Memory Limit: 30720 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
---|---|---|---|---|
OpenSMT | OpenSMT | OpenSMT | OpenSMT | Yices2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
OpenSMT | 0 | 4579 | 272280.40 | 272891.46 | 4579 | 2784 | 1795 | 246 | 0 | 237 | 0 |
cvc5 | 0 | 4443 | 311878.34 | 312467.20 | 4443 | 2752 | 1691 | 382 | 0 | 376 | 0 |
Yices2 | 0 | 4395 | 57937.67 | 58491.75 | 4395 | 2653 | 1742 | 430 | 0 | 417 | 7 |
Z3-alpha | 0 | 4204 (base +206) | 149811.20 | 41325.09 | 4271 | 2702 | 1569 | 554 | 0 | 535 | 13 |
SMTInterpol | 0 | 4203 | 227287.72 | 173651.57 | 4207 | 2491 | 1716 | 618 | 0 | 527 | 0 |
Z3-alpha-base n | 0 | 3998 | 122151.77 | 122664.35 | 3998 | 2531 | 1467 | 827 | 0 | 798 | 22 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
OpenSMT | 0 | 4579 | 272280.40 | 272891.46 | 4579 | 2784 | 1795 | 246 | 0 | 237 | 0 |
cvc5 | 0 | 4443 | 311878.34 | 312467.20 | 4443 | 2752 | 1691 | 382 | 0 | 376 | 0 |
Yices2 | 0 | 4395 | 57937.67 | 58491.75 | 4395 | 2653 | 1742 | 430 | 0 | 417 | 7 |
Z3-alpha | 0 | 4271 (base +273) | 306454.92 | 81046.39 | 4271 | 2702 | 1569 | 554 | 0 | 535 | 13 |
SMTInterpol | 0 | 4207 | 234194.14 | 177646.97 | 4207 | 2491 | 1716 | 618 | 0 | 527 | 0 |
Z3-alpha-base n | 0 | 3998 | 122151.77 | 122664.35 | 3998 | 2531 | 1467 | 827 | 0 | 798 | 22 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
OpenSMT | 0 | 2784 | 201903.25 | 202278.99 | 2784 | 2784 | 0 | 175 | 1866 | 175 | 0 |
cvc5 | 0 | 2752 | 149143.95 | 149501.80 | 2752 | 2752 | 0 | 207 | 1866 | 207 | 0 |
Z3-alpha | 0 | 2702 (base +171) | 207881.32 | 54171.60 | 2702 | 2702 | 0 | 257 | 1866 | 252 | 5 |
Yices2 | 0 | 2653 | 51275.14 | 51611.30 | 2653 | 2653 | 0 | 306 | 1866 | 306 | 0 |
SMTInterpol | 0 | 2491 | 131371.72 | 108236.85 | 2491 | 2491 | 0 | 468 | 1866 | 461 | 0 |
Z3-alpha-base n | 0 | 2531 | 91157.88 | 91484.46 | 2531 | 2531 | 0 | 428 | 1866 | 426 | 2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
OpenSMT | 0 | 1795 | 70377.15 | 70612.48 | 1795 | 0 | 1795 | 47 | 2983 | 44 | 0 |
Yices2 | 0 | 1742 | 6662.53 | 6880.45 | 1742 | 0 | 1742 | 100 | 2983 | 100 | 0 |
SMTInterpol | 0 | 1716 | 102822.43 | 69410.12 | 1716 | 0 | 1716 | 126 | 2983 | 55 | 0 |
cvc5 | 0 | 1691 | 162734.40 | 162965.40 | 1691 | 0 | 1691 | 151 | 2983 | 151 | 0 |
Z3-alpha | 0 | 1569 (base +102) | 98573.61 | 26874.79 | 1569 | 0 | 1569 | 273 | 2983 | 272 | 1 |
Z3-alpha-base n | 0 | 1467 | 30993.89 | 31179.88 | 1467 | 0 | 1467 | 375 | 2983 | 357 | 17 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Yices2 | 0 | 4216 | 3518.54 | 4043.76 | 4216 | 2501 | 1715 | 6 | 603 | 0 | 0 |
Z3-alpha | 0 | 3837 (base +356) | 26294.17 | 9483.85 | 3837 | 2402 | 1435 | 6 | 982 | 0 | 0 |
OpenSMT | 0 | 3329 | 8996.70 | 9411.05 | 3329 | 1980 | 1349 | 9 | 1487 | 0 | 0 |
cvc5 | 0 | 3143 | 5509.61 | 5895.61 | 3143 | 2058 | 1085 | 6 | 1676 | 0 | 0 |
SMTInterpol | 0 | 2955 | 22204.94 | 10092.25 | 2955 | 1874 | 1081 | 44 | 1826 | 0 | 0 |
Z3-alpha-base n | 0 | 3481 | 8193.26 | 8623.78 | 3481 | 2224 | 1257 | 6 | 1338 | 0 | 0 |