The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_NonLinearRealArith division in the Single Query Track. Chart
Results were generated on 2025-08-11
Benchmarks: 3104
Time Limit: 1200 seconds
Memory Limit: 30720 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24 seconds Performance (parallel) |
---|---|---|---|---|
Z3-alpha | Z3-alpha | Z3-alpha | Z3-alpha | Z3-alpha |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Z3-alpha | 0 | 2856 (base +9) | 67264.36 | 22562.80 | 2872 | 1452 | 1420 | 232 | 0 | 230 | 1 |
z3siri | 0 | 2803 (base -44) | 80486.25 | 80842.87 | 2803 | 1413 | 1390 | 301 | 0 | 295 | 1 |
cvc5 | 0 | 2766 | 114285.94 | 114640.93 | 2766 | 1353 | 1413 | 338 | 0 | 338 | 0 |
Yices2 | 0 | 2746 | 21997.19 | 22341.69 | 2746 | 1392 | 1354 | 358 | 0 | 357 | 1 |
SMT-RAT | 0 | 2582 | 75051.01 | 75380.36 | 2582 | 1296 | 1286 | 522 | 0 | 521 | 1 |
SMTInterpol | 0 | 551 | 4555.75 | 3400.39 | 551 | 22 | 529 | 2553 | 0 | 0 | 0 |
Z3-alpha-base n | 0 | 2847 | 50463.53 | 50822.13 | 2847 | 1433 | 1414 | 257 | 0 | 255 | 2 |
z3siri-base n | 0 | 2847 | 51826.40 | 52185.55 | 2847 | 1433 | 1414 | 257 | 0 | 255 | 2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Z3-alpha | 0 | 2872 (base +25) | 104134.69 | 33978.73 | 2872 | 1452 | 1420 | 232 | 0 | 230 | 1 |
z3siri | 0 | 2803 (base -44) | 80486.25 | 80842.87 | 2803 | 1413 | 1390 | 301 | 0 | 295 | 1 |
cvc5 | 0 | 2766 | 114285.94 | 114640.93 | 2766 | 1353 | 1413 | 338 | 0 | 338 | 0 |
Yices2 | 0 | 2746 | 21997.19 | 22341.69 | 2746 | 1392 | 1354 | 358 | 0 | 357 | 1 |
SMT-RAT | 0 | 2582 | 75051.01 | 75380.36 | 2582 | 1296 | 1286 | 522 | 0 | 521 | 1 |
SMTInterpol | 0 | 551 | 4555.75 | 3400.39 | 551 | 22 | 529 | 2553 | 0 | 0 | 0 |
Z3-alpha-base n | 0 | 2847 | 50463.53 | 50822.13 | 2847 | 1433 | 1414 | 257 | 0 | 255 | 2 |
z3siri-base n | 0 | 2847 | 51826.40 | 52185.55 | 2847 | 1433 | 1414 | 257 | 0 | 255 | 2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Z3-alpha | 0 | 1452 (base +19) | 45895.54 | 15216.23 | 1452 | 1452 | 0 | 88 | 1564 | 86 | 1 |
z3siri | 0 | 1413 (base -20) | 27290.79 | 27468.80 | 1413 | 1413 | 0 | 127 | 1564 | 126 | 0 |
Yices2 | 0 | 1392 | 13962.43 | 14137.35 | 1392 | 1392 | 0 | 148 | 1564 | 148 | 0 |
cvc5 | 0 | 1353 | 53885.77 | 54059.48 | 1353 | 1353 | 0 | 187 | 1564 | 187 | 0 |
SMT-RAT | 0 | 1296 | 34785.43 | 34950.85 | 1296 | 1296 | 0 | 244 | 1564 | 244 | 0 |
SMTInterpol | 0 | 22 | 3267.57 | 2870.90 | 22 | 22 | 0 | 1518 | 1564 | 0 | 0 |
Z3-alpha-base n | 0 | 1433 | 15586.25 | 15765.45 | 1433 | 1433 | 0 | 107 | 1564 | 106 | 1 |
z3siri-base n | 0 | 1433 | 16021.22 | 16200.71 | 1433 | 1433 | 0 | 107 | 1564 | 106 | 1 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Z3-alpha | 0 | 1420 (base +6) | 58239.15 | 18762.51 | 1420 | 0 | 1420 | 37 | 1647 | 37 | 0 |
cvc5 | 0 | 1413 | 60400.18 | 60581.46 | 1413 | 0 | 1413 | 44 | 1647 | 44 | 0 |
z3siri | 0 | 1390 (base -24) | 53195.46 | 53374.08 | 1390 | 0 | 1390 | 67 | 1647 | 64 | 0 |
Yices2 | 0 | 1354 | 8034.77 | 8204.34 | 1354 | 0 | 1354 | 103 | 1647 | 102 | 1 |
SMT-RAT | 0 | 1286 | 40265.58 | 40429.50 | 1286 | 0 | 1286 | 171 | 1647 | 171 | 0 |
SMTInterpol | 0 | 529 | 1288.17 | 529.49 | 529 | 0 | 529 | 928 | 1647 | 0 | 0 |
Z3-alpha-base n | 0 | 1414 | 34877.29 | 35056.68 | 1414 | 0 | 1414 | 43 | 1647 | 43 | 0 |
z3siri-base n | 0 | 1414 | 35805.18 | 35984.83 | 1414 | 0 | 1414 | 43 | 1647 | 43 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
Z3-alpha | 0 | 2690 (base +293) | 7786.82 | 3548.56 | 2690 | 1390 | 1300 | 0 | 414 | 0 | 0 |
Yices2 | 0 | 2633 | 1777.40 | 2104.80 | 2633 | 1339 | 1294 | 0 | 471 | 0 | 0 |
cvc5 | 0 | 2507 | 2628.03 | 2937.21 | 2507 | 1251 | 1256 | 0 | 597 | 0 | 0 |
SMT-RAT | 0 | 2299 | 3253.10 | 3537.32 | 2299 | 1195 | 1104 | 0 | 805 | 0 | 0 |
z3siri | 0 | 2256 (base -141) | 1612.73 | 1891.29 | 2256 | 1240 | 1016 | 0 | 848 | 0 | 0 |
SMTInterpol | 0 | 536 | 1373.30 | 564.25 | 536 | 7 | 529 | 2507 | 61 | 0 | 0 |
z3siri-base n | 0 | 2397 | 2729.81 | 3026.06 | 2397 | 1333 | 1064 | 0 | 707 | 0 | 0 |
Z3-alpha-base n | 0 | 2397 | 2744.32 | 3040.61 | 2397 | 1333 | 1064 | 0 | 707 | 0 | 0 |