The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_UFNIA logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 298 Time Limit: 1200 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 242 | 5476.532 | 5477.652 | 242 | 173 | 69 | 56 | 56 | 0 |
2020-CVC4n | 0 | 241 | 5216.389 | 5217.191 | 241 | 172 | 69 | 57 | 36 | 0 |
Yices2 | 0 | 217 | 1911.502 | 1911.949 | 217 | 169 | 48 | 81 | 81 | 0 |
SMTInterpol | 0 | 65 | 1036.113 | 520.065 | 65 | 50 | 15 | 233 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 242 | 5476.532 | 5477.652 | 242 | 173 | 69 | 56 | 56 | 0 |
2020-CVC4n | 0 | 241 | 5216.389 | 5217.191 | 241 | 172 | 69 | 57 | 36 | 0 |
Yices2 | 0 | 217 | 1911.502 | 1911.949 | 217 | 169 | 48 | 81 | 81 | 0 |
SMTInterpol | 0 | 65 | 1036.113 | 520.065 | 65 | 50 | 15 | 233 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 173 | 5306.737 | 5307.731 | 173 | 173 | 0 | 14 | 111 | 56 | 0 |
2020-CVC4n | 0 | 172 | 3991.483 | 3992.143 | 172 | 172 | 0 | 15 | 111 | 36 | 0 |
Yices2 | 0 | 169 | 1906.191 | 1906.577 | 169 | 169 | 0 | 18 | 111 | 81 | 0 |
SMTInterpol | 0 | 50 | 995.163 | 503.921 | 50 | 50 | 0 | 137 | 111 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 69 | 169.795 | 169.921 | 69 | 0 | 69 | 11 | 218 | 56 | 0 |
2020-CVC4n | 0 | 69 | 1224.906 | 1225.049 | 69 | 0 | 69 | 11 | 218 | 36 | 0 |
Yices2 | 0 | 48 | 5.311 | 5.372 | 48 | 0 | 48 | 32 | 218 | 81 | 0 |
SMTInterpol | 0 | 15 | 40.951 | 16.145 | 15 | 0 | 15 | 65 | 218 | 0 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
cvc5 | 0 | 223 | 209.416 | 209.434 | 223 | 156 | 67 | 75 | 75 | 0 |
2020-CVC4n | 0 | 217 | 210.88 | 210.836 | 217 | 152 | 65 | 81 | 63 | 0 |
Yices2 | 0 | 209 | 79.854 | 79.965 | 209 | 161 | 48 | 89 | 89 | 0 |
SMTInterpol | 0 | 55 | 305.679 | 120.039 | 55 | 40 | 15 | 243 | 11 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.