The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_ANIA logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 123 Time Limit: 1200 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
SMTInterpol | SMTInterpol | SMTInterpol | SMTInterpol | SMTInterpol |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTInterpol | 0 | 104 | 1507.673 | 1063.776 | 104 | 89 | 15 | 19 | 10 | 0 |
Yices2 | 0 | 97 | 5512.268 | 5512.774 | 97 | 86 | 11 | 26 | 26 | 0 |
2020-CVC4n | 0 | 91 | 3076.132 | 3076.467 | 91 | 78 | 13 | 32 | 32 | 0 |
cvc5 | 0 | 87 | 2944.518 | 2925.235 | 87 | 74 | 13 | 36 | 36 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTInterpol | 0 | 104 | 1507.673 | 1063.776 | 104 | 89 | 15 | 19 | 10 | 0 |
Yices2 | 0 | 97 | 5512.268 | 5512.774 | 97 | 86 | 11 | 26 | 26 | 0 |
2020-CVC4n | 0 | 91 | 3076.132 | 3076.467 | 91 | 78 | 13 | 32 | 32 | 0 |
cvc5 | 0 | 87 | 2944.518 | 2925.235 | 87 | 74 | 13 | 36 | 36 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
SMTInterpol | 0 | 89 | 551.486 | 335.534 | 89 | 89 | 0 | 3 | 31 | 10 | 0 |
Yices2 | 0 | 86 | 5432.511 | 5433.013 | 86 | 86 | 0 | 6 | 31 | 26 | 0 |
2020-CVC4n | 0 | 78 | 1665.829 | 1665.935 | 78 | 78 | 0 | 14 | 31 | 32 | 0 |
cvc5 | 0 | 74 | 1426.702 | 1415.926 | 74 | 74 | 0 | 18 | 31 | 36 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
SMTInterpol | 0 | 15 | 956.187 | 728.242 | 15 | 0 | 15 | 13 | 95 | 10 | 0 |
2020-CVC4n | 0 | 13 | 1410.303 | 1410.532 | 13 | 0 | 13 | 15 | 95 | 32 | 0 |
cvc5 | 0 | 13 | 1517.816 | 1509.309 | 13 | 0 | 13 | 15 | 95 | 36 | 0 |
Yices2 | 0 | 11 | 79.756 | 79.761 | 11 | 0 | 11 | 17 | 95 | 26 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTInterpol | 0 | 97 | 417.232 | 188.345 | 97 | 87 | 10 | 26 | 17 | 0 |
2020-CVC4n | 0 | 76 | 164.218 | 164.229 | 76 | 70 | 6 | 47 | 47 | 0 |
cvc5 | 0 | 73 | 426.501 | 406.78 | 73 | 65 | 8 | 50 | 50 | 0 |
Yices2 | 0 | 61 | 213.389 | 213.418 | 61 | 52 | 9 | 62 | 62 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.