The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the UFBVLIA logic in the Single Query Track.
Page generated on 2022-08-10 11:17:45 +0000
Benchmarks: 208 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| cvc5 | cvc5 | — | cvc5 | — |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| z3-4.8.17n | 0 | 4 | 245403.656 | 245453.292 | 4 | 0 | 4 | 204 | 204 | 0 |
| 2021-cvc5n | 0 | 2 | 83910.566 | 247223.209 | 2 | 0 | 2 | 206 | 206 | 0 |
| cvc5 | 0 | 2 | 241454.726 | 248010.848 | 2 | 0 | 2 | 206 | 206 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 157071.11 | 154309.426 | 0 | 0 | 0 | 208 | 118 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| z3-4.8.17n | 0 | 4 | 245443.556 | 245443.672 | 4 | 0 | 4 | 204 | 204 | 0 |
| 2021-cvc5n | 0 | 2 | 247211.809 | 247211.809 | 2 | 0 | 2 | 206 | 206 | 0 |
| cvc5 | 0 | 2 | 247969.636 | 248000.018 | 2 | 0 | 2 | 206 | 206 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 157071.11 | 154309.426 | 0 | 0 | 0 | 208 | 118 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| UltimateEliminator+MathSAT | 0 | 0 | 1677.771 | 1183.477 | 0 | 0 | 0 | 20 | 188 | 118 | 0 |
| 2021-cvc5n | 0 | 0 | 24000.0 | 24000.0 | 0 | 0 | 0 | 20 | 188 | 206 | 0 |
| cvc5 | 0 | 0 | 24000.0 | 24000.0 | 0 | 0 | 0 | 20 | 188 | 206 | 0 |
| z3-4.8.17n | 0 | 0 | 24000.0 | 24000.0 | 0 | 0 | 0 | 20 | 188 | 204 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| z3-4.8.17n | 0 | 4 | 5443.556 | 5443.672 | 4 | 0 | 4 | 4 | 200 | 204 | 0 |
| 2021-cvc5n | 0 | 2 | 7211.809 | 7211.809 | 2 | 0 | 2 | 6 | 200 | 206 | 0 |
| cvc5 | 0 | 2 | 7969.636 | 8000.018 | 2 | 0 | 2 | 6 | 200 | 206 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 1393.576 | 1200.753 | 0 | 0 | 0 | 8 | 200 | 118 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| 2021-cvc5n | 0 | 2 | 4955.809 | 4955.809 | 2 | 0 | 2 | 206 | 206 | 0 |
| z3-4.8.17n | 0 | 2 | 4967.552 | 4967.552 | 2 | 0 | 2 | 206 | 206 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 5011.98 | 4991.131 | 0 | 0 | 0 | 208 | 207 | 0 |
| cvc5 | 0 | 0 | 4992.0 | 4992.0 | 0 | 0 | 0 | 208 | 208 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.