The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the UFIDL logic in the Single Query Track.
Page generated on 2023-07-06 16:04:54 +0000
Benchmarks: 20 Time Limit: 1200 seconds Memory Limit: 60 GB
| Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
|---|---|---|---|---|
| cvc5 | cvc5 | SMTInterpol | cvc5 | cvc5 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 | 0 | 10 | 517.399 | 564.701 | 10 | 1 | 9 | 10 | 8 | 0 |
| 2022-cvc5n | 0 | 10 | 518.666 | 572.922 | 10 | 1 | 9 | 10 | 8 | 0 |
| SMTInterpol | 0 | 8 | 257.355 | 142.634 | 8 | 1 | 7 | 12 | 7 | 0 |
| Vampire | 0 | 7 | 1.232 | 1.297 | 7 | 0 | 7 | 13 | 13 | 0 |
| iProver | 0 | 7 | 132.407 | 36.641 | 7 | 0 | 7 | 13 | 11 | 0 |
| iProver Fixedn | 0 | 7 | 185.229 | 50.146 | 7 | 0 | 7 | 13 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 20 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 | 0 | 10 | 517.399 | 564.701 | 10 | 1 | 9 | 10 | 8 | 0 |
| 2022-cvc5n | 0 | 10 | 518.666 | 572.922 | 10 | 1 | 9 | 10 | 8 | 0 |
| SMTInterpol | 0 | 8 | 257.355 | 142.634 | 8 | 1 | 7 | 12 | 7 | 0 |
| Vampire | 0 | 7 | 1.232 | 1.297 | 7 | 0 | 7 | 13 | 13 | 0 |
| iProver | 0 | 7 | 132.407 | 36.641 | 7 | 0 | 7 | 13 | 11 | 0 |
| iProver Fixedn | 0 | 7 | 185.229 | 50.146 | 7 | 0 | 7 | 13 | 11 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 20 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SMTInterpol | 0 | 1 | 0.924 | 4.798 | 1 | 1 | 0 | 2 | 17 | 7 | 0 |
| cvc5 | 0 | 1 | 515.944 | 563.25 | 1 | 1 | 0 | 2 | 17 | 8 | 0 |
| 2022-cvc5n | 0 | 1 | 517.204 | 571.463 | 1 | 1 | 0 | 2 | 17 | 8 | 0 |
| Vampire | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 3 | 17 | 13 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 3 | 17 | 0 | 0 |
| iProver | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 3 | 17 | 11 | 0 |
| iProver Fixedn | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 3 | 17 | 11 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 | 0 | 9 | 1.455 | 1.451 | 9 | 0 | 9 | 0 | 11 | 8 | 0 |
| 2022-cvc5n | 0 | 9 | 1.462 | 1.459 | 9 | 0 | 9 | 0 | 11 | 8 | 0 |
| Vampire | 0 | 7 | 1.232 | 1.297 | 7 | 0 | 7 | 2 | 11 | 13 | 0 |
| iProver | 0 | 7 | 132.407 | 36.641 | 7 | 0 | 7 | 2 | 11 | 11 | 0 |
| iProver Fixedn | 0 | 7 | 185.229 | 50.146 | 7 | 0 | 7 | 2 | 11 | 11 | 0 |
| SMTInterpol | 0 | 7 | 256.431 | 137.836 | 7 | 0 | 7 | 2 | 11 | 7 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 9 | 11 | 0 | 0 |
| Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| cvc5 | 0 | 9 | 1.455 | 1.451 | 9 | 0 | 9 | 11 | 9 | 0 |
| 2022-cvc5n | 0 | 9 | 1.462 | 1.459 | 9 | 0 | 9 | 11 | 9 | 0 |
| Vampire | 0 | 7 | 1.232 | 1.297 | 7 | 0 | 7 | 13 | 13 | 0 |
| iProver | 0 | 7 | 132.407 | 36.641 | 7 | 0 | 7 | 13 | 11 | 0 |
| iProver Fixedn | 0 | 7 | 185.229 | 50.146 | 7 | 0 | 7 | 13 | 11 | 0 |
| SMTInterpol | 0 | 7 | 189.847 | 102.494 | 7 | 1 | 6 | 13 | 8 | 0 |
| UltimateEliminator+MathSAT | 0 | 0 | 0.0 | 0.0 | 0 | 0 | 0 | 20 | 0 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.