The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_IDL logic in the Cloud Track.
Page generated on 2021-07-18 17:32:03 +0000
Benchmarks: 16 Time Limit: 1200 seconds Memory Limit: N/A GB
This track is experimental. Solvers are only ranked by performance, but no winner is selected.
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|
| Par4n | 0 | 6 | 16059.905 | 6 | 3 | 3 | 10 | 10 | 0 |
| SMTS cube-and-conquer | 0 | 1 | 18461.592 | 1 | 1 | 0 | 15 | 15 | 0 |
| cvc5-gg | 0 | 0 | 19200.0 | 0 | 0 | 0 | 16 | 16 | 0 |
| SMTS portfolio | 0 | 0 | 19200.0 | 0 | 0 | 0 | 16 | 16 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Par4n | 0 | 3 | 5455.387 | 3 | 3 | 0 | 3 | 10 | 10 | 0 |
| SMTS cube-and-conquer | 0 | 1 | 6461.592 | 1 | 1 | 0 | 5 | 10 | 15 | 0 |
| cvc5-gg | 0 | 0 | 7200.0 | 0 | 0 | 0 | 6 | 10 | 16 | 0 |
| SMTS portfolio | 0 | 0 | 7200.0 | 0 | 0 | 0 | 6 | 10 | 16 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| Par4n | 0 | 3 | 4604.518 | 3 | 0 | 3 | 2 | 11 | 10 | 0 |
| SMTS cube-and-conquer | 0 | 0 | 6000.0 | 0 | 0 | 0 | 5 | 11 | 15 | 0 |
| cvc5-gg | 0 | 0 | 6000.0 | 0 | 0 | 0 | 5 | 11 | 16 | 0 |
| SMTS portfolio | 0 | 0 | 6000.0 | 0 | 0 | 0 | 5 | 11 | 16 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|
| SMTS cube-and-conquer | 0 | 0 | 384.0 | 0 | 0 | 0 | 16 | 16 | 0 |
| cvc5-gg | 0 | 0 | 384.0 | 0 | 0 | 0 | 16 | 16 | 0 |
| Par4n | 0 | 0 | 384.0 | 0 | 0 | 0 | 16 | 16 | 0 |
| SMTS portfolio | 0 | 0 | 384.0 | 0 | 0 | 0 | 16 | 16 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.