The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_LIA logic in the Cloud Track.
Page generated on 2022-08-10 14:49:53 +0000
Benchmarks: 26 Time Limit: 1200 seconds Memory Limit: N/A GB
This track is experimental. Solvers are only ranked by performance, but no winner is selected.
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|
SMTS cube-and-conquer (fixed) | 10 | 16 | 7936.263 | 16 | 12 | 4 | 10 | 0 | 0 |
SMTS portfolio | 12 | 14 | 10501.667 | 14 | 14 | 0 | 12 | 0 | 0 |
SMTS cube-and-conquer | 15 | 9 | 14816.597 | 9 | 9 | 0 | 17 | 0 | 0 |
cvc5-cloud | 17 | 1 | 26489.009 | 1 | 1 | 0 | 25 | 0 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTS cube-and-conquer (fixed) | 5 | 12 | 5092.439 | 12 | 12 | 0 | 8 | 6 | 0 | 0 |
SMTS portfolio | 6 | 14 | 5986.551 | 14 | 14 | 0 | 6 | 6 | 0 | 0 |
SMTS cube-and-conquer | 9 | 9 | 11100.215 | 9 | 9 | 0 | 11 | 6 | 0 | 0 |
cvc5-cloud | 11 | 1 | 22876.231 | 1 | 1 | 0 | 19 | 6 | 0 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTS cube-and-conquer (fixed) | 5 | 4 | 2843.824 | 4 | 0 | 4 | 2 | 20 | 0 | 0 |
cvc5-cloud | 6 | 0 | 3612.778 | 0 | 0 | 0 | 6 | 20 | 0 | 0 |
SMTS cube-and-conquer | 6 | 0 | 3716.382 | 0 | 0 | 0 | 6 | 20 | 0 | 0 |
SMTS portfolio | 6 | 0 | 4515.116 | 0 | 0 | 0 | 6 | 20 | 0 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|
SMTS portfolio | 0 | 11 | 480.161 | 11 | 11 | 0 | 15 | 15 | 0 |
SMTS cube-and-conquer (fixed) | 1 | 8 | 517.007 | 8 | 8 | 0 | 18 | 17 | 0 |
SMTS cube-and-conquer | 1 | 5 | 530.982 | 5 | 5 | 0 | 21 | 20 | 0 |
cvc5-cloud | 3 | 0 | 564.778 | 0 | 0 | 0 | 26 | 23 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.