The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_LinearIntArith division in the Cloud Track.
Page generated on 2021-07-18 17:32:03 +0000
Benchmarks: 31 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Par4n | 0 | 11 | 30274.421 | 11 | 5 | 6 | 20 | 0 | 20 | 0 |
SMTS cube-and-conquer | 0 | 10 | 27656.046 | 10 | 10 | 0 | 21 | 0 | 21 | 0 |
SMTS portfolio | 0 | 9 | 27947.422 | 9 | 9 | 0 | 22 | 0 | 22 | 0 |
cvc5-gg | 0 | 0 | 32400.0 | 0 | 0 | 0 | 31 | 0 | 27 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTS cube-and-conquer | 0 | 10 | 8456.046 | 10 | 10 | 0 | 5 | 16 | 21 | 0 |
SMTS portfolio | 0 | 9 | 8747.422 | 9 | 9 | 0 | 6 | 16 | 22 | 0 |
Par4n | 0 | 5 | 14410.91 | 5 | 5 | 0 | 10 | 16 | 20 | 0 |
cvc5-gg | 0 | 0 | 18000.0 | 0 | 0 | 0 | 15 | 16 | 27 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
Par4n | 0 | 6 | 9863.511 | 6 | 0 | 6 | 5 | 20 | 20 | 0 |
cvc5-gg | 0 | 0 | 8400.0 | 0 | 0 | 0 | 11 | 20 | 27 | 0 |
SMTS cube-and-conquer | 0 | 0 | 13200.0 | 0 | 0 | 0 | 11 | 20 | 21 | 0 |
SMTS portfolio | 0 | 0 | 13200.0 | 0 | 0 | 0 | 11 | 20 | 22 | 0 |
Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
SMTS cube-and-conquer | 0 | 2 | 727.457 | 2 | 2 | 0 | 29 | 0 | 29 | 0 |
SMTS portfolio | 0 | 1 | 728.54 | 1 | 1 | 0 | 30 | 0 | 30 | 0 |
cvc5-gg | 0 | 0 | 648.0 | 0 | 0 | 0 | 31 | 0 | 27 | 0 |
Par4n | 0 | 0 | 744.0 | 0 | 0 | 0 | 31 | 0 | 31 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.