The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the QF_LinearRealArith division in the Cloud Track.
Page generated on 2022-08-10 14:49:53 +0000
Benchmarks: 21 Time Limit: 1200 seconds Memory Limit: N/A GB
Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| SMTS portfolio | 3 | 16 | 6814.759 | 16 | 5 | 11 | 7 | -2 | 0 | 0 |
| SMTS cube-and-conquer | 5 | 14 | 8749.578 | 14 | 3 | 11 | 9 | -2 | 0 | 0 |
| SMTS cube-and-conquer (fixed) | 6 | 14 | 5681.526 | 14 | 2 | 12 | 9 | -2 | 0 | 0 |
| cvc5-cloud | 12 | 4 | 23704.175 | 4 | 2 | 2 | 19 | -2 | 0 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| SMTS portfolio | 1 | 5 | 1776.015 | 5 | 5 | 0 | 1 | 15 | 0 | 0 |
| SMTS cube-and-conquer (fixed) | 2 | 2 | 2338.112 | 2 | 2 | 0 | 4 | 15 | 0 | 0 |
| SMTS cube-and-conquer | 3 | 3 | 3578.498 | 3 | 3 | 0 | 3 | 15 | 0 | 0 |
| cvc5-cloud | 4 | 2 | 5615.68 | 2 | 2 | 0 | 4 | 15 | 0 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| SMTS portfolio | 2 | 11 | 4002.533 | 11 | 0 | 11 | 3 | 7 | 0 | 0 |
| SMTS cube-and-conquer | 2 | 11 | 4139.069 | 11 | 0 | 11 | 3 | 7 | 0 | 0 |
| SMTS cube-and-conquer (fixed) | 4 | 12 | 2862.425 | 12 | 0 | 12 | 2 | 7 | 0 | 0 |
| cvc5-cloud | 8 | 2 | 14488.495 | 2 | 0 | 2 | 12 | 7 | 0 | 0 |
| Solver | Error Score | Correct Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Abstained | Timeout | Memout |
|---|---|---|---|---|---|---|---|---|---|---|
| SMTS portfolio | 0 | 7 | 457.816 | 7 | 2 | 5 | 16 | -2 | 14 | 0 |
| SMTS cube-and-conquer | 0 | 7 | 482.905 | 7 | 1 | 6 | 16 | -2 | 14 | 0 |
| cvc5-cloud | 0 | 1 | 530.566 | 1 | 0 | 1 | 22 | -2 | 22 | 0 |
| SMTS cube-and-conquer (fixed) | 2 | 6 | 483.285 | 6 | 1 | 5 | 17 | -2 | 14 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.