The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the AUFBVDTLIA logic in the Single Query Track.
Page generated on 2021-07-18 17:29:04 +0000
Benchmarks: 842 Time Limit: 1200 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
cvc5 | cvc5 | cvc5 | cvc5 | cvc5 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
2020-CVC4n | 0 | 452 | 497338.677 | 511678.518 | 452 | 199 | 253 | 390 | 364 | 0 |
cvc5 | 0 | 375 | 295100.313 | 573444.995 | 375 | 140 | 235 | 467 | 443 | 0 |
cvc5 - fixedn | 0 | 364 | 278653.493 | 581306.045 | 364 | 133 | 231 | 478 | 453 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
2020-CVC4n | 0 | 452 | 508178.197 | 511659.998 | 452 | 199 | 253 | 390 | 364 | 0 |
cvc5 | 0 | 375 | 571465.197 | 573416.975 | 375 | 140 | 235 | 467 | 443 | 0 |
cvc5 - fixedn | 0 | 364 | 579484.863 | 581275.215 | 364 | 133 | 231 | 478 | 453 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
2020-CVC4n | 0 | 199 | 50701.954 | 53701.383 | 199 | 199 | 0 | 0 | 643 | 364 | 0 |
cvc5 | 0 | 140 | 91310.032 | 92885.555 | 140 | 140 | 0 | 59 | 643 | 443 | 0 |
cvc5 - fixedn | 0 | 133 | 97053.937 | 98441.279 | 133 | 133 | 0 | 66 | 643 | 453 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | N/A | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|---|
2020-CVC4n | 0 | 253 | 24943.89 | 25391.425 | 253 | 0 | 253 | 5 | 584 | 364 | 0 |
cvc5 | 0 | 235 | 41699.589 | 42039.635 | 235 | 0 | 235 | 23 | 584 | 443 | 0 |
cvc5 - fixedn | 0 | 231 | 45079.262 | 45435.134 | 231 | 0 | 231 | 27 | 584 | 453 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
2020-CVC4n | 0 | 203 | 15357.797 | 15358.149 | 203 | 7 | 196 | 639 | 639 | 0 |
cvc5 | 0 | 203 | 15366.146 | 15366.063 | 203 | 7 | 196 | 639 | 639 | 0 |
cvc5 - fixedn | 0 | 203 | 15366.236 | 15366.846 | 203 | 7 | 196 | 639 | 639 | 0 |
n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.