The International Satisfiability Modulo Theories (SMT) Competition.
Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions
Competition results for the Equality+NonLinearArith division in the Unsat Core Track.
Page generated on 2022-08-10 11:18:51 +0000
Benchmarks: 6829 Time Limit: 1200 seconds Memory Limit: 60 GB
Logics:Sequential Performance | Parallel Performance |
---|---|
cvc5 | cvc5 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|
2020-CVC4-ucn | 0 | 225070 | 993218.432 | 1003614.853 | 794 | 0 | |
cvc5 | 0 | 222083 | 1005556.81 | 1005727.649 | 772 | 0 | |
z3-4.8.17n | 0 | 197335 | 786105.814 | 787595.005 | 550 | 5 | |
Vampire | 0 | 144076 | 1741769.939 | 1307966.953 | 967 | 0 | |
UltimateEliminator+MathSAT | 0 | 1489 | 280629.729 | 263860.216 | 164 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Abstained | Timeout | Memout |
---|---|---|---|---|---|---|---|
2020-CVC4-ucn | 0 | 225070 | 1002817.072 | 1003577.863 | 794 | 0 | |
cvc5 | 0 | 222083 | 1005732.9 | 1005694.769 | 772 | 0 | |
z3-4.8.17n | 0 | 197335 | 786998.774 | 787571.335 | 550 | 5 | |
Vampire | 0 | 152612 | 2126453.399 | 1086096.546 | 636 | 0 | |
UltimateEliminator+MathSAT | 0 | 1489 | 280649.569 | 263853.036 | 163 | 0 |
n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.