SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFLIRA (Unsat Core Track)

Competition results for the AUFLIRA division in the Unsat Core Track.

Page generated on 2019-07-23 17:57:45 +0000

Benchmarks: 9885
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
CVC4-ucCVC4-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
2018-CVC4 (unsat core)n 0 179280 193056.757 193080.77980 0
CVC4-uc 0 179276 191712.601 191737.58779 0
Z3n 0 178986 25633.985 25636.4823 5
UltimateEliminator+Yices-2.6.1 0 0 117755.761 105108.1534 0
UltimateEliminator+MathSAT-5.5.4 0 0 118470.059 106302.91134 0
UltimateEliminator+SMTInterpol 0 0 118561.663 104430.01834 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
2018-CVC4 (unsat core)n 0 179280193078.357193077.46980 0
CVC4-uc 0 179276191735.211191733.72779 0
Z3n 0 17898625635.78525636.2723 5
UltimateEliminator+SMTInterpol 0 0118561.663104430.01834 0
UltimateEliminator+Yices-2.6.1 0 0117755.761105108.1534 0
UltimateEliminator+MathSAT-5.5.4 0 0118470.059106302.91134 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.