SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UFLIA (Unsat Core Track)

Competition results for the UFLIA division in the Unsat Core Track.

Page generated on 2019-07-23 17:57:45 +0000

Benchmarks: 3867
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
CVC4-ucCVC4-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
2018-CVC4 (unsat core)n 0 931101 380008.892 380046.889152 0
CVC4-uc 0 929656 389545.157 389605.89155 0
Z3n 0 884418 356529.445 357397.38797 3
UltimateEliminator+Yices-2.6.1 0 0 25847.677 20967.9385 0
UltimateEliminator+SMTInterpol 0 0 30291.52 25216.9827 0
UltimateEliminator+MathSAT-5.5.4 0 0 30792.921 26094.5267 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
2018-CVC4 (unsat core)n 0 931101380051.572380040.519152 0
CVC4-uc 0 929656389600.767389598.82155 0
Z3n 0 884418356565.205357392.64797 3
UltimateEliminator+Yices-2.6.1 0 025847.67720967.9385 0
UltimateEliminator+SMTInterpol 0 030291.5225216.9827 0
UltimateEliminator+MathSAT-5.5.4 0 030792.92126094.5267 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.