SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UF (Unsat Core Track)

Competition results for the UF division in the Unsat Core Track.

Page generated on 2019-07-23 17:57:45 +0000

Benchmarks: 1705
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
CVC4-ucCVC4-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
2018-CVC4 (unsat core)n 0 476991 369252.238 369294.265148 0
CVC4-uc 0 476907 371177.546 371220.642149 0
Z3n 0 407258 489761.404 489869.644129 15
UltimateEliminator+SMTInterpol 0 0 5910.242 3673.7810 0
UltimateEliminator+Yices-2.6.1 0 0 6071.522 4084.5530 0
UltimateEliminator+MathSAT-5.5.4 0 0 6075.107 4054.5410 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
2018-CVC4 (unsat core)n 0 476991369287.168369288.605148 0
CVC4-uc 0 476907371216.626371214.902149 0
Z3n 0 407258489822.624489864.084129 15
UltimateEliminator+SMTInterpol 0 05910.2423673.7810 0
UltimateEliminator+MathSAT-5.5.4 0 06075.1074054.5410 0
UltimateEliminator+Yices-2.6.1 0 06071.5224084.5530 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.