SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFNIRA (Unsat Core Track)

Competition results for the AUFNIRA division in the Unsat Core Track.

Page generated on 2019-07-23 17:57:45 +0000

Benchmarks: 526
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
CVC4-ucCVC4-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
CVC4-uc 0 15997 34623.708 34631.0514 0
2018-CVC4 (unsat core)n 0 15984 36601.895 36605.6515 0
Z3n 0 15600 15071.816 16006.032 0
UltimateEliminator+Yices-2.6.1 0 0 1699.677 1190.4920 0
UltimateEliminator+MathSAT-5.5.4 0 0 1833.51 1797.8210 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
CVC4-uc 0 1599734630.40834630.4514 0
2018-CVC4 (unsat core)n 0 1598436605.01536605.0115 0
Z3n 0 1560015072.12616005.962 0
UltimateEliminator+Yices-2.6.1 0 01699.6771190.4920 0
UltimateEliminator+MathSAT-5.5.4 0 01833.511797.8210 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.