SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFNIA (Single Query Track)

Competition results for the AUFNIA division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 3
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4-SymBreakn 0 0 0.031 0.0300030 0
UltimateEliminator+Yices-2.6.1 0 0 9.512 6.8300030 0
UltimateEliminator+MathSAT-5.5.4 0 0 9.892 6.88500030 0
CVC4 0 0 7133.26 7200.1400033 0
Z3n 0 0 7199.52 7200.1100033 0
Alt-Ergo 0 0 7200.0 7200.000033 0
Vampire 0 0 7200.0 7200.000033 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4-SymBreakn 0 00.0310.0300030 0
UltimateEliminator+Yices-2.6.1 0 09.5126.8300030 0
UltimateEliminator+MathSAT-5.5.4 0 09.8926.88500030 0
Alt-Ergo 0 07200.07200.000033 0
CVC4 0 07200.07200.000033 0
Vampire 0 07200.07200.000033 0
Z3n 0 07200.07200.000033 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Alt-Ergo 0 00.00.000033 0
CVC4 0 00.00.000033 0
CVC4-SymBreakn 0 00.00.000030 0
UltimateEliminator+MathSAT-5.5.4 0 00.00.000030 0
UltimateEliminator+Yices-2.6.1 0 00.00.000030 0
Vampire 0 00.00.000033 0
Z3n 0 00.00.000033 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4-SymBreakn 0 00.0310.0300030 0
UltimateEliminator+Yices-2.6.1 0 09.5126.8300030 0
UltimateEliminator+MathSAT-5.5.4 0 09.8926.88500030 0
Alt-Ergo 0 07200.07200.000033 0
CVC4 0 07200.07200.000033 0
Vampire 0 07200.07200.000033 0
Z3n 0 07200.07200.000033 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4-SymBreakn 0 00.0310.0300030 0
UltimateEliminator+Yices-2.6.1 0 09.5126.8300030 0
UltimateEliminator+MathSAT-5.5.4 0 09.8926.88500030 0
Alt-Ergo 0 072.072.000033 0
CVC4 0 072.072.000033 0
Vampire 0 072.072.000033 0
Z3n 0 072.072.000033 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.