SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFNIA (Single Query Track)

Competition results for the AUFNIA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 3
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
UltimateEliminator+MathSAT 0 0 10.198 7.04100030 0
CVC4 0 0 3589.91 3600.0700033 0
z3n 0 0 3599.77 3600.0700033 0
Alt-Ergo 0 0 3600.0 3600.000033 0
Vampire 0 0 3600.0 3600.000033 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
UltimateEliminator+MathSAT 0 0 10.198 7.04100030 0
Alt-Ergo 0 0 7200.2 3551.000033 0
Vampire 0 0 3600.0 3600.000033 0
CVC4 0 0 3600.0 3600.000033 0
z3n 0 0 3600.0 3600.000033 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Alt-Ergo 0 0 0.0 0.000033 0
Vampire 0 0 0.0 0.000033 0
CVC4 0 0 0.0 0.000033 0
z3n 0 0 0.0 0.000033 0
UltimateEliminator+MathSAT 0 0 0.0 0.000030 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
UltimateEliminator+MathSAT 0 0 10.198 7.04100030 0
Alt-Ergo 0 0 7200.2 3551.000033 0
Vampire 0 0 3600.0 3600.000033 0
CVC4 0 0 3600.0 3600.000033 0
z3n 0 0 3600.0 3600.000033 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
UltimateEliminator+MathSAT 0 0 10.198 7.04100030 0
Alt-Ergo 0 0 72.0 72.000033 0
Vampire 0 0 72.0 72.000033 0
CVC4 0 0 72.0 72.000033 0
z3n 0 0 72.0 72.000033 0

n Non-competing.