SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFDTNIRA (Single Query Track)

Competition results for the AUFDTNIRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
VampireVampire Vampire CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Vampire 0 222 163817.205 113572.86122202227878 0
Alt-Ergo 0 214 109708.231 103959.06521402148665 20
CVC4 0 208 44414.612 44428.81920802089237 0
UltimateEliminator+MathSAT 0 0 974.831 683.3480003000 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Vampire 0 296 246878.515 69879.049296029644 0
Alt-Ergo 0 218 112610.161 101102.78321802188261 20
CVC4 0 208 44427.342 44427.26920802089237 0
UltimateEliminator+MathSAT 0 0 974.831 683.3480003000 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Alt-Ergo 0 0 0.0 0.000030061 20
Vampire 0 0 0.0 0.00003004 0
CVC4 0 0 0.0 0.000030037 0
UltimateEliminator+MathSAT 0 0 0.0 0.00003000 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Vampire 0 296 246878.515 69879.049296029644 0
Alt-Ergo 0 218 112610.161 101102.78321802188261 20
CVC4 0 208 44427.342 44427.26920802089237 0
UltimateEliminator+MathSAT 0 0 974.831 683.3480003000 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 208 915.342 915.26920802089237 0
Alt-Ergo 0 202 2667.319 2427.62220202029877 20
Vampire 0 113 5104.921 4774.3111130113187187 0
UltimateEliminator+MathSAT 0 0 974.831 683.3480003000 0

n Non-competing.