SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UFDTNIRA (Single Query Track)

Competition results for the UFDTNIRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 736
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4Vampire Vampire CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4 0 659 20491.701 20496.18365906597717 0
Alt-Ergo 0 655 83181.955 80275.43365506558166 0
Vampire 0 634 234147.216 155074.0816340634102102 0
UltimateEliminator+MathSAT 0 0 2431.864 1686.0780007360 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 673272515.256130248.70667306736363 0
CVC4 0 65920495.32120495.17365906597717 0
Alt-Ergo 0 65988984.89578151.13965906597762 0
UltimateEliminator+MathSAT 0 02431.8641686.0780007360 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Alt-Ergo 0 00.00.000073662 0
Vampire 0 00.00.000073663 0
CVC4 0 00.00.000073617 0
UltimateEliminator+MathSAT 0 00.00.00007360 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Vampire 0 673248515.256106248.70667306736363 0
CVC4 0 65916894.12816893.97865906597717 0
Alt-Ergo 0 65975782.56264950.31265906597762 0
UltimateEliminator+MathSAT 0 02367.3151641.7920007360 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4 0 659503.321503.17365906597717 0
Alt-Ergo 0 6492457.9551982.6264906498772 0
Vampire 0 29912033.84111295.4282990299437437 0
UltimateEliminator+MathSAT 0 02452.5871684.9680007361 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.