SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UFDTLIA (Single Query Track)

Competition results for the UFDTLIA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 277
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4 CVC4 Vampire

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
2019-CVC4n 0 196 199077.794 205137.56919601968181 0
CVC4 0 195 150008.078 152487.47219501958282 0
Vampire 0 126 187106.552 183702.4591260126151151 0
Alt-Ergo 0 33 293692.395 293026.69533033244244 0
UltimateEliminator+MathSAT 0 0 906.745 641.3570002770 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
2019-CVC4n 0 196203161.694205130.97919601968181 0
CVC4 0 195151304.678152483.71219501958282 0
Vampire 0 127187798.802182993.4151270127150150 0
Alt-Ergo 0 36309733.045290551.20836036241241 0
UltimateEliminator+MathSAT 0 0906.745641.3570002770 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-CVC4n 0 00.00.000027781 0
Alt-Ergo 0 00.00.0000277241 0
Vampire 0 00.00.0000277150 0
CVC4 0 00.00.000027782 0
UltimateEliminator+MathSAT 0 00.00.00002770 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-CVC4n 0 196113161.694115130.97919601968181 0
CVC4 0 19561304.67862483.71219501958282 0
Vampire 0 12797798.80292993.4151270127150150 0
Alt-Ergo 0 36219733.045200551.20836036241241 0
UltimateEliminator+MathSAT 0 0658.145469.7650002770 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 1136900.7395551.7591130113164164 0
Alt-Ergo 0 306037.0955956.84430030247247 0
CVC4 0 286036.9726036.97528028249249 0
2019-CVC4n 0 276050.9036050.89727027250250 0
UltimateEliminator+MathSAT 0 0906.745641.3570002770 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.