SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UFDTLIA (Single Query Track)

Competition results for the UFDTLIA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 277
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4 CVC4 Vampire

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-CVC4n 0 196 199077.794 205137.56919601968181 0
CVC4 0 195 150008.078 152487.47219501958282 0
Vampire 0 126 187106.552 183702.4591260126151151 0
Alt-Ergo 0 33 293692.395 293026.69533033244244 0
UltimateEliminator+MathSAT 0 0 906.745 641.3570002770 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-CVC4n 0 196 203161.694 205130.97919601968181 0
CVC4 0 195 151304.678 152483.71219501958282 0
Vampire 0 127 187798.802 182993.4151270127150150 0
Alt-Ergo 0 36 309733.045 290551.20836036241241 0
UltimateEliminator+MathSAT 0 0 906.745 641.3570002770 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-CVC4n 0 0 0.0 0.000027781 0
Alt-Ergo 0 0 0.0 0.0000277241 0
Vampire 0 0 0.0 0.0000277150 0
CVC4 0 0 0.0 0.000027782 0
UltimateEliminator+MathSAT 0 0 0.0 0.00002770 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-CVC4n 0 196 113161.694 115130.97919601968181 0
CVC4 0 195 61304.678 62483.71219501958282 0
Vampire 0 127 97798.802 92993.4151270127150150 0
Alt-Ergo 0 36 219733.045 200551.20836036241241 0
UltimateEliminator+MathSAT 0 0 658.145 469.7650002770 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Vampire 0 113 6900.739 5551.7591130113164164 0
Alt-Ergo 0 30 6037.095 5956.84430030247247 0
CVC4 0 28 6036.972 6036.97528028249249 0
2019-CVC4n 0 27 6050.903 6050.89727027250250 0
UltimateEliminator+MathSAT 0 0 906.745 641.3570002770 0

n Non-competing.