SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFBVDTLIA (Single Query Track)

Competition results for the AUFBVDTLIA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 680
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4 0 374 386452.623 397584.938374152222306285 0
UltimateEliminator+MathSAT 0 0 2232.262 1637.0610006800 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4 0 374394698.463397568.438374152222306285 0
UltimateEliminator+MathSAT 0 02232.2621637.0610006800 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 15239242.35341807.6371521520528285 0
UltimateEliminator+MathSAT 0 0494.457362.9220006800 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 22212406.90312682.1592220222458285 0
UltimateEliminator+MathSAT 0 0724.175526.3410006800 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
CVC4 0 19311707.0411706.9861939184487487 0
UltimateEliminator+MathSAT 0 02232.2621637.0610006800 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.