SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

BVFPLRA (Single Query Track)

Competition results for the BVFPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 185
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 92 67226.461 67238.56928759356 0
UltimateEliminator+MathSAT 0 0 618.657 415.8960001850 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 92 67236.231 67236.2928759356 0
UltimateEliminator+MathSAT 0 0 618.657 415.8960001850 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 87 6018.514 6018.494878709856 0
UltimateEliminator+MathSAT 0 0 315.227 208.5180001850 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 5 9.094 9.09350518056 0
UltimateEliminator+MathSAT 0 0 16.238 11.0680001850 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 92 1380.231 1380.2928759356 0
UltimateEliminator+MathSAT 0 0 618.657 415.8960001850 0

n Non-competing.