SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_BVFPLRA (Single Query Track)

Competition results for the QF_BVFPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 168
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 COLIBRI CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT5n 0 157 17910.12 17913.441157116411111 0
CVC4 0 153 23735.41 23738.077153113401515 0
COLIBRI 0 138 22978.842 22980.90513895433019 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT5n 0 157 17912.24 17913.001157116411111 0
CVC4 0 153 23736.93 23737.577153113401515 0
COLIBRI 0 138 22980.132 22980.48513895433019 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT5n 0 116 1642.889 1643.07511611605211 0
CVC4 0 113 5036.349 5036.54211311305515 0
COLIBRI 0 95 14494.86 14495.088959507319 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
COLIBRI 0 43 8485.272 8485.3964304312519 0
MathSAT5n 0 41 16269.351 16269.9254104112711 0
CVC4 0 40 18700.58 18701.0354004012815 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 142 724.302 724.31142108342626 0
MathSAT5n 0 142 774.081 774.131142108342626 0
COLIBRI 0 137 635.445 635.79113795423120 0

n Non-competing.