SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_UFFP (Single Query Track)

Competition results for the QF_UFFP division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 2
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzla Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 2 0.231 0.23120200 0
Bitwuzla-fixedn 0 2 0.234 0.23420200 0
COLIBRI 0 2 0.638 0.65920200 0
CVC4 0 2 0.855 0.85420200 0
MathSAT5n 0 2 1.128 1.12920200 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 20.2310.23120200 0
Bitwuzla-fixedn 0 20.2340.23420200 0
COLIBRI 0 20.6380.65920200 0
CVC4 0 20.8550.85420200 0
MathSAT5n 0 21.1281.12920200 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
COLIBRI 0 00.00.000020 0
CVC4 0 00.00.000020 0
Bitwuzla 0 00.00.000020 0
MathSAT5n 0 00.00.000020 0
Bitwuzla-fixedn 0 00.00.000020 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 20.2310.23120200 0
Bitwuzla-fixedn 0 20.2340.23420200 0
COLIBRI 0 20.6380.65920200 0
CVC4 0 20.8550.85420200 0
MathSAT5n 0 21.1281.12920200 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Bitwuzla 0 20.2310.23120200 0
Bitwuzla-fixedn 0 20.2340.23420200 0
COLIBRI 0 20.6380.65920200 0
CVC4 0 20.8550.85420200 0
MathSAT5n 0 21.1281.12920200 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.