SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_FPLRA (Single Query Track)

Competition results for the QF_FPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 57
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
COLIBRICOLIBRICOLIBRI COLIBRI COLIBRI

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
COLIBRI 0 54 3677.786 3678.2735448633 0
MathSAT5n 0 48 11274.078 11276.1814845399 0
z3n 0 47 16959.87 16963.34474431010 0
CVC4 0 46 13315.869 13317.881464241111 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
COLIBRI 0 543678.1563678.2435448633 0
MathSAT5n 0 4811275.64811275.7014845399 0
z3n 0 4716962.1416962.85474431010 0
CVC4 0 4613317.37913317.381464241111 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
COLIBRI 0 483655.7883655.8434848093 0
MathSAT5n 0 457674.4697674.52245450129 0
z3n 0 4413362.01213362.722444401310 0
CVC4 0 4210851.91610851.917424201511 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
COLIBRI 0 622.36822.4606513 0
CVC4 0 42465.4632465.4644045311 0
z3n 0 33600.1283600.1283035410 0
MathSAT5n 0 33601.1793601.179303549 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
COLIBRI 0 54150.156150.2435448633 0
CVC4 0 44330.92330.918444131313 0
MathSAT5n 0 44332.033332.038444131313 0
z3n 0 191072.9161072.924191633838 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.