SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_ABVFPLRA (Single Query Track)

Competition results for the QF_ABVFPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 71
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 COLIBRI

Note: the division has disagreements

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 70 2081.345 2081.8787068211 0
COLIBRI 0 68 111.089 111.6026867130 0
MathSAT5n 0 62 1222.851 1223.7976262091 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 70 2081.555 2081.8587068211 0
COLIBRI 0 68 111.089 111.6026867130 0
MathSAT5n 0 62 1223.711 1223.7476262091 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 68 1291.416 1291.4566868031 0
COLIBRI 0 67 88.697 88.7846767040 0
MathSAT5n 0 62 1223.595 1223.6316262091 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 2 790.138 790.402202691 0
COLIBRI 0 1 22.392 22.818101700 0
MathSAT5n 0 0 0.116 0.116000711 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
COLIBRI 0 67 89.054 89.5646766141 0
CVC4 0 67 145.191 145.2166767044 0
MathSAT5n 0 62 47.711 47.7476262091 0

n Non-competing.