SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_RDL (Model Validation Track)

Competition results for the QF_RDL division in the Model Validation Track.

Page generated on 2020-07-04 11:50:14 +0000

Benchmarks: 109
Time Limit: 1200 seconds
Memory Limit: 60 GB

This division is experimental. Solvers are only ranked by performance, but no winner is selected.

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
Yices2-fixed Model Validationn 0 109 495.298 495.4020 0
Yices2 Model Validation 0 109 495.323 495.4040 0
CVC4-mv 0 106 6980.83 6981.7133 0
MathSAT5-mvn 0 106 7744.608 7745.9223 0
z3n 0 103 9489.126 9485.6416 0
SMTInterpol 0 101 15635.556 14813.8078 0
SMTInterpol-fixedn 0 101 15653.703 14841.7918 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
Yices2-fixed Model Validationn 0 109495.298495.4020 0
Yices2 Model Validation 0 109495.323495.4040 0
CVC4-mv 0 1066981.046981.5533 0
MathSAT5-mvn 0 1067744.8387745.8423 0
z3n 0 1039489.4569485.4016 0
SMTInterpol 0 10115635.55614813.8078 0
SMTInterpol-fixedn 0 10115653.70314841.7918 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.