SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

QF_LRA (Model Validation Track)

Competition results for the QF_LRA logic in the Model Validation Track.

Page generated on 2021-07-18 17:31:50 +0000

Benchmarks: 473
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
OpenSMTOpenSMT

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreTimeout Memout
OpenSMT 0 464 22434.98 22445.7469 0
2020-OpenSMTn 0 464 23505.938 23482.559 0
z3-mvn 0 459 38429.569 38431.17414 0
Yices2 model-validation 0 458 26127.284 26123.62115 0
cvc5-mv 0 452 45547.164 45539.69621 0
2020-Yices2-fixed Model Validationn 0 451 32123.88 32129.06922 0
SMTInterpol 0 440 74196.746 70327.33733 0
MathSAT5n 0 432 63460.823 63477.11137 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreTimeout Memout
OpenSMT 0 46422435.8722445.4869 0
2020-OpenSMTn 0 46423506.70823482.289 0
z3-mvn 0 45938431.75938430.48414 0
Yices2 model-validation 0 45826128.95426123.06115 0
cvc5-mv 0 45245550.94445539.01621 0
2020-Yices2-fixed Model Validationn 0 45132126.4932128.27922 0
SMTInterpol 0 44074196.74670327.33733 0
MathSAT5n 0 43263468.27363475.64137 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.