SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Previous Competitions
SMT-LIB

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_LIRA (Single Query Track)

Competition results for the QF_LIRA division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 7
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
Par4Par4Yices 2.6.2 Par4 Yices 2.6.2

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 7 226.017 113.79971600 0
2018-Z3n 0 6 2463.29 2463.58961511 0
Yices 2.6.2 0 6 2504.257 2504.68361511 0
Z3n 0 6 2638.019 2638.35361511 0
CVC4 0 6 3474.956 3476.10561511 0
SMTInterpol 0 4 7275.17 7238.00941333 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 7 226.017 113.79971600 0
2018-Z3n 0 6 2463.49 2463.49961511 0
Yices 2.6.2 0 6 2504.637 2504.65361511 0
Z3n 0 6 2638.229 2638.27361511 0
CVC4 0 6 3475.656 3476.08561511 0
SMTInterpol 0 4 7275.17 7238.00941333 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices 2.6.2 0 1 0.087 0.08711061 0
2018-Z3n 0 1 0.326 0.32711061 0
Par4 0 1 0.006 0.3311060 0
Z3n 0 1 0.409 0.40911061 0
CVC4 0 1 0.958 0.95811061 0
SMTInterpol 0 1 19.932 7.03811063 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Par4 0 6 226.012 113.46960610 0
2018-Z3n 0 5 2463.163 2463.17250521 0
Yices 2.6.2 0 5 2504.551 2504.56750521 0
Z3n 0 5 2637.82 2637.86450521 0
CVC4 0 5 3474.697 3475.12750521 0
SMTInterpol 0 3 7255.238 7230.97130343 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices 2.6.2 0 5 48.481 48.48151422 0
2018-Z3n 0 5 50.751 50.75151422 0
Par4 0 5 52.247 50.79951422 0
Z3n 0 5 52.624 52.62451422 0
CVC4 0 5 55.456 55.45551422 0
SMTInterpol 0 3 122.93 105.531244 0

n Non-competing.