SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_NIRA (Single Query Track)

Competition results for the QF_NIRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 2
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
SMT-RATSMT-RAT SMT-RAT

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMT-RAT 0 2 262.708 262.72120200 0
2018-SMTRAT-Ratn 0 2 314.192 314.22220200 0
z3n 0 1 1202.117 1202.16710111 0
CVC4 0 1 1239.161 1239.7710111 0
MathSAT5n 0 1 1425.389 1425.75210111 0
Yices2 0 0 2399.97 2400.1100022 0
Yices2-fixedn 0 0 2400.0 2400.000022 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMT-RAT 0 2 262.708 262.72120200 0
2018-SMTRAT-Ratn 0 2 314.192 314.22220200 0
z3n 0 1 1202.137 1202.13710111 0
CVC4 0 1 1239.661 1239.6610111 0
MathSAT5n 0 1 1425.739 1425.73210111 0
Yices2 0 0 2400.0 2400.000022 0
Yices2-fixedn 0 0 2400.0 2400.000022 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-SMTRAT-Ratn 0 0 0.0 0.000020 0
SMT-RAT 0 0 0.0 0.000020 0
CVC4 0 0 0.0 0.000021 0
z3n 0 0 0.0 0.000021 0
Yices2 0 0 0.0 0.000022 0
MathSAT5n 0 0 0.0 0.000021 0
Yices2-fixedn 0 0 0.0 0.000022 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMT-RAT 0 2 262.708 262.72120200 0
2018-SMTRAT-Ratn 0 2 314.192 314.22220200 0
z3n 0 1 1202.137 1202.13710111 0
CVC4 0 1 1239.661 1239.6610111 0
MathSAT5n 0 1 1425.739 1425.73210111 0
Yices2 0 0 2400.0 2400.000022 0
Yices2-fixedn 0 0 2400.0 2400.000022 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 1 26.137 26.13710111 0
2018-SMTRAT-Ratn 0 0 48.0 48.000022 0
SMT-RAT 0 0 48.0 48.000022 0
CVC4 0 0 48.0 48.000022 0
Yices2 0 0 48.0 48.000022 0
MathSAT5n 0 0 48.0 48.000022 0
Yices2-fixedn 0 0 48.0 48.000022 0

n Non-competing.