SMT-COMP 2019

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Papers
Benchmark Submission
Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Previous Competitions

SMT-LIB

QF_NIRA (Single Query Track)

Competition results for the QF_NIRA division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 2
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
SMT-RATSMT-RAT SMT-RAT

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-SMTRAT-Ratn 0 2 296.166 296.18420200 0
SMT-RAT 0 2 487.525 487.59820200 0
Z3n 0 1 2402.51 2402.6210111 0
CVC4 0 1 2440.685 2441.53810111 0
MathSAT-default 0 1 3498.77 3499.2810111 0
MathSAT-na-ext 0 0 4798.92 4800.1400022 0
Yices 2.6.2 0 0 4799.29 4800.0400022 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-SMTRAT-Ratn 0 2 296.166 296.18420200 0
SMT-RAT 0 2 487.525 487.59820200 0
Z3n 0 1 2402.56 2402.5610111 0
CVC4 0 1 2441.515 2441.51810111 0
MathSAT-default 0 1 3499.05 3499.2610111 0
MathSAT-na-ext 0 0 4800.0 4800.000022 0
Yices 2.6.2 0 0 4800.0 4800.000022 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-SMTRAT-Ratn 0 0 0.0 0.000020 0
CVC4 0 0 0.0 0.000021 0
MathSAT-default 0 0 0.0 0.000021 0
MathSAT-na-ext 0 0 0.0 0.000022 0
SMT-RAT 0 0 0.0 0.000020 0
Yices 2.6.2 0 0 0.0 0.000022 0
Z3n 0 0 0.0 0.000021 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-SMTRAT-Ratn 0 2 296.166 296.18420200 0
SMT-RAT 0 2 487.525 487.59820200 0
Z3n 0 1 2402.56 2402.5610111 0
CVC4 0 1 2441.515 2441.51810111 0
MathSAT-default 0 1 3499.05 3499.2610111 0
MathSAT-na-ext 0 0 4800.0 4800.000022 0
Yices 2.6.2 0 0 4800.0 4800.000022 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Z3n 0 1 26.56 26.5610111 0
2018-SMTRAT-Ratn 0 0 48.0 48.000022 0
CVC4 0 0 48.0 48.000022 0
MathSAT-default 0 0 48.0 48.000022 0
MathSAT-na-ext 0 0 48.0 48.000022 0
SMT-RAT 0 0 48.0 48.000022 0
Yices 2.6.2 0 0 48.0 48.000022 0

n Non-competing.