SMT-COMP 2019

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Papers
Benchmark Submission
Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Previous Competitions

SMT-LIB

QF_AUFNIA (Single Query Track)

Competition results for the QF_AUFNIA division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 9
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
MathSAT-defaultMathSAT-defaultMathSAT-default MathSAT-na-ext MathSAT-default

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT-default 0 9 3.504 3.50592700 0
MathSAT-na-ext 0 9 3.65 3.6592700 0
2018-Z3n 0 9 14.267 14.26992700 0
CVC4 0 9 19.826 19.82592700 0
Z3n 0 9 22.833 22.83492700 0
Alt-Ergo 0 6 4365.783 2911.81460631 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT-default 0 9 3.504 3.50592700 0
MathSAT-na-ext 0 9 3.65 3.6592700 0
2018-Z3n 0 9 14.267 14.26992700 0
CVC4 0 9 19.826 19.82592700 0
Z3n 0 9 22.833 22.83492700 0
Alt-Ergo 0 6 4365.783 2911.81460631 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT-default 0 2 0.433 0.43322070 0
MathSAT-na-ext 0 2 0.589 0.58922070 0
CVC4 0 2 2.907 2.90722070 0
2018-Z3n 0 2 13.4 13.40222070 0
Z3n 0 2 21.961 21.96222070 0
Alt-Ergo 0 0 199.423 66.26900091 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-Z3n 0 7 0.867 0.86770720 0
Z3n 0 7 0.872 0.87270720 0
MathSAT-na-ext 0 7 3.06 3.0670720 0
MathSAT-default 0 7 3.071 3.07170720 0
CVC4 0 7 16.919 16.91870720 0
Alt-Ergo 0 6 4166.36 2845.54560631 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT-default 0 9 3.504 3.50592700 0
MathSAT-na-ext 0 9 3.65 3.6592700 0
2018-Z3n 0 9 14.267 14.26992700 0
CVC4 0 9 19.826 19.82592700 0
Z3n 0 9 22.833 22.83492700 0
Alt-Ergo 0 1 222.7 199.80410188 0

n Non-competing.