SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Previous Competitions
SMT-LIB

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

QF_ANIA (Single Query Track)

Competition results for the QF_ANIA division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 7
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4 CVC4 MathSAT-na-ext

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 7 583.432 583.570700 0
MathSAT-na-ext 0 7 588.174 588.16270700 0
MathSAT-default 0 7 650.693 650.71970700 0
2018-Z3n 0 6 2409.807 2410.23760611 0
Z3n 0 6 2548.144 2548.83660611 0
Alt-Ergo 0 5 6248.82 5164.96550522 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 7 583.432 583.570700 0
MathSAT-na-ext 0 7 588.174 588.16270700 0
MathSAT-default 0 7 650.693 650.71970700 0
2018-Z3n 0 6 2410.167 2410.16760611 0
Z3n 0 6 2548.774 2548.81660611 0
Alt-Ergo 0 5 6248.82 5164.96550522 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-Z3n 0 0 0.0 0.000071 0
Alt-Ergo 0 0 0.0 0.000072 0
CVC4 0 0 0.0 0.000070 0
MathSAT-default 0 0 0.0 0.000070 0
MathSAT-na-ext 0 0 0.0 0.000070 0
Z3n 0 0 0.0 0.000071 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 7 583.432 583.570700 0
MathSAT-na-ext 0 7 588.174 588.16270700 0
MathSAT-default 0 7 650.693 650.71970700 0
2018-Z3n 0 6 2410.167 2410.16760611 0
Z3n 0 6 2548.774 2548.81660611 0
Alt-Ergo 0 5 6248.82 5164.96550522 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-Z3n 0 6 34.167 34.16760611 0
Z3n 0 5 57.166 57.16650522 0
MathSAT-na-ext 0 5 89.526 89.52950522 0
MathSAT-default 0 5 102.251 102.25950522 0
CVC4 0 3 105.459 105.45930344 0
Alt-Ergo 0 3 260.75 137.62930344 0

n Non-competing.