SMT-COMP 2019

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Papers
Benchmark Submission
Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Previous Competitions

SMT-LIB

ABVFP (Single Query Track)

Competition results for the ABVFP division in the Single Query Track.

Page generated on 2019-07-23 17:56:09 +0000

Benchmarks: 1
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-CVC4n 0 1 2.57 2.5711000 0
CVC4 0 1 3.4 3.411000 0
UltimateEliminator+MathSAT-5.5.4 0 0 3.501 2.48200010 0
Z3n 0 0 2399.79 2400.0200011 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-CVC4n 0 1 2.57 2.5711000 0
CVC4 0 1 3.4 3.411000 0
UltimateEliminator+MathSAT-5.5.4 0 0 3.501 2.48200010 0
Z3n 0 0 2400.0 2400.000011 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-CVC4n 0 1 2.57 2.5711000 0
CVC4 0 1 3.4 3.411000 0
UltimateEliminator+MathSAT-5.5.4 0 0 3.501 2.48200010 0
Z3n 0 0 2400.0 2400.000011 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-CVC4n 0 0 0.0 0.000010 0
CVC4 0 0 0.0 0.000010 0
UltimateEliminator+MathSAT-5.5.4 0 0 0.0 0.000010 0
Z3n 0 0 0.0 0.000011 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-CVC4n 0 1 2.57 2.5711000 0
CVC4 0 1 3.4 3.411000 0
UltimateEliminator+MathSAT-5.5.4 0 0 3.501 2.48200010 0
Z3n 0 0 24.0 24.000011 0

n Non-competing.