SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Competitions by Year

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

NRA (Single Query Track)

Competition results for the NRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 93
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
VampireVampire Vampire Vampire

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 90 3897.283 3897.5519028833 0
2019-Par4n 0 85 9709.162 9658.3488518488 0
Vampire 0 82 13380.395 13308.295820821111 0
CVC4 0 62 34672.829 34873.346620623129 0
UltimateEliminator+MathSAT 0 1 327.177 224.263101920 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 90 3897.443 3897.4819028833 0
2019-Par4n 0 85 9709.162 9658.3488518488 0
Vampire 0 82 13380.395 13308.295820821111 0
CVC4 0 62 34870.669 34872.246620623129 0
UltimateEliminator+MathSAT 0 1 327.177 224.263101920 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 2 0.079 0.079220913 0
2019-Par4n 0 1 1200.007 1200.084110928 0
UltimateEliminator+MathSAT 0 0 7.039 4.742000930 0
Vampire 0 0 2400.0 2400.00009311 0
CVC4 0 0 2400.0 2400.00009329 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 88 3897.363 3897.4018808853 0
2019-Par4n 0 84 8509.156 8458.2648408498 0
Vampire 0 82 10980.395 10908.295820821111 0
CVC4 0 62 32470.669 32472.246620623129 0
UltimateEliminator+MathSAT 0 1 320.138 219.521101920 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 89 99.526 99.5338928744 0
2019-Par4n 0 84 225.252 224.2548418399 0
Vampire 0 79 383.365 358.96790791414 0
CVC4 0 62 754.264 754.246620623131 0
UltimateEliminator+MathSAT 0 1 327.177 224.263101920 0

n Non-competing.