SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

UFBV (Single Query Track)

Competition results for the UFBV division in the Single Query Track.

Page generated on 2020-07-04 11:46:59 +0000

Benchmarks: 72
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4 CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2018-Z3n 0 50 26465.515 26470.1835018322222 0
2019-Par4n 0 50 26527.12 26468.8875018322222 0
z3n 0 49 27629.809 27634.2554918312323 0
CVC4 0 27 36606.133 37946.924270274526 0
UltimateEliminator+MathSAT 0 6 5022.737 4853.305606663 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-Par4n 0 50 26527.12 26468.8875018322222 0
2018-Z3n 0 50 26469.425 26469.4435018322222 0
z3n 0 49 27632.839 27632.8454918312323 0
CVC4 0 27 37777.534 37945.354270274526 0
UltimateEliminator+MathSAT 0 6 5022.737 4853.305606663 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 18 2.163 2.164181805423 0
2019-Par4n 0 18 1.352 2.844181805422 0
2018-Z3n 0 18 3.006 3.007181805422 0
UltimateEliminator+MathSAT 0 0 890.169 828.629000723 0
CVC4 0 0 10802.007 10802.0070007226 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2019-Par4n 0 32 1325.767 1266.043320324022 0
2018-Z3n 0 32 1266.418 1266.436320324022 0
z3n 0 31 2430.676 2430.681310314123 0
CVC4 0 27 5947.731 5968.374270274526 0
UltimateEliminator+MathSAT 0 6 122.016 82.416606663 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3n 0 49 584.839 584.8454918312323 0
2019-Par4n 0 49 614.22 588.3384918312323 0
2018-Z3n 0 49 588.933 588.9374918312323 0
CVC4 0 15 1251.747 1251.761150155747 0
UltimateEliminator+MathSAT 0 6 451.845 346.457606667 0

n Non-competing.