SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

ABVFPLRA (Single Query Track)

Competition results for the ABVFPLRA division in the Single Query Track.

Page generated on 2020-07-04 11:46:58 +0000

Benchmarks: 75
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 18 16949.738 16951.703181625713 0
UltimateEliminator+MathSAT 0 0 249.949 167.428000750 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 18 16951.008 16951.223181625713 0
UltimateEliminator+MathSAT 0 0 249.949 167.428000750 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 16 2.14 2.135161605913 0
UltimateEliminator+MathSAT 0 0 54.625 35.697000750 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 2 4.161 4.1612027313 0
UltimateEliminator+MathSAT 0 0 6.333 4.428000750 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 18 370.054 370.038181625715 0
UltimateEliminator+MathSAT 0 0 249.949 167.428000750 0

n Non-competing.