SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2020

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

AUFLIRA (Unsat Core Track)

Competition results for the AUFLIRA division in the Unsat Core Track.

Page generated on 2020-07-04 11:49:32 +0000

Benchmarks: 7908
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
CVC4-ucCVC4-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
z3n 0 142486 8009.126 8011.0242 2
CVC4-uc 0 142347 49840.36 49848.03241 0
SMTInterpol 0 120065 425388.723 422775.926345 0
SMTInterpol-fixedn 0 120065 425393.475 422118.316344 0
UltimateEliminator+MathSAT 0 0 85069.838 72455.64342 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
z3n 0 1424868009.3768010.9742 2
CVC4-uc 0 14234749847.0849846.49241 0
SMTInterpol-fixedn 0 120065446317.495415463.492327 0
SMTInterpol 0 120065444228.353417250.119330 0
UltimateEliminator+MathSAT 0 087175.13871554.90740 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.