SMT-COMP 2019

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Papers
Benchmark Submission
Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Previous Competitions

SMT-LIB

AUFLIA (Unsat Core Track)

Competition results for the AUFLIA division in the Unsat Core Track.

Page generated on 2019-07-23 17:57:45 +0000

Benchmarks: 1245
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
CVC4-ucCVC4-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreTimeout Memout
2018-CVC4 (unsat core)n 0 37870 215787.872 215834.51584 0
CVC4-uc 0 37328 238181.332 238224.895 0
Z3n 0 35012 192275.07 192303.31650 6
UltimateEliminator+SMTInterpol 0 1 99589.358 97089.91439 0
UltimateEliminator+MathSAT-5.5.4 0 1 99895.911 97429.9939 0
UltimateEliminator+Yices-2.6.1 0 0 97470.179 94994.26638 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreTimeout Memout
2018-CVC4 (unsat core)n 0 37870 215828.992 215831.29584 0
CVC4-uc 0 37328 238219.162 238220.4795 0
Z3n 0 35012 192293.84 192300.68650 6
UltimateEliminator+SMTInterpol 0 1 107468.218 96015.94437 0
UltimateEliminator+MathSAT-5.5.4 0 1 105675.061 97358.7638 0
UltimateEliminator+Yices-2.6.1 0 0 103179.109 94916.72637 0

n Non-competing.