SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Previous Competitions
SMT-LIB

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

Largest Contribution Ranking - Unsat Core Track

Page generated on 2019-07-23 17:57:53 +0000

Winners

Sequential Performance Parallel Performance
CVC4-uc CVC4-uc

Sequential Performance

Solver Correct Score Time Score Division
CVC4-uc 0.43380473 0.43005401 AUFLIRA
CVC4-uc 0.16970388 0.16249208 UFLIA
CVC4-uc 0.07482419 0.06803631 UF
CVC4-uc 0.05463555 0.04997013 AUFLIA
CVC4-uc 0.05200391 0.03802048 UFNIA
CVC4-uc 0.01731269 0.01683777 AUFNIRA
CVC4-uc 0.0076799 0.00030923 LIA
CVC4-uc 0.00407255 2.0e-08 QF_AUFLIA
MathSAT-default 0.00325743 0.00383404 QF_NIA
Yices 2.6.2 0.00199465 0.00012468 QF_AX
CVC4-uc 0.00131655 0.00131652 UFIDL
Yices 2.6.2 0.00126762 0.00138072 QF_LIA
CVC4-uc 0.00043885 0.00043885 UFLRA
Yices 2.6.2 0.00034276 0.0005159 QF_LRA
SMTInterpol 0.00032135 0.00332488 QF_UF
CVC4-uc 0.00016349 0.00021213 QF_UFLRA
CVC4-uc 0.00013987 0.0002996 QF_NRA
CVC4-uc 0.00012049 0.00359269 QF_UFNIA
CVC4-uc 6.248e-05 0.00022476 QF_ANIA
Yices 2.6.2 3.388e-05 0.00019805 QF_ALIA
CVC4-uc 2.27e-06 -0.00028405 QF_AUFNIA
Yices 2.6.2 0.0 0.00048641 QF_UFLIA
Yices 2.6.2 0.0 0.00025336 QF_UFIDL
MathSAT-default 0.0 7.84e-06 QF_UFNRA
MathSAT-na-ext 0.0 0.0 QF_NIRA

Parallel Performance

Solver Correct Score Time Score Division
CVC4-uc 0.43380473 0.43005404 AUFLIRA
CVC4-uc 0.16970388 0.16249211 UFLIA
CVC4-uc 0.07482419 0.06803634 UF
CVC4-uc 0.05463555 0.0499701 AUFLIA
CVC4-uc 0.05200391 0.03802038 UFNIA
CVC4-uc 0.01731269 0.01683777 AUFNIRA
CVC4-uc 0.0076799 0.00030889 LIA
CVC4-uc 0.00407255 -2.0e-08 QF_AUFLIA
MathSAT-default 0.00325743 0.00383389 QF_NIA
Yices 2.6.2 0.00199465 0.00012429 QF_AX
CVC4-uc 0.00131655 0.00131652 UFIDL
Yices 2.6.2 0.00126762 0.00135348 QF_LIA
CVC4-uc 0.00043885 0.00043885 UFLRA
Yices 2.6.2 0.00034276 0.00044947 QF_LRA
SMTInterpol 0.00032135 0.00336417 QF_UF
CVC4-uc 0.00016349 0.00021213 QF_UFLRA
CVC4-uc 0.00013987 0.00029969 QF_NRA
CVC4-uc 0.00012049 0.0035927 QF_UFNIA
CVC4-uc 6.248e-05 0.00022475 QF_ANIA
Yices 2.6.2 3.388e-05 0.00018929 QF_ALIA
CVC4-uc 2.27e-06 -0.00028401 QF_AUFNIA
Yices 2.6.2 0.0 0.00041572 QF_UFLIA
Yices 2.6.2 0.0 0.00013541 QF_UFIDL
MathSAT-default 0.0 7.86e-06 QF_UFNRA
MathSAT-na-ext 0.0 0.0 QF_NIRA

n Non-competing.