SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Previous Competitions
SMT-LIB

SMT-COMP 2019

Rules
Benchmarks
Tools
Specs
Participants
Results
Slides

SMT-COMP 2019 Results - Challenge Track (non-incremental) (Summary)

Summary of all competition results for the Challenge Track (non-incremental).
Results are given ranked by performance for each scoring scheme (best solver is given as left-most solver).

QF_ABV

Scoring SchemeWinnerRanking
Sequential PerformanceBoolectorBoolector, Poolector, Yices 2.6.2, Z3n, 2018-Boolectorn, CVC4
Parallel PerformanceBoolectorBoolector, Poolector, Yices 2.6.2, Z3n, 2018-Boolectorn, CVC4
SAT PerformanceBoolectorBoolector, Poolector, Yices 2.6.2, Z3n, 2018-Boolectorn, CVC4
UNSAT Performance-2018-Boolectorn, Boolector, CVC4, Poolector, Yices 2.6.2, Z3n
24s PerformancePoolectorPoolector, Boolector, 2018-Boolectorn, CVC4, Yices 2.6.2, Z3n

QF_AUFBV

Scoring SchemeWinnerRanking
Sequential PerformanceYices 2.6.2Yices 2.6.2, Z3n, Boolector, Poolector, 2018-CVC4n, CVC4
Parallel PerformanceYices 2.6.2Yices 2.6.2, Z3n, Boolector, Poolector, 2018-CVC4n, CVC4
SAT PerformanceYices 2.6.2Yices 2.6.2, Z3n, Boolector, Poolector, 2018-CVC4n, CVC4
UNSAT PerformancePoolectorPoolector, Yices 2.6.2, 2018-CVC4n, CVC4, Z3n, Boolector
24s PerformanceYices 2.6.2Yices 2.6.2, Poolector, Z3n, Boolector, 2018-CVC4n, CVC4

QF_BV

Scoring SchemeWinnerRanking
Sequential PerformanceBoolector2018-Boolectorn, Boolector, Yices 2.6.2 CaDiCal, Minkeyrink Solver MT, Yices 2.6.2 New Bvsolver, Minkeyrink Solver, 2018-Minkeyrink MTn, Poolector, Yices 2.6.2 Cryptominisat, Yices 2.6.2, Z3n, STP-minisat, STP, STP-mergesat-fixedn, STP-portfolio-fixedn, CVC4, STP-mt, STP-mergesat, STP-riss, STP-portfolio
Parallel PerformanceMinkeyrink Solver MTMinkeyrink Solver MT, 2018-Minkeyrink MTn, 2018-Boolectorn, Poolector, Boolector, Yices 2.6.2 CaDiCal, Yices 2.6.2 New Bvsolver, Minkeyrink Solver, Yices 2.6.2 Cryptominisat, Yices 2.6.2, Z3n, STP-minisat, STP, STP-mergesat-fixedn, STP-portfolio-fixedn, STP-mt, CVC4, STP-mergesat, STP-riss, STP-portfolio
SAT PerformanceMinkeyrink Solver MTMinkeyrink Solver MT, 2018-Minkeyrink MTn, 2018-Boolectorn, Poolector, Boolector, Yices 2.6.2 CaDiCal, Yices 2.6.2 New Bvsolver, Minkeyrink Solver, Yices 2.6.2 Cryptominisat, Yices 2.6.2, Z3n, STP-minisat, STP, STP-mergesat-fixedn, STP-portfolio-fixedn, STP-mt, CVC4, STP-mergesat, STP-riss, STP-portfolio
UNSAT Performance-2018-Boolectorn, 2018-Minkeyrink MTn, Boolector, CVC4, Minkeyrink Solver, Minkeyrink Solver MT, Poolector, STP, STP-mergesat, STP-minisat, STP-mt, STP-portfolio, STP-riss, Yices 2.6.2, Yices 2.6.2 CaDiCal, Yices 2.6.2 Cryptominisat, Yices 2.6.2 New Bvsolver, Z3n, STP-mergesat-fixedn, STP-portfolio-fixedn
24s PerformanceMinkeyrink Solver MTMinkeyrink Solver MT, STP-mt, 2018-Minkeyrink MTn, Minkeyrink Solver, Z3n, 2018-Boolectorn, Poolector, STP, Boolector, STP-minisat, Yices 2.6.2 CaDiCal, STP-mergesat, STP-riss, STP-portfolio, CVC4, Yices 2.6.2, Yices 2.6.2 Cryptominisat, Yices 2.6.2 New Bvsolver, STP-mergesat-fixedn, STP-portfolio-fixedn