SMT-COMP 2019 Results - Challenge Track (non-incremental) (Summary)

Summary of all competition results for the Challenge Track (non-incremental).
Results are given ranked by performance for each scoring scheme (best solver is given as left-most solver).

QF_ABV

Scoring Scheme	Winner	Ranking
Sequential Performance	Boolector	Boolector, Poolector, Yices 2.6.2, Z3n, 2018-Boolectorn, CVC4
Parallel Performance	Boolector	Boolector, Poolector, Yices 2.6.2, Z3n, 2018-Boolectorn, CVC4
SAT Performance	Boolector	Boolector, Poolector, Yices 2.6.2, Z3n, 2018-Boolectorn, CVC4
UNSAT Performance	-	2018-Boolectorn, Boolector, CVC4, Poolector, Yices 2.6.2, Z3n
24s Performance	Poolector	Poolector, Boolector, 2018-Boolectorn, CVC4, Yices 2.6.2, Z3n

QF_AUFBV

Scoring Scheme	Winner	Ranking
Sequential Performance	Yices 2.6.2	Yices 2.6.2, Z3n, Boolector, Poolector, 2018-CVC4n, CVC4
Parallel Performance	Yices 2.6.2	Yices 2.6.2, Z3n, Boolector, Poolector, 2018-CVC4n, CVC4
SAT Performance	Yices 2.6.2	Yices 2.6.2, Z3n, Boolector, Poolector, 2018-CVC4n, CVC4
UNSAT Performance	Poolector	Poolector, Yices 2.6.2, 2018-CVC4n, CVC4, Z3n, Boolector
24s Performance	Yices 2.6.2	Yices 2.6.2, Poolector, Z3n, Boolector, 2018-CVC4n, CVC4

QF_BV

Scoring Scheme	Winner	Ranking
Sequential Performance	Boolector	2018-Boolectorn, Boolector, Yices 2.6.2 CaDiCal, Minkeyrink Solver MT, Yices 2.6.2 New Bvsolver, Minkeyrink Solver, 2018-Minkeyrink MTn, Poolector, Yices 2.6.2 Cryptominisat, Yices 2.6.2, Z3n, STP-minisat, STP, STP-mergesat-fixedn, STP-portfolio-fixedn, CVC4, STP-mt, STP-mergesat, STP-riss, STP-portfolio
Parallel Performance	Minkeyrink Solver MT	Minkeyrink Solver MT, 2018-Minkeyrink MTn, 2018-Boolectorn, Poolector, Boolector, Yices 2.6.2 CaDiCal, Yices 2.6.2 New Bvsolver, Minkeyrink Solver, Yices 2.6.2 Cryptominisat, Yices 2.6.2, Z3n, STP-minisat, STP, STP-mergesat-fixedn, STP-portfolio-fixedn, STP-mt, CVC4, STP-mergesat, STP-riss, STP-portfolio
SAT Performance	Minkeyrink Solver MT	Minkeyrink Solver MT, 2018-Minkeyrink MTn, 2018-Boolectorn, Poolector, Boolector, Yices 2.6.2 CaDiCal, Yices 2.6.2 New Bvsolver, Minkeyrink Solver, Yices 2.6.2 Cryptominisat, Yices 2.6.2, Z3n, STP-minisat, STP, STP-mergesat-fixedn, STP-portfolio-fixedn, STP-mt, CVC4, STP-mergesat, STP-riss, STP-portfolio
UNSAT Performance	-	2018-Boolectorn, 2018-Minkeyrink MTn, Boolector, CVC4, Minkeyrink Solver, Minkeyrink Solver MT, Poolector, STP, STP-mergesat, STP-minisat, STP-mt, STP-portfolio, STP-riss, Yices 2.6.2, Yices 2.6.2 CaDiCal, Yices 2.6.2 Cryptominisat, Yices 2.6.2 New Bvsolver, Z3n, STP-mergesat-fixedn, STP-portfolio-fixedn
24s Performance	Minkeyrink Solver MT	Minkeyrink Solver MT, STP-mt, 2018-Minkeyrink MTn, Minkeyrink Solver, Z3n, 2018-Boolectorn, Poolector, STP, Boolector, STP-minisat, Yices 2.6.2 CaDiCal, STP-mergesat, STP-riss, STP-portfolio, CVC4, Yices 2.6.2, Yices 2.6.2 Cryptominisat, Yices 2.6.2 New Bvsolver, STP-mergesat-fixedn, STP-portfolio-fixedn