SMT-COMP 2024

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

SMT-COMP 2024

SMT-COMP 2024 Results - Unsat Core Track

Summary of all competition results for the Unsat Core Track.
Results are given ranked by performance for each scoring scheme (best solver is given as left-most solver).

Arith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds Performancecvc5cvc5, SMTInterpol

Bitvec

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, Bitwuzla
Parallel Performancecvc5cvc5, Bitwuzla
SAT Performance-
UNSAT Performancecvc5cvc5, Bitwuzla
24 seconds Performancecvc5cvc5, Bitwuzla

Equality

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol, Yices2
Parallel Performancecvc5cvc5, SMTInterpol, Yices2
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol, Yices2
24 seconds Performancecvc5cvc5, SMTInterpol, Yices2

Equality_LinearArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds Performancecvc5cvc5, SMTInterpol

Equality_MachineArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, Bitwuzla
Parallel Performancecvc5cvc5, Bitwuzla
SAT Performance-
UNSAT Performancecvc5cvc5, Bitwuzla
24 seconds Performancecvc5cvc5, Bitwuzla

Equality_NonLinearArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds Performancecvc5cvc5, SMTInterpol

FPArith

Scoring SchemeWinnerRanking
Sequential PerformanceBitwuzlaBitwuzla, cvc5
Parallel PerformanceBitwuzlaBitwuzla, cvc5
SAT Performance-
UNSAT PerformanceBitwuzlaBitwuzla, cvc5
24 seconds PerformanceBitwuzlaBitwuzla, cvc5

QF_Bitvec

Scoring SchemeWinnerRanking
Sequential PerformanceBitwuzlaBitwuzla, Yices2, cvc5
Parallel PerformanceBitwuzlaBitwuzla, Yices2, cvc5
SAT Performance-
UNSAT PerformanceBitwuzlaBitwuzla, Yices2, cvc5
24 seconds PerformanceYices2Yices2, Bitwuzla, cvc5

QF_Datatypes

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds PerformanceSMTInterpolSMTInterpol, cvc5

QF_Equality

Scoring SchemeWinnerRanking
Sequential PerformanceYices2Yices2, OpenSMT, SMTInterpol, plat-smt, cvc5
Parallel PerformanceYices2Yices2, SMTInterpol, OpenSMT, plat-smt, cvc5
SAT Performance-
UNSAT PerformanceYices2Yices2, SMTInterpol, OpenSMT, plat-smt, cvc5
24 seconds PerformanceYices2Yices2, OpenSMT, SMTInterpol, plat-smt, cvc5

QF_Equality_Bitvec

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, Yices2, Bitwuzla
Parallel Performancecvc5cvc5, Yices2, Bitwuzla
SAT Performance-
UNSAT Performancecvc5cvc5, Yices2, Bitwuzla
24 seconds PerformanceYices2Yices2, Bitwuzla, cvc5

QF_Equality_LinearArith

Scoring SchemeWinnerRanking
Sequential PerformanceYices2Yices2, OpenSMT, SMTInterpol, cvc5
Parallel PerformanceYices2Yices2, OpenSMT, SMTInterpol, cvc5
SAT Performance-
UNSAT PerformanceYices2Yices2, OpenSMT, SMTInterpol, cvc5
24 seconds PerformanceYices2Yices2, cvc5, SMTInterpol, OpenSMT

QF_Equality_NonLinearArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds PerformanceSMTInterpolSMTInterpol, cvc5

QF_FPArith

Scoring SchemeWinnerRanking
Sequential PerformanceBitwuzlaBitwuzla, cvc5
Parallel PerformanceBitwuzlaBitwuzla, cvc5
SAT Performance-
UNSAT PerformanceBitwuzlaBitwuzla, cvc5
24 seconds PerformanceBitwuzlaBitwuzla, cvc5

QF_LinearIntArith

Scoring SchemeWinnerRanking
Sequential PerformanceSMTInterpolSMTInterpol, Yices2, cvc5, OpenSMT
Parallel PerformanceSMTInterpolSMTInterpol, Yices2, cvc5, OpenSMT
SAT Performance-
UNSAT PerformanceSMTInterpolSMTInterpol, Yices2, cvc5, OpenSMT
24 seconds PerformanceYices2Yices2, cvc5, OpenSMT, SMTInterpol

QF_LinearRealArith

Scoring SchemeWinnerRanking
Sequential PerformanceOpenSMTOpenSMT, Yices2, cvc5, SMTInterpol
Parallel PerformanceOpenSMTOpenSMT, Yices2, cvc5, SMTInterpol
SAT Performance-
UNSAT PerformanceOpenSMTOpenSMT, Yices2, cvc5, SMTInterpol
24 seconds PerformanceYices2Yices2, OpenSMT, cvc5, SMTInterpol

QF_NonLinearIntArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds Performancecvc5cvc5, SMTInterpol

QF_NonLinearRealArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol
Parallel Performancecvc5cvc5, SMTInterpol
SAT Performance-
UNSAT Performancecvc5cvc5, SMTInterpol
24 seconds Performancecvc5cvc5, SMTInterpol

QF_Strings

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5
Parallel Performancecvc5cvc5
SAT Performance-
UNSAT Performancecvc5cvc5
24 seconds Performancecvc5cvc5