SMT-COMP 2024

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

SMT-COMP 2024

SMT-COMP 2024 Results - Model Validation Track

Summary of all competition results for the Model Validation Track.
Results are given ranked by performance for each scoring scheme (best solver is given as left-most solver).

QF_ADT_BitVec

Scoring SchemeWinnerRanking
Sequential PerformanceBitwuzlaBitwuzla, cvc5, SMTInterpol
Parallel PerformanceBitwuzlaBitwuzla, cvc5, SMTInterpol
SAT PerformanceBitwuzlaBitwuzla, cvc5, SMTInterpol
UNSAT Performance-
24 seconds PerformanceBitwuzlaBitwuzla, cvc5, SMTInterpol

QF_ADT_LinArith

Scoring SchemeWinnerRanking
Sequential PerformanceSMTInterpolSMTInterpol, cvc5
Parallel PerformanceSMTInterpolSMTInterpol, cvc5
SAT PerformanceSMTInterpolSMTInterpol, cvc5
UNSAT Performance-
24 seconds PerformanceSMTInterpolSMTInterpol, cvc5

QF_Bitvec

Scoring SchemeWinnerRanking
Sequential PerformanceSTPSTP, Bitwuzla, Yices2, cvc5, SMTInterpol
Parallel PerformanceSTPSTP, Bitwuzla, Yices2, cvc5, SMTInterpol
SAT PerformanceSTPSTP, Bitwuzla, Yices2, cvc5, SMTInterpol
UNSAT Performance-
24 seconds PerformanceSTPSTP, Bitwuzla, Yices2, cvc5, SMTInterpol

QF_Datatypes

Scoring SchemeWinnerRanking
Sequential PerformanceSMTInterpolSMTInterpol, cvc5
Parallel PerformanceSMTInterpolSMTInterpol, cvc5
SAT PerformanceSMTInterpolSMTInterpol, cvc5
UNSAT Performance-
24 seconds PerformanceSMTInterpolSMTInterpol, cvc5

QF_Equality

Scoring SchemeWinnerRanking
Sequential PerformanceOpenSMTOpenSMT, cvc5, SMTInterpol, Yices2, plat-smt
Parallel PerformanceOpenSMTOpenSMT, cvc5, SMTInterpol, Yices2, plat-smt
SAT PerformanceOpenSMTOpenSMT, cvc5, SMTInterpol, Yices2, plat-smt
UNSAT Performance-
24 seconds PerformanceOpenSMTOpenSMT, cvc5, SMTInterpol, Yices2, plat-smt

QF_Equality_Bitvec

Scoring SchemeWinnerRanking
Sequential PerformanceYices2Yices2, Bitwuzla, cvc5, SMTInterpol
Parallel PerformanceYices2Yices2, Bitwuzla, cvc5, SMTInterpol
SAT PerformanceYices2Yices2, Bitwuzla, cvc5, SMTInterpol
UNSAT Performance-
24 seconds PerformanceYices2Yices2, Bitwuzla, cvc5, SMTInterpol

QF_Equality_LinearArith

Scoring SchemeWinnerRanking
Sequential PerformanceOpenSMTOpenSMT, SMTInterpol, cvc5, Yices2
Parallel PerformanceOpenSMTOpenSMT, SMTInterpol, cvc5, Yices2
SAT PerformanceOpenSMTOpenSMT, SMTInterpol, cvc5, Yices2
UNSAT Performance-
24 seconds PerformanceOpenSMTOpenSMT, SMTInterpol, Yices2, cvc5

QF_Equality_NonLinearArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, SMTInterpol, Yices2
Parallel Performancecvc5cvc5, SMTInterpol, Yices2
SAT Performancecvc5cvc5, SMTInterpol, Yices2
UNSAT Performance-
24 seconds Performancecvc5cvc5, SMTInterpol, Yices2

QF_FPArith

Scoring SchemeWinnerRanking
Sequential Performancecvc5cvc5, Bitwuzla
Parallel Performancecvc5cvc5, Bitwuzla
SAT Performancecvc5cvc5, Bitwuzla
UNSAT Performance-
24 seconds Performancecvc5cvc5, Bitwuzla

QF_LinearIntArith

Scoring SchemeWinnerRanking
Sequential PerformanceOpenSMTOpenSMT, cvc5, Yices2, SMTInterpol
Parallel PerformanceOpenSMTOpenSMT, cvc5, Yices2, SMTInterpol
SAT PerformanceOpenSMTOpenSMT, cvc5, Yices2, SMTInterpol
UNSAT Performance-
24 seconds PerformanceYices2Yices2, cvc5, OpenSMT, SMTInterpol

QF_LinearRealArith

Scoring SchemeWinnerRanking
Sequential PerformanceOpenSMTOpenSMT, Yices2, cvc5, SMTInterpol
Parallel PerformanceOpenSMTOpenSMT, Yices2, cvc5, SMTInterpol
SAT PerformanceOpenSMTOpenSMT, Yices2, cvc5, SMTInterpol
UNSAT Performance-
24 seconds PerformanceYices2Yices2, OpenSMT, cvc5, SMTInterpol

QF_NonLinearIntArith

Scoring SchemeWinnerRanking
Sequential PerformanceYices2Yices2, cvc5, SMTInterpol
Parallel PerformanceYices2Yices2, cvc5, SMTInterpol
SAT PerformanceYices2Yices2, cvc5, SMTInterpol
UNSAT Performance-
24 seconds PerformanceYices2Yices2, cvc5, SMTInterpol

QF_NonLinearRealArith

Scoring SchemeWinnerRanking
Sequential PerformanceSMT-RATSMT-RAT, cvc5, SMTInterpol, Yices2
Parallel PerformanceSMT-RATSMT-RAT, cvc5, SMTInterpol, Yices2
SAT PerformanceSMT-RATSMT-RAT, cvc5, SMTInterpol, Yices2
UNSAT Performance-
24 seconds PerformanceSMT-RATSMT-RAT, cvc5, SMTInterpol, Yices2