SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

SMT-COMP 2022 Results - Model Validation Track (Summary)

Summary of all competition results for the Model Validation Track.
Results are given ranked by performance for each scoring scheme (best solver is given as left-most solver).

QF_Bitvec

Scoring SchemeWinnerRanking
Sequential PerformanceBitwuzla2020-Bitwuzlan, Bitwuzla, Yices2, STP, z3-4.8.17n, cvc5, MathSATn, Z3++BV
Parallel PerformanceBitwuzla2020-Bitwuzlan, Bitwuzla, Yices2, STP, z3-4.8.17n, cvc5, MathSATn, Z3++BV

QF_Equality+Bitvec

Scoring SchemeWinnerRanking
Sequential PerformanceBitwuzlaBitwuzla, 2021-Yices2 model-validationn, Yices2, z3-4.8.17n, cvc5, MathSATn
Parallel PerformanceBitwuzlaBitwuzla, Yices2, 2021-Yices2 model-validationn, z3-4.8.17n, cvc5, MathSATn

QF_Equality+LinearArith

Scoring SchemeWinnerRanking
Sequential Performancesmtinterpolsmtinterpol, 2021-SMTInterpoln, cvc5, z3-4.8.17n, Yices2, OpenSMT, MathSATn
Parallel Performancesmtinterpolsmtinterpol, 2021-SMTInterpoln, cvc5, z3-4.8.17n, Yices2, OpenSMT, MathSATn

QF_Equality

Scoring SchemeWinnerRanking
Sequential PerformanceYices2Yices2, 2021-Yices2 model-validationn, z3-4.8.17n, cvc5, smtinterpol, OpenSMT, MathSATn
Parallel PerformanceYices22021-Yices2 model-validationn, Yices2, z3-4.8.17n, cvc5, smtinterpol, OpenSMT, MathSATn

QF_FPArith

This division is experimental. Solvers are only ranked by performance, but no winner is selected.

Scoring SchemeRanking
Sequential PerformanceBitwuzla, cvc5, z3-4.8.17n, MathSATn
Parallel PerformanceBitwuzla, cvc5, z3-4.8.17n, MathSATn

QF_LinearIntArith

Scoring SchemeWinnerRanking
Sequential PerformanceZ3++Z3++, 2020-z3n, z3-4.8.17n, OpenSMT, Yices2, cvc5, MathSATn, smtinterpol
Parallel PerformanceZ3++Z3++, 2020-z3n, z3-4.8.17n, OpenSMT, Yices2, cvc5, MathSATn, smtinterpol

QF_LinearRealArith

Scoring SchemeWinnerRanking
Sequential PerformanceOpenSMTOpenSMT, 2021-Yices2 model-validationn, Yices2, cvc5, z3-4.8.17n, MathSATn, smtinterpol
Parallel PerformanceOpenSMTOpenSMT, 2021-Yices2 model-validationn, Yices2, cvc5, z3-4.8.17n, smtinterpol, MathSATn