SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

SMT-COMP 2021 Results - Cloud Track (Summary)

Summary of all competition results for the Cloud Track.
Results are given ranked by performance for each scoring scheme (best solver is given as left-most solver).
This track is experimental. Solvers are only ranked by performance, but no winner is selected.

Arith

Scoring SchemeRanking
Parallel PerformancePar4n, Vampire, cvc5-gg
SAT PerformancePar4n, cvc5-gg, Vampire
UNSAT PerformanceVampire, Par4n, cvc5-gg
24s PerformancePar4n, Vampire, cvc5-gg

Bitvec

Scoring SchemeRanking
Parallel PerformancePar4n, cvc5-gg
SAT PerformancePar4n, cvc5-gg
UNSAT Performancecvc5-gg, Par4n
24s Performancecvc5-gg, Par4n

Equality+LinearArith

Scoring SchemeRanking
Parallel PerformanceVampire, Par4n, cvc5-gg
SAT PerformancePar4n, cvc5-gg, Vampire
UNSAT PerformanceVampire, Par4n, cvc5-gg
24s PerformanceVampire, Par4n, cvc5-gg

Equality+MachineArith

Scoring SchemeRanking
Parallel Performancecvc5-gg, Par4n
SAT Performancecvc5-gg, Par4n
UNSAT Performancecvc5-gg, Par4n
24s Performancecvc5-gg, Par4n

Equality+NonLinearArith

Scoring SchemeRanking
Parallel PerformanceVampire, cvc5-gg, Par4n
SAT Performancecvc5-gg, Par4n, Vampire
UNSAT PerformanceVampire, cvc5-gg, Par4n
24s Performancecvc5-gg, Vampire, Par4n

Equality

Scoring SchemeRanking
Parallel PerformanceVampire, Par4n, cvc5-gg
SAT PerformanceVampire, Par4n, cvc5-gg
UNSAT PerformanceVampire, cvc5-gg, Par4n
24s PerformanceVampire, cvc5-gg, Par4n

QF_Bitvec

Scoring SchemeRanking
Parallel PerformanceSTP-CMS-Cloud, Par4n, cvc5-gg
SAT PerformanceSTP-CMS-Cloud, cvc5-gg, Par4n
UNSAT PerformanceSTP-CMS-Cloud, Par4n, cvc5-gg
24s PerformanceSTP-CMS-Cloud, cvc5-gg, Par4n

QF_Equality+Bitvec

Scoring SchemeRanking
Parallel PerformancePar4n, cvc5-gg
SAT PerformancePar4n, cvc5-gg
UNSAT PerformancePar4n, cvc5-gg
24s Performancecvc5-gg, Par4n

QF_Equality+NonLinearArith

Scoring SchemeRanking
Parallel PerformancePar4n, cvc5-gg
SAT PerformancePar4n, cvc5-gg
UNSAT Performancecvc5-gg, Par4n
24s Performancecvc5-gg, Par4n

QF_FPArith

Scoring SchemeRanking
Parallel Performancecvc5-gg, Par4n
SAT Performancecvc5-gg, Par4n
UNSAT Performancecvc5-gg, Par4n
24s Performancecvc5-gg, Par4n

QF_LinearIntArith

Scoring SchemeRanking
Parallel PerformancePar4n, SMTS cube-and-conquer, SMTS portfolio, cvc5-gg
SAT PerformanceSMTS cube-and-conquer, SMTS portfolio, Par4n, cvc5-gg
UNSAT PerformancePar4n, cvc5-gg, SMTS cube-and-conquer, SMTS portfolio
24s PerformanceSMTS cube-and-conquer, SMTS portfolio, cvc5-gg, Par4n

QF_LinearRealArith

Scoring SchemeRanking
Parallel PerformanceSMTS portfolio, SMTS cube-and-conquer, Par4n, cvc5-gg
SAT PerformancePar4n, SMTS portfolio, SMTS cube-and-conquer, cvc5-gg
UNSAT PerformanceSMTS portfolio, SMTS cube-and-conquer, Par4n, cvc5-gg
24s PerformancePar4n, SMTS cube-and-conquer, SMTS portfolio, cvc5-gg

QF_NonLinearIntArith

Scoring SchemeRanking
Parallel PerformancePar4n, cvc5-gg
SAT PerformancePar4n, cvc5-gg
UNSAT PerformancePar4n, cvc5-gg
24s PerformancePar4n, cvc5-gg

QF_NonLinearRealArith

Scoring SchemeRanking
Parallel PerformancePar4n, cvc5-gg
SAT PerformancePar4n, cvc5-gg
UNSAT PerformancePar4n, cvc5-gg
24s Performancecvc5-gg, Par4n