SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

Equality (Parallel Track)

Competition results for the Equality division in the Parallel Track.

Page generated on 2021-07-18 17:32:11 +0000

Benchmarks: 34
Time Limit: 1200 seconds
Memory Limit: N/A GB

Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.

Parallel Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 1722983.122178917017 0
cvc5-gg 0 23604.0652023203 0
Par4n 0 218763.275211151715 0

SAT Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 83470.07688012517 0
Par4n 0 14173.31911033015 0
cvc5-gg 0 01200.00009253 0

UNSAT Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 92713.04690922317 0
cvc5-gg 0 24.0652029233 0
Par4n 0 14989.95610142915 0

24 seconds Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 8662.60681726026 0
cvc5-gg 0 276.0652023203 0
Par4n 0 0408.0000171717 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.