SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

Arith (Parallel Track)

Competition results for the Arith division in the Parallel Track.

Page generated on 2021-07-18 17:32:11 +0000

Benchmarks: 20
Time Limit: 1200 seconds
Memory Limit: N/A GB

Logics: This track is experimental. Solvers are only ranked by performance, but no winner is selected.

Parallel Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Par4n 0 616666.69862413113 0
Vampire 0 518158.40250515015 0
cvc5-gg 0 00.00002000 0

SAT Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Par4n 0 21809.59722011713 0
cvc5-gg 0 00.00004160 0
Vampire 0 04800.000041615 0

UNSAT Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Vampire 0 59758.4025058715 0
Par4n 0 411257.1014049713 0
cvc5-gg 0 00.00001370 0

24 seconds Performance

Solver Error Score Correct ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedAbstainedTimeout Memout
Par4n 0 3385.85131216116 0
Vampire 0 1456.49910119019 0
cvc5-gg 0 00.00002000 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.