SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

Bitvec (Unsat Core Track)

Competition results for the Bitvec division in the Unsat Core Track.

Page generated on 2021-07-18 17:31:25 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Logics:

Winners

Sequential PerformanceParallel Performance
cvc5-uccvc5-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreAbstainedTimeout Memout
2020-CVC4-ucn 0 80 94429.871 94458.07778 0
cvc5-uc 0 77 95973.332 95985.56778 0
z3n 0 43 28336.359 28302.13920 0
UltimateEliminator+MathSAT 0 0 13102.189 12243.8199 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreAbstainedTimeout Memout
2020-CVC4-ucn 0 8094453.79194453.92778 0
cvc5-uc 0 7795984.77295982.55778 0
z3n 0 4328340.75928301.28920 0
UltimateEliminator+MathSAT 0 013102.18912243.8199 0

n Non-competing.
Abstained: Total of benchmarks in logics in this division that solver chose to abstain from. For SAT/UNSAT scores, this column also includes benchmarks not known to be SAT/UNSAT.