SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

QF_UFDT (Single Query Track)

Competition results for the QF_UFDT logic in the Single Query Track.

Page generated on 2021-07-18 17:29:07 +0000

Benchmarks: 203
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 104 169813.755 169842.50210428769999 0
z3n 0 98 159924.689 159963.129981088105105 0
SMTInterpol 0 19 229500.84 228785.6719316184184 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 104169831.325169838.36210428769999 0
z3n 0 98159938.689159959.089981088105105 0
SMTInterpol 0 23229865.65228663.5323320180180 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 28103106.401103109.16282807510099 0
z3n 0 10115844.323115844.8151010093100105 0
SMTInterpol 0 3120001.068120000.835330100100180 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
z3n 0 8844094.36644114.2748808812103105 0
cvc5 0 7666724.92466729.202760762410399 0
SMTInterpol 0 20109864.582108662.6952002080103180 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 34800.0524800.05330200200 0
z3n 0 34800.0874800.087330200200 0
SMTInterpol 0 34801.0684800.835330200200 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.