SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_UFDT (Single Query Track)

Competition results for the QF_UFDT logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 200
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 SMTInterpol

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2022-z3-4.8.17n 0 98 35999.15 36003.64598692102102 0
cvc5 0 96 46826.618 46778.053962274104104 0
SMTInterpol 0 38 17482.522 13364.529382018162162 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2022-z3-4.8.17n 0 9835999.1536003.64598692102102 0
cvc5 0 9646826.61846778.053962274104104 0
SMTInterpol 0 4730552.15321593.211472126153153 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 2210467.15410469.1212222078100104 0
SMTInterpol 0 217814.2077405.4162121079100153 0
2022-z3-4.8.17n 0 63027.4983027.7766094100102 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2022-z3-4.8.17n 0 9232971.65232975.875920928100102 0
cvc5 0 7436359.46436308.9327407426100104 0
SMTInterpol 0 2622737.94514187.7952602674100153 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 379.91445.508330197197 0
2022-z3-4.8.17n 0 123.82323.822101199199 0
cvc5 0 00.00.0000200200 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.