SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_DT (Single Query Track)

Competition results for the QF_DT logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 201
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 SMTInterpol

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2022-z3-4.8.17n 0 103 54329.683 54335.16910341629898 0
cvc5 0 86 45760.349 45768.208862561115115 0
SMTInterpol 0 29 11629.946 9699.692291910172172 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2022-z3-4.8.17n 0 10354329.68354335.16910341629898 0
cvc5 0 8645760.34945768.208862561115115 0
SMTInterpol 0 3827398.11618770.7381919163163 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2022-z3-4.8.17n 0 4123076.74223079.023414105910198 0
cvc5 0 2513167.83113171.5182525075101115 0
SMTInterpol 0 196737.1276414.3221919081101163 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2022-z3-4.8.17n 0 6231252.94131256.146620623910098 0
cvc5 0 6132592.51832596.696106140100115 0
SMTInterpol 0 1920660.98912356.3781901982100163 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 6148.9486.111651195195 0
2022-z3-4.8.17n 0 221.18821.186202199199 0
cvc5 0 116.41816.419101200200 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.