SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_RDL (Single Query Track)

Competition results for the QF_RDL logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 247
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
Yices2Yices2Yices2 Yices2 Yices2

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices2 0 214 3501.757 3502.1362141061083333 0
2022-Yices2n 0 214 3540.854 3540.4882141061083333 0
2021-Yices2n 0 214 3567.438 3567.9372141061083333 0
cvc5 0 211 7333.958 7335.1322111031083636 0
OpenSMT 0 192 16704.85 16701.78419299935555 0
SMTInterpol 0 178 12073.787 9034.34117898806969 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices2 0 2143501.7573502.1362141061083333 0
2022-Yices2n 0 2143540.8543540.4882141061083333 0
2021-Yices2n 0 2143567.4383567.9372141061083333 0
cvc5 0 2117333.9587335.1322111031083636 0
OpenSMT 0 19216704.8516701.78419299935555 0
SMTInterpol 0 17913693.82710055.66117998816868 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Yices2 0 1061766.951767.0911061060014133 0
2022-Yices2n 0 1061785.6851785.8221061060014133 0
2021-Yices2n 0 1061795.0421795.2791061060014133 0
cvc5 0 1033273.9513274.4211031030314136 0
OpenSMT 0 998230.4638226.50599990714155 0
SMTInterpol 0 985541.2094637.73898980814168 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Yices2 0 1081734.8071735.0451080108113833 0
2022-Yices2n 0 1081755.1691754.6661080108113833 0
2021-Yices2n 0 1081772.3961772.6591080108113833 0
cvc5 0 1084060.0074060.711080108113836 0
OpenSMT 0 938474.3878475.279930931613855 0
SMTInterpol 0 818152.6195417.923810812813868 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Yices2 0 193345.539345.65519399945454 0
2022-Yices2n 0 193349.486348.85919399945454 0
2021-Yices2n 0 192325.495325.6119299935555 0
cvc5 0 164650.082650.24316483818383 0
OpenSMT 0 142391.368386.5781427765105105 0
SMTInterpol 0 1251474.121681.6981257154122122 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.