SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_ANIA (Single Query Track)

Competition results for the QF_ANIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 123
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
SMTInterpolSMTInterpolSMTInterpol SMTInterpol SMTInterpol

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 104 1507.673 1063.77610489151910 0
Yices2 0 97 5512.268 5512.7749786112626 0
2020-CVC4n 0 91 3076.132 3076.4679178133232 0
cvc5 0 87 2944.518 2925.2358774133636 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 1041507.6731063.77610489151910 0
Yices2 0 975512.2685512.7749786112626 0
2020-CVC4n 0 913076.1323076.4679178133232 0
cvc5 0 872944.5182925.2358774133636 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
SMTInterpol 0 89551.486335.5348989033110 0
Yices2 0 865432.5115433.0138686063126 0
2020-CVC4n 0 781665.8291665.93578780143132 0
cvc5 0 741426.7021415.92674740183136 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
SMTInterpol 0 15956.187728.24215015139510 0
2020-CVC4n 0 131410.3031410.53213013159532 0
cvc5 0 131517.8161509.30913013159536 0
Yices2 0 1179.75679.76111011179526 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 97417.232188.3459787102617 0
2020-CVC4n 0 76164.218164.229767064747 0
cvc5 0 73426.501406.78736585050 0
Yices2 0 61213.389213.418615296262 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.