SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_AUFNIA (Single Query Track)

Competition results for the QF_AUFNIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 9
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
SMTInterpolSMTInterpolSMTInterpol SMTInterpol SMTInterpol

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2020-CVC4n 0 9 20.607 20.60592700 0
SMTInterpol 0 9 48.726 16.7692700 0
cvc5 0 9 49.831 49.87292700 0
Yices2 0 9 282.853 235.86892700 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 948.72616.7692700 0
2020-CVC4n 0 920.60720.60592700 0
cvc5 0 949.83149.87292700 0
Yices2 0 9282.853235.86892700 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2020-CVC4n 0 22.1882.188220070 0
SMTInterpol 0 28.0442.854220070 0
cvc5 0 24.5094.514220070 0
Yices2 0 295.03895.041220070 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
SMTInterpol 0 740.68213.906707020 0
2020-CVC4n 0 718.41918.417707020 0
cvc5 0 745.32245.358707020 0
Yices2 0 7187.815140.827707020 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
SMTInterpol 0 948.72616.7692700 0
2020-CVC4n 0 920.60720.60592700 0
cvc5 0 949.83149.87292700 0
Yices2 0 41.5771.57740455 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.