SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

QF_UFNIA (Single Query Track)

Competition results for the QF_UFNIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 298
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 242 5476.532 5477.652242173695656 0
2020-CVC4n 0 241 5216.389 5217.191241172695736 0
Yices2 0 217 1911.502 1911.949217169488181 0
SMTInterpol 0 65 1036.113 520.0656550152330 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 2425476.5325477.652242173695656 0
2020-CVC4n 0 2415216.3895217.191241172695736 0
Yices2 0 2171911.5021911.949217169488181 0
SMTInterpol 0 651036.113520.0656550152330 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 1735306.7375307.73117317301411156 0
2020-CVC4n 0 1723991.4833992.14317217201511136 0
Yices2 0 1691906.1911906.57716916901811181 0
SMTInterpol 0 50995.163503.921505001371110 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 69169.795169.921690691121856 0
2020-CVC4n 0 691224.9061225.049690691121836 0
Yices2 0 485.3115.372480483221881 0
SMTInterpol 0 1540.95116.14515015652180 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 223209.416209.434223156677575 0
2020-CVC4n 0 217210.88210.836217152658163 0
Yices2 0 20979.85479.965209161488989 0
SMTInterpol 0 55305.679120.03955401524311 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.