SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

UFFPDTLIRA (Single Query Track)

Competition results for the UFFPDTLIRA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:07 +0000

Benchmarks: 381
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 344 12603.573 26850.133344413033717 0
cvc5 0 344 13949.556 26464.993344413033717 0
2020-CVC4n 0 325 17399.899 17367.306325223035613 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 34426389.48826464.203344413033717 0
cvc5 - fixedn 0 34426676.40826849.433344413033717 0
2020-CVC4n 0 32517404.25917366.826325223035613 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 411082.4031083.2841410034017 0
cvc5 - fixedn 0 411096.9421097.85941410034017 0
2020-CVC4n 0 2290.07990.15222201934013 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2020-CVC4n 0 3032897.2182859.16303030327613 0
cvc5 - fixedn 0 3034911.7644947.896303030327617 0
cvc5 0 3035087.6265133.947303030327617 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 3301228.5451223.984330322985142 0
cvc5 - fixedn 0 3301223.6641225.842330322985142 0
2020-CVC4n 0 320825.273825.877320222986123 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.