SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

AUFBVDTLIA (Single Query Track)

Competition results for the AUFBVDTLIA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:04 +0000

Benchmarks: 842
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2020-CVC4n 0 452 497338.677 511678.518452199253390364 0
cvc5 0 375 295100.313 573444.995375140235467443 0
cvc5 - fixedn 0 364 278653.493 581306.045364133231478453 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2020-CVC4n 0 452508178.197511659.998452199253390364 0
cvc5 0 375571465.197573416.975375140235467443 0
cvc5 - fixedn 0 364579484.863581275.215364133231478453 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2020-CVC4n 0 19950701.95453701.38319919900643364 0
cvc5 0 14091310.03292885.555140140059643443 0
cvc5 - fixedn 0 13397053.93798441.279133133066643453 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2020-CVC4n 0 25324943.8925391.42525302535584364 0
cvc5 0 23541699.58942039.635235023523584443 0
cvc5 - fixedn 0 23145079.26245435.134231023127584453 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2020-CVC4n 0 20315357.79715358.1492037196639639 0
cvc5 0 20315366.14615366.0632037196639639 0
cvc5 - fixedn 0 20315366.23615366.8462037196639639 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.