SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

AUFBVFP (Single Query Track)

Competition results for the AUFBVFP logic in the Single Query Track.

Page generated on 2021-07-18 17:29:04 +0000

Benchmarks: 57
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 17 15787.258 45526.262170174035 0
cvc5 - fixedn 0 16 16379.791 45861.454160164136 0
UltimateEliminator+MathSAT 0 0 266.459 159.18000570 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 1745342.91345523.502170174035 0
cvc5 - fixedn 0 1645800.5545859.684160164136 0
UltimateEliminator+MathSAT 0 0266.459159.18000570 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 00.00.000005735 0
UltimateEliminator+MathSAT 0 00.00.00000570 0
cvc5 - fixedn 0 00.00.000005736 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 17707.265806.6311701704035 0
cvc5 - fixedn 0 161389.5281384.6931601614036 0
UltimateEliminator+MathSAT 0 077.25246.26100017400 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 121160.4231155.533120124545 0
cvc5 0 121157.5581157.589120124545 0
UltimateEliminator+MathSAT 0 0266.459159.18000570 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.