SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

FPLRA (Single Query Track)

Competition results for the FPLRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 87
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 70 22636.463 22612.7637055151717 0
Bitwuzla 0 58 37766.316 37771.6745843152929 0
cvc5 0 50 42180.236 42176.3455035153735 0
2021-cvc5n 0 50 42246.502 42252.2595035153735 0
UltimateEliminator+MathSAT 0 36 560.237 402.55362313510 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 7022640.47322611.9837055151717 0
Bitwuzla 0 5837770.24637770.7145843152929 0
cvc5 0 5042183.81642175.1555035153735 0
2021-cvc5n 0 5042250.53242250.5495035153735 0
UltimateEliminator+MathSAT 0 36560.237402.55362313510 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
z3-4.8.17n 0 5513050.17513021.48155550102217 0
Bitwuzla 0 4329368.60229369.06643430222229 0
cvc5 0 3533757.34133748.66235350302235 0
2021-cvc5n 0 3533824.4933824.50135350302235 0
UltimateEliminator+MathSAT 0 23422.995307.4092323042220 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla 0 151.6441.6481501507229 0
2021-cvc5n 0 1526.04226.0481501507235 0
cvc5 0 1526.47526.4931501507235 0
z3-4.8.17n 0 151190.2981190.5021501507217 0
UltimateEliminator+MathSAT 0 1388.20358.715130132720 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 53841.678841.6855338153434 0
z3-4.8.17n 0 501154.3211154.252504553737 0
cvc5 0 49946.357937.6884934153836 0
2021-cvc5n 0 49952.956952.964934153836 0
UltimateEliminator+MathSAT 0 36560.237402.55362313510 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.