SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

FPLRA (Single Query Track)

Competition results for the FPLRA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 41
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
BitwuzlaBitwuzlaBitwuzla Bitwuzla

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 37 31.207 31.2113737044 0
Bitwuzla Fixedn 0 37 31.733 31.7443737044 0
2022-Bitwuzlan 0 27 810.086 810.146272701414 0
cvc5 0 23 140.884 140.879232301817 0
UltimateEliminator+MathSAT 0 14 94.99 70.96814140270 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 3731.20731.2113737044 0
Bitwuzla Fixedn 0 3731.73331.7443737044 0
2022-Bitwuzlan 0 27810.086810.146272701414 0
cvc5 0 23140.884140.879232301817 0
UltimateEliminator+MathSAT 0 1494.9970.96814140270 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
Bitwuzla 0 3731.20731.21137370044 0
Bitwuzla Fixedn 0 3731.73331.74437370044 0
2022-Bitwuzlan 0 27810.086810.1462727010414 0
cvc5 0 23140.884140.8792323014417 0
UltimateEliminator+MathSAT 0 1494.9970.968141402340 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2022-Bitwuzlan 0 00.00.000004114 0
cvc5 0 00.00.000004117 0
Bitwuzla 0 00.00.00000414 0
UltimateEliminator+MathSAT 0 00.00.00000410 0
Bitwuzla Fixedn 0 00.00.00000414 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
Bitwuzla 0 3731.20731.2113737044 0
Bitwuzla Fixedn 0 3731.73331.7443737044 0
2022-Bitwuzlan 0 2527.01427.02252501616 0
cvc5 0 229.2729.262222201918 0
UltimateEliminator+MathSAT 0 1494.9970.96814140270 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.