SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

BVFPLRA (Single Query Track)

Competition results for the BVFPLRA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:05 +0000

Benchmarks: 185
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 96 66061.983 66071.193969158955 0
2020-CVC4n 0 92 66024.663 66037.656928759355 0
UltimateEliminator+MathSAT 0 38 1315.147 967.172383351470 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 9666069.49366069.453969158955 0
2020-CVC4n 0 9266035.19366035.176928759355 0
UltimateEliminator+MathSAT 0 381315.147967.172383351470 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 916040.7296040.6949191068855 0
2020-CVC4n 0 876019.1546019.14187870108855 0
UltimateEliminator+MathSAT 0 33695.794517.0823333064880 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2020-CVC4n 0 57.9097.908505018055 0
cvc5 0 518.73218.735505018055 0
UltimateEliminator+MathSAT 0 548.28537.36650501800 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 961389.4931389.453969158955 0
2020-CVC4n 0 921355.1931355.176928759355 0
UltimateEliminator+MathSAT 0 381290.979948.772383351473 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.