SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

UFBVLIA (Single Query Track)

Competition results for the UFBVLIA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 208
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 4 245403.656 245453.292404204204 0
2021-cvc5n 0 2 83910.566 247223.209202206206 0
cvc5 0 2 241454.726 248010.848202206206 0
UltimateEliminator+MathSAT 0 0 157071.11 154309.426000208118 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 4245443.556245443.672404204204 0
2021-cvc5n 0 2247211.809247211.809202206206 0
cvc5 0 2247969.636248000.018202206206 0
UltimateEliminator+MathSAT 0 0157071.11154309.426000208118 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
UltimateEliminator+MathSAT 0 01677.7711183.47700020188118 0
2021-cvc5n 0 024000.024000.000020188206 0
cvc5 0 024000.024000.000020188206 0
z3-4.8.17n 0 024000.024000.000020188204 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
z3-4.8.17n 0 45443.5565443.6724044200204 0
2021-cvc5n 0 27211.8097211.8092026200206 0
cvc5 0 27969.6368000.0182026200206 0
UltimateEliminator+MathSAT 0 01393.5761200.7530008200118 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
2021-cvc5n 0 24955.8094955.809202206206 0
z3-4.8.17n 0 24967.5524967.552202206206 0
UltimateEliminator+MathSAT 0 05011.984991.131000208207 0
cvc5 0 04992.04992.0000208208 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.