SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

AUFBVDTLIA (Single Query Track)

Competition results for the AUFBVDTLIA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 742
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 358 486249.167 499016.417358209149384358 0
2021-cvc5n 0 288 275503.387 560549.151288157131454430 0
z3-4.8.17n 0 150 669405.058 669613.3741505991592547 0
UltimateEliminator+MathSAT 0 0 3419.184 2100.5270007420 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 358496018.197498998.867358209149384358 0
2021-cvc5n 0 288558929.54560526.701288157131454430 0
z3-4.8.17n 0 150669496.648669592.1041505991592547 0
UltimateEliminator+MathSAT 0 03419.1842100.5270007420 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 20947612.95550069.01120920902531358 0
2021-cvc5n 0 15793042.56994406.481157157054531430 0
z3-4.8.17n 0 59179263.1179263.51859590152531547 0
UltimateEliminator+MathSAT 0 0976.336606.2980002115310 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 14919224.22319682.59214901490593358 0
2021-cvc5n 0 13134269.1334476.847131013118593430 0
z3-4.8.17n 0 9170113.98670114.0529109158593547 0
UltimateEliminator+MathSAT 0 0672.324416.0460001495930 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
z3-4.8.17n 0 14314222.79814222.5361435390599591 0
cvc5 0 10415334.57815335.306104995638638 0
2021-cvc5n 0 10215376.92415376.943102795640640 0
UltimateEliminator+MathSAT 0 03419.1842100.5270007420 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.