SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2022

Rules
Benchmarks
Tools
Specs
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

AUFDTNIRA (Single Query Track)

Competition results for the AUFDTNIRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 762
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 603 141883.565 141903.7656030603159118 0
2020-CVC4n 0 599 46147.833 46162.199599059916338 0
z3-4.8.17n 0 599 191296.237 191613.8935990599163158 0
Vampire 0 581 329198.948 245494.6615810581181181 0
UltimateEliminator+MathSAT 0 0 3542.411 2091.220007620 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 603141900.635141899.4256030603159118 0
2020-CVC4n 0 59946160.27346160.199599059916338 0
z3-4.8.17n 0 599191607.797191607.3135990599163158 0
Vampire 0 596372536.448234695.5425960596166166 0
UltimateEliminator+MathSAT 0 03542.4112091.220007620 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2020-CVC4n 0 00.00.0000076238 0
cvc5 0 00.00.00000762118 0
Vampire 0 00.00.00000762166 0
UltimateEliminator+MathSAT 0 00.00.000007620 0
z3-4.8.17n 0 00.00.00000762158 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 60310929.03810928.793603060311148118 0
2020-CVC4n 0 59910149.10110149.05159905991514838 0
z3-4.8.17n 0 59917577.45817576.73599059915148158 0
Vampire 0 596162534.32857158.662596059618148166 0
UltimateEliminator+MathSAT 0 02855.1281684.2480006141480 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 6033132.6353131.4256030603159118 0
2020-CVC4n 0 598995.369995.187598059816439 0
z3-4.8.17n 0 5954020.0494019.05950595167165 0
Vampire 0 4309965.0148511.9574300430332332 0
UltimateEliminator+MathSAT 0 03542.4112091.220007620 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.