SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2023

Rules
Benchmarks
Specs
Model Validation Track
Proof Exhibition Track
Parallel & Cloud Tracks
Participants
Results
Statistics
Comparisons
Slides

UFLRA (Single Query Track)

Competition results for the UFLRA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 7
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 2 0.041 0.03920252 0
2022-cvc5n 0 2 0.046 0.04420253 0
SMTInterpol 0 2 1.289 0.88820254 0
Vampire 0 2 5.533 1.78720255 0
iProver 0 2 7.797 2.30220254 0
iProver Fixedn 0 2 8.464 2.80520254 0
UltimateEliminator+MathSAT 0 0 0.0 0.000070 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 20.0410.03920252 0
2022-cvc5n 0 20.0460.04420253 0
SMTInterpol 0 21.2890.88820254 0
Vampire 0 25.5331.78720255 0
iProver 0 27.7972.30220254 0
iProver Fixedn 0 28.4642.80520254 0
UltimateEliminator+MathSAT 0 00.00.000070 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
2022-cvc5n 0 00.00.0000523 0
Vampire 0 00.00.0000525 0
cvc5 0 00.00.0000522 0
SMTInterpol 0 00.00.0000524 0
UltimateEliminator+MathSAT 0 00.00.0000520 0
iProver 0 00.00.0000524 0
iProver Fixedn 0 00.00.0000524 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 20.0410.039202052 0
2022-cvc5n 0 20.0460.044202053 0
SMTInterpol 0 21.2890.888202054 0
Vampire 0 25.5331.787202055 0
iProver 0 27.7972.302202054 0
iProver Fixedn 0 28.4642.805202054 0
UltimateEliminator+MathSAT 0 00.00.0000250 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 20.0410.03920255 0
2022-cvc5n 0 20.0460.04420255 0
SMTInterpol 0 21.2890.88820254 0
Vampire 0 25.5331.78720255 0
iProver 0 27.7972.30220254 0
iProver Fixedn 0 28.4642.80520254 0
UltimateEliminator+MathSAT 0 00.00.000070 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.