SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

UFLRA (Unsat Core Track)

Competition results for the UFLRA logic in the Unsat Core Track.

Page generated on 2021-07-18 17:31:25 +0000

Benchmarks: 10
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel Performance
cvc5-uccvc5-uc

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreTimeout Memout
z3n 0 16 0.162 0.1820 0
cvc5-uc 0 16 0.199 0.1940 0
2020-z3n 0 16 0.332 0.3460 0
SMTInterpol 0 16 6.317 4.2380 0
SMTInterpol-remus 0 16 220.278 186.1550 0
2020-CVC4-ucn 0 14 0.174 0.2650 0
UltimateEliminator+MathSAT 0 0 48.313 28.9160 0
Vampire 0 0 2400.84 2400.8342 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreTimeout Memout
z3n 0 160.1620.1820 0
cvc5-uc 0 160.1990.1940 0
2020-z3n 0 160.3320.3460 0
SMTInterpol 0 166.3174.2380 0
SMTInterpol-remus 0 16220.278186.1550 0
2020-CVC4-ucn 0 140.1740.2650 0
Vampire 0 23651.03921.510 0
UltimateEliminator+MathSAT 0 048.31328.9160 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.