SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

ABVFPLRA (Single Query Track)

Competition results for the ABVFPLRA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:04 +0000

Benchmarks: 75
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 0 22 53358.92 54343.984221845345 0
cvc5 - fixedn 0 22 54269.656 54342.892221845345 0
2020-CVC4n 0 20 14017.358 14019.597201825511 0
UltimateEliminator+MathSAT 0 10 1654.83 1518.18610100650 1

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 2254336.68654340.942221845345 0
cvc5 0 2254336.83254341.734221845345 0
2020-CVC4n 0 2014019.04814019.247201825511 0
UltimateEliminator+MathSAT 0 101654.831518.18610100650 1

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 - fixedn 0 181.6921.6821818005745 0
cvc5 0 181.751.7451818005745 0
2020-CVC4n 0 182.5772.581818005711 0
UltimateEliminator+MathSAT 0 10165.735113.543101008570 1

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 - fixedn 0 426.65126.66340407145 0
cvc5 0 426.69926.69940407145 0
2020-CVC4n 0 210.65810.65820227111 0
UltimateEliminator+MathSAT 0 018.1112.5730004710 1

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 211130.6921130.677211835447 0
cvc5 0 211130.7711131.251211835447 0
2020-CVC4n 0 20328.833328.825201825513 0
UltimateEliminator+MathSAT 0 10478.83342.18610100650 1

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.