SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

GitHub

Home
Introduction
Benchmark Submission
Publications
SMT-LIB
Previous Editions

SMT-COMP 2021

Rules
Benchmarks
Tools
Specs
Parallel & Cloud Tracks
Participants
Results
Slides

QF_SNIA (Single Query Track)

Competition results for the QF_SNIA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:07 +0000

Benchmarks: 5
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
cvc5cvc5cvc5 cvc5

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 5 0.126 0.12355000 0
cvc5 0 5 0.127 0.12555000 0
Z3str4 0 0 0.102 0.10400050 0

Parallel Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 50.1260.12355000 0
cvc5 0 50.1270.12555000 0
Z3str4 0 00.1020.10400050 0

SAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 - fixedn 0 50.1260.123550000 0
cvc5 0 50.1270.125550000 0
Z3str4 0 00.1020.104000500 0

UNSAT Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedN/ATimeout Memout
cvc5 0 00.00.0000050 0
Z3str4 0 00.00.0000050 0
cvc5 - fixedn 0 00.00.0000050 0

24 seconds Performance

Solver Error Score Correct ScoreCPU Time ScoreWall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
cvc5 - fixedn 0 50.1260.12355000 0
cvc5 0 50.1270.12555000 0
Z3str4 0 00.1020.10400050 0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.