QF_SNIA (Single Query Track)

Competition results for the QF_SNIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 70
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
z3-alpha	z3-alpha	z3-alpha	—	z3-alpha

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-alpha	0	70	1.442	1.442	70	70	0	0	0	0
cvc5	0	70	1.492	1.459	70	70	0	0	0	0
2022-cvc5n	0	70	2.103	2.073	70	70	0	0	0	0
OSTRICH	0	70	194.424	112.795	70	70	0	0	0	0
OSTRICH Fixedn	0	70	207.123	115.61	70	70	0	0	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-alpha	0	70	1.442	1.442	70	70	0	0	0	0
cvc5	0	70	1.492	1.459	70	70	0	0	0	0
2022-cvc5n	0	70	2.103	2.073	70	70	0	0	0	0
OSTRICH	0	70	194.424	112.795	70	70	0	0	0	0
OSTRICH Fixedn	0	70	207.123	115.61	70	70	0	0	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-alpha	0	70	1.442	1.442	70	70	0	0	0	0	0
cvc5	0	70	1.492	1.459	70	70	0	0	0	0	0
2022-cvc5n	0	70	2.103	2.073	70	70	0	0	0	0	0
OSTRICH	0	70	194.424	112.795	70	70	0	0	0	0	0
OSTRICH Fixedn	0	70	207.123	115.61	70	70	0	0	0	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-cvc5n	0	0	0.0	0.0	0	0	0	0	70	0	0
cvc5	0	0	0.0	0.0	0	0	0	0	70	0	0
z3-alpha	0	0	0.0	0.0	0	0	0	0	70	0	0
OSTRICH	0	0	0.0	0.0	0	0	0	0	70	0	0
OSTRICH Fixedn	0	0	0.0	0.0	0	0	0	0	70	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-alpha	0	70	1.442	1.442	70	70	0	0	0	0
cvc5	0	70	1.492	1.459	70	70	0	0	0	0
2022-cvc5n	0	70	2.103	2.073	70	70	0	0	0	0
OSTRICH	0	70	194.424	112.795	70	70	0	0	0	0
OSTRICH Fixedn	0	70	207.123	115.61	70	70	0	0	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.