QF_FP (Single Query Track)

Competition results for the QF_FP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 285
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	COLIBRI	COLIBRI

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	249	62131.795	62137.601	249	153	96	36	36	0
cvc5	0	240	76945.67	76920.387	240	151	89	45	45	0
COLIBRI	0	236	60269.156	60267.817	236	137	99	49	49	0
2021-cvc5n	0	233	82129.287	82113.582	233	144	89	52	52	0
MathSATn	0	217	100504.42	100526.21	217	140	77	68	68	0
z3-4.8.17n	0	185	130470.344	139738.858	185	115	70	100	78	2

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	249	62136.035	62136.341	249	153	96	36	36	0
cvc5	0	240	76954.22	76918.247	240	151	89	45	45	0
COLIBRI	0	236	60269.156	60267.817	236	137	99	49	49	0
2021-cvc5n	0	233	82137.437	82110.982	233	144	89	52	52	0
MathSATn	0	217	100518.79	100523.49	217	140	77	68	68	0
z3-4.8.17n	0	185	130957.074	139735.238	185	115	70	100	78	2

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	153	10596.792	10595.155	153	153	0	3	129	36	0
cvc5	0	151	15064.708	15065.93	151	151	0	5	129	45	0
2021-cvc5n	0	144	21803.002	21779.279	144	144	0	12	129	52	0
MathSATn	0	140	27027.832	27029.819	140	140	0	16	129	68	0
COLIBRI	0	137	23578.963	23577.575	137	137	0	19	129	49	0
z3-4.8.17n	0	115	51613.86	58546.283	115	115	0	41	129	78	2

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
COLIBRI	0	99	24690.193	24690.241	99	0	99	20	166	49	0
Bitwuzla	0	96	39539.243	39541.186	96	0	96	23	166	36	0
2021-cvc5n	0	89	48334.435	48331.703	89	0	89	30	166	52	0
cvc5	0	89	49889.512	49852.317	89	0	89	30	166	45	0
MathSATn	0	77	61490.958	61493.671	77	0	77	42	166	68	0
z3-4.8.17n	0	70	67343.214	69188.955	70	0	70	49	166	78	2

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI	0	218	2045.466	2044.074	218	129	89	67	67	0
Bitwuzla	0	183	2965.665	2962.636	183	119	64	102	102	0
cvc5	0	157	3986.751	3948.024	157	102	55	128	128	0
2021-cvc5n	0	155	4099.122	4068.998	155	101	54	130	130	0
MathSATn	0	131	4337.667	4337.763	131	90	41	154	154	0
z3-4.8.17n	0	81	5348.689	5342.677	81	61	20	204	202	2

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.