QF_BVFP (Single Query Track)

Competition results for the QF_BVFP logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 414
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	413	2286.374	2286.461	413	150	263	1	1	0
Bitwuzla Fixedn	0	413	2339.557	2279.105	413	150	263	1	1	0
2022-Bitwuzlan	0	413	2402.482	2401.988	413	149	264	1	1	0
Z3-Owl Fixedn	0	401	24967.3	24898.099	401	150	251	13	13	0
cvc5	0	389	3336.094	3324.587	389	146	243	25	3	0
COLIBRI	0	366	625.607	627.38	366	143	223	48	19	0
Z3-Owl	243	171	157.616	157.672	171	150	21	243	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla Fixedn	0	413	2339.557	2279.105	413	150	263	1	1	0
Bitwuzla	0	413	2286.374	2286.461	413	150	263	1	1	0
2022-Bitwuzlan	0	413	2402.482	2401.988	413	149	264	1	1	0
Z3-Owl Fixedn	0	401	24967.3	24898.099	401	150	251	13	13	0
cvc5	0	389	3336.094	3324.587	389	146	243	25	3	0
COLIBRI	0	366	625.607	627.38	366	143	223	48	19	0
Z3-Owl	243	171	157.616	157.672	171	150	21	243	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	150	186.186	186.31	150	150	0	0	264	1	0
Bitwuzla Fixedn	0	150	194.14	186.541	150	150	0	0	264	1	0
Z3-Owl Fixedn	0	150	6192.497	6150.391	150	150	0	0	264	13	0
2022-Bitwuzlan	0	149	343.779	343.878	149	149	0	1	264	1	0
cvc5	0	146	1339.308	1337.699	146	146	0	4	264	3	0
COLIBRI	0	143	203.883	204.144	143	143	0	7	264	19	0
Z3-Owl	243	150	109.521	109.559	150	150	0	0	264	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-Bitwuzlan	0	264	2058.703	2058.11	264	0	264	0	150	1	0
Bitwuzla Fixedn	0	263	2145.416	2092.563	263	0	263	1	150	1	0
Bitwuzla	0	263	2100.188	2100.151	263	0	263	1	150	1	0
Z3-Owl Fixedn	0	251	18774.803	18747.708	251	0	251	13	150	13	0
cvc5	0	243	1996.786	1986.888	243	0	243	21	150	3	0
COLIBRI	0	223	421.724	423.236	223	0	223	41	150	19	0
Z3-Owl	0	21	48.095	48.113	21	0	21	243	150	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla Fixedn	0	403	462.581	453.574	403	149	254	11	11	0
Bitwuzla	0	403	455.438	455.17	403	149	254	11	11	0
2022-Bitwuzlan	0	400	422.591	421.882	400	147	253	14	14	0
COLIBRI	0	362	412.665	414.381	362	143	219	52	23	0
cvc5	0	359	1275.671	1263.782	359	127	232	55	33	0
Z3-Owl Fixedn	0	261	2258.885	2260.618	261	108	153	153	153	0
Z3-Owl	243	171	157.616	157.672	171	150	21	243	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.