QF_UFBV (Single Query Track)

Competition results for the QF_UFBV logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-Bitwuzlan	0	287	12591.348	12589.737	287	178	109	13	12	1
Bitwuzla Fixedn	0	284	19914.508	19900.084	284	176	108	16	15	0
Bitwuzla	0	284	19921.49	19865.311	284	176	108	16	15	0
Yices2	0	248	34926.401	34908.5	248	168	80	52	52	0
cvc5	0	246	35213.17	35161.613	246	155	91	54	44	9
Z3-Owl Fixedn	0	63	2953.419	2958.478	63	40	23	237	76	0
UltimateIntBlastingWrapper+SMTInterpol	0	8	3972.506	3570.618	8	8	0	292	205	1
Z3-Owl	4	217	39842.755	39850.645	217	144	73	83	79	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-Bitwuzlan	0	287	12591.348	12589.737	287	178	109	13	12	1
Bitwuzla	0	284	19921.49	19865.311	284	176	108	16	15	0
Bitwuzla Fixedn	0	284	19914.508	19900.084	284	176	108	16	15	0
Yices2	0	248	34926.401	34908.5	248	168	80	52	52	0
cvc5	0	246	35213.17	35161.613	246	155	91	54	44	9
Z3-Owl Fixedn	0	63	2953.419	2958.478	63	40	23	237	76	0
UltimateIntBlastingWrapper+SMTInterpol	0	9	5195.056	4733.648	9	9	0	291	204	1
Z3-Owl	4	217	39842.755	39850.645	217	144	73	83	79	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-Bitwuzlan	0	178	5450.98	5447.405	178	178	0	5	117	12	1
Bitwuzla	0	176	14078.361	14079.457	176	176	0	7	117	15	0
Bitwuzla Fixedn	0	176	14113.216	14117.829	176	176	0	7	117	15	0
Yices2	0	168	12924.511	12904.964	168	168	0	15	117	52	0
cvc5	0	155	14527.536	14480.684	155	155	0	28	117	44	9
Z3-Owl Fixedn	0	40	2048.637	2051.291	40	40	0	143	117	76	0
UltimateIntBlastingWrapper+SMTInterpol	0	9	5195.056	4733.648	9	9	0	174	117	204	1
Z3-Owl	4	144	22507.975	22512.336	144	144	0	39	117	79	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-Bitwuzlan	0	109	7140.369	7142.333	109	0	109	1	190	12	1
Bitwuzla Fixedn	0	108	5801.292	5782.255	108	0	108	2	190	15	0
Bitwuzla	0	108	5843.129	5785.854	108	0	108	2	190	15	0
cvc5	0	91	20685.633	20680.929	91	0	91	19	190	44	9
Yices2	0	80	22001.89	22003.536	80	0	80	30	190	52	0
Z3-Owl	0	73	17334.78	17338.309	73	0	73	37	190	79	0
Z3-Owl Fixedn	0	23	904.782	907.187	23	0	23	87	190	76	0
UltimateIntBlastingWrapper+SMTInterpol	0	0	0.0	0.0	0	0	0	110	190	204	1

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-Bitwuzlan	0	192	759.751	755.304	192	130	62	108	107	1
Bitwuzla	0	181	781.914	780.325	181	117	64	119	119	0
Bitwuzla Fixedn	0	180	776.284	756.101	180	117	63	120	120	0
Yices2	0	178	391.875	370.634	178	139	39	122	122	0
cvc5	0	134	894.317	871.308	134	103	31	166	157	9
Z3-Owl Fixedn	0	55	154.216	155.587	55	36	19	245	180	0
UltimateIntBlastingWrapper+SMTInterpol	0	1	16.331	5.477	1	1	0	299	262	1
Z3-Owl	1	125	646.21	644.29	125	92	33	175	174	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.