UFBV (Single Query Track)

Competition results for the UFBV logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 143
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	101	50625.789	50633.691	101	32	69	42	39	0
cvc5	0	94	41789.721	42831.201	94	18	76	49	18	0
Bitwuzla	0	94	60435.682	60443.794	94	17	77	49	49	0
2021-cvc5n	0	80	49022.629	56060.791	80	3	77	63	29	0
UltimateEliminator+MathSAT	0	6	12668.442	12146.888	6	0	6	137	4	4

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	101	50631.629	50631.941	101	32	69	42	39	0
cvc5	0	94	42365.061	42830.201	94	18	76	49	18	0
Bitwuzla	0	94	60441.322	60441.544	94	17	77	49	49	0
2021-cvc5n	0	80	55726.556	56059.221	80	3	77	63	29	0
UltimateEliminator+MathSAT	0	6	12668.442	12146.888	6	0	6	137	4	4

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	32	4930.775	4930.746	32	32	0	4	107	39	0
cvc5	0	18	11842.048	12083.54	18	18	0	18	107	18	0
Bitwuzla	0	17	22839.53	22839.537	17	17	0	19	107	49	0
2021-cvc5n	0	3	24679.271	24870.723	3	3	0	33	107	29	0
UltimateEliminator+MathSAT	0	0	2885.97	2732.433	0	0	0	36	107	4	4

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2021-cvc5n	0	77	10024.829	10073.546	77	0	77	9	57	29	0
Bitwuzla	0	77	12401.792	12402.007	77	0	77	9	57	49	0
cvc5	0	76	9504.635	9641.058	76	0	76	10	57	18	0
z3-4.8.17n	0	69	20500.854	20501.195	69	0	69	17	57	39	0
UltimateEliminator+MathSAT	0	6	4315.671	4037.068	6	0	6	80	57	4	4

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	96	1305.983	1305.834	96	31	65	47	47	0
Bitwuzla	0	90	1398.057	1398.092	90	17	73	53	53	0
cvc5	0	60	2139.39	2121.784	60	1	59	83	83	0
2021-cvc5n	0	59	2146.153	2146.158	59	0	59	84	84	0
UltimateEliminator+MathSAT	0	5	1243.8	916.94	5	0	5	138	11	4

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.