UFBV (Single Query Track)

Competition results for the UFBV logic in the Single Query Track.

Page generated on 2021-07-18 17:29:07 +0000

Benchmarks: 143
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2018-Z3n	0	106	45221.546	45229.165	106	34	72	37	36	0
2020-z3n	0	106	45810.833	45818.022	106	36	70	37	36	0
z3n	0	102	50779.127	50788.645	102	33	69	41	40	0
cvc5 - fixedn	0	80	48713.874	56568.682	80	2	78	63	30	0
cvc5	0	80	51747.274	57783.66	80	2	78	63	32	0
2020-CVC4n	0	33	52896.152	54290.42	33	0	33	110	28	0
UltimateEliminator+MathSAT	0	6	13033.666	12513.401	6	0	6	137	4	5

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2018-Z3n	0	106	45226.966	45227.585	106	34	72	37	36	0
2020-z3n	0	106	45816.443	45816.402	106	36	70	37	36	0
z3n	0	102	50786.177	50786.725	102	33	69	41	40	0
cvc5 - fixedn	0	80	56225.28	56566.992	80	2	78	63	30	0
cvc5	0	80	57483.019	57782.06	80	2	78	63	32	0
2020-CVC4n	0	33	53945.942	54288.79	33	0	33	110	28	0
UltimateEliminator+MathSAT	0	6	13033.666	12513.401	6	0	6	137	4	5

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-z3n	0	36	1170.374	1169.748	36	36	0	0	107	36	0
2018-Z3n	0	34	2971.38	2971.558	34	34	0	2	107	36	0
z3n	0	33	4108.434	4108.544	33	33	0	3	107	40	0
cvc5 - fixedn	0	2	24929.648	25141.497	2	2	0	34	107	30	0
cvc5	0	2	24996.079	25199.146	2	2	0	34	107	32	0
UltimateEliminator+MathSAT	0	0	2098.536	2002.38	0	0	0	36	107	4	5
2020-CVC4n	0	0	22461.356	22587.672	0	0	0	36	107	28	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	78	8170.96	8217.433	78	0	78	6	59	32	0
cvc5 - fixedn	0	78	8178.799	8233.292	78	0	78	6	59	30	0
2018-Z3n	0	72	14723.815	14723.838	72	0	72	12	59	36	0
2020-z3n	0	70	17360.992	17361.085	70	0	70	14	59	36	0
z3n	0	69	19939.434	19939.805	69	0	69	15	59	40	0
2020-CVC4n	0	33	9254.882	9328.984	33	0	33	51	59	28	0
UltimateEliminator+MathSAT	0	6	3424.538	3080.6	6	0	6	78	59	4	5

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2018-Z3n	0	94	1257.607	1257.622	94	26	68	49	49	0
2020-z3n	0	94	1297.793	1296.777	94	31	63	49	49	0
z3n	0	89	1406.019	1406.125	89	29	60	54	54	0
cvc5	0	61	2129.905	2129.912	61	0	61	82	82	0
cvc5 - fixedn	0	61	2130.178	2130.178	61	0	61	82	82	0
2020-CVC4n	0	19	1850.178	1850.268	19	0	19	124	71	0
UltimateEliminator+MathSAT	0	6	1356.888	1003.216	6	0	6	137	11	5

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.