AUFBV (Single Query Track)

Competition results for the AUFBV logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 761
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	cvc5	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	307	564861.077	564972.11	307	4	303	454	454	0
z3-4.8.17n	0	202	640955.456	641053.68	202	73	129	559	490	12
cvc5	0	195	597010.207	645219.174	195	6	189	566	465	0
2021-cvc5n	0	170	340356.472	669753.434	170	5	165	591	518	0
UltimateEliminator+MathSAT	0	7	843811.324	842710.085	7	0	7	754	694	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	307	564948.967	564952.54	307	4	303	454	454	0
z3-4.8.17n	0	202	641044.156	641031.64	202	73	129	559	490	12
cvc5	0	195	640832.573	645193.404	195	6	189	566	465	0
2021-cvc5n	0	170	668010.224	669724.774	170	5	165	591	518	0
UltimateEliminator+MathSAT	0	7	843813.544	842709.975	7	0	7	754	694	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	73	5884.363	5885.16	73	73	0	3	685	490	12
cvc5	0	6	44767.442	45657.582	6	6	0	70	685	465	0
2021-cvc5n	0	5	52171.298	52699.962	5	5	0	71	685	518	0
Bitwuzla	0	4	87794.05	87794.155	4	4	0	72	685	454	0
UltimateEliminator+MathSAT	0	0	78267.492	78104.766	0	0	0	76	685	694	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	303	52354.917	52358.385	303	0	303	28	430	454	0
cvc5	0	189	183692.348	186182.998	189	0	189	142	430	465	0
2021-cvc5n	0	165	198839.076	199653.785	165	0	165	166	430	518	0
z3-4.8.17n	0	129	244810.852	244794.776	129	0	129	202	430	490	12
UltimateEliminator+MathSAT	0	7	346904.082	346028.08	7	0	7	324	430	694	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	206	14095.285	14095.426	206	2	204	555	555	0
2021-cvc5n	0	142	15327.673	15300.133	142	2	140	619	609	0
cvc5	0	142	15313.642	15322.209	142	2	140	619	608	0
z3-4.8.17n	0	138	15533.299	15514.227	138	58	80	623	610	12
UltimateEliminator+MathSAT	0	5	18227.844	17871.236	5	0	5	756	728	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.