AUFBVFP (Single Query Track)

Competition results for the AUFBVFP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 57
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	—	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	22	44418.936	44429.031	22	0	22	35	35	0
cvc5	0	19	40544.481	45684.95	19	0	19	38	33	0
2021-cvc5n	0	17	19567.074	46855.598	17	0	17	40	36	0
z3-4.8.17n	0	6	56398.411	56413.545	6	2	4	51	45	0
UltimateEliminator+MathSAT	0	0	28170.352	28165.531	0	0	0	57	23	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	22	44426.506	44427.291	22	0	22	35	35	0
cvc5	0	19	45112.671	45683.13	19	0	19	38	33	0
2021-cvc5n	0	17	46460.47	46853.688	17	0	17	40	36	0
z3-4.8.17n	0	6	56410.911	56411.235	6	2	4	51	45	0
UltimateEliminator+MathSAT	0	0	28170.352	28165.531	0	0	0	57	23	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	2	38.515	38.514	2	2	0	0	55	45	0
UltimateEliminator+MathSAT	0	0	1206.69	1207.337	0	0	0	2	55	23	0
2021-cvc5n	0	0	1873.391	1874.048	0	0	0	2	55	36	0
cvc5	0	0	1894.754	1897.875	0	0	0	2	55	33	0
Bitwuzla	0	0	2400.0	2400.0	0	0	0	2	55	35	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	22	4826.506	4827.291	22	0	22	2	33	35	0
cvc5	0	19	9392.157	9892.465	19	0	19	5	33	33	0
2021-cvc5n	0	17	9840.023	10162.725	17	0	17	7	33	36	0
z3-4.8.17n	0	4	22899.036	22899.286	4	0	4	20	33	45	0
UltimateEliminator+MathSAT	0	0	11223.868	11211.66	0	0	0	24	33	23	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	15	1053.87	1053.883	15	0	15	42	42	0
cvc5	0	14	1164.006	1164.013	14	0	14	43	43	0
2021-cvc5n	0	13	1161.854	1161.87	13	0	13	44	44	0
z3-4.8.17n	0	2	1298.441	1298.435	2	1	1	55	53	0
UltimateEliminator+MathSAT	0	0	802.279	830.706	0	0	0	57	24	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.