BVFP (Single Query Track)

Competition results for the BVFP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 205
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	177	31681.238	31688.136	177	165	12	28	24	0
cvc5	0	171	48662.935	48996.938	171	164	7	34	34	0
Bitwuzla	0	148	68193.382	68164.812	148	134	14	57	56	0
2021-cvc5n	0	128	92794.235	94019.204	128	121	7	77	77	0
UltimateEliminator+MathSAT	0	25	1379.402	980.684	25	25	0	180	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	177	31686.958	31687.046	177	165	12	28	24	0
cvc5	0	171	48809.565	48995.408	171	164	7	34	34	0
Bitwuzla	0	148	68201.652	68162.652	148	134	14	57	56	0
2021-cvc5n	0	128	94011.342	94015.644	128	121	7	77	77	0
UltimateEliminator+MathSAT	0	25	1379.402	980.684	25	25	0	180	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	165	27153.574	27153.588	165	165	0	22	18	24	0
cvc5	0	164	34678.917	34864.545	164	164	0	23	18	34	0
Bitwuzla	0	134	62504.474	62465.199	134	134	0	53	18	56	0
2021-cvc5n	0	121	80130.154	80134.077	121	121	0	66	18	77	0
UltimateEliminator+MathSAT	0	25	1283.094	903.861	25	25	0	162	18	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	14	897.179	897.454	14	0	14	0	191	56	0
z3-4.8.17n	0	12	3303.811	3303.87	12	0	12	2	191	24	0
2021-cvc5n	0	7	9081.188	9081.567	7	0	7	7	191	77	0
cvc5	0	7	9330.648	9330.863	7	0	7	7	191	34	0
UltimateEliminator+MathSAT	0	0	77.183	60.99	0	0	0	14	191	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	167	1020.814	1020.522	167	160	7	38	35	0
Bitwuzla	0	145	1474.804	1474.82	145	133	12	60	59	0
cvc5	0	139	1614.09	1614.041	139	139	0	66	66	0
2021-cvc5n	0	121	2052.969	2052.384	121	118	3	84	84	0
UltimateEliminator+MathSAT	0	19	1209.106	825.343	19	19	0	186	6	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.