QF_BVFP (Single Query Track)

Competition results for the QF_BVFP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 465
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	465	2645.652	2633.804	465	195	270	0	0	0
2021-cvc5n	0	463	5666.608	5653.003	463	195	268	2	2	0
cvc5	0	463	6712.252	6675.592	463	195	268	2	2	0
MathSATn	0	457	13878.234	13875.403	457	195	262	8	8	0
z3-4.8.17n	0	455	19852.05	21026.71	455	195	260	10	8	0
COLIBRI	0	410	28165.213	28160.346	410	189	221	55	21	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	465	2645.652	2633.804	465	195	270	0	0	0
2021-cvc5n	0	463	5667.998	5652.963	463	195	268	2	2	0
cvc5	0	463	6712.482	6675.492	463	195	268	2	2	0
MathSATn	0	457	13879.244	13875.123	457	195	262	8	8	0
z3-4.8.17n	0	455	19853.28	21026.45	455	195	260	10	8	0
COLIBRI	0	410	28165.213	28160.346	410	189	221	55	21	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	195	205.256	205.341	195	195	0	0	270	0	0
MathSATn	0	195	424.81	424.383	195	195	0	0	270	8	0
2021-cvc5n	0	195	543.552	538.969	195	195	0	0	270	2	0
cvc5	0	195	892.394	884.414	195	195	0	0	270	2	0
z3-4.8.17n	0	195	1811.488	1811.527	195	195	0	0	270	8	0
COLIBRI	0	189	3695.778	3691.129	189	189	0	6	270	21	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	270	2440.396	2428.463	270	0	270	0	195	0	0
2021-cvc5n	0	268	5124.446	5113.993	268	0	268	2	195	2	0
cvc5	0	268	5820.088	5791.079	268	0	268	2	195	2	0
MathSATn	0	262	13454.434	13450.74	262	0	262	8	195	8	0
z3-4.8.17n	0	260	18041.792	19214.924	260	0	260	10	195	8	0
COLIBRI	0	221	24469.435	24469.216	221	0	221	49	195	21	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	451	854.028	841.933	451	194	257	14	14	0
2021-cvc5n	0	444	1932.482	1917.023	444	192	252	21	21	0
cvc5	0	437	2108.195	2070.856	437	187	250	28	28	0
MathSATn	0	432	1608.583	1603.467	432	192	240	33	33	0
z3-4.8.17n	0	411	2672.902	2672.529	411	185	226	54	54	0
COLIBRI	0	400	1175.794	1170.657	400	188	212	65	31	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.