QF_ABV (Single Query Track)

Competition results for the QF_ABV logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 1830
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	1804	43381.309	43378.32	1804	1147	657	26	26	0
2020-Bitwuzlan	0	1804	44686.66	44698.613	1804	1147	657	26	26	0
Yices2	0	1792	64887.465	64881.042	1792	1140	652	38	38	0
MathSATn	0	1749	115661.874	115670.048	1749	1110	639	81	76	5
z3-4.8.17n	0	1730	147041.386	147009.439	1730	1100	630	100	100	0
cvc5	0	1728	136975.371	140342.913	1728	1101	627	102	102	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	1804	43384.629	43377.18	1804	1147	657	26	26	0
2020-Bitwuzlan	0	1804	44689.16	44697.693	1804	1147	657	26	26	0
Yices2	0	1792	64893.715	64879.592	1792	1140	652	38	38	0
MathSATn	0	1749	115676.954	115665.978	1749	1110	639	81	76	5
z3-4.8.17n	0	1730	147056.516	147005.399	1730	1100	630	100	100	0
cvc5	0	1728	140179.512	140337.703	1728	1101	627	102	102	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	1147	8146.769	8138.722	1147	1147	0	2	681	26	0
2020-Bitwuzlan	0	1147	8672.501	8677.686	1147	1147	0	2	681	26	0
Yices2	0	1140	19095.068	19081.06	1140	1140	0	9	681	38	0
MathSATn	0	1110	57217.687	57215.968	1110	1110	0	39	681	76	5
cvc5	0	1101	66281.577	66448.684	1101	1101	0	48	681	102	0
z3-4.8.17n	0	1100	74673.091	74674.951	1100	1100	0	49	681	100	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	657	35237.861	35238.458	657	0	657	24	1149	26	0
2020-Bitwuzlan	0	657	36016.659	36020.007	657	0	657	24	1149	26	0
Yices2	0	652	45798.647	45798.531	652	0	652	29	1149	38	0
MathSATn	0	639	58459.267	58450.01	639	0	639	42	1149	76	5
z3-4.8.17n	0	630	72383.425	72330.448	630	0	630	51	1149	100	0
cvc5	0	627	73897.934	73889.019	627	0	627	54	1149	102	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	1736	3403.655	3393.456	1736	1103	633	94	94	0
2020-Bitwuzlan	0	1733	3377.393	3382.386	1733	1100	633	97	97	0
Yices2	0	1719	3847.769	3830.158	1719	1103	616	111	111	0
MathSATn	0	1663	6327.321	6312.927	1663	1062	601	167	162	5
cvc5	0	1653	8332.959	8266.676	1653	1056	597	177	177	0
z3-4.8.17n	0	1650	5832.688	5809.305	1650	1054	596	180	180	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.