QF_ANIA (Single Query Track)

Competition results for the QF_ANIA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:05 +0000

Benchmarks: 94
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	88	7774.41	7776.256	88	81	7	6	6	0
2019-CVC4n	0	88	7940.203	7942.623	88	82	6	6	6	0
cvc5 - fixedn	0	86	12145.011	12148.519	86	79	7	8	8	0
cvc5	0	86	12163.999	12155.271	86	79	7	8	8	0
MathSAT5n	0	83	6155.214	6156.233	83	80	3	11	4	0
z3n	0	49	56296.498	56310.318	49	42	7	45	45	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	88	7775.81	7775.936	88	81	7	6	6	0
2019-CVC4n	0	88	7942.143	7942.373	88	82	6	6	6	0
cvc5 - fixedn	0	86	12147.371	12148.029	86	79	7	8	8	0
cvc5	0	86	12166.399	12154.741	86	79	7	8	8	0
MathSAT5n	0	83	6155.774	6156.103	83	80	3	11	4	0
z3n	0	49	56307.958	56308.298	49	42	7	45	45	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2019-CVC4n	0	82	5440.728	5440.955	82	82	0	4	8	6	0
2020-CVC4n	0	81	6202.41	6202.409	81	81	0	5	8	6	0
MathSAT5n	0	80	22.272	22.281	80	80	0	6	8	4	0
cvc5 - fixedn	0	79	10547.019	10547.663	79	79	0	7	8	8	0
cvc5	0	79	10567.022	10555.223	79	79	0	7	8	8	0
z3n	0	42	55039.004	55039.326	42	42	0	44	8	45	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3n	0	7	1268.954	1268.973	7	0	7	1	86	45	0
2020-CVC4n	0	7	1573.4	1573.527	7	0	7	1	86	6	0
cvc5	0	7	1599.377	1599.518	7	0	7	1	86	8	0
cvc5 - fixedn	0	7	1600.352	1600.366	7	0	7	1	86	8	0
2019-CVC4n	0	6	2501.415	2501.418	6	0	6	2	86	6	0
MathSAT5n	0	3	6133.502	6133.822	3	0	3	5	86	4	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	82	433.894	433.89	82	79	3	12	12	0
MathSAT5n	0	81	172.364	172.373	81	80	1	13	6	0
2019-CVC4n	0	81	433.056	433.052	81	78	3	13	13	0
cvc5	0	74	584.816	572.344	74	71	3	20	20	0
cvc5 - fixedn	0	74	572.414	572.405	74	71	3	20	20	0
z3n	0	42	1303.741	1303.749	42	36	6	52	52	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.