AUFDTLIA (Single Query Track)

Competition results for the AUFDTLIA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 188
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	181	31033.522	32204.04	181	93	88	7	7	0
2020-CVC4n	0	181	31040.153	32019.641	181	93	88	7	7	0
z3-4.8.17n	0	138	59940.025	59949.865	138	45	93	50	49	0
Vampire	0	88	127912.069	122000.233	88	0	88	100	100	0
UltimateEliminator+MathSAT	0	0	871.749	520.695	0	0	0	188	0	0
smtinterpol-fixedn	1	88	45977.485	44953.061	88	1	87	100	35	0
smtinterpol	1	75	50253.6	49301.196	75	1	74	113	39	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	181	31706.893	32019.301	181	93	88	7	7	0
cvc5	0	181	31826.412	32203.64	181	93	88	7	7	0
z3-4.8.17n	0	138	59947.735	59947.685	138	45	93	50	49	0
Vampire	0	88	149513.159	121966.783	88	0	88	100	100	0
UltimateEliminator+MathSAT	0	0	871.749	520.695	0	0	0	188	0	0
smtinterpol-fixedn	1	88	45977.485	44953.061	88	1	87	100	35	0
smtinterpol	1	75	50253.6	49301.196	75	1	74	113	39	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-CVC4n	0	93	22884.436	23194.177	93	93	0	0	95	7	0
cvc5	0	93	23242.338	23619.561	93	93	0	0	95	7	0
z3-4.8.17n	0	45	57006.519	57006.573	45	45	0	48	95	49	0
UltimateEliminator+MathSAT	0	0	422.124	253.562	0	0	0	93	95	0	0
Vampire	0	0	133201.09	111566.55	0	0	0	93	95	100	0
smtinterpol-fixedn	1	1	37508.242	37314.241	1	1	0	92	95	35	0
smtinterpol	1	1	39745.559	39586.053	1	1	0	92	95	39	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	93	2941.216	2941.112	93	0	93	2	93	49	0
cvc5	0	88	8584.075	8584.079	88	0	88	7	93	7	0
2020-CVC4n	0	88	8822.456	8825.124	88	0	88	7	93	7	0
Vampire	0	88	16312.069	10400.233	88	0	88	7	93	100	0
smtinterpol-fixedn	0	87	8469.244	7638.82	87	0	87	8	93	35	0
smtinterpol	0	74	10508.041	9715.143	74	0	74	21	93	39	0
UltimateEliminator+MathSAT	0	0	449.625	267.133	0	0	0	95	93	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	133	1520.013	1520.931	133	45	88	55	55	0
2020-CVC4n	0	132	1480.23	1480.439	132	45	87	56	56	0
z3-4.8.17n	0	131	1385.599	1385.353	131	45	86	57	57	0
smtinterpol-fixedn	0	79	2198.041	1524.313	79	1	78	109	49	0
smtinterpol	0	74	2214.092	1481.272	74	1	73	114	46	0
Vampire	0	68	4444.204	3285.922	68	0	68	120	120	0
UltimateEliminator+MathSAT	0	0	871.749	520.695	0	0	0	188	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.