AUFDTLIA (Single Query Track)

Competition results for the AUFDTLIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:53 +0000

Benchmarks: 188
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-cvc5n	0	181	22243.838	22582.646	181	93	88	7	7	0
cvc5	0	181	23231.562	24176.995	181	93	88	7	7	0
SMTInterpol	0	88	2068.289	1376.188	88	1	87	100	35	0
Vampire	0	88	7836.673	1982.745	88	0	88	100	100	0
iProver	0	41	14564.667	3713.47	41	0	41	147	145	0
iProver Fixedn	0	38	13746.071	3516.44	38	0	38	150	148	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-cvc5n	0	181	22243.838	22582.646	181	93	88	7	7	0
cvc5	0	181	23231.562	24176.995	181	93	88	7	7	0
SMTInterpol	0	88	2068.289	1376.188	88	1	87	100	35	0
Vampire	0	88	7836.673	1982.745	88	0	88	100	100	0
iProver	0	56	50168.247	12777.043	56	0	56	132	109	0
iProver Fixedn	0	54	51263.991	13109.545	54	0	54	134	111	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-cvc5n	0	93	22060.205	22398.902	93	93	0	0	95	7	0
cvc5	0	93	23131.049	24076.472	93	93	0	0	95	7	0
SMTInterpol	0	1	0.858	0.512	1	1	0	92	95	35	0
Vampire	0	0	0.0	0.0	0	0	0	93	95	100	0
iProver	0	0	0.0	0.0	0	0	0	93	95	109	0
iProver Fixedn	0	0	0.0	0.0	0	0	0	93	95	111	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	88	100.513	100.523	88	0	88	0	100	7	0
2022-cvc5n	0	88	183.633	183.744	88	0	88	0	100	7	0
Vampire	0	88	7836.673	1982.745	88	0	88	0	100	100	0
SMTInterpol	0	87	2067.431	1375.676	87	0	87	1	100	35	0
iProver	0	56	50168.247	12777.043	56	0	56	32	100	109	0
iProver Fixedn	0	54	51263.991	13109.545	54	0	54	34	100	111	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	133	116.297	131.787	133	45	88	55	55	0
2022-cvc5n	0	133	199.852	200.662	133	45	88	55	55	0
SMTInterpol	0	78	733.578	251.175	78	1	77	110	53	0
Vampire	0	68	1788.787	457.813	68	0	68	120	120	0
iProver	0	12	81.181	25.326	12	0	12	176	176	0
iProver Fixedn	0	12	114.077	33.862	12	0	12	176	176	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.