AUFLIA (Single Query Track)

Competition results for the AUFLIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:53 +0000

Benchmarks: 1663
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	Vampire	Vampire

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-cvc5n	0	1411	22274.259	22587.21	1411	150	1261	252	208	0
cvc5	0	1404	22262.699	22797.549	1404	148	1256	259	215	0
Vampire	0	1393	11474.685	3030.384	1393	111	1282	270	270	0
iProver	0	1231	14470.972	4213.182	1231	0	1231	432	326	0
iProver Fixedn	0	1230	12870.243	3803.3	1230	0	1230	433	327	0
SMTInterpol	0	1140	24746.189	20436.598	1140	95	1045	523	408	0
UltimateEliminator+MathSAT	0	65	347.768	196.493	65	14	51	1598	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-cvc5n	0	1411	22274.259	22587.21	1411	150	1261	252	208	0
cvc5	0	1404	22262.699	22797.549	1404	148	1256	259	215	0
Vampire	0	1399	23353.165	6016.461	1399	111	1288	264	264	0
iProver	0	1237	30318.742	8227.898	1237	0	1237	426	307	0
iProver Fixedn	0	1237	31070.953	8399.311	1237	0	1237	426	306	0
SMTInterpol	0	1140	24746.189	20436.598	1140	95	1045	523	392	0
UltimateEliminator+MathSAT	0	65	347.768	196.493	65	14	51	1598	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2022-cvc5n	0	150	11634.132	11744.337	150	150	0	23	1490	208	0
cvc5	0	148	10668.255	10760.504	148	148	0	25	1490	215	0
Vampire	0	111	16.86	11.537	111	111	0	62	1490	264	0
SMTInterpol	0	95	65.136	48.8	95	95	0	78	1490	392	0
UltimateEliminator+MathSAT	0	14	66.594	40.256	14	14	0	159	1490	0	0
iProver	0	0	0.0	0.0	0	0	0	173	1490	307	0
iProver Fixedn	0	0	0.0	0.0	0	0	0	173	1490	306	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Vampire	0	1288	23336.305	6004.924	1288	0	1288	18	357	264	0
2022-cvc5n	0	1261	10640.127	10842.872	1261	0	1261	45	357	208	0
cvc5	0	1256	11594.444	12037.045	1256	0	1256	50	357	215	0
iProver	0	1237	30318.742	8227.898	1237	0	1237	69	357	307	0
iProver Fixedn	0	1237	31070.953	8399.311	1237	0	1237	69	357	306	0
SMTInterpol	0	1045	24681.053	20387.798	1045	0	1045	261	357	392	0
UltimateEliminator+MathSAT	0	51	281.174	156.237	51	0	51	1255	357	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Vampire	0	1367	1327.635	474.28	1367	111	1256	296	296	0
2022-cvc5n	0	1266	297.332	297.991	1266	108	1158	397	361	0
cvc5	0	1260	219.017	221.199	1260	107	1153	403	369	0
iProver	0	1192	5298.684	1853.483	1192	0	1192	471	373	0
iProver Fixedn	0	1190	4923.741	1767.384	1190	0	1190	473	374	0
SMTInterpol	0	1056	3704.693	1663.907	1056	95	961	607	503	0
UltimateEliminator+MathSAT	0	65	347.768	196.493	65	14	51	1598	21	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.