UFNIA (Single Query Track)

Competition results for the UFNIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 6279
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	cvc5	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	3623	122297.938	125475.911	3623	742	2881	2656	2647	0
2022-cvc5n	0	3588	137415.366	139922.33	3588	741	2847	2691	2684	0
Vampire	0	2436	279879.777	70788.321	2436	0	2436	3843	3843	0
iProver	0	1486	128646.631	33632.893	1486	0	1486	4793	4793	0
iProver Fixedn	0	1465	119007.13	31016.174	1465	0	1465	4814	4814	0
UltimateEliminator+MathSAT	0	608	11637.288	10430.454	608	426	182	5671	529	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	3623	122297.938	125475.911	3623	742	2881	2656	2647	0
2022-cvc5n	0	3588	137415.366	139922.33	3588	741	2847	2691	2684	0
Vampire	0	2738	944263.147	237815.669	2738	0	2738	3541	3539	0
iProver	0	1690	500889.071	128099.717	1690	0	1690	4589	4589	0
iProver Fixedn	0	1667	451840.86	115459.946	1667	0	1667	4612	4612	0
UltimateEliminator+MathSAT	0	608	11637.288	10430.454	608	426	182	5671	529	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	742	23882.119	23928.202	742	742	0	6	5531	2647	0
2022-cvc5n	0	741	29139.899	29266.639	741	741	0	7	5531	2684	0
UltimateEliminator+MathSAT	0	426	10386.566	9536.193	426	426	0	322	5531	529	0
Vampire	0	0	0.0	0.0	0	0	0	748	5531	3539	0
iProver	0	0	0.0	0.0	0	0	0	748	5531	4589	0
iProver Fixedn	0	0	0.0	0.0	0	0	0	748	5531	4612	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5	0	2881	98415.818	101547.708	2881	0	2881	289	3109	2647	0
2022-cvc5n	0	2847	108275.467	110655.691	2847	0	2847	323	3109	2684	0
Vampire	0	2738	944263.147	237815.669	2738	0	2738	432	3109	3539	0
iProver	0	1690	500889.071	128099.717	1690	0	1690	1480	3109	4589	0
iProver Fixedn	0	1667	451840.86	115459.946	1667	0	1667	1503	3109	4612	0
UltimateEliminator+MathSAT	0	182	1250.723	894.261	182	0	182	2988	3109	529	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5	0	2988	2717.017	2679.795	2988	688	2300	3291	3286	0
2022-cvc5n	0	2922	3164.986	3108.219	2922	676	2246	3357	3352	0
Vampire	0	1552	17569.891	4597.17	1552	0	1552	4727	4727	0
iProver	0	1241	15918.718	4582.613	1241	0	1241	5038	5038	0
iProver Fixedn	0	1235	15235.967	4434.09	1235	0	1235	5044	5044	0
UltimateEliminator+MathSAT	0	569	4118.092	3003.98	569	389	180	5710	630	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.