UFDTNIRA (Single Query Track)

Competition results for the UFDTNIRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 2149
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
cvc5	cvc5	—	cvc5	cvc5

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	1965	26593.605	26599.226	1965	0	1965	184	22	0
cvc5	0	1959	131985.13	132004.481	1959	0	1959	190	108	0
z3-4.8.17n	0	1929	229725.267	229759.556	1929	15	1914	220	190	0
Vampire	0	1795	566819.11	453670.133	1795	0	1795	354	346	0
UltimateEliminator+MathSAT	0	0	10015.212	5921.427	0	0	0	2149	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	1965	26597.985	26597.916	1965	0	1965	184	22	0
cvc5	0	1959	132000.66	131999.391	1959	0	1959	190	108	0
z3-4.8.17n	0	1929	229755.047	229751.576	1929	15	1914	220	190	0
Vampire	0	1824	672973.16	436201.984	1824	0	1824	325	315	0
UltimateEliminator+MathSAT	0	0	10015.212	5921.427	0	0	0	2149	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	15	4.127	4.099	15	15	0	0	2134	190	0
UltimateEliminator+MathSAT	0	0	68.091	40.373	0	0	0	15	2134	0	0
2020-CVC4n	0	0	1200.431	1200.428	0	0	0	15	2134	22	0
cvc5	0	0	1201.344	1201.336	0	0	0	15	2134	108	0
Vampire	0	0	18000.0	18000.0	0	0	0	15	2134	315	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
2020-CVC4n	0	1965	13390.218	13390.161	1965	0	1965	19	165	22	0
cvc5	0	1959	11752.533	11751.24	1959	0	1959	25	165	108	0
z3-4.8.17n	0	1914	69946.791	69943.362	1914	0	1914	70	165	190	0
Vampire	0	1824	453371.78	238219.254	1824	0	1824	160	165	315	0
UltimateEliminator+MathSAT	0	0	9263.65	5468.786	0	0	0	1984	165	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2020-CVC4n	0	1965	725.985	725.916	1965	0	1965	184	22	0
cvc5	0	1958	3404.331	3402.657	1958	0	1958	191	116	0
z3-4.8.17n	0	1925	4971.268	4967.667	1925	15	1910	224	198	0
Vampire	0	1441	18933.509	17583.155	1441	0	1441	708	703	0
UltimateEliminator+MathSAT	0	0	10015.212	5921.427	0	0	0	2149	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.