QF_UFIDL (Single Query Track)

Competition results for the QF_UFIDL logic in the Single Query Track.

Page generated on 2021-07-18 17:29:07 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
SMTInterpol	SMTInterpol	SMTInterpol	Yices2	veriT

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
SMTInterpol	0	252	81451.105	76917.734	252	89	163	48	48	0
z3n	0	248	80566.473	80576.219	248	71	177	52	52	0
2019-Yices 2.6.2n	0	238	95976.925	95985.062	238	66	172	62	62	0
Yices2	0	237	95036.279	95046.186	237	66	171	63	63	0
cvc5	0	231	116619.515	116631.741	231	69	162	69	69	0
cvc5 - fixedn	0	230	116716.162	116733.72	230	69	161	70	70	0
veriT	0	224	99156.663	99158.592	224	82	142	76	73	0
MathSAT5n	0	224	107928.039	107940.491	224	44	180	76	76	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
SMTInterpol	0	253	81483.595	76807.534	253	89	164	47	47	0
z3n	0	248	80571.613	80573.919	248	71	177	52	52	0
2019-Yices 2.6.2n	0	238	95982.335	95983.172	238	66	172	62	62	0
Yices2	0	237	95042.519	95044.436	237	66	171	63	63	0
cvc5	0	231	116629.265	116629.341	231	69	162	69	69	0
cvc5 - fixedn	0	230	116724.852	116730.57	230	69	161	70	70	0
veriT	0	224	99161.983	99156.432	224	82	142	76	73	0
MathSAT5n	0	224	107941.139	107936.601	224	44	180	76	76	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
SMTInterpol	0	89	5069.211	4386.102	89	89	0	1	210	47	0
veriT	0	82	13963.548	13957.119	82	82	0	8	210	73	0
z3n	0	71	25356.805	25357.075	71	71	0	19	210	52	0
cvc5 - fixedn	0	69	34193.511	34195.235	69	69	0	21	210	70	0
cvc5	0	69	34287.985	34290.369	69	69	0	21	210	69	0
Yices2	0	66	37133.828	37134.999	66	66	0	24	210	63	0
2019-Yices 2.6.2n	0	66	37496.796	37497.76	66	66	0	24	210	62	0
MathSAT5n	0	44	55220.936	55220.939	44	44	0	46	210	76	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
MathSAT5n	0	180	52720.203	52715.662	180	0	180	30	90	76	0
z3n	0	177	55214.808	55216.844	177	0	177	33	90	52	0
2019-Yices 2.6.2n	0	172	58485.539	58485.411	172	0	172	38	90	62	0
Yices2	0	171	57908.691	57909.437	171	0	171	39	90	63	0
SMTInterpol	0	164	76414.384	72421.432	164	0	164	46	90	47	0
cvc5	0	162	82341.28	82338.972	162	0	162	48	90	69	0
cvc5 - fixedn	0	161	82531.341	82535.335	161	0	161	49	90	70	0
veriT	0	142	85198.435	85199.312	142	0	142	68	90	73	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3n	0	214	2318.326	2318.751	214	67	147	86	86	0
veriT	0	199	2828.772	2822.04	199	71	128	101	101	0
2019-Yices 2.6.2n	0	195	2641.938	2640.446	195	44	151	105	105	0
Yices2	0	195	2643.413	2643.526	195	44	151	105	105	0
SMTInterpol	0	188	5095.746	3740.105	188	69	119	112	112	0
MathSAT5n	0	168	3714.088	3706.726	168	44	124	132	132	0
cvc5	0	138	4423.64	4418.309	138	45	93	162	162	0
cvc5 - fixedn	0	138	4421.639	4421.718	138	45	93	162	162	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.