QF_UFIDL (Single Query Track)

Competition results for the QF_UFIDL logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 300
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
OpenSMT	OpenSMT	OpenSMT	OpenSMT	Yices2

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
OpenSMT	0	277	22420.784	22415.854	277	98	179	23	23	0
2022-z3-4.8.17n	0	259	15625.638	15624.384	259	91	168	41	41	0
cvc5	0	238	35820.93	35764.468	238	86	152	62	62	0
Yices2	0	236	20403.149	20403.72	236	66	170	64	64	0
SMTInterpol	0	224	18691.481	14335.556	224	91	133	76	76	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
OpenSMT	0	277	22420.784	22415.854	277	98	179	23	23	0
2022-z3-4.8.17n	0	259	15625.638	15624.384	259	91	168	41	41	0
cvc5	0	238	35820.93	35764.468	238	86	152	62	62	0
Yices2	0	236	20403.149	20403.72	236	66	170	64	64	0
SMTInterpol	0	231	28164.601	20736.044	231	92	139	69	69	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
OpenSMT	0	98	4722.812	4723.549	98	98	0	4	198	23	0
SMTInterpol	0	92	12205.09	11406.105	92	92	0	10	198	69	0
2022-z3-4.8.17n	0	91	2532.237	2531.291	91	91	0	11	198	41	0
cvc5	0	86	16303.817	16307.02	86	86	0	16	198	62	0
Yices2	0	66	10209.303	10209.077	66	66	0	36	198	64	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
OpenSMT	0	179	17697.972	17692.305	179	0	179	19	102	23	0
Yices2	0	170	10193.846	10194.642	170	0	170	28	102	64	0
2022-z3-4.8.17n	0	168	13093.401	13093.092	168	0	168	30	102	41	0
cvc5	0	152	19517.113	19457.449	152	0	152	46	102	62	0
SMTInterpol	0	139	15959.511	9329.939	139	0	139	59	102	69	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
2022-z3-4.8.17n	0	227	316.366	313.881	227	86	141	73	73	0
Yices2	0	193	129.156	127.902	193	48	145	107	107	0
OpenSMT	0	186	853.703	846.073	186	73	113	114	114	0
SMTInterpol	0	166	2288.336	943.824	166	56	110	134	134	0
cvc5	0	136	430.529	430.657	136	48	88	164	164	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.