QF_IDL (Cloud Track)

Competition results for the QF_IDL logic in the Cloud Track.

Page generated on 2022-08-10 14:49:53 +0000

Benchmarks: 58
Time Limit: 1200 seconds
Memory Limit: N/A GB

This track is experimental. Solvers are only ranked by performance, but no winner is selected.

Parallel Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5-cloud	42	9	65054.076	9	2	7	54	0	0
SMTS cube-and-conquer (fixed)	44	1	41096.535	1	1	0	62	0	0
SMTS cube-and-conquer	45	0	28549.919	0	0	0	63	0	0
SMTS portfolio	45	0	33298.7	0	0	0	63	0	0

SAT Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5-cloud	23	2	27858.359	2	2	0	23	33	0	0
SMTS cube-and-conquer (fixed)	23	1	14597.214	1	1	0	24	33	0	0
SMTS cube-and-conquer	24	0	8179.114	0	0	0	25	33	0	0
SMTS portfolio	24	0	11940.137	0	0	0	25	33	0	0

UNSAT Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
cvc5-cloud	19	7	22795.717	7	0	7	19	32	0	0
SMTS cube-and-conquer	21	0	14177.271	0	0	0	26	32	0	0
SMTS cube-and-conquer (fixed)	21	0	15171.921	0	0	0	26	32	0	0
SMTS portfolio	21	0	16339.752	0	0	0	26	32	0	0

24 seconds Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
cvc5-cloud	1	5	1393.347	5	0	5	58	57	0
SMTS cube-and-conquer (fixed)	6	1	1493.256	1	1	0	62	54	0
SMTS cube-and-conquer	6	0	1497.725	0	0	0	63	53	0
SMTS portfolio	6	0	1509.535	0	0	0	63	53	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.