QF_LRA (Cloud Track)

Competition results for the QF_LRA logic in the Cloud Track.

Page generated on 2022-08-10 14:49:53 +0000

Benchmarks: 18
Time Limit: 1200 seconds
Memory Limit: N/A GB

This track is experimental. Solvers are only ranked by performance, but no winner is selected.

Parallel Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
SMTS portfolio	1	16	4367.12	16	5	11	3	0	0
SMTS cube-and-conquer	3	14	6302.134	14	3	11	5	0	0
SMTS cube-and-conquer (fixed)	4	14	3233.629	14	2	12	5	0	0
cvc5-cloud	10	4	18904.175	4	2	2	15	0	0

SAT Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
SMTS portfolio	1	5	1776.015	5	5	0	1	12	0	0
SMTS cube-and-conquer (fixed)	2	2	2338.112	2	2	0	4	12	0	0
SMTS cube-and-conquer	3	3	3578.498	3	3	0	3	12	0	0
cvc5-cloud	4	2	5615.68	2	2	0	4	12	0	0

UNSAT Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
SMTS portfolio	0	11	1602.533	11	0	11	1	6	0	0
SMTS cube-and-conquer	0	11	1739.069	11	0	11	1	6	0	0
SMTS cube-and-conquer (fixed)	2	12	462.425	12	0	12	0	6	0	0
cvc5-cloud	6	2	12088.495	2	0	2	10	6	0	0

24 seconds Performance

Solver	Error Score	Correct Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
SMTS portfolio	0	7	362.177	7	2	5	12	12	0
SMTS cube-and-conquer	0	7	387.461	7	1	6	12	12	0
cvc5-cloud	0	1	434.566	1	0	1	18	18	0
SMTS cube-and-conquer (fixed)	2	6	387.47	6	1	5	13	11	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.