QF_ALIA (Single Query Track)

Competition results for the QF_ALIA logic in the Single Query Track.

Page generated on 2023-07-06 16:04:54 +0000

Benchmarks: 166
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
SMTInterpol	SMTInterpol	SMTInterpol	Yices2	Yices2

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
SMTInterpol	0	163	4786.798	3840.137	163	101	62	3	3	0
OpenSMT	0	162	12020.747	11967.883	162	100	62	4	4	0
Yices2	0	152	1564.692	1565.105	152	90	62	14	14	0
2022-z3-4.8.17n	0	145	10771.061	10772.292	145	83	62	21	21	0
cvc5	0	114	13447.042	13359.246	114	53	61	52	52	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
SMTInterpol	0	163	4786.798	3840.137	163	101	62	3	3	0
OpenSMT	0	162	12020.747	11967.883	162	100	62	4	4	0
Yices2	0	152	1564.692	1565.105	152	90	62	14	14	0
2022-z3-4.8.17n	0	145	10771.061	10772.292	145	83	62	21	21	0
cvc5	0	114	13447.042	13359.246	114	53	61	52	52	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
SMTInterpol	0	101	3664.734	3082.116	101	101	0	0	65	3	0
OpenSMT	0	100	11423.95	11371.033	100	100	0	1	65	4	0
Yices2	0	90	1557.9	1558.052	90	90	0	11	65	14	0
2022-z3-4.8.17n	0	83	9559.777	9561.004	83	83	0	18	65	21	0
cvc5	0	53	9809.576	9720.768	53	53	0	48	65	52	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Yices2	0	62	6.792	7.052	62	0	62	0	104	14	0
OpenSMT	0	62	596.797	596.85	62	0	62	0	104	4	0
SMTInterpol	0	62	1122.064	758.021	62	0	62	0	104	3	0
2022-z3-4.8.17n	0	62	1211.284	1211.288	62	0	62	0	104	21	0
cvc5	0	61	3637.466	3638.478	61	0	61	1	104	52	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Yices2	0	149	111.024	111.401	149	87	62	17	17	0
SMTInterpol	0	146	839.416	334.768	146	89	57	20	20	0
OpenSMT	0	115	229.04	229.091	115	58	57	51	51	0
2022-z3-4.8.17n	0	113	178.06	177.903	113	54	59	53	53	0
cvc5	0	83	25.183	25.156	83	34	49	83	83	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.