QF_ALIA (Single Query Track)

Competition results for the QF_ALIA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 116
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Yices2	Yices2	Yices2	Yices2	Yices2

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Yices2	0	116	74.124	74.465	116	54	62	0	0	0
MathSATn	0	116	103.037	102.514	116	54	62	0	0	0
2021-SMTInterpoln	0	116	1132.625	615.916	116	54	62	0	0	0
smtinterpol	0	116	1247.362	687.688	116	54	62	0	0	0
z3-4.8.17n	0	115	2934.236	2934.315	115	54	61	1	1	0
cvc5	0	94	29308.328	29318.37	94	34	60	22	22	0
veriT	0	6	4.521	4.552	6	0	6	110	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Yices2	0	116	74.124	74.465	116	54	62	0	0	0
MathSATn	0	116	103.037	102.514	116	54	62	0	0	0
2021-SMTInterpoln	0	116	1132.625	615.916	116	54	62	0	0	0
smtinterpol	0	116	1247.362	687.688	116	54	62	0	0	0
z3-4.8.17n	0	115	2934.286	2934.285	115	54	61	1	1	0
cvc5	0	94	29316.458	29317.33	94	34	60	22	22	0
veriT	0	6	4.521	4.552	6	0	6	110	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
MathSATn	0	54	62.285	61.749	54	54	0	0	62	0	0
Yices2	0	54	67.407	67.43	54	54	0	0	62	0	0
smtinterpol	0	54	454.092	167.64	54	54	0	0	62	0	0
2021-SMTInterpoln	0	54	467.546	171.431	54	54	0	0	62	0	0
z3-4.8.17n	0	54	1616.84	1616.92	54	54	0	0	62	1	0
cvc5	0	34	24489.682	24489.846	34	34	0	20	62	22	0
veriT	0	0	2.566	2.559	0	0	0	54	62	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Yices2	0	62	6.717	7.035	62	0	62	0	54	0	0
MathSATn	0	62	40.752	40.765	62	0	62	0	54	0	0
2021-SMTInterpoln	0	62	665.079	444.484	62	0	62	0	54	0	0
smtinterpol	0	62	793.27	520.048	62	0	62	0	54	0	0
z3-4.8.17n	0	61	1317.446	1317.365	61	0	61	1	54	1	0
cvc5	0	60	4826.776	4827.484	60	0	60	2	54	22	0
veriT	0	6	1.954	1.993	6	0	6	56	54	0	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Yices2	0	116	74.124	74.465	116	54	62	0	0	0
MathSATn	0	116	103.037	102.514	116	54	62	0	0	0
2021-SMTInterpoln	0	111	798.677	380.218	111	54	57	5	5	0
smtinterpol	0	111	815.835	394.099	111	54	57	5	5	0
z3-4.8.17n	0	96	645.499	645.351	96	36	60	20	20	0
cvc5	0	81	859.694	859.678	81	33	48	35	35	0
veriT	0	6	4.521	4.552	6	0	6	110	0	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.