QF_FPLRA (Single Query Track)

Competition results for the QF_FPLRA logic in the Single Query Track.

Page generated on 2021-07-18 17:29:06 +0000

Benchmarks: 55
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	COLIBRI	COLIBRI

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	54	2954.331	2954.754	54	51	3	1	1	0
COLIBRI - fixedn	0	53	2495.793	2496.435	53	49	4	2	2	0
COLIBRI	0	53	2504.264	2504.707	53	49	4	2	2	0
2020-COLIBRIn	0	52	3694.957	3678.592	52	48	4	3	3	0
2020-CVC4n	0	48	10857.022	10858.748	48	45	3	7	7	0
cvc5	0	47	10283.468	10285.209	47	45	2	8	8	0
MathSAT5n	0	46	11243.654	11244.543	46	45	1	9	9	0
2020-MathSAT5n	0	46	11275.031	11276.774	46	45	1	9	9	0
z3n	0	42	19184.316	19268.134	42	41	1	13	11	2

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	54	2954.341	2954.744	54	51	3	1	1	0
COLIBRI - fixedn	0	53	2496.153	2496.315	53	49	4	2	2	0
COLIBRI	0	53	2504.454	2504.557	53	49	4	2	2	0
2020-COLIBRIn	0	52	3695.177	3678.452	52	48	4	3	3	0
2020-CVC4n	0	48	10857.892	10858.418	48	45	3	7	7	0
cvc5	0	47	10284.868	10284.949	47	45	2	8	8	0
MathSAT5n	0	46	11246.144	11244.163	46	45	1	9	9	0
2020-MathSAT5n	0	46	11276.381	11276.414	46	45	1	9	9	0
z3n	0	42	19266.986	19267.594	42	41	1	13	11	2

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	51	1125.052	1125.376	51	51	0	0	4	1	0
COLIBRI - fixedn	0	49	2482.88	2483.04	49	49	0	2	4	2	0
COLIBRI	0	49	2490.684	2490.78	49	49	0	2	4	2	0
2020-COLIBRIn	0	48	3671.178	3654.45	48	48	0	3	4	3	0
MathSAT5n	0	45	7644.04	7643.077	45	45	0	6	4	9	0
2020-MathSAT5n	0	45	7675.227	7675.259	45	45	0	6	4	9	0
cvc5	0	45	7833.427	7833.505	45	45	0	6	4	8	0
2020-CVC4n	0	45	8445.224	8445.398	45	45	0	6	4	7	0
z3n	0	41	15666.937	15667.545	41	41	0	10	4	11	2

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
COLIBRI - fixedn	0	4	13.273	13.275	4	0	4	0	51	2	0
COLIBRI	0	4	13.77	13.777	4	0	4	0	51	2	0
2020-COLIBRIn	0	4	24.0	24.002	4	0	4	0	51	3	0
Bitwuzla	0	3	1829.289	1829.368	3	0	3	1	51	1	0
2020-CVC4n	0	3	2412.668	2413.021	3	0	3	1	51	7	0
cvc5	0	2	2451.441	2451.444	2	0	2	2	51	8	0
z3n	0	1	3600.049	3600.049	1	0	1	3	51	11	2
MathSAT5n	0	1	3602.105	3601.085	1	0	1	3	51	9	0
2020-MathSAT5n	0	1	3601.155	3601.155	1	0	1	3	51	9	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI - fixedn	0	53	144.153	144.315	53	49	4	2	2	0
COLIBRI	0	53	152.454	152.557	53	49	4	2	2	0
2020-COLIBRIn	0	52	167.177	150.452	52	48	4	3	3	0
Bitwuzla	0	46	253.77	253.785	46	45	1	9	9	0
cvc5	0	43	321.057	321.066	43	42	1	12	12	0
MathSAT5n	0	42	329.815	327.75	42	41	1	13	13	0
2020-MathSAT5n	0	42	328.55	328.554	42	41	1	13	13	0
2020-CVC4n	0	42	336.044	336.034	42	41	1	13	13	0
z3n	0	15	1113.497	1113.507	15	14	1	40	38	2

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.