QF_FPLRA (Single Query Track)

Competition results for the QF_FPLRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:45 +0000

Benchmarks: 55
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
COLIBRI	COLIBRI	Bitwuzla	COLIBRI	COLIBRI

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI	0	53	2470.253	2470.326	53	49	4	2	2	0
Bitwuzla	0	53	4858.132	4858.78	53	51	2	2	2	0
cvc5	0	47	10786.133	10787.744	47	45	2	8	8	0
2021-cvc5n	0	47	10945.089	10946.763	47	45	2	8	8	0
MathSATn	0	46	11271.593	11273.536	46	45	1	9	9	0
z3-4.8.17n	0	43	18407.362	18411.732	43	42	1	12	10	2

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI	0	53	2470.253	2470.326	53	49	4	2	2	0
Bitwuzla	0	53	4858.302	4858.69	53	51	2	2	2	0
cvc5	0	47	10787.233	10787.364	47	45	2	8	8	0
2021-cvc5n	0	47	10946.149	10946.373	47	45	2	8	8	0
MathSATn	0	46	11273.183	11273.226	46	45	1	9	9	0
z3-4.8.17n	0	43	18410.362	18411.242	43	42	1	12	10	2

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	51	1878.378	1878.666	51	51	0	0	4	2	0
COLIBRI	0	49	2453.282	2453.325	49	49	0	2	4	2	0
MathSATn	0	45	7672.056	7672.099	45	45	0	6	4	9	0
cvc5	0	45	8313.534	8313.663	45	45	0	6	4	8	0
2021-cvc5n	0	45	8505.218	8505.406	45	45	0	6	4	8	0
z3-4.8.17n	0	42	14810.311	14811.193	42	42	0	9	4	10	2

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
COLIBRI	0	4	16.97	17.001	4	0	4	0	51	2	0
2021-cvc5n	0	2	2440.931	2440.967	2	0	2	2	51	8	0
cvc5	0	2	2473.699	2473.701	2	0	2	2	51	8	0
Bitwuzla	0	2	2979.923	2980.023	2	0	2	2	51	2	0
z3-4.8.17n	0	1	3600.051	3600.049	1	0	1	3	51	10	2
MathSATn	0	1	3601.127	3601.127	1	0	1	3	51	9	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
COLIBRI	0	53	118.253	118.326	53	49	4	2	2	0
Bitwuzla	0	47	231.269	231.277	47	46	1	8	8	0
2021-cvc5n	0	43	320.785	320.796	43	42	1	12	12	0
cvc5	0	43	320.886	320.88	43	42	1	12	12	0
MathSATn	0	42	344.056	344.074	42	41	1	13	13	0
z3-4.8.17n	0	22	973.832	973.82	22	21	1	33	31	2

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.