FP (Single Query Track)

Competition results for the FP logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 1334
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	1273	99611.808	99571.894	1273	122	1151	61	61	0
cvc5	0	1193	208103.905	212524.123	1193	106	1087	141	141	0
2021-cvc5n	0	1192	202559.857	216487.519	1192	100	1092	142	142	0
z3-4.8.17n	0	1129	302470.942	302461.134	1129	85	1044	205	200	0
UltimateEliminator+MathSAT	0	170	40930.135	39231.405	170	1	169	1164	30	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	1273	99624.198	99569.554	1273	122	1151	61	61	0
cvc5	0	1193	211944.095	212517.493	1193	106	1087	141	141	0
2021-cvc5n	0	1192	216056.443	216479.569	1192	100	1092	142	142	0
z3-4.8.17n	0	1129	302514.552	302452.154	1129	85	1044	205	200	0
UltimateEliminator+MathSAT	0	170	40930.135	39231.405	170	1	169	1164	30	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	122	20286.121	20283.354	122	122	0	1	1211	61	0
cvc5	0	106	49123.964	48860.828	106	106	0	17	1211	141	0
2021-cvc5n	0	100	50600.28	50648.678	100	100	0	23	1211	142	0
z3-4.8.17n	0	85	70038.645	70042.886	85	85	0	38	1211	200	0
UltimateEliminator+MathSAT	0	1	539.036	833.925	1	1	0	122	1211	30	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
Bitwuzla	0	1151	19338.078	19286.2	1151	0	1151	6	177	61	0
2021-cvc5n	0	1092	100656.163	101030.892	1092	0	1092	65	177	142	0
cvc5	0	1087	104020.132	104856.665	1087	0	1087	70	177	141	0
z3-4.8.17n	0	1044	173620.936	173554.295	1044	0	1044	113	177	200	0
UltimateEliminator+MathSAT	0	169	21012.812	19085.312	169	0	169	988	177	30	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
Bitwuzla	0	1126	5975.763	5969.019	1126	33	1093	208	208	0
cvc5	0	1050	8624.422	8595.175	1050	45	1005	284	284	0
2021-cvc5n	0	1045	8662.714	8644.8	1045	40	1005	289	289	0
z3-4.8.17n	0	894	12196.616	12172.053	894	0	894	440	435	0
UltimateEliminator+MathSAT	0	168	7377.494	5409.742	168	1	167	1166	37	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.