BVFPLRA (Single Query Track)

Competition results for the BVFPLRA logic in the Single Query Track.

Page generated on 2022-08-10 11:17:44 +0000

Benchmarks: 209
Time Limit: 1200 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
Bitwuzla	Bitwuzla	Bitwuzla	UltimateEliminator+MathSAT	Bitwuzla

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	193	20748.556	20751.6	193	184	9	16	15	0
Bitwuzla	0	141	80812.977	80821.072	141	132	9	68	67	0
2021-cvc5n	0	104	84073.37	84088.322	104	95	9	105	70	0
cvc5	0	104	84076.332	84083.18	104	95	9	105	70	0
UltimateEliminator+MathSAT	0	46	1475.535	1039.953	46	37	9	163	0	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	193	20751.866	20750.91	193	184	9	16	15	0
Bitwuzla	0	141	80818.137	80818.312	141	132	9	68	67	0
cvc5	0	104	84087.242	84080.87	104	95	9	105	70	0
2021-cvc5n	0	104	84085.28	84085.242	104	95	9	105	70	0
UltimateEliminator+MathSAT	0	46	1475.535	1039.953	46	37	9	163	0	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
z3-4.8.17n	0	184	18125.568	18124.592	184	184	0	14	11	15	0
Bitwuzla	0	132	78415.465	78415.633	132	132	0	66	11	67	0
cvc5	0	95	82861.136	82854.761	95	95	0	103	11	70	0
2021-cvc5n	0	95	82858.071	82858.033	95	95	0	103	11	70	0
UltimateEliminator+MathSAT	0	37	1386.815	973.592	37	37	0	161	11	0	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	N/A	Timeout	Memout
UltimateEliminator+MathSAT	0	9	83.425	63.167	9	0	9	1	199	0	0
Bitwuzla	0	9	1202.672	1202.678	9	0	9	1	199	67	0
cvc5	0	9	1224.763	1224.768	9	0	9	1	199	70	0
2021-cvc5n	0	9	1226.296	1226.296	9	0	9	1	199	70	0
z3-4.8.17n	0	9	1426.298	1426.318	9	0	9	1	199	15	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
z3-4.8.17n	0	169	1102.679	1101.399	169	163	6	40	40	0
Bitwuzla	0	140	1688.272	1688.33	140	131	9	69	68	0
cvc5	0	104	1767.242	1760.87	104	95	9	105	70	0
2021-cvc5n	0	104	1765.28	1765.242	104	95	9	105	70	0
UltimateEliminator+MathSAT	0	45	1448.87	1020.811	45	37	8	164	3	0

n Non-competing.
N/A: Benchmarks not known to be SAT/UNSAT, respectively.