Anuj Modi created HADOOP-19624:
----------------------------------
Summary: [Bug Report] Thread leak in ABFS
AbfsClientThrottlingAnalyzer
Key: HADOOP-19624
URL: https://issues.apache.org/jira/browse/HADOOP-19624
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/azure
Affects Versions: 3.4.1, 3.5.0
Reporter: Anuj Modi
Bug reported by Matt over common-dev discussion.
> What seems to be the issue is that the timer tasks are cleaned up but
> the timer threads themselves are never actually cleaned up. This will
> eventually lead to an OOM since nothing is collecting these. I was
> able to reproduce this locally in 3.3.6 and 3.4.1 but I believe that
> it would affect any version that relies on autothrottling for ABFS.
>
> I was also able to make a quick fix as well as confirm a workaround --
> the long term fix would be to include `timer.cancel()` and
> `timer.purge()` in a method for AbfsClientThrottlingAnalyzer.java. The
> short term workaround is to disable autothrottling and rely on Azure
> to throttle the connections as needed with the below configuration.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
