Da Zhou created HADOOP-16242:
--------------------------------
Summary: ABFS: add bufferpool to AbfsOutputStream
Key: HADOOP-16242
URL: https://issues.apache.org/jira/browse/HADOOP-16242
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/azure
Affects Versions: 3.2.0
Environment: In current AbfsOutPutStream, new temporary buffers always
get allocated when uploading the data to server. These big chunk creates huge
pressure on the GC, and in some extreme cases that GC doesn't happen in
time(observed in some customer's env), it also lead to OutOfMemory issue easily.
Hence we need to replace the current implementation with a bufferpool.
Reporter: Da Zhou
Assignee: Da Zhou
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
