[
https://issues.apache.org/jira/browse/HADOOP-16242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Da Zhou updated HADOOP-16242:
-----------------------------
Description:
In current AbfsOutPutStream, new temporary buffers always get allocated when
uploading the data to server. These big chunk creates huge pressure on the GC,
and in some extreme cases that GC doesn't happen in time(observed in some
customer's env), it also lead to OutOfMemory issue easily.
Hence we need to replace the current implementation with a bufferpool.
> ABFS: add bufferpool to AbfsOutputStream
> ----------------------------------------
>
> Key: HADOOP-16242
> URL: https://issues.apache.org/jira/browse/HADOOP-16242
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.2.0
> Reporter: Da Zhou
> Assignee: Da Zhou
> Priority: Major
>
> In current AbfsOutPutStream, new temporary buffers always get allocated when
> uploading the data to server. These big chunk creates huge pressure on the
> GC, and in some extreme cases that GC doesn't happen in time(observed in some
> customer's env), it also lead to OutOfMemory issue easily.
> Hence we need to replace the current implementation with a bufferpool.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
