[
https://issues.apache.org/jira/browse/HADOOP-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15523231#comment-15523231
]
Steve Loughran commented on HADOOP-12387:
-----------------------------------------
This is superceded by HADOOP-13560, which offers pooled off-heap byte arrays
for anyone wanting pure-RAM storage of temporary data. There is still going to
be the delay of copying write() data from the source buffer into that byte
array, and again on the read.
> Improve S3AFastOutputStream memory management
> ---------------------------------------------
>
> Key: HADOOP-12387
> URL: https://issues.apache.org/jira/browse/HADOOP-12387
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Thomas Demoor
> Assignee: Thomas Demoor
>
> The use of ByteArrayOutputStream causes unexpected memory copies that causes
> unintuitive memory usage for certain combinations of the configuration
> parameters. Replacing it by more fine grained memory buffer management would
> fix this, reduce memory usage and eliminate a memory copy.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
