[
https://issues.apache.org/jira/browse/HADOOP-19622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18010599#comment-18010599
]
ASF GitHub Bot commented on HADOOP-19622:
-----------------------------------------
anujmodi2021 opened a new pull request, #7832:
URL: https://github.com/apache/hadoop/pull/7832
### Description of PR
JIRA: https://issues.apache.org/jira/browse/HADOOP-19622
Implementing ReadBufferManagerV2 as per the new design document.
Following capabilities are added to ReadBufferManager:
1. Configurable minimum and maximum number of prefetch threads.
2. Configurable minimum and maximum size of cached buffer pool
3. Dynamically adjusting thread pool size and buffer pool size based on
workload requirement and resource utilization but within the limits defined by
user.
4. Mapping prefetched data to file ETag so that multiple streams reading
same file can share the cache and save TPS.
For more details on design doc please refer to the design doc attached to
parent JIRA: https://issues.apache.org/jira/browse/HADOOP-19596
### How was this patch tested?
TBA
> ABFS: [ReadAheadV2] Implement Read Buffer Manager V2 with improved
> aggressiveness
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-19622
> URL: https://issues.apache.org/jira/browse/HADOOP-19622
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.5.0, 3.4.1
> Reporter: Anuj Modi
> Assignee: Anuj Modi
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
