[
https://issues.apache.org/jira/browse/HADOOP-19613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18005034#comment-18005034
]
ASF GitHub Bot commented on HADOOP-19613:
-----------------------------------------
anujmodi2021 opened a new pull request, #7801:
URL: https://github.com/apache/hadoop/pull/7801
This is the first PR in series of work done under Parent Jira:
[HADOOP-19596](https://issues.apache.org/jira/browse/HADOOP-19596) to improve
the performance of sequential reads in ABFS Driver.
Please refer to Parent JIRA for more details.
### Description of PR
Jira: https://issues.apache.org/jira/browse/HADOOP-19613
Read Buffer Manager used today was introduced way back and has been stable
for quite a while.
Read Buffer Manager to be introduced as part of
[HADOOP-19596](https://issues.apache.org/jira/browse/HADOOP-19596) will
introduce many changes incrementally over time. While the development goes on
and we are able to fully stabilise the optimized version we need the current
flow to be functional and undisturbed.
This work item is to isolate that from new code by refactoring
ReadBufferManager class to have 2 different implementations with same public
interfaces: ReadBufferManagerV1 and ReadBufferManagerV2.
This will also introduce new configs that can be used to toggle between new
and old code.
### How was this patch tested?
Existing tests were modified to work with the Refactored Classes.
More tests will be added with coming up PRs where new implementation will be
introduced.
Test suite result added.
> ABFS: [ReadAheadV2] Refactor ReadBufferManager to isolate new code with the
> current working code
> ------------------------------------------------------------------------------------------------
>
> Key: HADOOP-19613
> URL: https://issues.apache.org/jira/browse/HADOOP-19613
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.5.0, 3.4.1
> Reporter: Anuj Modi
> Assignee: Anuj Modi
> Priority: Major
>
> Read Buffer Manager used today was introduced way back and has been stable
> for quite a while.
> Read Buffer Manager to be introduced as part of
> https://issues.apache.org/jira/browse/HADOOP-19596 will introduce many
> changes incrementally over time. While the development goes on and we are
> able to fully stabilise the optimized version we need the current flow to be
> functional and undisturbed.
> This work item is to isolate that from new code by refactoring
> ReadBufferManager class to have 2 different implementations with same public
> interfaces: ReadBufferManagerV1 and ReadBufferManagerV2.
> This will also introduce new configs that can be used to toggle between new
> and old code.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
