[
https://issues.apache.org/jira/browse/HADOOP-17475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-17475:
------------------------------------
Description:
The ABFS connector now implements listStatusIterator() with
asynchronous prefetching of the next page(s) of results.
For listing large directories this can provide tangible speedups.
If for any reason this needs to be disabled, set
fs.azure.enable.abfslistiterator to false.
> ABFS : add high performance listStatusIterator
> ----------------------------------------------
>
> Key: HADOOP-17475
> URL: https://issues.apache.org/jira/browse/HADOOP-17475
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.4.0
> Reporter: Bilahari T H
> Assignee: Bilahari T H
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.3.1
>
> Time Spent: 8h 40m
> Remaining Estimate: 0h
>
> The ABFS connector now implements listStatusIterator() with
> asynchronous prefetching of the next page(s) of results.
> For listing large directories this can provide tangible speedups.
> If for any reason this needs to be disabled, set
> fs.azure.enable.abfslistiterator to false.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
