steveloughran commented on a change in pull request #2149:
URL: https://github.com/apache/hadoop/pull/2149#discussion_r467944142
##########
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Listing.java
##########
@@ -142,12 +142,27 @@ public FileStatusListingIterator
createFileStatusListingIterator(
Listing.FileStatusAcceptor acceptor,
RemoteIterator<S3AFileStatus> providedStatus) throws IOException {
return new FileStatusListingIterator(
- new ObjectListingIterator(listPath, request),
+ createObjectListingIterator(listPath, request),
filter,
acceptor,
providedStatus);
}
+ /**
+ * Create an object listing iterator against a path, with a given
+ * list object request.
+ * @param listPath path of the listing
+ * @param request initial request to make
+ * @return the iterator
+ * @throws IOException IO Problems
+ */
+ @Retries.RetryRaw
+ public ObjectListingIterator createObjectListingIterator(
Review comment:
Mukund is doing a lot of work on listing performance; I'm just trying to
keep up with the changes with this and the io statistics patches.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
