Anuj Modi created HADOOP-19474:
----------------------------------
Summary: ABFS: [FnsOverBlob] Listing Optimizations to avoid
multiple iteration over list response.
Key: HADOOP-19474
URL: https://issues.apache.org/jira/browse/HADOOP-19474
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/azure
Affects Versions: 3.4.1, 3.5.0
Reporter: Anuj Modi
Assignee: Anuj Modi
On blob endpoint, there are a couple of handling that is needed to be done on
client side.
This involves:
# Parsing of xml response and converting them to VersionedFileStatus list
# Removing duplicate entries for non-empty explicit directories coming due to
presence of the marker files
# Trigerring Rename recovery on the previously failed rename indicated by the
presence of pending json file.
Currently all three are done in a separate iteration over whole list. This is
to pbring all those things to a common place so that single iteration over list
reposne can handle all three.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
