[
https://issues.apache.org/jira/browse/HADOOP-14488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050439#comment-16050439
]
Sean Mackrory commented on HADOOP-14488:
----------------------------------------
+1 to that patch. I can commit it this morning.
Also, forgot to throw in that I tested this with the following in addition to
all combinations of -Ds3guard, -Ddynamo, -Dauth so that all tests would
exercise the new path for any deletes / renames:
{code}-Dfs.s3a.s3.client.factory.impl=org.apache.hadoop.fs.s3a.InconsistentS3ClientFactory
\
-Dfs.s3a.failinject.inconsistency.key.substring=DELAY_LISTING_ME \
-Dfs.s3a.failinject.inconsistency.probability=1.0{code}
> s3guard w/ failure injection: listStatus fails after renaming file into
> directory
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-14488
> URL: https://issues.apache.org/jira/browse/HADOOP-14488
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Steve Loughran
> Assignee: Sean Mackrory
> Priority: Blocker
> Attachments: HADOOP-14488-HADOOP-13345-001.patch,
> HADOOP-14488-HADOOP-13345-002.patch, HADOOP-14488-HADOOP-13345-003.patch,
> HADOOP-14488-HADOOP-13345-004.patch, HADOOP-14488-HADOOP-13345-005.patch,
> output.txt
>
>
> Running scala integration test with inconsistent s3 client & local DDB enabled
> {code}
> fs.rename("work/task-00/part-00", work)
> fs.listStatus(work)
> {code}
> The list status work fails with a message about the childStatus not being a
> child of the parent.
> Hypothesis: rename isn't updating the child path entry
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
