[
https://issues.apache.org/jira/browse/HADOOP-14488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042564#comment-16042564
]
Steve Loughran commented on HADOOP-14488:
-----------------------------------------
Got a patch in to do the logging, it implies that somehow the rename got the
wrong path element in.
Problem only seems to surface if inconsistent is on.
I have attached a patch which adds a test for hadoop-aws which tries to mimic
the scala code. But it doesn't replicate the problem...don't know why not.
I'll also attach a log of the scala run, which is [this test
case|https://github.com/hortonworks-spark/cloud-integration/blob/master/cloud-examples/src/test/scala/com/hortonworks/spark/cloud/s3/S3AConsistencySuite.scala#L73].
Note that this is in the HADOOP-13786 branch, but so is the hadoop-aws test
which isn't having the problem. I doesn't understands it
> s3guard listStatus fails after renaming file into directory
> -----------------------------------------------------------
>
> Key: HADOOP-14488
> URL: https://issues.apache.org/jira/browse/HADOOP-14488
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Steve Loughran
> Priority: Blocker
> Attachments: HADOOP-14488-HADOOP-13345-001.patch
>
>
> Running scala integration test with inconsistent s3 client & local DDB enabled
> {code}
> fs.rename("work/task-00/part-00", work)
> fs.listStatus(work)
> {code}
> The list status work fails with a message about the childStatus not being a
> child of the parent.
> Hypothesis: rename isn't updating the child path entry
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
