[
https://issues.apache.org/jira/browse/HADOOP-13345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802338#comment-15802338
]
Aaron Fabbri commented on HADOOP-13345:
---------------------------------------
Thanks [[email protected]], this is good stuff. Sounds like you are adding
(1) CLI polish / docs / fsck and (2) FS metrics to my list.
In terms of clean integration with S3A code: I spent a lot of time
streamlining the S3AFileSystem integration. One of the main warts IMO is the
isEmptyDirectory thing, but refactoring that post-merge seems much easier to me
(and also isn't S3Guard specific per-se). Anything else actionable we can do
to address the maintainability point? Maybe we do another feature branch code
review with this in mind after we get the above features in?
> S3Guard: Improved Consistency for S3A
> -------------------------------------
>
> Key: HADOOP-13345
> URL: https://issues.apache.org/jira/browse/HADOOP-13345
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/s3
> Reporter: Chris Nauroth
> Assignee: Chris Nauroth
> Attachments: HADOOP-13345.prototype1.patch,
> S3C-ConsistentListingonS3-Design.pdf, S3GuardImprovedConsistencyforS3A.pdf,
> S3GuardImprovedConsistencyforS3AV2.pdf, s3c.001.patch
>
>
> This issue proposes S3Guard, a new feature of S3A, to provide an option for a
> stronger consistency model than what is currently offered. The solution
> coordinates with a strongly consistent external store to resolve
> inconsistencies caused by the S3 eventual consistency model.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
