[
https://issues.apache.org/jira/browse/HADOOP-13449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15603207#comment-15603207
]
Lei (Eddy) Xu commented on HADOOP-13449:
----------------------------------------
Hi, [~liuml07]
The patch looks good to me overall. Looking forward to fill the gaps of tests.
{code:title=PathMetadataToDynamoDBTranslation.java}
final FileStatus fileStatus = isDir ? new S3AFileStatus(true, false, path) :
new S3AFileStatus(0, 0, path, 0);
{code}
Here, it seems that it only has the path be correctly populated. It assumes
that {{S3AFileSystem}} only checks the existence of file in {{MS}}. It is
different to {{InMemoryMetadataStore}}. I feel that we should have a consistent
contract for all the stores.
* Regarding {{isEmptyDirectory}}. should we store it in dynamodb as well? The
drawback is that we should update this field in DynamoDB in
{{S3AFileStatus#finishWrite}} for every file.
* {{DynamoDBMetadataStore}} should have a {{getTableName()}} or {{getTable()}}.
The table name is parsed within {{initialize()}}, so from the caller (i.e., CLI
tool) point of view, it is difficult to get the table name to call
{{deleteTable(String tableName);}}.
* For {{authoritative()}}, do you think storing it as a flag in the DynamoDB is
a good idea?
> S3Guard: Implement DynamoDBMetadataStore.
> -----------------------------------------
>
> Key: HADOOP-13449
> URL: https://issues.apache.org/jira/browse/HADOOP-13449
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Chris Nauroth
> Assignee: Mingliang Liu
> Attachments: HADOOP-13449-HADOOP-13345.000.patch
>
>
> Provide an implementation of the metadata store backed by DynamoDB.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
