[
https://issues.apache.org/jira/browse/HADOOP-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372895#comment-17372895
]
Steve Loughran commented on HADOOP-17784:
-----------------------------------------
Apparently it'll be moving to requester pays to give a warning that it'll go:
https://lists.osgeo.org/pipermail/landsat-pds/2021-June/000181.html
What do we want from a new file?
* AWS fund the data reads, so keeping costs down, especially for open source
developers without someone paying their bills.
* eliminates the overhead of creating a multi MB dataset on test runs
* CSV.GZ so we can verify the code can read .csv.gz data created through other
applications
* supports S3 select
* world/anonymous readable
* read-only so we can do permission and credential tests
> hadoop-aws landsat-pds test bucket will be deleted on Jul 1, 2021
> -----------------------------------------------------------------
>
> Key: HADOOP-17784
> URL: https://issues.apache.org/jira/browse/HADOOP-17784
> Project: Hadoop Common
> Issue Type: Test
> Components: fs/s3, test
> Reporter: Leona Yoda
> Priority: Major
>
> I found an anouncement that landsat-pds buket will be deleted on July 1, 2021
> (https://registry.opendata.aws/landsat-8/)
> and I think this bucket is used in th test of hadoop-aws module use
> [https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/S3ATestConstants.java#L93]
>
> At this time I can access the bucket but we might have to change the test
> bucket in someday.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
