[
https://issues.apache.org/jira/browse/HADOOP-18878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Fabbri resolved HADOOP-18878.
-----------------------------------
Fix Version/s: 3.5.1
3.6.0
Release Note: hadoop-aws: S3A multipart purge option is now deprecated
(fs.s3a.multipart.purge)
Resolution: Fixed
> remove/deprecate fs.s3a.multipart.purge
> ---------------------------------------
>
> Key: HADOOP-18878
> URL: https://issues.apache.org/jira/browse/HADOOP-18878
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.6
> Reporter: Steve Loughran
> Assignee: Aaron Fabbri
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.5.1, 3.6.0
>
>
> the fs.s3a.multipart.purge option has been in for a long time, to help avoid
> running up costs from incomplete uploads, especially during testing.
> but
> * adds overhead on startup (list + delete)
> * dangerous if one client has a very short lifespan; all active s3a committer
> jobs will be broken
> * obsoleted by s3 lifecycle rules
> * and "hadoop s3guard uploads" cli.
> proposed: deprecate for the next release, delete after.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
