[
https://issues.apache.org/jira/browse/HADOOP-17928?focusedWorklogId=669666&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-669666
]
ASF GitHub Bot logged work on HADOOP-17928:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 25/Oct/21 17:29
Start Date: 25/Oct/21 17:29
Worklog Time Spent: 10m
Work Description: steveloughran opened a new pull request #3585:
URL: https://github.com/apache/hadoop/pull/3585
This switches the default behavior of S3A output streams
to warning that Syncable.hsync() or hflush() have been
called; it's not considered an error unless the defaults
are overridden.
This avoids breaking applications which call the APIs,
at the risk of people trying to use S3 as a safe store
of streamed data (HBase WALs, audit logs etc).
Contributed by Steve Loughran.
Change-Id: Id7f8fc65a32a5ab664ebbd68d92754d4c38e29d8
### How was this patch tested?
New unit tests; cloud store test in progress
### For code changes:
- [X] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the
endpoint declared according to the connector-specific documentation?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 669666)
Remaining Estimate: 0h
Time Spent: 10m
> s3a: set fs.s3a.downgrade.syncable.exceptions = true by default
> ---------------------------------------------------------------
>
> Key: HADOOP-17928
> URL: https://issues.apache.org/jira/browse/HADOOP-17928
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.1
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> HADOOP-17597 set policy of reacting to hsync() on an s3 output stream to be
> one of :Fail, warn, with default == fail.
> I propose downgrading this to warn. We've done it internally, after having it
> on fail long enough to identify which processes were doing either of
> * having unrealistic expectations about the output stream (fix: move off s3)
> * were using hflush() as a variant of flush(), with the failure being an
> over-reaction
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
