VenkatSNarayanan opened a new pull request, #8085: URL: https://github.com/apache/hadoop/pull/8085
This commit adds a MRv1 wrapper for the MagicS3GuardCommitter so applications like Hive can use it. How was this patch tested? The ITest suite was run with the changes in the us-east1 region. Two tests were added to test the code to handle Tez-generated UUIDs, and to check that the output path generated by the JobContext codepath matches the prefix of the one generated by the TaskAttemptContext codepath. Exactly one test failed, with a timeout error. I've seen this error before, and I don't think it has anything to do with my change. [ERROR] org.apache.hadoop.fs.s3a.impl.ITestConnectionTimeouts.testObjectUploadTimeouts -- Time elapsed: 18.71 s <<< FAILURE! java.lang.AssertionError: [Duration of write] Expecting: <PT16.212S> to be less than: at org.apache.hadoop.fs.s3a.impl.ITestConnectionTimeouts.testObjectUploadTimeouts(ITestConnectionTimeouts.java:247) at java.lang.reflect.Method.invoke(Method.java:498) at java.util.ArrayList.forEach(ArrayList.java:1259) at java.util.ArrayList.forEach(ArrayList.java:1259) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
