fuatbasik opened a new pull request, #13739:
URL: https://github.com/apache/iceberg/pull/13739

   **Context**
   We have integrated 
[analytics-accelerator-s3](https://github.com/awslabs/analytics-accelerator-s3) 
into Iceberg in PR https://github.com/apache/iceberg/pull/12299. Currently, 
Iceberg customers need to enable the s3.analytics-accelerator.enabled flag in 
S3FileIOProperties to use the library. There is a proposal to make Analytics 
stream the default input stream: 
https://docs.google.com/document/d/13shy0RWotwfWC_qQksb95PXdi-vSUCKQyDzjoExQEN0
   
   **Description of Change**
   Starting from 1.2.2 AAL will allow consumers to pass Retry strategy to 
execute on Input Stream from S3 to AAL. 
(https://github.com/awslabs/analytics-accelerator-s3/pull/340)
   
   With this change we are using that stream to ensure parity with 
S3SeekableInputStream and Analytics Stream on Iceberg.
   
   Unlike current retries where stream has to be re-opened from the last-read 
position, in these retries, we do not need to do anything on the stream level 
as AAL will ensure reads are idempotent. 
   
   **Testing**
   Extended FlakyInputStream tests to AAL and confirmed all tests are passing 
in the presence of exceptions and non-retriable exceptions are not retries. 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to