rdblue opened a new pull request, #8644:
URL: https://github.com/apache/iceberg/pull/8644

   `This PR adds `AsyncFileIO`, a child class of `ResolvingFileIO` that will 
asynchronously download files from other `FileIO` instances and use the 
downloaded copies. This mimics an optimization used by v1 data sources in EMR.
   
   The `AsyncFileIO` can use either a `memory:/` or `file:/` path for 
`async.cache-location`, which determines where the data is locally cached.
   
   Files are downloaded when an `InputFile` is created and cleaned up when the 
`InputFile` is garbage collected. `FileIO.close()` also drops cached data, but 
this may not be reliable if `close` isn't called.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to