zeroshade opened a new issue, #45015:
URL: https://github.com/apache/arrow/issues/45015

   ### Describe the enhancement requested
   
   The Parquet library currently requires multiple round trips to read the 
footer of a file whose metadata is >64KB. For high latency file systems like 
S3, it can be beneficial to allow increasing the 64KB default footer read size 
to accommodate handling files with larger metadata while reducing the number of 
round trips to read the footer.
   
   We can simply add the `footer_read_size` as a Reader Property that is 
configurable and then use it in the file reader, where all handling of the 
footer read is centralized in a `GetFooterReadSize` method.
   
   ### Component(s)
   
   C++, Parquet


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to