Xuanwo opened a new pull request, #802:
URL: https://github.com/apache/iceberg-rust/pull/802
   This PR will store file io props to allow users to re-build it.
   
   This PR will partly address https://github.com/apache/iceberg-rust/issues/791
   
   ---
   
   In a distributed system, we need to fetch table metadata, plan tasks, and 
distribute these tasks to different nodes. Each node will reconstruct the table 
instances to perform I/O while receiving a task. By storing file I/O 
properties, we can rebuild the `Table` without repeatedly fetching all the 
metadata from the catalog. This approach helps reduce the large number of 
catalog requests, especially when there are many workers.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to