sdd commented on issue #1217: URL: https://github.com/apache/iceberg-rust/issues/1217#issuecomment-2820378745
I agree with @liurenjie1024 around caching in the FileIO layer. My experience of trying this was that the lack of context about what the type of each file is by the time you are inside FileIO limits the flexibility. For example caching both the raw bytes and the parsed object for manifests and manifest lists is a waste of cache space. The ObjectCache / ByteCache approach suggested by @Xuanwo would allow us to retain the context. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
