gaborkaszab commented on PR #12194: URL: https://github.com/apache/iceberg/pull/12194#issuecomment-2701567647
Thanks for taking a look, @1raghavmahajan! This is the proposal doc the freshness-aware table loading just in case: https://docs.google.com/document/d/1rnVSP_iv2I47giwfAe-Z3DYhKkKwWCVvCkC9rEvtaLA In general the whole improvement could work with letting the HttpClient to take care of the caching out of the box itself as you proposed. However, The idea is to do the caching on RESTSessionCatalog side so that we can cache Table objects instead of the HTTP messages. Additionally, if the caching was on RESTSessionCatalog level then the cached objects could be tied to the lifecycle of the tables, e.g. dropping a table could also evict the table object from the cache (via using weak-references) while the CachedHttpClient would only see HTTP messages. So I'd continue with this PR to add extended header support for Iceberg's REST clients. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
