gaborkaszab commented on PR #16207: URL: https://github.com/apache/iceberg/pull/16207#issuecomment-4398767205
Thanks for the explanation @grantatspothero ! > Consider a multitenant coordinator service (ie: a query engine like trino). If the coordinator service does a read only query that doesn't access historical snapshots, then loading a slim version of table metadata in the client is enough to satisfy query planning entirely. The full table metadata must only be pulled into the client for read queries using time travel or write queries. I get this, what I don't get is how this PR helps with achieving this. If a REST server sends a full snapshot log we still put that full log into the TableMetadata, this PR doesn't help you with reducing the memory pressure, then, right? > this PR changes the behavior of REFS mode I think this is partially correct: this PR changes the behavior of REFS mode for the reference REST catalog we use for tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
