singhpk234 opened a new pull request, #14944: URL: https://github.com/apache/iceberg/pull/14944
### About the change This change attempts to avoid object store call to recreate the TableMetadata from the object store in case we are making a serialized table copy of the table, this could be seen as an optimization where rather than going to the obj store we keep the serialized copy of the table and then just store it and send it via wire for example (spark driver sending to executor) or can also be looked as a feature where if the catalog has redacted some sensitive info, all the serializable table respects it and reads that rather than going to the object store (which it may not have access to). Presently its gauraded only for RESTTable and for the I understand that spec wording the following: Per REST spec the metadata location is nullable in certain cases https://github.com/apache/iceberg/blob/4632f3133efbf6b8232ed9526de7142fd50e1aa6/open-api/rest-catalog-open-api.yaml#L3396-L3399 The spec says the following but that is **SHOULD** and not **MUST** : https://github.com/apache/iceberg/blob/4632f3133efbf6b8232ed9526de7142fd50e1aa6/open-api/rest-catalog-open-api.yaml#L3365 just wanted to float this to folks on what they think of this feature. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
