geruh commented on issue #2051: URL: https://github.com/apache/iceberg-python/issues/2051#issuecomment-2932378816
Hey @psavalle, thanks for raising this. In the Glue commit path, we're eagerly converting the Glue table to an Iceberg table to get the latest metadata pointer from Glue for optimistic concurrency. The commit path in PyIceberg does this so it can apply the `TableUpdateRequirements` to the most recent metadata in case another writer has already committed the next expected version. https://github.com/apache/iceberg-python/blob/8bfb16cf063d121a177d43fec01620e1a5e6d84a/pyiceberg/catalog/__init__.py#L872 This is similar to what happens in the Java commit flow. However, in their case, they use the current table that the action started on, and if the commit fails due to an assertion, they refresh the table. At that point, similar to PyIceberg, the conversion from a Glue table to an Iceberg table happens. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
