sachet-saurabh opened a new pull request, #11692: URL: https://github.com/apache/iceberg/pull/11692
This PR adds integration with [Glue extensions for Iceberg](https://github.com/awslabs/glue-extensions-for-iceberg/), to enable access to the new Glue multi-catalog hierarchy in the Amazon SageMaker Lakehouse, as announced in the CEO Keynote with Matt Garman during AWS re:Invent 2024. This will allow access to read non-Iceberg data sources through Iceberg GlueCatalog, starting with Amazon Redshift data right away, and will be extended to many more federated data sources in subsequent releases of the Glue service in 2025. The extensions library is used to communicate with the [Glue catalog extensions API](https://editor-next.swagger.io/?url=https://raw.githubusercontent.com/awslabs/glue-extensions-for-iceberg/refs/heads/main/glue-extensions-api.yaml) is another set of APIs in OpenAPI specification that we have added and can be viewed as extensions to the Glue Catalog APIs and Glue IRC APIs to enable additional functionalities that we have been discussing in open source Iceberg IRC spec for scan planning, fine-grained data commit and long-running transaction supports. As we continue to discuss these IRC features in open source, AWS Glue customers will be able to use these features early with all AWS analytics service integrations through this extensions API that is integrated with the GlueCatalog component in Iceberg. @jackye1995 @yyanyy -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
