duoxoud opened a new pull request, #11334: URL: https://github.com/apache/iceberg/pull/11334
This PR addresses a feature request for improving the Glue schema generation process. It introduces a new configuration option that allows users to exclude non-current fields from the schema, providing clarity and reducing confusion for Athena users who primarily query current data. In PR #3888, the Glue schema generation was modified to include all historical fields. This was intended to help users recognize previously used columns and avoid duplicating column names. However, in practice, this approach has led to confusion among users and incompatibility on AWS Redshift Spectrum (for example, the issue is well explained in #7584 ). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
