tgorthi opened a new issue, #13850: URL: https://github.com/apache/iceberg/issues/13850
### Apache Iceberg version 1.9.2 (latest release) ### Query engine None ### Please describe the bug 🐞 Hi team, After upgrading Iceberg to 1.9.2, we observed failures when dropping a column with the highest field ID. The operation fails with the following exception: `java.lang.IllegalArgumentException: Invalid last column ID: 1 < 2 (previous last column ID)` lastColumnId was replaced with a call to schema.highestFieldId() in the past 6 months, which seems to be the cause. Reference commit: [[Iceberg commit link](https://github.com/apache/iceberg/commit/30fd752f24d796ce548dbeef550e875941ce6fb7#diff-c9084b0a7dc6e0b40a6fc32f0d22db7e400c248aac70fb17574e385dedee1ce5L109)]. - Works in version 1.8.1. - Fails in versions 1.9.0 and later. - The same schema update succeeds in Glue but fails when using REST. ### Expected behaviour: We should probably validate against the lastColumnId and not the highestFieldId, and be able to drop the column successfully. ### Willingness to contribute - [ ] I can contribute a fix for this bug independently - [x] I would be willing to contribute a fix for this bug with guidance from the Iceberg community - [ ] I cannot contribute a fix for this bug at this time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
