szehon-ho opened a new pull request, #10020: URL: https://github.com/apache/iceberg/pull/10020
The position_deletes metadata table (used to rewrite_position_deletes) has both 'partition' field and row field (esesentially the table schema again, for the optional 'row' column of position deletes). If the table has over 1000 columns, than the field ids will collide. Attempts to re-assign field id of the 'partition' fields does not work, as the partition field seem needed while reading manifests. So this re-assigns the 'row' field ids. This fix seems to work because 'rewrite_position_deletes' procedure should not have any filters targeting 'row', only partitions. In addition, the position_deletes table does not do predicate pushdown for any filter on 'row'. However, I am open if there are better ideas. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
