RussellSpitzer opened a new pull request, #12319: URL: https://github.com/apache/iceberg/pull/12319
Fixes #12273 I wrote a full overview of the behavior on the above ticket but the fix here is relatively simple. Instead of attempting to intuit what the Partition Spec should be and blindly using "0" as the given specId for any added files, we look in the table to see if there currently exists a Spec which contains a partitioning identical to the one in the Spark table. We should extend this in the future to potentially handle V1 Tables (with null partitions being ignored) and cases where the Iceberg table partitioning ordering is different than the source table. For now I wanted to fix this as cleanly as possible while preserving the old behavior. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
