geruh opened a new pull request, #13344: URL: https://github.com/apache/iceberg/pull/13344
This PR back ports the row lineage support in row-level operations from Spark 3.5 that was done in #12736 to Spark 3.4. Which was mostly a 1:1 port from 3.5, however Spark 3.4 uses custom Iceberg rules that aren't exactly the same as the changes that were merged into Spark itself. ### Key Differences from 3.5 * Custom Iceberg Rules in 3.4 (i.e. `MergeIntoIcebergTable, UpdateIcebergTable`) So we adapt to use these instead * Spark 3.4 doesn't have support for`WHEN NOT MATCHED BY SOURCE`, so we ingore in backport * `SparkParquetReader` didn't have handling for row lineage columns yet Everything else was a straight port from 3.5 with the logical plan name changes. cc: @amogh-jahagirdar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
