albertmorenosugr commented on issue #14851: URL: https://github.com/apache/iceberg/issues/14851#issuecomment-3673021811
You can verify this by inspecting the DAG and physical plans of the MERGE INTO operation. I also reproduced your scenario with a unit test using the Apache Iceberg Spark 4.x extension, where the changelog behaves as expected. This confirms that the issue is specific to Spark 3.5 MERGE execution semantics rather than Iceberg itself. Iceberg support for Spark 4.x is available starting from Iceberg 1.10.0, and upgrading to this stack should resolve the issue. Feel free to come back to me if the issue persists. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
