andygrove commented on issue #5122: URL: https://github.com/apache/datafusion-comet/issues/5122#issuecomment-5786261060
Status update, since some of this has landed: | Plan node | State on `main` | |---|---| | `ReplaceDataExec` (copy-on-write DELETE / UPDATE / MERGE) | Done for Iceberg via the split-operator plan and native writer, behind the off-by-default `spark.comet.write.iceberg.splitOperator.enabled` and `spark.comet.iceberg.write.enabled` flags. Copy-on-write MERGE still falls back to the JVM write path because `MergeRowsExec` isn't native yet. | | `MergeRowsExec` | In progress in #5318 (@unikdahal), awaiting review. | | `WriteDeltaExec` (merge-on-read) | Not started. The split plan never intercepts Iceberg `WriteDelta`. | | `InsertOnlyMergeExec` (Spark 4.2+) | Not started. | The dependency on native DataSource V2 writes mentioned above now lives in #5649 (#5121 is closed in its favor), and this issue is tracked there under phase 3. Keeping this open for the merge-on-read and insert-only MERGE paths. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
