Re: [I] When deleting data from Iceberg tables in Spark, the current approach is to delete all data and then rewrite the new data, which is very wasteful in terms of storage space and computation. However, when using the Trino engine to delete data from Iceberg tables, it only marks the data to be deleted with the pos flag. It is hoped that Iceberg's Spark runtime can do the same. [iceberg]

[via GitHub]

amitgilad3 commented on issue #9891:
URL: https://github.com/apache/iceberg/issues/9891#issuecomment-1984132293

   i think that if you set write.delete.mode = merge-on-read in the table 
configuration then spark will do positional deletes , the default for it 
according to the docs is copy-on-write - 
https://iceberg.apache.org/docs/latest/configuration/#write-properties:~:text=write.-,delete,-.mode.
   Trino does this by default since they dont supoort copy-on-write


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org