ZENOTME commented on PR #798: URL: https://github.com/apache/iceberg-rust/pull/798#issuecomment-2558853987
> > Is it possible to have action like combing fast append and append delete file and data file? In fact, I try this in practice and it can be read by spark. And for this action, I think we don't need the ManifestMergerManager. > > The reason we can have a fast append action in iceberg is that append only data file always have no conflict with other actions. Remember that iceberg supports concurrent write, so for update/deletion actions, we need to detect conflction. It works in simple case doesn't mean it's right. Do you mean that for appending only the data file, we can always retry by using the original data file, but for delete data file, the related data may be deleted already, so we should use something like ManifestMergerManager to merge and discard the useless delete file. I think for now we have conflicting detect using uuid, but we don't have the retry. https://github.com/apache/iceberg-rust/blob/90115e0167e9bf715aed6344fe1087358de9a9a8/crates/iceberg/src/transaction.rs#L561. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
