flyrain commented on PR #9141: URL: https://github.com/apache/iceberg/pull/9141#issuecomment-1861376560
Think a bit more, it will break the compatibility by changing the behavior of ExpireSnapshot procedure. Some users already relies on a combination of `delete` and `expire-snapshot` to remove data permanently. The change will break the assumption. To make sure CDC view work well, 1. Users need to keep more snapshots 2. Providing an option to ignore the deleted data files, so that the CDC process can continue. We will lose the changelogs for deleted records though. WDYT? cc @RussellSpitzer @aokolnychyi @szehon-ho -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
