jkolash commented on issue #13300: URL: https://github.com/apache/iceberg/issues/13300#issuecomment-2966099141
The maintenence jobs that run normally may attempt to delete files at the snapshotted location. Which may be undesirable. I do actually snapshot the same tables repeatedly and turn this off. My recommendation if you want to do this is to disable file file deletion logic in maintenence jobs and rely only on orphan file deletion for deleting files. This will in effect only search orphan files inside the standard table location paths. This also speeds up maintenece jobs and the deletion cost is amortized with the orphan cleanup which will do the deletes in bulk. The tradeoff is you may be keeping files around longer than necessary between orphan cleanups. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
