nk1506 commented on issue #8670: URL: https://github.com/apache/iceberg/issues/8670#issuecomment-1750610633
Hi @hwfff , I tried to repro with duplicate files as well invalid files. Iceberg is catching all the errors while deleting the files. Although it has BulkDelete as well as single delete file operation. But both types are catching any exceptions. Ref: [DeleteOrphanFilesSparkAction](https://github.com/apache/iceberg/blob/0259918eb2bac08beb1329f53046aa099de15021/spark/v3.5/spark/src/main/java/org/apache/iceberg/spark/actions/DeleteOrphanFilesSparkAction.java#L246 ) If possible , Please share more details like following: - Iceberg Version - Engine details like spark with version. - Catalog details - Also Stacktrace @RussellSpitzer , I couldn't find anything to fix here. Please correct me if I am wrong. I will plan to add test cases with concurrent `remove_orphan_files`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
