zhongqishang commented on issue #10765: URL: https://github.com/apache/iceberg/issues/10765#issuecomment-2247428566
> As a result, the commit for checkpoint id 19516 was performed twice, pointing to the same data file. @pvary I think we can clean `checkpointsState` in `notifyCheckpointComplete` to avoid submitting duplicate files after restart. WDYT? But submitting files repeatedly does not generate duplicate data. @maekchi You can check the snapshot information of checkpoint id = 19518. If possible, you can use [Time travel](https://iceberg.apache.org/docs/nightly/spark-queries/#time-travel) to confirm which specific submission caused the duplicate data. ```sql SELECT * FROM prod.db.table VERSION AS OF 10963874102873; ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
