AllenWee1106 commented on issue #9218: URL: https://github.com/apache/iceberg/issues/9218#issuecomment-1842133235
@Fokko However, the following anomalies are occurring frequently now： `Caused by: org.apache.iceberg.exceptions.CommitFailedException: Cannot commit datalake.slp_quality: metadata location s3://warehouse/datalake/SLP_Quality/metadata/6390c7416eff.metadata.json has changed from s3://warehouse/datalake/SLP_Quality/metadata/b167af31b5fa.metadata.json org.apache.iceberg.jdbc.JdbcTableOperations.validateMetadataLocation(JdbcTableOperations.java:211) ` regarding this question, This is the issue I raised: https://github.com/apache/iceberg/issues/9178 , the analysis provided by the technical personnel is likely due to a large number of concurrent operations causing this problem to occur. Iceberg has a retry mechanism, but it also affects the time it takes for my task to end. It should have been around 10 minutes, but now it takes about 40 minutes for this issue to occur, and sometimes it can cause the task to fail directly. Therefore, I would like to inquire about how such issues can be quickly and efficiently resolved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
