FranMorilloAWS commented on issue #9089: URL: https://github.com/apache/iceberg/issues/9089#issuecomment-1813965148
Its Flink Version 1.13.2. Currently it would be complicated to update Iceberg version as the application has a lot of state. Checkpoints are being triggered and finished as scheduled, however there are no commits happening to the tables. And when a commit does happen, it happens at random times. The issue started to appear after scaling the application's parallelism. How can i detect if its a concurrent commit. In the logs i can't find any exception, or error, or the Flink Application restarting. Dont want to update Iceberg version and Flink Version without finding the root cause. Its a Flink application that its writing to multiple Iceberg Tables in S3 In logs I am able to see: - org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.notifyCheckpointComplete - Discarding local task state snapshot TaskOperatorSubtaskStates - Start to flush snapshot state to state backend, table: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
