pvary commented on issue #9089: URL: https://github.com/apache/iceberg/issues/9089#issuecomment-1855679569
@FranMorilloAWS: Do you have data committed to the tables where the checkpointId is not increased? Normally, if Flink sees a commit without additional files, it just skips creating an empty Iceberg commit. In this case we store in the state that there is an empty commit. To clean up the state eventually, after 10 empty commits we still write out an empty commit to Iceberg with the current checkpointId, and purge the state. The number of empty commits to keep in state could be configured by the `flink.max-continuous-empty-commits` table property. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
