mxm commented on issue #15846: URL: https://github.com/apache/iceberg/issues/15846#issuecomment-5539458264
In https://github.com/apache/iceberg/pull/15913 we concluded, that it's not possible to retain correctness with unaligned checkpointing enabled, at least not with the current design where we flush on receiving the checkpoint barrier. We would need a different design where we only finish writing when the checkpoint completes, allowing any buffered records in unaligned checkpoints to get included. This is a substantial change we cannot make in time for this release. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
