developer-rpai opened a new pull request, #18439: URL: https://github.com/apache/iceberg/pull/18439
When ConvertEqualityDeletes shares the Flink-maintained lock with another maintenance task, the lock is never released: EqualityConvertCommitter.processWatermark drops watermarks while planResult == null, stalling the unioned watermark that LockRemoverOperator needs to emit the lock release. The fix forwards watermarks when no conversion cycle is active and keeps the hold-back behavior mid-cycle. Fixes #18435. Test plan: new forwardsWatermarkWithoutActiveCycle unit test asserts a watermark is forwarded with no plan received; existing holdsBackWatermarkUntilCommit still covers the mid-cycle hold-back. Note: the same pattern exists in flink/v1.20 and flink/v2.2 — left for a follow-up to keep this minimal. Could not compile locally (no JDK on this machine); relying on CI. --- **AI Disclosure** - Model: Muse Spark 1.3 (Meta) - Platform/Tool: Muse personal agent - Human Oversight: partially reviewed - Prompt Summary: Investigate apache/iceberg#18435 (Flink maintenance-lock deadlock) and implement the fix with a unit test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
