beyond-up opened a new issue, #13797:
URL: https://github.com/apache/iceberg/issues/13797
### Query engine
Description
In Iceberg 1.5.2, it seems that the Flink sink does not support the
GlobalCommitter capability.
I’m trying to implement a Flink job where multiple subtasks in the same job
each write to a different partition of an Iceberg table, and then perform a
global commit at the end.
However, what I observe is that each subtask appears to commit
independently, which leads to optimistic lock conflicts in the REST catalog.
This behavior looks like the absence of a true GlobalCommitter stage in the
Flink integration.
### Question
Flink GlobalCommitter support seems missing in Iceberg 1.5.2, causing
commit conflicts when multiple subtasks write different partitions？ If I want
to implement a Flink job where multiple subtasks in the same job each write to
a different partition of an Iceberg table, and then perform a global commit at
the end how should I do?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
