ajreid21 opened a new pull request, #17713:
URL: https://github.com/apache/iceberg/pull/17713
Suppose one live Coordinator has consumed through offset 109:
Kafka committed offset: 100
Kafka consumer position: 110
Channel next offset: 110
CommitState: -> 109
A rebalance begins:
KafkaConsumer remains the same Java object
Channel remains the same Java object
CommitState remains populated
Under eager assignment, Kafka clears the partition assignment and its
associated fetch position.
The same consumer then receives the same control topic again:
Kafka committed offset: 100
new Kafka consumer position: 100
Channel next offset: 110
CommitState: –>109
The next poll() can return offsets 100–109 again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
