The GitHub Actions job "Flink Connector Kafka CI" on 
flink-connector-kafka.git/main has failed.
Run started by GitHub user MartijnVisser (triggered by MartijnVisser).

Head commit for run:
01e1a7744ebdb64de3cb00b50d2603e48227a3e0 / MartijnVisser 
<[email protected]>
[FLINK-31006][Connectors/Kafka] Signal no more splits after a restored bounded 
enumerator finds no partition changes

When the enumerator is recreated from state, its one-time discovery finds
every subscribed partition already assigned, so checkPartitionChanges
returns early on the empty change and never reaches
handlePartitionSplitChanges, the only place that sets
noMoreNewPartitionSplits. The re-registered readers therefore wait for a
NoMoreSplitsEvent that never arrives and a bounded source never finishes.
The same early return hangs a bounded source that subscribes to no
existing partition on a fresh start.

Let an empty change through for a bounded source with one-time discovery,
so that it reaches handlePartitionSplitChanges and signals the registered
readers. Unbounded sources keep returning early: treating an empty change
as a finished discovery would make partitions found later start from the
earliest offset rather than the configured one. A bounded source that
started without partitions now snapshots initialDiscoveryFinished as true
too, but it finishes straight away, so a restore from that state is not
expected in practice.

Signalling from addReader on the restored initialDiscoveryFinished flag
would finish a reader before the post-restore discovery assigns it a
partition created while the job was down, which is why apache/flink#21909
was rejected. testRestoredBoundedEnumeratorAssignsBeforeItSignals pins
that ordering.

The early return came in with 0b38d1a9; before it, the discovery callback
always ran.

KafkaSourceBoundedRestoreITCase covers the reported symptom over
stop-with-savepoint and restore. In KafkaSourceEnumeratorTest, a
parameterised test covers the restore and the empty subscription, and two
more pin the unbounded source that keeps skipping an empty change and the
assign-before-signal ordering. DynamicKafkaSourceEnumeratorTest covers the
same restore through the sub-enumerators.

Generated-by: Claude Code (Claude Opus 5.5)

Report URL: 
https://github.com/apache/flink-connector-kafka/actions/runs/40103378944

With regards,
GitHub Actions via GitBox

Reply via email to