[
https://issues.apache.org/jira/browse/KAFKA-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897431#comment-17897431
]
PoAn Yang commented on KAFKA-16460:
-----------------------------------
> My question is: why was consumer A's assignment revoked?
Hi [~kirktrue], I find the reason. Following is related server log in my
cluster. When the third member join the group, the target assignment changes.
We use RangeAssignor, the assignment change is caused by the change of
member.id relative order.
{noformat}
[GroupId test_group_id] Member a45a9X28TsytoqZU2S0zYQ joins the consumer group
using the consumer protocol.
[GroupId test_group_id] Member a45a9X28TsytoqZU2S0zYQ updated its subscribed
topics to: [test_topic].
[GroupId test_group_id] Computed new subscription metadata:
{test_topic=TopicMetadata(id=mZkLnq_pSLSzCjXUFtuFow, name=test_topic,
numPartitions=1)}.
[GroupId test_group_id] Bumped group epoch to 1.
[GroupId test_group_id] Computed a new target assignment for epoch 1 with
'range' assignor in 5ms:
{a45a9X28TsytoqZU2S0zYQ=MemberAssignment(partitions={mZkLnq_pSLSzCjXUFtuFow=RangeSet(from=0
(inclusive), to=1 (exclusive))})}.
[GroupId test_group_id] Member a45a9X28TsytoqZU2S0zYQ new assignment state:
epoch=1, previousEpoch=0, state=STABLE,
assignedPartitions=[mZkLnq_pSLSzCjXUFtuFow-0] and revokedPartitions=[].
[GroupId test_group_id] Member k6bk7X-vT5SDXzKJtaM7tQ joins the consumer group
using the consumer protocol.
[GroupId test_group_id] Member k6bk7X-vT5SDXzKJtaM7tQ updated its subscribed
topics to: [test_topic].
[GroupId test_group_id] Bumped group epoch to 2.
[GroupId test_group_id] Computed a new target assignment for epoch 2 with
'range' assignor in 1ms:
{a45a9X28TsytoqZU2S0zYQ=MemberAssignment(partitions={mZkLnq_pSLSzCjXUFtuFow=RangeSet(from=0
(inclusive), to=1 (exclusive))}),
k6bk7X-vT5SDXzKJtaM7tQ=MemberAssignment(partitions={})}.
[GroupId test_group_id] Member k6bk7X-vT5SDXzKJtaM7tQ new assignment state:
epoch=2, previousEpoch=0, state=STABLE, assignedPartitions=[] and
revokedPartitions=[].
[GroupId test_group_id] Member TpLC0hQXSpGvGoKocAK18w joins the consumer group
using the consumer protocol.
[GroupId test_group_id] Member TpLC0hQXSpGvGoKocAK18w updated its subscribed
topics to: [test_topic].
[GroupId test_group_id] Bumped group epoch to 3.
[GroupId test_group_id] Computed a new target assignment for epoch 3 with
'range' assignor in 1ms:
{TpLC0hQXSpGvGoKocAK18w=MemberAssignment(partitions={mZkLnq_pSLSzCjXUFtuFow=RangeSet(from=0
(inclusive), to=1 (exclusive))}),
a45a9X28TsytoqZU2S0zYQ=MemberAssignment(partitions={}),
k6bk7X-vT5SDXzKJtaM7tQ=MemberAssignment(partitions={})}.
[GroupId test_group_id] Member TpLC0hQXSpGvGoKocAK18w new assignment state:
epoch=3, previousEpoch=0, state=UNRELEASED_PARTITIONS, assignedPartitions=[]
and revokedPartitions=[].
[GroupId test_group_id] Member TpLC0hQXSpGvGoKocAK18w new assignment state:
epoch=3, previousEpoch=3, state=UNRELEASED_PARTITIONS, assignedPartitions=[]
and revokedPartitions=[].
[GroupId test_group_id] Member a45a9X28TsytoqZU2S0zYQ new assignment state:
epoch=1, previousEpoch=1, state=UNREVOKED_PARTITIONS, assignedPartitions=[] and
revokedPartitions=[mZkLnq_pSLSzCjXUFtuFow-0].
[GroupId test_group_id] Member TpLC0hQXSpGvGoKocAK18w new assignment state:
epoch=3, previousEpoch=3, state=STABLE,
assignedPartitions=[mZkLnq_pSLSzCjXUFtuFow-0] and revokedPartitions=[].
{noformat}
> New consumer times out consuming records in multiple consumer_test.py system
> tests
> ----------------------------------------------------------------------------------
>
> Key: KAFKA-16460
> URL: https://issues.apache.org/jira/browse/KAFKA-16460
> Project: Kafka
> Issue Type: Bug
> Components: clients, consumer, system tests
> Affects Versions: 3.7.0
> Reporter: Kirk True
> Assignee: PoAn Yang
> Priority: Critical
> Labels: kip-848-client-support, system-tests
> Fix For: 4.0.0
>
> Attachments: verifiable_consumer_worker_A.log,
> verifiable_consumer_worker_A.stdout, verifiable_consumer_worker_B.log,
> verifiable_consumer_worker_B.stdout
>
>
> The {{consumer_test.py}} system test fails with the following errors:
> {quote}
> * Timed out waiting for consumption
> {quote}
> Affected tests:
> * {{test_broker_failure}}
> * {{test_consumer_bounce}}
> * {{test_static_consumer_bounce}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
