[
https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842453#comment-17842453
]
Kirk True commented on KAFKA-16623:
-----------------------------------
If I add the following code to {{test_fencing_static_consumer}} before stopping
the consumer, the test runs:
{code:python}
# Make sure the conflicting consumers are all dead, but then go
ahead and stop them all to ensure
# that everything is cleanly stopped, otherwise we may get
spurious errors
assert len(conflict_consumer.dead_nodes()) ==
len(conflict_consumer.nodes), "Conflicting consumers should all have received
errors on startup and quit"
conflict_consumer.stop_all()
wait_until(lambda: len(conflict_consumer.dead_nodes()) ==
len(conflict_consumer.nodes),
timeout_sec=self.session_timeout_sec+5,
err_msg="Timed out waiting for the conflict consumer
to shutdown")
{code}
I'm still investigating, though, as I'm not sure if this is a "fix" or if it
"masks" a real issue.
> KafkaAsyncConsumer system tests warn about revoking partitions that weren't
> previously assigned
> -----------------------------------------------------------------------------------------------
>
> Key: KAFKA-16623
> URL: https://issues.apache.org/jira/browse/KAFKA-16623
> Project: Kafka
> Issue Type: Bug
> Components: clients, consumer, system tests
> Affects Versions: 3.8.0
> Reporter: Kirk True
> Assignee: Kirk True
> Priority: Critical
> Labels: consumer-threading-refactor, kip-848-client-support,
> system-tests
> Fix For: 3.8.0
>
>
> When running system tests for the KafkaAsyncConsumer, we occasionally see
> this warning:
> {noformat}
> File "/usr/lib/python3.7/threading.py", line 917, in _bootstrap_inner
> self.run()
> File "/usr/lib/python3.7/threading.py", line 865, in run
> self._target(*self._args, **self._kwargs)
> File
> "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/venv/lib/python3.7/site-packages/ducktape/services/background_thread.py",
> line 38, in _protected_worker
> self._worker(idx, node)
> File
> "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py",
> line 304, in _worker
> handler.handle_partitions_revoked(event, node, self.logger)
> File
> "/home/jenkins/workspace/system-test-kafka-branch-builder/kafka/tests/kafkatest/services/verifiable_consumer.py",
> line 163, in handle_partitions_revoked
> (tp, node.account.hostname)
> AssertionError: Topic partition TopicPartition(topic='test_topic',
> partition=0) cannot be revoked from worker20 as it was not previously
> assigned to that consumer
> {noformat}
> It is unclear what is causing this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
