[
https://issues.apache.org/jira/browse/KAFKA-19181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chirag Wadhwa updated KAFKA-19181:
----------------------------------
Description:
The nightly runs for system tests has picked failures for the following 2 tests
-
1) test_share_multiple_partitions
2) test_broker_failure
Investigation analysis -
1) for the first test, 3 brokers are run, with 3 share consumers (all part of
same group). A million messages are produced to a topic with 3 partitions. Once
the messages are produced and consumed, the assertions include checks that all
consumers include some messages for all share partitions. But with the new
SimpleAssignor algorithm in place, some consumers are not assigned some
partitions, so they don't consume from those share partitions, resulting into
assertion failures.
Fix - change the test to first find the assignment of the consumers using the
kafka-share-groups.sh --describe command and only include assertions for
assigned share partitions
2) In progress
> Investigate system test failures
> --------------------------------
>
> Key: KAFKA-19181
> URL: https://issues.apache.org/jira/browse/KAFKA-19181
> Project: Kafka
> Issue Type: Sub-task
> Reporter: Chirag Wadhwa
> Assignee: Chirag Wadhwa
> Priority: Major
>
> The nightly runs for system tests has picked failures for the following 2
> tests -
> 1) test_share_multiple_partitions
> 2) test_broker_failure
> Investigation analysis -
> 1) for the first test, 3 brokers are run, with 3 share consumers (all part of
> same group). A million messages are produced to a topic with 3 partitions.
> Once the messages are produced and consumed, the assertions include checks
> that all consumers include some messages for all share partitions. But with
> the new SimpleAssignor algorithm in place, some consumers are not assigned
> some partitions, so they don't consume from those share partitions, resulting
> into assertion failures.
> Fix - change the test to first find the assignment of the consumers using the
> kafka-share-groups.sh --describe command and only include assertions for
> assigned share partitions
>
> 2) In progress
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
