philipnee opened a new pull request, #15548:
URL: https://github.com/apache/kafka/pull/15548
Adding this as part of the greater effort to modify the system tests to
incorporate the use of consumer group protocol from KIP-848. Following is the
test results and the tests using protocol = consumer are expected to fail:
```
================================================================================
SESSION REPORT (ALL TESTS)
ducktape version: 0.11.4
session_id: 2024-03-16--002
run time: 76 minutes 36.150 seconds
tests run: 28
passed: 25
flaky: 0
failed: 3
ignored: 0
================================================================================
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 2 minutes 5.067 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 2 minutes 3.908 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: FAIL
run time: 12 minutes 10.546 seconds
TimeoutError('consume_workload failed to finish in the expected amount
of time.')
Traceback (most recent call last):
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
186, in _do_run
data = self.run_test()
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
246, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
433, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/consume_bench_test.py",
line 111, in test_consume_bench
consume_workload.wait_for_done(timeout_sec=360)
File "/opt/kafka-dev/tests/kafkatest/services/trogdor/trogdor.py", line
352, in wait_for_done
wait_until(lambda: self.done(),
File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
58, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
last_exception
ducktape.errors.TimeoutError: consume_workload failed to finish in the
expected amount of time.
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.0-4.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 2 minutes 2.461 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 2 minutes 6.186 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 2 minutes 4.417 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: PASS
run time: 2 minutes 4.510 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_consume_bench.topics=.consume_bench_topic.0-5.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 2 minutes 0.361 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 2 minutes 14.046 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 2 minutes 14.037 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: FAIL
run time: 10 minutes 33.474 seconds
TimeoutError('consume_workload failed to finish in the expected amount
of time.')
Traceback (most recent call last):
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
186, in _do_run
data = self.run_test()
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
246, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
433, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/consume_bench_test.py",
line 256, in test_multiple_consumers_random_group_partitions
consume_workload.wait_for_done(timeout_sec=360)
File "/opt/kafka-dev/tests/kafkatest/services/trogdor/trogdor.py", line
352, in wait_for_done
wait_until(lambda: self.done(),
File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
58, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
last_exception
ducktape.errors.TimeoutError: consume_workload failed to finish in the
expected amount of time.
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_partitions.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 2 minutes 12.690 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 1 minute 59.728 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 2 minutes 4.751 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: PASS
run time: 2 minutes 2.370 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_random_group_topics.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 1 minute 57.040 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 1 minute 14.091 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 1 minute 15.042 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: PASS
run time: 1 minute 14.844 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_multiple_consumers_specified_group_partitions_should_raise.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 1 minute 12.074 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 1 minute 58.561 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 2 minutes 0.083 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: FAIL
run time: 5 minutes 28.610 seconds
TimeoutError('consume_workload failed to finish in the expected amount
of time.')
Traceback (most recent call last):
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
186, in _do_run
data = self.run_test()
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
246, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
433, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/consume_bench_test.py",
line 146, in test_single_partition
consume_workload.wait_for_done(timeout_sec=180)
File "/opt/kafka-dev/tests/kafkatest/services/trogdor/trogdor.py", line
352, in wait_for_done
wait_until(lambda: self.done(),
File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
58, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
last_exception
ducktape.errors.TimeoutError: consume_workload failed to finish in the
expected amount of time.
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_single_partition.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 1 minute 56.572 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=False
status: PASS
run time: 2 minutes 6.544 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=classic
status: PASS
run time: 2 minutes 6.178 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ISOLATED_KRAFT.use_new_coordinator=True.group_protocol=consumer
status: PASS
run time: 2 minutes 4.364 seconds
--------------------------------------------------------------------------------
test_id:
kafkatest.tests.core.consume_bench_test.ConsumeBenchTest.test_two_consumers_specified_group_topics.metadata_quorum=ZK.use_new_coordinator=False
status: PASS
run time: 2 minutes 1.623 seconds
--------------------------------------------------------------------------------
================================================================================
FAILED TEST SUITE
Test suite to rerun failed tests:
/opt/kafka-dev/results/2024-03-16--002/rerun-failed.yml
================================================================================
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
