Fang-Yu Rao created IMPALA-14866:
------------------------------------
Summary: test_dedicated_coordinator_legacy_mem_accounting() seems
to be flaky
Key: IMPALA-14866
URL: https://issues.apache.org/jira/browse/IMPALA-14866
Project: IMPALA
Issue Type: Bug
Reporter: Fang-Yu Rao
Assignee: Yida Wu
We found that
[test_dedicated_coordinator_legacy_mem_accounting()|https://github.com/apache/impala/blame/59504bd/tests/custom_cluster/test_admission_controller.py#L689]
could fail with the following error.
*Error Message*
{code}
AssertionError: expected_mem_limits:{'coordinator': 146755478.0, 'executor':
277183958.0} actual_mem_limits:{'coordinator': 146758696.96, 'executor':
277180579.84} mem_admitted:{'executor': [0.0], 'coordinator': 146758696.96}
assert 277183958.0 < (5 * 1048576)
+ where 277183958.0 = abs((0.0 - 277183958.0))
{code}
*Stacktrace*
{code}
custom_cluster/test_admission_controller.py:694: in
test_dedicated_coordinator_legacy_mem_accounting
self.__verify_mem_accounting(vector, using_dedicated_coord_estimates=False)
self =
<tests.custom_cluster.test_admission_controller.TestAdmissionControllerWithACServiceCompress
object at 0xffff7bbf7c50>
vector = "table_format: text/none" | "protocol: hs2" |
"exec_option: {'abort_on_error': 1, 'batch_size': 0, 'disable_codegen': ...ld':
5000, 'exec_single_node_rows_threshold': 0, 'num_nodes': 0, 'test_replan': 1,
'request_pool': 'root.regularPool'}"
custom_cluster/test_admission_controller.py:777: in __verify_mem_accounting
assert abs(
E AssertionError: expected_mem_limits:{'coordinator': 146755478.0,
'executor': 277183958.0} actual_mem_limits:{'coordinator': 146758696.96,
'executor': 277180579.84} mem_admitted:{'executor': [0.0], 'coordinator':
146758696.96}
E assert 277183958.0 < (5 * 1048576)
E + where 277183958.0 = abs((0.0 - 277183958.0))
MB = 1048576
actual_mem_limits = {'coordinator': 146758696.96, 'executor':
277180579.84}
debug_string = " expected_mem_limits:{'coordinator': 146755478.0,
'executor': 277183958.0} actual_mem_limits:{'coordinator': 146758696.96,
'executor': 277180579.84} mem_admitted:{'executor': [0.0], 'coordinator':
146758696.96}"
expected_mem_limits = {'coordinator': 146755478.0, 'executor':
277183958.0}
handle = <tests.common.impala_connection.OperationHandle object at
0xffff4e9ebc50>
mem_admitted = {'coordinator': 146758696.96, 'executor': [0.0]}
query = 'select * from functional.alltypesagg where id != {0}
union all select * from functional.alltypesagg where id != {0} u...ll select *
from functional.alltypesagg where id != {0} union all select * from
functional.alltypesagg where id != {0}'
self =
<tests.custom_cluster.test_admission_controller.TestAdmissionControllerWithACServiceCompress
object at 0xffff7bbf7c50>
using_dedicated_coord_estimates = False
vector = "table_format: text/none" | "protocol: hs2" |
"exec_option: {'abort_on_error': 1, 'batch_size': 0, 'disable_codegen': ...ld':
5000, 'exec_single_node_rows_threshold': 0, 'num_nodes': 0, 'test_replan': 1,
'request_pool': 'root.regularPool'}"
{code}
It failed the check at
https://github.com/apache/impala/blame/59504bd/tests/custom_cluster/test_admission_controller.py#L777-L779.
{code:python}
assert abs(
mem_admitted['executor'][0] - expected_mem_limits['executor']) < 5 *
MB, \
debug_string
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
