zhengchenyu commented on PR #4450: URL: https://github.com/apache/hadoop/pull/4450#issuecomment-1314709006
@slfan1989 In AsyncDispatcher event execute in sequence. If one operation is slow, the size of queue will increase, resourcemanager will work in bad performance. We can't do any high cost operation in "RM Event dispatcher". In my experience, connect to zookeeper in "RM Event dispatcher" would be bottleneck when cluster is over 4~5k. The difference is below code. I think here should do in async mode https://github.com/apache/hadoop/blob/a48e8c9bebf4ab7b46eccac07e9743d4038b45c2/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/RMAppManager.java#L365 @szilard-nemeth @goiri We have some difference, can you give us some suggesstion? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
