What OS do you have? For 2.8.3 you can set yarn.nodemanager.resource.detect-hardware-capabilities to true and then either don’t set any values for yarn.nodemanager.resource.memory-mb and yarn.nodemanager.resource.cpu-vcores or explicitly set both to -1. As a result, they will be automatically calculated based on the actual resource available, so you won’t need to modify yarn-site when you add resources.
-Gour From: Soheil Pourbafrani <[email protected]> Date: Friday, April 27, 2018 at 12:18 AM To: "[email protected]" <[email protected]> Subject: How to configurate nodemanagers resources dynamically Hi, I use Hadoop 2.8.3 In nodemanager's yarn-site.xml, we should set properties to determine how much memory and vcore that nodemanager will devote to resourcemanager. I want to know is any way to set this resources (memory and vcore) dynamically, because now, every time I want to add resources, I should change the configuration in yarn-site.xml!
