Not familiar with AWS but this warning can be work arounded by upping the IPC default length limit: See if you can update core-site.xml, change the property ipc.maximum.response.length which has the default of 128MB (=128*1024*1024) to something bigger, such as 256MB.
On Thu, Jun 16, 2022 at 10:05 AM Leon Xu <[email protected]> wrote: > Hi Hadoop/Yarn Users, > > I am trying to set up AWS ALB(application load balancer) for YARN resource > managers. I am wondering if anyone has experience on that? > I am able to connect my yarn client to the YARN RM instance directly. But > after I set up the ALB and try to connect through the ALB, I am getting > this error: > > *java.io.IOException: Failed on local exception: > org.apache.hadoop.ipc.RpcException: RPC response exceeds maximum data > length;* > > Wondering if anyone has ideas > > Thanks > Leon > > >
