Hi Subroto,
It will not use yarn-env.sh for launching the application master. NM uses
the environment set by the client for launching application master. Can you
set the environment variables in /etc/profile or update the yarn application
classpath with the absolute paths.
Thanks
Devaraj
________________________________
From: Subroto [[email protected]]
Sent: Tuesday, June 05, 2012 2:25 PM
To: [email protected]
Subject: Re: java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/v2/app/MRAppMaste
Hi Deva,
Thanks for your response.
The file etc/hadoop/yarn-env.sh has the following entries:
export HADOOP_MAPRED_HOME=/usr/local/hadoop
export HADOOP_COMMON_HOME=/usr/local/hadoop
export HADOOP_HDFS_HOME=/usr/local/hadoop
export YARN_HOME=/usr/local/hadoop
export HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop
export YARN_CONF_DIR=$HADOOP_CONF_DIR
Is it expected to have these variables in profile file of the Linux user??
I am not using Windows client. My client is running on Mac and the cluster is
running on Linux versions.
Cheers,
Subroto Sanyal
On Jun 5, 2012, at 10:50 AM, Devaraj k wrote:
Can you check all the hadoop environment variables are set properly in which
the app master is getting launching.
If you are submitting from windows, this might be the issue
https://issues.apache.org/jira/browse/MAPREDUCE-4052.
Thanks
Devaraj
________________________________
From: Subroto [[email protected]<mailto:[email protected]>]
Sent: Tuesday, June 05, 2012 2:14 PM
To: [email protected]<mailto:[email protected]>
Subject: java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/v2/app/MRAppMaste
Hi,
While running MR Jobs over a yarn cluster I keep on getting:
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/v2/app/MRAppMaster
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.mapreduce.v2.app.MRAppMaster
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster.
Program will exit.
My client is running from a different environment from where the cluster is
running.
If I submit a job from the cluster environment; it runs successfully.
I have verified the property yarn.application.classpath before submitting it
from the client. The value is set to:
$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*,$YARN_HOME/*,$YARN_HOME/lib/*
Please let me know if I am missing anything.
Cheers,
Subroto Sanyal
