This has got nothing to do with the scheduler. I believe this has got to do with some compilation issue. How did you build hadoop?
Also, I found that the repo at github (which is a mirror of git repo at apache) doesn't always pick all the commits immediately. You are better off checking out from svn (http://hadoop.apache.org/common/version_control.html) HTH, +Vinod On Jun 21, 2012, at 9:34 AM, Prajakta Kalmegh wrote: > Okay, the below problem was fixed after commenting out the property to use > CapacityScheduler from my yarn-site.xml. I found a reference to this in > this JIRA <https://issues.apache.org/jira/browse/MAPREDUCE-4339>. YARN now > uses the default FIFO scheduler. > > Is the Dispatcher used in the CapacityScheduler's (or any scheduler's) > flow? > > Thanks in advance. > Regards, > Prajakta > > > > > > On Thu, Jun 21, 2012 at 10:53 AM, Prajakta Kalmegh <[email protected]>wrote: > >> Hi Jagat >> >> Thanks for your reply. I am not using Pig. I have the latest hadoop >> running cloned from github trunk. Actually I was able to execute my >> programs until I refreshed my github foked copy yesterday and ran a build >> on it. :( >> >> I figured out from a debug that the lines that are creating a problem are: >> ---------------- >> //service to log job history events >> EventHandler<JobHistoryEvent> historyService = >> createJobHistoryHandler(context); >> >> dispatcher.register(org.apache.hadoop.mapreduce.jobhistory.EventType.class, >> historyService); >> ---------------- >> in the MRAppMaster.java class. The reason being the register method >> from org.apache.hadoop.yarn.event.Dispatcher is not >> accepting EventHandler<JobHistoryEvent> as the second argument. Not sure >> why. >> >> Regards, >> Prajakta >> >> >> >> On Thu, Jun 21, 2012 at 10:22 AM, Jagat Singh <[email protected]>wrote: >> >>> Seems you are using Pig with Hadoop 0.23 or 2.0 version. >>> >>> Can you quickly recompile pig with 23 option and try this again. >>> >>> >>> >>> On Thu, Jun 21, 2012 at 10:02 AM, Prajakta Kalmegh <[email protected] >>>> wrote: >>> >>>> Hi >>>> >>>> I am getting the following error while trying to execute any example >>>> (wordcount, terasort etc): >>>> 12/06/21 09:52:39 INFO mapreduce.Job: Running job: >>> job_1340251923324_0001 >>>> 12/06/21 09:52:45 INFO mapreduce.Job: Job job_1340251923324_0001 >>> running in >>>> uber mode : false >>>> 12/06/21 09:52:45 INFO mapreduce.Job: map 0% reduce 0% >>>> 12/06/21 09:52:45 INFO mapreduce.Job: Job job_1340251923324_0001 failed >>>> with state FAILED due to: Application application_1340251923324_0001 >>> failed >>>> 1 times due to AM Container for appattempt_1340251923324_0001_000001 >>> exited >>>> with exitCode: 1 due to: >>>> .Failing this attempt.. Failing the application. >>>> 12/06/21 09:52:45 INFO mapreduce.Job: Counters: 0 >>>> ----------------------------- >>>> >>>> *The contents of containers logs are pasted below:* >>>> 2012-06-21 09:52:43,856 INFO [main] >>>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for >>>> application appattempt_1340251923324_0001_000001 >>>> 2012-06-21 09:52:44,625 FATAL [main] >>>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting >>> MRAppMaster >>>> java.lang.Error: Unresolved compilation problems: >>>> The method register(Class<? extends Enum>, EventHandler) in the type >>>> Dispatcher is not applicable for the arguments (Class<EventType>, >>>> EventHandler<JobHistoryEvent>) >>>> org.apache.hadoop.mapreduce.jobhistory.EventType cannot be resolved to >>> a >>>> type >>>> >>>> at >>>> >>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster.init(MRAppMaster.java:261) >>>> at >>>> >>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:1049) >>>> at java.security.AccessController.doPrivileged(Native Method) >>>> at javax.security.auth.Subject.doAs(Subject.java:415) >>>> at >>>> >>>> >>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232) >>>> at >>>> >>>> >>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1046) >>>> at >>>> >>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1010) >>>> 2012-06-21 09:52:44,628 INFO [Thread-0] >>>> org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster received a >>>> signal. Signaling RMCommunicator and JobHistoryEventHandler. >>>> >>>> ---------------------- >>>> >>>> Any idea what would be going wrong? >>>> >>>> Regards, >>>> Prajakta >>>> >>> >> >>
