Hi,
I am running 200+ jobs, and each job contains 100 tasks, when i using slsrun.sh
to start SLS.
it came out error:
2018-07-24 04:47:27,957 INFO capacity.CapacityScheduler: Added node
11.178.150.104:1604 clusterResource: <memory:821760000, vCores:15408000, disk:
6099000000M, resource2: 8025G>
Exception in thread "main" java.lang.OutOfMemoryError: unable to create new
native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:717)
at
java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:957)
at
java.util.concurrent.ThreadPoolExecutor.prestartAllCoreThreads(ThreadPoolExecutor.java:1617)
at
org.apache.hadoop.yarn.sls.scheduler.TaskRunner.start(TaskRunner.java:157)
at org.apache.hadoop.yarn.sls.SLSRunner.start(SLSRunner.java:247)
at org.apache.hadoop.yarn.sls.SLSRunner.run(SLSRunner.java:950)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.yarn.sls.SLSRunner.main(SLSRunner.java:957)
I set the Xmx and Xms in Hadoop-env.sh: -Xmx20480m, -Xms20480m, but still
doesn't work.
Anyone help me?
thanks inadvance
Sichen