How about simply increasing the heap size if RAM is available? You should also check the update handler config, e.g. auto commit, if docs aren’t being written to disk, they would be hanging around in memory. And “openSearcher” setting too as opening new searchers consumes memory, especially if expensive warm-up requests are configured.
Setup some graphs, monitoring the JVM heap, indexing rate, pending docs etc etc. Boon --- Boon Low Lead Big Data / Search Engineer DCT Family History On 24 Jul 2014, at 15:12, François Schiettecatte <fschietteca...@gmail.com<mailto:fschietteca...@gmail.com>> wrote: A default garbage collector will be chosen for you by the VM, might help to get the stack trace to look at. François On Jul 24, 2014, at 10:06 AM, Ameya Aware <ameya.aw...@gmail.com<mailto:ameya.aw...@gmail.com>> wrote: ooh ok. So you want to say that since i am using large heap but didnt set my garbage collection, thats why i why getting java heap space error? On Thu, Jul 24, 2014 at 9:58 AM, Marcello Lorenzi <mlore...@sorint.it<mailto:mlore...@sorint.it>> wrote: I think that on large heap is suggested to monitor the garbage collection behavior and try to add a strategy adapted to your performance. On my production environment with a heap of 6 GB I set this parameter (server with 8 cores): -server -Xms6144m -Xmx6144m -XX:MaxPermSize=512m -Dcom.sun.management.jmxremote -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -XX:+CMSParallelRemarkEnabled -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=70 -XX:ConcGCThreads=6 -XX:ParallelGCThreads=6 Marcello On 07/24/2014 03:53 PM, Ameya Aware wrote: I did not make any other change than this.. rest of the settings are default. Do i need to set garbage collection strategy? On Thu, Jul 24, 2014 at 9:49 AM, Marcello Lorenzi <mlore...@sorint.it<mailto:mlore...@sorint.it>> wrote: Hi, Did you set a Garbage collection strategy on your JVM ? Marcello On 07/24/2014 03:32 PM, Ameya Aware wrote: Hi I am in process of indexing around 2,00,000 documents. I have increase java jeap space to 4 GB using below command : java -Xmx4096M -Xms4096M -jar start.jar Still after indexing around 15000 documents it gives java heap space error again. Any fix for this? Thanks, Ameya ________________________________ This message is confidential and may contain privileged information. You should not disclose its contents to any other person. If you are not the intended recipient, please notify the sender named above immediately. It is expressly declared that this e-mail does not constitute nor form part of a contract or unilateral obligation. Opinions, conclusions and other information in this message that do not relate to the official business of D.C. Thomson Family History shall be understood as neither given nor endorsed by it. ________________________________ This email has been checked for virus and other malicious content prior to leaving our network.
