Have you done a Java heap dump to see what the most common objects are?

-- Jack Krupansky

From: Annette Newton 
Sent: Wednesday, November 28, 2012 11:06 AM
To: solr-user@lucene.apache.org 
Cc: Andy Kershaw 
Subject: Permanently Full Old Generation...

Hi,

 

I’m hoping someone can help me with an issue we are encountering with solr 
cloud..

 

We are seeing strange gc behaviour after running solr cloud under quite heavy 
insert load for a period of time.  The old generation becomes full and no 
amount of garbage collection will free up the memory.  I have attached a memory 
profile, as you can see it gets progressively worse as the day goes on to the 
point where we are always doing full garbage collections all the time.  The 
only way I have found to resolve this issue is to reload the core, then 
subsequent garbage collections reclaim the used space, that’s what happened at 
3pm on the Memory profile.  All the nodes eventually display the same behaviour.

 

We have multiple threads running adding batches of upto 100 documents at a 
time.  I have also attached our Schema and Config.

 

We are running 4 shards each with a single replica, have a 3 node zookeeper 
setup and the 8 solr boxes instances are aws High-Memory Double Extra Large 
with 34.2 GB Memory, 4 Virtual cores.

 

Thanks in advance

 

Annette Newton

Reply via email to