Have you done a Java heap dump to see what the most common objects are? -- Jack Krupansky
From: Annette Newton Sent: Wednesday, November 28, 2012 11:06 AM To: solr-user@lucene.apache.org Cc: Andy Kershaw Subject: Permanently Full Old Generation... Hi, I’m hoping someone can help me with an issue we are encountering with solr cloud.. We are seeing strange gc behaviour after running solr cloud under quite heavy insert load for a period of time. The old generation becomes full and no amount of garbage collection will free up the memory. I have attached a memory profile, as you can see it gets progressively worse as the day goes on to the point where we are always doing full garbage collections all the time. The only way I have found to resolve this issue is to reload the core, then subsequent garbage collections reclaim the used space, that’s what happened at 3pm on the Memory profile. All the nodes eventually display the same behaviour. We have multiple threads running adding batches of upto 100 documents at a time. I have also attached our Schema and Config. We are running 4 shards each with a single replica, have a 3 node zookeeper setup and the 8 solr boxes instances are aws High-Memory Double Extra Large with 34.2 GB Memory, 4 Virtual cores. Thanks in advance Annette Newton