Re: solr OOM Crash

2014-01-09 Thread Sébastien Michel
Hi Sandra, Excuse me for the late reply. We use lotsofcores (http://wiki.apache.org/solr/LotsOfCores) Solr feature, around 100 simultaneous loaded cores. But the issue is reproducible with few less cores. We also have a high rate of indexing, and also reindexing (atomic update). We are indexing m

Re: solr OOM Crash

2013-12-30 Thread Sandra Scott
Hello Sébastien, Can you give some information about your environment so I can make sure we are having the same problem you had? Also, did you find out what caused the GC to go crazy or what caused the increased commit rate? Thanks, Sandra On Thu, Dec 19, 2013 at 12:34 PM, Sébastien Michel < se

Re: solr OOM Crash

2013-12-19 Thread Sébastien Michel
Hi Sandra, I'm not sure if your problem is same as ours, but we encountered the same issue on our Solr 4.2, the major memory usage was due to CompressingStoredFieldsReader and GC became crazy. In our context, we have some stored fields and for some documents the content of the text field could be

Re: solr OOM Crash

2013-12-12 Thread Otis Gospodnetic
Hi Sandra, Not a direct answer, but if you are seeing this around merges, have you tried relaxing the merge factor to, say, 10? Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Thu, Dec 12, 2013 at 12:10 PM, Sandra Scott wr

solr OOM Crash

2013-12-12 Thread Sandra Scott
Helllo, We are experiencing unexplained OOM crashes. We have already seen it a few times, over our different solr instances. The crash happens only at a single shard of the collection. Environment details: 1. Solr 4.3, running on tomcat. 2. 24 Shards. 3. Indexing rate of ~800 docs per minute. So