Hi everyone, A couple of days back I encountered a weird problem of continuously increasing memory consumption. I am not sure if this is a problem of java or Solr (3.4).
Till 3 days ago, we were running Solr 3.4 instance with following java command line options java -server -*Xms2048m* -*Xmx4096m* -Dsolr.solr.home=etc -jar start.jar Then we increased the memory with following options and restarted the server java -server *-**Xms4096m* -*Xmx10g* -Dsolr.solr.home=etc -jar start.jar (Let me tell that we were not facing memory issues. It was just because we were expecting more queries in near future) Since we restarted Solr, the memory usage of application is continuously increasing. The swap usage goes from almost zero to as high as 4GB in every 6-8 hours. We kept restarting the Solr to push it down to ~zero but the same memory usage trend kept repeating itself. We analyzed if query-rate or query-parameters were changed but nothing was found. We distributed the queries over two servers and found that a set of particular queries is creating problem. There were some queries to negatively boost records of particular countries with following parameter bq=(*:* -countryiso:(WX XY YZ))^1000 The server receiving these queries was still eating memory. Then finally I reverted the least expected change, the command line memory options, back to min 2g, max 4g and I was surprised to see that the problem vanished. java -server *-Xms2g* *-Xmx4g* -Dsolr.solr.home=etc -jar start.jar Is this a memory leak or my lack of understanding of java/linux memory allocation? Any help is appreciated. *We are using:* Solr 3.4 java version "1.6.0_22" Java(TM) SE Runtime Environment (build 1.6.0_22-b04) Java HotSpot(TM) 64-Bit Server VM (build 17.1-b03, mixed mode) Linux 2.6.18-274.3.1.el5 *Hardware:* 16GB RAM Intel(R) Xeon(R) CPU X5675 @ 3.07GHz (*24 processors*) Solid State Drive *Index:* Total documents:14.6 million Index size:33GB A duplicate core with 31GB but only one core is used at a time. We swap those after a full indexing. -- Regards, Samar
