Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Shawn Heisey
On 8/24/2015 12:48 AM, Pavel Hladik wrote: > we have a Solr 5.2.1 with 9 cores and one of them has 140M docs. Can you > please recommend tuning of those GC parameters? The performance is not a > issue, sometimes during peaks we have OOM and we use 50G of heap memory, the > server has 64G of ram. >

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Toke Eskildsen
On Mon, 2015-08-24 at 03:17 -0700, Pavel Hladik wrote: > It seems that most elements are really on 31G, but can we say that Solr > application is used like a number of elements from this result? Fortunately Solr uses a lot of bit packing, which often translates to arrays of longs, which take up th

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Pavel Hladik
Very interesting, never heard about that. We tested on our x64 linux with java 1.8.0_51 and result is: java -jar -Xms31g -Xmx31g -Xmn50m memory.jar Total Memory (in bytes): 33279705088 Free Memory (in bytes): 33277314136 Max Memory (in bytes): 33279705088 Elements created and added to LinkedList:

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Rallavagu
One other item to check is non heap memory usage. This can be monitored from admin page. On 8/23/15 11:48 PM, Pavel Hladik wrote: Hi, we have a Solr 5.2.1 with 9 cores and one of them has 140M docs. Can you please recommend tuning of those GC parameters? The performance is not a issue, sometim

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Toke Eskildsen
On Sun, 2015-08-23 at 23:48 -0700, Pavel Hladik wrote: > we have a Solr 5.2.1 with 9 cores and one of them has 140M docs. Can you > please recommend tuning of those GC parameters? The performance is not a > issue, sometimes during peaks we have OOM and we use 50G of heap memory, the > server has 64

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Pavel Hladik
On sorting fields we have: -- View this message in context: http://lucene.472066.n3.nabble.com/GC-parameters-tuning-for-core-of-140M-docs-on-50G-of-heap-memory-tp4224813p4224820.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: GC parameters tuning for core of 140M docs on 50G of heap memory

2015-08-24 Thread Yago Riveiro
Do you have docValues on for your fields? On Mon, Aug 24, 2015 at 7:48 AM, Pavel Hladik wrote: > Hi, > we have a Solr 5.2.1 with 9 cores and one of them has 140M docs. Can you > please recommend tuning of those GC parameters? The performance is not a > issue, sometimes during peaks we have OOM a