Solr-8.1.0 uses much more memory

2019-05-26 Thread Joe Doupnik
    Comparing memory consumption (real, not virtual) of quiesent Solr v8.0 and prior with Solr v8.1.0 reveals the older versions use about 1.6GB on my systems but v8.1.0 uses 4.5 to 5+GB. Systems used are SUSE Linux, with Oracle JDK v1.8 and openjdk v10. This is a major memory consumption issue

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Shawn Heisey
On 5/25/2019 9:40 AM, Joe Doupnik wrote:     Comparing memory consumption (real, not virtual) of quiesent Solr v8.0 and prior with Solr v8.1.0 reveals the older versions use about 1.6GB on my systems but v8.1.0 uses 4.5 to 5+GB. Systems used are SUSE Linux, with Oracle JDK v1.8 and openjdk v10

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Joe Doupnik
On 26/05/2019 19:08, Shawn Heisey wrote: On 5/25/2019 9:40 AM, Joe Doupnik wrote: Comparing memory consumption (real, not virtual) of quiesent Solr v8.0 and prior with Solr v8.1.0 reveals the older versions use about 1.6GB on my systems but v8.1.0 uses 4.5 to 5+GB. Systems used are SUSE L

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Jörn Franke
Different garbage collector configuration? It does not mean that Solr uses more memory if it is occupied - it could also mean that the JVM just kept it reserved for future memory needs. > Am 25.05.2019 um 17:40 schrieb Joe Doupnik : > > Comparing memory consumption (real, not virtual) of q

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Joe Doupnik
On 26/05/2019 19:15, Joe Doupnik wrote: On 26/05/2019 19:08, Shawn Heisey wrote: On 5/25/2019 9:40 AM, Joe Doupnik wrote: Comparing memory consumption (real, not virtual) of quiesent Solr v8.0 and prior with Solr v8.1.0 reveals the older versions use about 1.6GB on my systems but v8.1.0 u

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Jörn Franke
I think this is also a very risky memory strategy. What happens if you Index and query at the same time etc. maybe it is more worth to provide as much memory as for concurrent operations are needed. This includes JVM memory but also the disk caches. > Am 26.05.2019 um 20:38 schrieb Joe Doupnik

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Joe Doupnik
On 26/05/2019 19:38, Jörn Franke wrote: Different garbage collector configuration? It does not mean that Solr uses more memory if it is occupied - it could also mean that the JVM just kept it reserved for future memory needs. Am 25.05.2019 um 17:40 schrieb Joe Doupnik : Comparing memory

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Joe Doupnik
    I do queries while indexing, have done so for a long time, without difficulty nor memory usage spikes from dual use. The system has been designed to support that.     Again, one may look at the numbers using "top" or similar. Try Solr v8.0 and 8.1 to see the difference which I experience her

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Shawn Heisey
On 5/26/2019 12:52 PM, Joe Doupnik wrote:     I do queries while indexing, have done so for a long time, without difficulty nor memory usage spikes from dual use. The system has been designed to support that.     Again, one may look at the numbers using "top" or similar. Try Solr v8.0 and 8.1

Re: Solr-8.1.0 uses much more memory

2019-05-26 Thread Joel Bernstein
I'm not sure this issue applies in this situation but it's worth taking a look at: https://issues.apache.org/jira/browse/SOLR-12833?focusedCommentId=16807868&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16807868 Although the memory issue in the ticket involves d