RE: Solr uses lots of shared memory!

2017-09-04 Thread Markus Jelsma
17:08 > To: solr-user@lucene.apache.org > Subject: Re: Solr uses lots of shared memory! > > Hi all > Malloc has a lock while it is active in the heap. If there is more than one > thread, and malloc finds the lock in use, then it avoids waiting on the lock > by creating a

Re: Solr uses lots of shared memory!

2017-09-03 Thread Rick Leir
10K/lib/x86_64-linux-gnu/libz.so.1.2.11 >> 0x7fdf5fc2b000 1813K /lib/x86_64-linux-gnu/libc-2.24.so >> 0x7fdf5fff2000 58K >/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so >> 0x7fdf60201000 158K/lib/x86_64-linux-gnu/ld-2.24.s

Re: Solr uses lots of shared memory!

2017-09-02 Thread Kevin Risden
gnu/libz.so.1.2.11 > 0x7fdf5fc2b000 1813K /lib/x86_64-linux-gnu/libc-2.24.so > 0x7fdf5fff2000 58K > /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so > 0x7fdf60201000 158K/lib/x86_64-linux-gnu/ld-2.24.so > > -Original message-

RE: Solr uses lots of shared memory!

2017-09-01 Thread Markus Jelsma
kus Jelsma > Sent: Thursday 24th August 2017 17:20 > To: solr-user@lucene.apache.org > Subject: RE: Solr uses lots of shared memory! > > Hello Bernd, > > According to the man page, i should get a list of stuff in shared memory if i > invoke it with just a PID. Which sho

RE: Solr uses lots of shared memory!

2017-08-24 Thread Markus Jelsma
r/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so 0x7fdf60201000 158K/lib/x86_64-linux-gnu/ld-2.24.so -Original message- > From:Bernd Fehling > Sent: Thursday 24th August 2017 15:39 > To: solr-user@lucene.apache.org > Subject: Re: Solr uses lots of shared

Re: Solr uses lots of shared memory!

2017-08-24 Thread Bernd Fehling
uot;${solr.directoryFactory:solr.NRTCachingDirectoryFactory}"> > false > > > NRTCachingDirectoryFactory implies MMapDirectory right? > > Thanks, > Markus > > -Original message- >> From:Shalin Shekhar Mangar >> Sent: Thursday 24th A

RE: Solr uses lots of shared memory!

2017-08-24 Thread Markus Jelsma
config is i am wrong: false NRTCachingDirectoryFactory implies MMapDirectory right? Thanks, Markus -Original message- > From:Shalin Shekhar Mangar > Sent: Thursday 24th August 2017 5:51 > To: solr-user@lucene.apache.org > Subject: Re: Solr uses lots of sh

RE: Solr uses lots of shared memory!

2017-08-24 Thread Markus Jelsma
me know what you think. Thanks, Markus -Original message- > From:Erick Erickson > Sent: Thursday 24th August 2017 3:35 > To: solr-user > Subject: Re: Solr uses lots of shared memory! > > I suspect you've already seen this, but top and similar can be >

Re: Solr uses lots of shared memory!

2017-08-23 Thread Shalin Shekhar Mangar
size? > Is anyone else seeing this on their 6.6 cloud production or local machines? > > Thanks, > Markus > > [1]: http://www.evanjones.ca/java-bytebuffer-leak.html > > -----Original message- >> From:Shawn Heisey >> Sent: Tuesday 22nd August 2017 17:32 >> To: solr

Re: Solr uses lots of shared memory!

2017-08-23 Thread Erick Erickson
nst it? We immediately see a sharp rise in shared > memory, MB's per second until it reaches some sort of plateau. > > -Original message- >> From:Shawn Heisey >> Sent: Wednesday 23rd August 2017 16:37 >> To: solr-user@lucene.apache.org >> Subject:

RE: Solr uses lots of shared memory!

2017-08-23 Thread Markus Jelsma
l it reaches some sort of plateau. -Original message- > From:Shawn Heisey > Sent: Wednesday 23rd August 2017 16:37 > To: solr-user@lucene.apache.org > Subject: Re: Solr uses lots of shared memory! > > On 8/23/2017 7:32 AM, Markus Jelsma wrote: > > Why does it slo

Re: Solr uses lots of shared memory!

2017-08-23 Thread Shawn Heisey
On 8/23/2017 7:32 AM, Markus Jelsma wrote: > Why does it slowly increase over time? > Why does it appear to correlate to index size? > Is anyone else seeing this on their 6.6 cloud production or local machines? More detailed information included here.  My 6.6 dev install is NOT having the problem,

RE: Solr uses lots of shared memory!

2017-08-23 Thread Markus Jelsma
size? Is anyone else seeing this on their 6.6 cloud production or local machines? Thanks, Markus [1]: http://www.evanjones.ca/java-bytebuffer-leak.html -Original message- > From:Shawn Heisey > Sent: Tuesday 22nd August 2017 17:32 > To: solr-user@lucene.apache.org > Subje

Re: Solr uses lots of shared memory!

2017-08-22 Thread Shawn Heisey
On 8/22/2017 7:24 AM, Markus Jelsma wrote: > I have never seen this before, one of our collections, all nodes eating tons > of shared memory! > > Here's one of the nodes: > 10497 solr 20 0 19.439g 4.505g 3.139g S 1.0 57.8 2511:46 java > > RSS is roughly equal to heap size + usual off-h