Solr 5.2.1 - ReplicationHandler - No route to a host that is long gone

2015-10-06 Thread Eric Torti
Hey guys! We have a deploy of SolrCloud 5.2.1 that is composed of 5 to 8 amazon linux ec2 c3.2xlarge instances. Our main core is composed of 4M docs (6GB) and we serve an average of 70 req/s per machine. We are using zookeeper 3.4.6 to provide cluster synchronization. The thing is we are noticing

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

2015-10-07 Thread Eric Torti
Hello Shawn, I'm sorry to diverge this thread a little bit. But could please point me to resources that explain deeply how this process of OS using the non-java memory to cache index data? > Whatever RAM is left over after you give 12GB to Java for Solr will be > used automatically by the operati

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

2015-10-07 Thread Eric Torti
Cool, Toke and Shawn! That's exactly what I was looking for. I'll have a look at those resources and if something is yet unclear I'll open a thread for it. Thanks for the information, Eric On Wed, Oct 7, 2015 at 10:29 AM, Shawn Heisey wrote: > On 10/7/2015 4:03 AM, Eric To

Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-07 Thread Eric Torti
Schindler in this post about the use of virtual memory? [http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html] Thanks! Best, Eric Torti

Re: Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-07 Thread Eric Torti
it at each 15min. So our scenario is not near real time in that sense. In light of this, do you thing using NRTCachingDirectory is still convenient? Best, Eric On Wed, Oct 7, 2015 at 12:08 PM, Shawn Heisey wrote: > On 10/7/2015 8:48 AM, Eric Torti wrote: >> > class="${solr.

Re: Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-07 Thread Eric Torti
Correcting: When I mentioned high non-JVM memory usage, what I probably meant was high virtual memory allocation. On Wed, Oct 7, 2015 at 3:00 PM, Eric Torti wrote: > Thanks, Shawn. > >> After a look at the code, I found that StandardDirectoryFactory should >> use MMap if the O

Re: Is solr.StandardDirectoryFactory an MMapDirectory?

2015-10-09 Thread Eric Torti
Ok, thanks Shawn! That makes sense. We'll be experimenting with it. Best, Eric On Wed, Oct 7, 2015 at 5:54 PM, Shawn Heisey wrote: > On 10/7/2015 12:00 PM, Eric Torti wrote: >> Can we read "high reopen rate" as "frequent soft commits"? (In our >> case,

Re: slow queries

2015-10-15 Thread Eric Torti
I don't think this relates to your problem because the GC pauses are not superior to 30s which seems to be the time zookeeper would let a node be irresponsive before considering it in recovery. Best, Eric Torti On Thu, Oct 15, 2015 at 6:51 AM, Lorenzo Fundaró wrote: > On 14 October 2015

`cat /dev/null > solr-8983-console.log` frees host's memory

2015-10-20 Thread Eric Torti
here would be greatly appreciated. Best, Eric Torti

Re: `cat /dev/null > solr-8983-console.log` frees host's memory

2015-10-21 Thread Eric Torti
Thank you Shawn, Timothy, Emir and Rajani. Sorry, Shawn, I ended up cropping out the legend but you were right on your guess. Indeed, Timothy, this log is completely redundant. Will get rid of it soon. I'll look into the resources you all pointed out. Thanks! Best, Eric Torti On Wed, O