Log messages?
On Wed, Jul 24, 2013 at 1:37 AM, Neil Prosser <neil.pros...@gmail.com> wrote: > Great. Thanks for your suggestions. I'll go through them and see what I can > come up with to try and tame my GC pauses. I'll also make sure I upgrade to > 4.4 before I start. Then at least I know I've got all the latest changes. > > In the meantime, does anyone have any idea why I am able to get leaders who > are marked as down? I've just had the situation where of two nodes hosting > replicas of the same shard the leader was alive and marked as down and the > other replica was gone. I could perform searches directly on the two nodes > (with distrib=false) and once I'd restarted the node which was down the > leader sprung into live. I assume that since there was a change in > clusterstate.json it forced the leader to reconsider what it was up to. > > Does anyone know the hole my nodes are falling into? Is it likely to be > tied up in my GC woes? > > > On 23 July 2013 13:06, Otis Gospodnetic <otis.gospodne...@gmail.com> wrote: > >> Hi, >> >> On Tue, Jul 23, 2013 at 8:02 AM, Erick Erickson <erickerick...@gmail.com> >> wrote: >> > Neil: >> > >> > Here's a must-read blog about why allocating more memory >> > to the JVM than Solr requires is a Bad Thing: >> > http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html >> > >> > It turns out that you actually do yourself harm by allocating more >> > memory to the JVM than it really needs. Of course the problem is >> > figuring out how much it "really needs", which if pretty tricky. >> > >> > Your long GC pauses _might_ be ameliorated by allocating _less_ >> > memory to the JVM, counterintuitive as that seems. >> >> ....or by using G1 :) >> >> See http://blog.sematext.com/2013/06/24/g1-cms-java-garbage-collector/ >> >> Otis >> -- >> Solr & ElasticSearch Support -- http://sematext.com/ >> Performance Monitoring -- http://sematext.com/spm >> >> >> > On Mon, Jul 22, 2013 at 5:05 PM, Neil Prosser <neil.pros...@gmail.com> >> wrote: >> >> I just have a little python script which I run with cron (luckily that's >> >> the granularity we have in Graphite). It reads the same JSON the admin >> UI >> >> displays and dumps numeric values into Graphite. >> >> >> >> I can open source it if you like. I just need to make sure I remove any >> >> hacks/shortcuts that I've taken because I'm working with our cluster! >> >> >> >> >> >> On 22 July 2013 19:26, Lance Norskog <goks...@gmail.com> wrote: >> >> >> >>> Are you feeding Graphite from Solr? If so, how? >> >>> >> >>> >> >>> On 07/19/2013 01:02 AM, Neil Prosser wrote: >> >>> >> >>>> That was overnight so I was unable to track exactly what happened (I'm >> >>>> going off our Graphite graphs here). >> >>>> >> >>> >> >>> >>