Re: Solr timeout after reboot

2013-11-11 Thread michael.boom
Thank you, Peter! Last weekend I was up until 4am trying to understand why is Solr starting so so sooo slow, when i had gave enough memory to fit the entire index. And then I remembered your trick used on the m3.xlarge machines, tried it and it worked like a charm! Thank you again! - Thanks,

Re: Solr timeout after reboot

2013-10-22 Thread Erick Erickson
Have you considered just putting some killer queries in the firstSearcher and newSearcher sections of solrconfig.xml? By "killer" I mean even single queries that search something on all the fields you care about, facet on a bunch of fields and sort by a bunch of fields. These can even be all in the

Re: Solr timeout after reboot

2013-10-21 Thread Otis Gospodnetic
Hi Michael, I agree with Shawn, don't listen to Peter ;) but only this once - he's a smart guy, as you can see in list archives. And I disagree with Shawn. again, only just this once and only somewhat. :) Because: In general, Shawn's advice is correct, but we have no way of knowing your

Re: Solr timeout after reboot

2013-10-21 Thread Shawn Heisey
On 10/21/2013 8:03 AM, michael.boom wrote: > I'm using the m3.xlarge server with 15G RAM, but my index size is over 100G, > so I guess putting running the above command would bite all available > memory. With a 100GB index, I would want a minimum server memory size of 64GB, and I would much prefer

Re: Solr timeout after reboot

2013-10-21 Thread François Schiettecatte
Well no, the OS is smarter than that, it manages file system cache along with other memory requirements. If applications need more memory then file system cache will likely be reduced. The command is a cheap trick to get the OS to fill the file system cache as quickly as possible, not sure how

Re: Solr timeout after reboot

2013-10-21 Thread michael.boom
I'm using the m3.xlarge server with 15G RAM, but my index size is over 100G, so I guess putting running the above command would bite all available memory. - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-timeout-after-reboot-tp4096408p4096827.html S

Re: Solr timeout after reboot

2013-10-21 Thread Peter Keegan
I found this warming to be especially necessary after starting an instance of those m3.xlarge servers, else the response times for the first minutes was terrible. Peter On Mon, Oct 21, 2013 at 8:39 AM, François Schiettecatte < fschietteca...@gmail.com> wrote: > To put the file data into file sy

Re: Solr timeout after reboot

2013-10-21 Thread François Schiettecatte
To put the file data into file system cache which would make for faster access. François On Oct 21, 2013, at 8:33 AM, michael.boom wrote: > Hmm, no, I haven't... > > What would be the effect of this ? > > > > - > Thanks, > Michael > -- > View this message in context: > http://lucene.4

Re: Solr timeout after reboot

2013-10-21 Thread michael.boom
Hmm, no, I haven't... What would be the effect of this ? - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-timeout-after-reboot-tp4096408p4096809.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr timeout after reboot

2013-10-21 Thread Peter Keegan
Have you tried this old trick to warm the FS cache? cat ...//data/index/* >/dev/null Peter On Mon, Oct 21, 2013 at 5:31 AM, michael.boom wrote: > Thank you, Otis! > > I've integrated the SPM on my Solr instances and now I have access to > monitoring data. > Could you give me some hints on whic

Re: Solr timeout after reboot

2013-10-21 Thread michael.boom
Thank you, Otis! I've integrated the SPM on my Solr instances and now I have access to monitoring data. Could you give me some hints on which metrics should I watch? Below I've added my query configs. Is there anything I could tweak here? 1024

Re: Solr timeout after reboot

2013-10-18 Thread Otis Gospodnetic
Michael, The servlet container controls timeouts, max threads and such. That's not a high query rate, but yes, it could be solr or OS caches are cold. You will ne able too see all this in SPM for Solr while you hammer your poor Solr servers :) Otis Solr & ElasticSearch Support http://sematext.co