Re: Performance optimization of Proximity/Wildcard searches

2011-02-07 Thread Otis Gospodnetic
matext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message > From: Salman Akram > To: solr-user@lucene.apache.org > Sent: Mon, February 7, 2011 2:49:44 AM > Subject: Re: Performance optimization of Proximity/Wildcard searches >

Re: Performance optimization of Proximity/Wildcard searches

2011-02-06 Thread Salman Akram
gt; > > Lucene ecosystem search :: http://search-lucene.com/ > > > > > > > > > > > > - Original Message > > > > From: Salman Akram > > > > To: solr-user@lucene.apache.org > > > > Sent: Fri, February 4, 2011 3

Re: Performance optimization of Proximity/Wildcard searches

2011-02-05 Thread Otis Gospodnetic
t; > Otis > > > > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > > Lucene ecosystem search :: http://search-lucene.com/ > > > > > > > > - Original Message > > > From: Salman Akram > > > To: solr-user@lucene.apache.o

Re: Performance optimization of Proximity/Wildcard searches

2011-02-05 Thread Salman Akram
> > Otis > > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > Lucene ecosystem search :: http://search-lucene.com/ > > > > - Original Message > > From: Salman Akram > > To: solr-user@lucene.apache.org > > Sent: Fri, February 4, 2011 3:

Re: Performance optimization of Proximity/Wildcard searches

2011-02-05 Thread Salman Akram
> > > > - Original Message > > From: Salman Akram > > To: solr-user@lucene.apache.org > > Sent: Fri, February 4, 2011 3:33:41 PM > > Subject: Re: Performance optimization of Proximity/Wildcard searches > > > > I know so we are not really using it fo

Re: Performance optimization of Proximity/Wildcard searches

2011-02-04 Thread Otis Gospodnetic
.apache.org > Sent: Fri, February 4, 2011 3:38:55 PM > Subject: Re: Performance optimization of Proximity/Wildcard searches > > Well I assume many people out there would have indexes larger than 100GB and > I don't think so normally you will have more RAM than 32GB or 64! >

Re: Performance optimization of Proximity/Wildcard searches

2011-02-04 Thread Otis Gospodnetic
rom: Salman Akram > To: solr-user@lucene.apache.org > Sent: Fri, February 4, 2011 3:33:41 PM > Subject: Re: Performance optimization of Proximity/Wildcard searches > > I know so we are not really using it for regular warm-ups (in any case index > is updated on hourly basis). Ju

Re: Performance optimization of Proximity/Wildcard searches

2011-02-04 Thread Salman Akram
Well I assume many people out there would have indexes larger than 100GB and I don't think so normally you will have more RAM than 32GB or 64! As I mentioned the queries are mostly phrase, proximity, wildcard and combination of these. What exactly do you mean by distribution of documents? On this

Re: Performance optimization of Proximity/Wildcard searches

2011-02-04 Thread Salman Akram
t; - Original Message > > From: Salman Akram > > To: solr-user@lucene.apache.org; t...@statsbiblioteket.dk > > Sent: Tue, January 25, 2011 6:32:48 AM > > Subject: Re: Performance optimization of Proximity/Wildcard searches > > > > By warmed index you onl

Re: Performance optimization of Proximity/Wildcard searches

2011-02-04 Thread Otis Gospodnetic
Hi, > Sharding is an option too but that too comes with limitations so want to > keep that as a last resort but I think there must be other things coz 150GB > is not too big for one drive/server with 32GB Ram. Hmm what makes you think 32 GB is enough for your 150 GB index? It depends on q

Re: Performance optimization of Proximity/Wildcard searches

2011-02-04 Thread Otis Gospodnetic
e.apache.org; t...@statsbiblioteket.dk > Sent: Tue, January 25, 2011 6:32:48 AM > Subject: Re: Performance optimization of Proximity/Wildcard searches > > By warmed index you only mean warming the SOLR cache or OS cache? As I said > our index is updated every hour so I am not sure h

Re: Performance optimization of Proximity/Wildcard searches

2011-01-25 Thread Salman Akram
By warmed index you only mean warming the SOLR cache or OS cache? As I said our index is updated every hour so I am not sure how much SOLR cache would be helpful but OS cache should still be helpful, right? I haven't compared the results with a proper script but from manual testing here are some o

Re: Performance optimization of Proximity/Wildcard searches

2011-01-25 Thread Toke Eskildsen
On Tue, 2011-01-25 at 10:20 +0100, Salman Akram wrote: > Cache warming is a good option too but the index get updated every hour so > not sure how much would that help. What is the time difference between queries with a warmed index and a cold one? If the warmed index performs satisfactory, then o