RE: Hardware config for SOLR

2008-09-22 Thread Andrey Shulinskiy
Otis, Thanks for the responses; you've nailed it down mostly. Please see my thoughts below. > > One more question - is it worth it to try to keep the whole index in > > memory and shard when it doesn't fit anymore? For me it seems like a bit > > of overhead, but I may be very wrong here. > > What

Re: Hardware config for SOLR

2008-09-21 Thread Otis Gospodnetic
Hi Andrey, Responses inlined. - Original Message > From: Andrey Shulinskiy <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Sunday, September 21, 2008 11:23:00 PM > Subject: RE: Hardware config for SOLR > > Grant, > > Thanks a lot for the

RE: Hardware config for SOLR

2008-09-21 Thread Andrey Shulinskiy
Grant, Thanks a lot for the answers. Please see my replies below. > > 1) Should we do sharding or not? > > If we start without sharding, how hard will it be to enable it? > > Is it just some config changes + the index rebuild or is it more? > > There will be operations setup, etc. And you'll ha

Re: Hardware config for SOLR

2008-09-20 Thread Lars Kotthoff
> I have not worked with SSDs, though I've read all the good information that's > trickling to us from Denmark. One thing that I've been wondering all along is > - what about writes? That is, what about writes "wearing out" the SSD? How > quickly does that happen and when it does happen, what ar

Re: Hardware config for SOLR

2008-09-20 Thread Otis Gospodnetic
arl Wettin <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Friday, September 19, 2008 6:15:53 PM > Subject: Re: Hardware config for SOLR > > > 19 sep 2008 kl. 23.22 skrev Grant Ingersoll: > > > As for HDDs, people have noted some nice speedups in

Re: Hardware config for SOLR

2008-09-19 Thread Lars Kotthoff
> > As for HDDs, people have noted some nice speedups in Lucene using > > Solid-state drives, if you can afford them. > > I've seen the average response time cut in 5-10 times when switching > to SSD. 64GB SSD is starting at EUR 200 so that can be a lot cheaper > to do replace the disk than

Re: Hardware config for SOLR

2008-09-19 Thread Karl Wettin
19 sep 2008 kl. 23.22 skrev Grant Ingersoll: As for HDDs, people have noted some nice speedups in Lucene using Solid-state drives, if you can afford them. I've seen the average response time cut in 5-10 times when switching to SSD. 64GB SSD is starting at EUR 200 so that can be a lot cheap

Re: Hardware config for SOLR

2008-09-19 Thread Grant Ingersoll
Inline below. On Sep 17, 2008, at 6:32 PM, Andrey Shulinskiy wrote: Hello, First, some numbers we're expecting. - The average size of a doc: ~100K - The number of indexes: 1 - The query response time we're looking for: < 200 - 300ms - The number of stored docs: 1st year: 500K - 1M 2nd

RE: Hardware config for SOLR

2008-09-18 Thread Andrey Shulinskiy
Matthew, Thanks, a very good point. Andrey. > -Original Message- > From: Matthew Runo [mailto:[EMAIL PROTECTED] > Sent: Thursday, September 18, 2008 11:38 AM > To: solr-user@lucene.apache.org > Subject: Re: Hardware config for SOLR > > I can't speak to a lot o

Re: Hardware config for SOLR

2008-09-18 Thread Matthew Runo
I can't speak to a lot of this - but regarding the servers I'd go with the more powerful ones, if only for the amount of ram. Your index will likely be larger than 1 gig, and with only two you'll have a lot of your index not stored in ram, which will slow down your QPS. Thanks for your time