On Tue, 2010-02-16 at 10:35 +0100, Tim Terlegård wrote:
> I actually tried SSD yesterday. Queries which need to go to disk are
> much faster now. I did expect that warmup for sort fields would be
> much quicker as well, but that seems to be cpu bound.
That and bulk I/O. The sorter imports the Term
On a related note. Maybe it'd be good to have wiki page of
experiences and possibly stats of various SSD drives? Either on
Lucene or Solr wiki sites?
2010/2/16 Tim Terlegård :
> 2010/2/15 Toke Eskildsen :
>> From: Tim Terlegård [tim.terleg...@gmail.com]
>>> If the index size is more than you can
2010/2/15 Toke Eskildsen :
> From: Tim Terlegård [tim.terleg...@gmail.com]
>> If the index size is more than you can have in RAM, do you recommend
>> to split the index to several servers so it can all be in RAM?
>>
>> I do expect phrase queries. Total index size is 107 GB. *prx files are
>> total
Hi Tim,
Due to our performance needs we optimize the index early in the morning and
then run the cache-warming queries once we mount the optimized index on our
servers. If you are indexing and serving using the same Solr instance, you
shouldn't have to re-run the cache warming queries when you a
From: Tim Terlegård [tim.terleg...@gmail.com]
> If the index size is more than you can have in RAM, do you recommend
> to split the index to several servers so it can all be in RAM?
>
> I do expect phrase queries. Total index size is 107 GB. *prx files are
> total 65GB and *frq files 38GB. It's pro
Hi Tom,
1600 warming queries, that's quite many. Do you run them every time a
document is added to the index? Do you have any tips on warming?
If the index size is more than you can have in RAM, do you recommend
to split the index to several servers so it can all be in RAM?
I do expect phrase qu
Hi Tim,
We generally run about 1600 cache-warming queries to warm up the OS disk
cache and the Solr caches when we mount a new index.
Do you have/expect phrase queries? If you don't, then you don't need to
get any position information into your OS disk cache. Our position
information takes ab
One solution is to add the persistent cache with memcache at the
application layer.
--
Tommy Chheng
Programmer and UC Irvine Graduate Student
Twitter @tommychheng
http://tommy.chheng.com
On 2/12/10 5:19 AM, Tim Terlegård wrote:
2010/2/12 Shalin Shekhar Mangar:
2010/2/12 Tim Terlegård
Do
2010/2/12 Shalin Shekhar Mangar :
> 2010/2/12 Tim Terlegård
>
>> Does Solr use some sort of a persistent cache?
>>
> Solr does not have a persistent cache. That is the operating system's file
> cache at work.
Aha, that's very interesting and seems to make sense.
So is the primary goal of warmup
2010/2/12 Tim Terlegård
> Does Solr use some sort of a persistent cache?
>
> I do this 10 times in a loop:
> * start solr
> * create a core
> * execute warmup query
> * execute query with sort fields
> * stop solr
>
> Executing the query with sort fields takes 5-20 times longer the first
> i
10 matches
Mail list logo
