On 2/13/07, Ian Meyer <[EMAIL PROTECTED]> wrote:
On 2/13/07, Yonik Seeley <[EMAIL PROTECTED]> wrote:
> Yes, sorting by fields does take up memory (the fieldcache).
> 256M is pretty small for a 5M doc index.
> If you have any more memory slots, spring for some more memory (a
> little over $100 for 1GB).
Yeah, I'll see if I can give solr a bit more.
I'll second that--it is the cheapest way of improving Solr performance
(_way_ cheaper than dev time)
> To try and lessen the memory used by the Lucene FieldCache, you might
> try lowering the mergeFactor of the index (see solrconfig.xml). This
> will cause more merges, slowing indexing, but it will squeeze out
> deleted documents faster. Also, try to optimize as often as possible
> (nightly?) for the same reasons.
Ah, I don't know if I mentioned, but we're optimizing nightly when
impressions are at their lowest. So, I will lower the mergeFactor and
re-load all of the docs to see if that helps us out.. I believe I left
Once you've optimized, the merge factor is irrelevant--the index is
already as tight as possible. At that point, it should only affect
your incremental updates, and then only if you add dups (ie. do
deletions).
-Mike
