Have you tried profiling? How often are you committing? Have you
looked at Garbage Collection or any of the usual suspects like that?
On Aug 11, 2009, at 4:49 PM, Fuad Efendi wrote:
In a heavily loaded Write-only Master SOLR, I have 5 minutes of RAM
Buffer
Flash / Segment Merge per 1 minute of (heavy) batch document updates.
Define heavy. How many docs per second?
I am using mergeFactor=100 etc (I already posted message...)
So that... I can't see hardware is a problem: with more CPU and faster
RAID-0 I'll get the same numbers, 5:1. Why?..
I'll try with better hardware anyway... during segment merge
everything
stops in SOLR although I am (in theory) using
ConcurrentMergeScheduler with
Java 6.
Having mergeFactor=100000 and doing "commit" only once a year (and
waiting a
week(s) till it merge/commit/optimize)???
