September 26, 2011 10:21 AM
>Subject: Re: Update ingest rate drops suddenly
>
>Just to bring closure on this one, we were slurping data from the
>wrong DB (hardly desktop class machine)...
>
>Solr did not cough on 41Mio records @34k updates / sec., single threaded.
>Great!
>
Just to bring closure on this one, we were slurping data from the
wrong DB (hardly desktop class machine)...
Solr did not cough on 41Mio records @34k updates / sec., single threaded.
Great!
On Sat, Sep 24, 2011 at 9:18 PM, eks dev wrote:
> just looking for hints where to look for...
>
> We we
Thanks Otis,
we will look into these issues again, slightly deeper. Network
problems are not likely, but DB, I do not know, this is huge select
... we will try to scan db, without indexing, just to see if it can
sustain... But gut feeling says, nope, this is not the one.
IO saturation would surpri
eks,
This is clear as day - you're using Winblows! Kidding.
I'd:
* watch IO with something like vmstat 2 and see if the rate drops correlate to
increased disk IO or IO wait time
* monitor the DB from which you were pulling the data - maybe the DB or the
server that runs it had issues
* monitor
