On Mon, Jun 2, 2008 at 10:13 AM, Erick Erickson <[EMAIL PROTECTED]> wrote:
> But are you sure you're not just masking the problem? That is, your limit
> may now be 90,000 queries...
>
> I always assume this kind of thing is a memory leak somewhere, have you
> any tools to monitor your memory consumption and see if that's ever-rising?

1. is it possible to tell Solr to use more cache mem than is allocated
to the VM? Will this crash Solr? What are the defaults that java runs
with? This is my config script:
http://iua-share.upf.edu/svn/nightingale/trunk/sandbox/solr/config/solrconfig.xml

2. I noticed that if I let the script keep running (after slowdown) it
would crash eventually, giving an *if I recall correctly* Heap
Allocation Exception or something like it. In the traceback I saw
DisMax somewhere mentioned as well. If you want (if it is useful) I
can run it again until it crashes and give the full stack trace.

3. after changing the VM mem, I ran it again and it went to well over
100K queries without any problems (I think I also noticed less disk
access - but I can be wrong)


I can monitor mem usage through top or through anything you would like
me to run, ... If there are any particular tests to run let me know!


 - Bram

PS:
http://freesound.iua.upf.edu/blog/ has now more about my adventures with Solr

Reply via email to