On Feb 23, 2007, at 8:31 PM, Yonik Seeley wrote:
-- it does not go down until I
restart solr. This would be the cause of my too many files open
problem. Turning off autocommit / not commiting after every add keeps
this count steady at 100-200. The files are all of type:
[...]
Bug or feature?
If the searchers holding these index files open are still working,
then this is a problem, but not exactly a bug. If not, you may have
hit a new bug in searcher synchronization.
It doesn't look like it. I hope I'm not getting a reputation on here
for "discovering" bugs that seem to be my own fault, you'd all laugh
if you knew how much time I wasted before posting about it this
evening...
But I just narrowed this down to a bad line in my solrconfig.xml.
The one I was using said this for some reason :
<requestHandler name="/update" class="solr.XmlUpdateRequestHandler"
and the trunk version says this:
<requestHandler name="/update/xml"
class="solr.XmlUpdateRequestHandler"
changing my line to the trunk line fixed the fdesc problem.
The confounding thing to me is that the solr install worked fine
otherwise. I don't know what would make removing the /xml path make a
ton of files open but everything else work OK.
If you want to reproduce it:
1) Download trunk/nightly
2) Change line 347 of example/solr/conf/solrconfig.xml to
<requestHandler name="/update" class="solr.XmlUpdateRequestHandler">
3) java -jar start.jar...
3) Run post.sh a bunch of times on the same xml file... (in a shell
script or whatever)
4) After a few seconds/minutes jetty will crash with "too many open
files"
Now, to see if this also caused my heap overflow problems. Thanks
Mike and Yonik...
