Thanks for the help! I the problem was I was not using "ulimit -n". It's back to normal now.
thanks, Kevin On 10/30/06, Yonik Seeley <[EMAIL PROTECTED]> wrote:
On 10/30/06, Kevin Lewandowski <[EMAIL PROTECTED]> wrote: > I'm no longer able to add new data or optimize my index. There are > currently 1600 files in the index directory and it's about 1.1gb. I've > tried changing solrconfig.xml to use the compound file format and that > didn't make a difference. My ulimit is "unlimited" but I've tried > setting it at 1000000 and restarting tomcat but tomcat wouldn't start > after doing that. > > I'm not sure what else can be done. Any ideas? What are your index stats? number of indexed fields, maxBufferedDocs, maxMergeDocs, mergeFactor, etc? 1600 files sounds like too many, unless they are no longer part of the active index and are just left over from previous merge failures. A ulimit of 8192 is normally more than enough.... depending on the OS, raising the limit could take extra resources, so don't set it as high as you can. Be aware that using "ulimit" to change the number of open files or file descriptors is probably only setting the "soft" limit, and not the system-wide hard limit (which may be 1024 unless you change it) http://www.google.com/search?q=linux+ulimit+hard+limit -Yonik
