Deadlock in Server?

2010-08-20 Thread Devin Foley
Hi All, I'm currently using Solr to run a search engine that is pulling in new data 24 hours a day. Currently, I'm indexing about 5 million documents per day, each document being around 2k in size. Every few days, the server locks up, and calls to /update stop working. During this lock, CPU, me

Re: Deadlock in Server?

2010-08-20 Thread Devin Foley
a nightly optimize - which will take just as long, but > you control when it happens. > The other option is to prevent too big of segments being greated (at > the expense of search speed) with options such as maxMergeDocs. > > -Yonik > http://www.lucidimagination.com > > On Fr