Yes, that would be helpful to include, sorry, the official 1.4. -----Original Message----- From: Ryan McKinley [mailto:ryan...@gmail.com] Sent: Thursday, January 07, 2010 2:15 PM To: solr-user@lucene.apache.org Subject: Re: Corrupted Index
what version of solr are you running? On Jan 7, 2010, at 3:08 PM, Jake Brownell wrote: > Hi all, > > Our application uses solrj to communicate with our solr servers. We > started a fresh index yesterday after upping the maxFieldLength > setting in solrconfig. Our task indexes content in batches and all > appeared to be well until noonish today, when after 40k docs, I > started seeing errors. I've placed three stack traces below, the > first occurred once and was the initial error, the second occurred a > few times before the third started occurring on each request. I'd > really appreciate any insight into what could have caused this, a > missing file and then a corrupt index. If you know we'll have to > nuke the entire index and start over I'd like to know that too-oddly > enough searches against the index appear to be working. > > Thanks! > Jake > > #1 > > January 7, 2010 12:10:06 PM CST Caught error; TaskWrapper block 1 > January 7, 2010 12:10:07 PM CST solr-home/core0/data/index/ > _fsk_1uj.del (No such file or directory) > > solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) > > request: /core0/update solr-home/core0/data/index/_fsk_1uj.del (No > such file or directory) > > solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) > > request: /core0/update > January 7, 2010 12:10:07 PM CST solr-home/core0/data/index/ > _fsk_1uj.del (No such file or directory) > > solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) > > request: /core0/update solr-home/core0/data/index/_fsk_1uj.del (No > such file or directory) > > solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) > > request: /core0/update > org.benetech.exception.WrappedException > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) > > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) > > org > .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) > org.apache.solr.client.solrj.SolrServer#commit(86) > org.apache.solr.client.solrj.SolrServer#commit(75) > org.bookshare.search.solr.SolrSearchServerWrapper#add(63) > org.bookshare.search.solr.SolrSearchEngine#index(232) > > org > .bookshare > .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) > org.bookshare.service.task.SearchEngineIndexingTask#run(53) > org.bookshare.service.scheduler.TaskWrapper#run(233) > java.util.TimerThread#mainLoop(512) > java.util.TimerThread#run(462) > Caused by: > solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) > > solr-home/core0/data/index/_fsk_1uj.del (No such file or directory) > > request: /core0/update > org.apache.solr.common.SolrException > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) > > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) > > org > .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) > org.apache.solr.client.solrj.SolrServer#commit(86) > org.apache.solr.client.solrj.SolrServer#commit(75) > org.bookshare.search.solr.SolrSearchServerWrapper#add(63) > org.bookshare.search.solr.SolrSearchEngine#index(232) > > org > .bookshare > .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) > org.bookshare.service.task.SearchEngineIndexingTask#run(53) > org.bookshare.service.scheduler.TaskWrapper#run(233) > java.util.TimerThread#mainLoop(512) > java.util.TimerThread#run(462) > > #2 > > January 7, 2010 12:10:10 PM CST Caught error; TaskWrapper block 1 > January 7, 2010 12:10:10 PM CST > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > request: /core0/update > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > request: /core0/update > January 7, 2010 12:10:10 PM CST > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > request: /core0/update > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > request: /core0/update > org.benetech.exception.WrappedException > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) > > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) > > org > .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) > org.apache.solr.client.solrj.SolrServer#commit(86) > org.apache.solr.client.solrj.SolrServer#commit(75) > org.bookshare.search.solr.SolrSearchServerWrapper#add(63) > org.bookshare.search.solr.SolrSearchEngine#index(232) > > org > .bookshare > .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) > org.bookshare.service.task.SearchEngineIndexingTask#run(53) > org.bookshare.service.scheduler.TaskWrapper#run(233) > java.util.TimerThread#mainLoop(512) > java.util.TimerThread#run(462) > Caused by: > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > org.apache.lucene.index.CorruptIndexException: doc counts differ for > segment _hug: fieldsReader shows 8 but segmentInfo shows 2 > > request: /core0/update > org.apache.solr.common.SolrException > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) > > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) > > org > .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) > org.apache.solr.client.solrj.SolrServer#commit(86) > org.apache.solr.client.solrj.SolrServer#commit(75) > org.bookshare.search.solr.SolrSearchServerWrapper#add(63) > org.bookshare.search.solr.SolrSearchEngine#index(232) > > org > .bookshare > .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) > org.bookshare.service.task.SearchEngineIndexingTask#run(53) > org.bookshare.service.scheduler.TaskWrapper#run(233) > java.util.TimerThread#mainLoop(512) > java.util.TimerThread#run(462) > > > #3 > > > January 7, 2010 12:10:21 PM CST Caught error; TaskWrapper block 1 > January 7, 2010 12:10:21 PM CST Array index out of range: 7 > > Array index out of range: 7 > > request: /core0/update Array index out of range: 7 > > Array index out of range: 7 > > request: /core0/update > January 7, 2010 12:10:21 PM CST Array index out of range: 7 > > Array index out of range: 7 > > request: /core0/update Array index out of range: 7 > > Array index out of range: 7 > > request: /core0/update > org.benetech.exception.WrappedException > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) > > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) > > org > .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) > org.apache.solr.client.solrj.SolrServer#commit(86) > org.apache.solr.client.solrj.SolrServer#commit(75) > org.bookshare.search.solr.SolrSearchServerWrapper#add(63) > org.bookshare.search.solr.SolrSearchEngine#index(232) > > org > .bookshare > .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) > org.bookshare.service.task.SearchEngineIndexingTask#run(53) > org.bookshare.service.scheduler.TaskWrapper#run(233) > java.util.TimerThread#mainLoop(512) > java.util.TimerThread#run(462) > Caused by: > Array index out of range: 7 > > Array index out of range: 7 > > request: /core0/update > org.apache.solr.common.SolrException > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(424) > > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer#request(243) > > org > .apache.solr.client.solrj.request.AbstractUpdateRequest#process(105) > org.apache.solr.client.solrj.SolrServer#commit(86) > org.apache.solr.client.solrj.SolrServer#commit(75) > org.bookshare.search.solr.SolrSearchServerWrapper#add(63) > org.bookshare.search.solr.SolrSearchEngine#index(232) > > org > .bookshare > .service.task.SearchEngineIndexingTask#initialInstanceLoad(95) > org.bookshare.service.task.SearchEngineIndexingTask#run(53) > org.bookshare.service.scheduler.TaskWrapper#run(233) > java.util.TimerThread#mainLoop(512) > java.util.TimerThread#run(462) >
