Hi Bastian,
this seems to be related to IO and file deletion (optimization compacts and
removes index files), are you running Solr on NFS or a distributed file
system?
You could set a propert IndexDeletionPolicy (SolrDeletionPolicy) in
solrconfig.xml to handle this.
My 2 cents,
Tommaso
2010/8/11 Bastian Spitzer <bspit...@magix.net>
> Hi,
>
> we are using solr 1.4.1 in a master-slave setup with replication,
> requests are loadbalanced to both instances. this is just working fine,
> but the slave
> behaves strange sometimes with a "SolrException log" (trace below). We
> are using 1.4.1 for weeks now, and this has happened only a few times
> so far, and it only occured on the Slave. The Problem seemed to be gone
> when we added a cron-job to send a periodic <optimize/> (once a day)
> to the master, but today it did happen again. The Index contains 55
> files right now, after optimize there are only 10. So it seems its a
> problem when
> the index is spread among a lot files. The Slave wont ever recover once
> this Exception shows up, the only thing that helps is a restart.
>
> Is this a known issue? Only workaround would be to track the
> commit-counts and send additional <optimize/> requests after a certain
> amount of
> commits, but id prefer solving this problem rather than building a
> workaround..
>
> Any hints/thoughts on this issue are verry much appreciated, thanks in
> advance for your help.
>
> cheers Bastian.
>
> Aug 11, 2010 4:51:58 PM org.apache.solr.core.SolrCore execute
> INFO: [] webapp=/solr path=/select
> params={fl=media_id,keyword_1004&sort=priority_1000+desc,+score+desc&ind
> ent=off&start=0&q=mandant_id:1000+AND+partner_id:1000+AND+active_1000:tr
> ue+AND+cat_id_path_1000:7231/7258*+AND+language_id:1004&rows=24&version=
> 2.2} status=500 QTime=2
> Aug 11, 2010 4:51:58 PM org.apache.solr.common.SolrException log
> SEVERE: java.io.IOException: read past EOF
> at
> org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.jav
> a:151)
> at
> org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.j
> ava:38)
> at
> org.apache.lucene.store.IndexInput.readVInt(IndexInput.java:78)
> at
> org.apache.lucene.index.SegmentTermDocs.next(SegmentTermDocs.java:112)
> at
> org.apache.lucene.search.FieldCacheImpl$IntCache.createValue(FieldCacheI
> mpl.java:461)
> at
> org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:22
> 4)
> at
> org.apache.lucene.search.FieldCacheImpl.getInts(FieldCacheImpl.java:430)
> at
> org.apache.lucene.search.FieldCacheImpl$IntCache.createValue(FieldCacheI
> mpl.java:445)
> at
> org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:22
> 4)
> at
> org.apache.lucene.search.FieldCacheImpl.getInts(FieldCacheImpl.java:430)
> at
> org.apache.lucene.search.FieldComparator$IntComparator.setNextReader(Fie
> ldComparator.java:332)
> at
> org.apache.lucene.search.TopFieldCollector$MultiComparatorNonScoringColl
> ector.setNextReader(TopFieldCollector.java:435)
> at
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:249)
> at org.apache.lucene.search.Searcher.search(Searcher.java:171)
> at
> org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.
> java:988)
> at
> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.j
> ava:884)
> at
> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:3
> 41)
> at
> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.
> java:182)
> at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(Search
> Handler.java:195)
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerB
> ase.java:131)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
> at
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.ja
> va:338)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.j
> ava:241)
> at
> org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(Web
> ApplicationHandler.java:821)
> at
> org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicationH
> andler.java:471)
> at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:568)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1530)
> at
> org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationCon
> text.java:633)
> at org.mortbay.http.HttpContext.handle(HttpContext.java:1482)
> at org.mortbay.http.HttpServer.service(HttpServer.java:909)
> at
> org.mortbay.http.HttpConnection.service(HttpConnection.java:820)
> at
> org.mortbay.http.ajp.AJP13Connection.handleNext(AJP13Connection.java:295
> )
> at
> org.mortbay.http.HttpConnection.handle(HttpConnection.java:837)
> at
> org.mortbay.http.ajp.AJP13Listener.handleConnection(AJP13Listener.java:2
> 12)
> at
> org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
> at
> org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
>
