I hooked up the dataimorthandler to my db which has around 15M records. When I run the full-imoport, its erroring out with java heap space message. Is there something I need to configure?
Thank you, Peri Subrahmanya On 4/27/13 3:53 AM, "Mohsen Saboorian" <mohs...@gmail.com> wrote: >I have a Solr 4.2 server setup on a CentOS 6.4 x86 and Java: >OpenJDK Runtime Environment (rhel-2.3.8.0.el6_4-i386) >OpenJDK Server VM (build 23.7-b01, mixed mode) > >Currently it has a 4.6GB index with ~400k records. When I search for >certain keywords, Solr fails with the following message. >Any idea why this happens? Can I repair indices? > >1. I didn't specify any SolrDeletionPolicy. It's commented in >solrconfig.xml as default. >2. <luceneMatchVersion> is now LUCENE_42 (but it was LUCNE_41 before I >upgrade to solr 4.2) > >Thanks, >Mohsen > >SEVERE: null:java.io.IOException: Input/output error: >NIOFSIndexInput(path="/app/solr/tomcat/solr/core1/data/index/_2xmx.tvd") > at >org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.readInternal(NIOFSD >irectory.java:191) > at >org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java: >272) > at >org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.jav >a:51) > at >org.apache.lucene.util.packed.BlockPackedReaderIterator.skip(BlockPackedRe >aderIterator.java:127) > at >org.apache.lucene.codecs.compressing.CompressingTermVectorsReader.readPosi >tions(CompressingTermVectorsReader.java:586) > at >org.apache.lucene.codecs.compressing.CompressingTermVectorsReader.get(Comp >ressingTermVectorsReader.java:381) > at >org.apache.lucene.index.SegmentReader.getTermVectors(SegmentReader.java:17 >5) > at >org.apache.lucene.index.BaseCompositeReader.getTermVectors(BaseCompositeRe >ader.java:97) > at >org.apache.lucene.search.highlight.TokenSources.getTokenStreamWithOffsets( >TokenSources.java:280) > at >org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlight >er(DefaultSolrHighlighter.java:453) > at >org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSol >rHighlighter.java:391) > at >org.apache.solr.handler.component.HighlightComponent.process(HighlightComp >onent.java:139) > at >org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHa >ndler.java:208) > at >org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBas >e.java:135) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1817) > at >org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java >:639) > at >org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.jav >a:345) > at >org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.jav >a:141) > at >org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Applicati >onFilterChain.java:243) > at >org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilter >Chain.java:210) > at >org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve. >java:222) > at >org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve. >java:123) > at >org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:1 >71) > at >org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:9 >9) > at >org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:947) > at >org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.ja >va:118) > at >org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408 >) > at >org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Pro >cessor.java:1009) > at >org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstr >actProtocol.java:589) > at >org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.jav >a:310) > at >java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: >1145) > at >java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java >:615) > at java.lang.Thread.run(Thread.java:722) >Caused by: java.io.IOException: Input/output error > at sun.nio.ch.FileDispatcherImpl.pread0(Native Method) > at sun.nio.ch.FileDispatcherImpl.pread(FileDispatcherImpl.java:51) > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:222) > at sun.nio.ch.IOUtil.read(IOUtil.java:198) > at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:674) > at >org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.readInternal(NIOFSD >irectory.java:176) > ... 32 more > > *** DISCLAIMER *** This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind HTC Global Services to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose.
