Yep, there ya go... your OS configuration is limiting you to 27G of virtual address space per process. Consider setting that to unlimited.
-Yonik http://www.lucidimagination.com On Fri, Jul 22, 2011 at 1:05 PM, mdz-munich <sebastian.lu...@bsb-muenchen.de> wrote: > It says: > > /core file size (blocks, -c) 0 > data seg size (kbytes, -d) unlimited > scheduling priority (-e) 0 > file size (blocks, -f) unlimited > pending signals (-i) 257869 > max locked memory (kbytes, -l) 64 > max memory size (kbytes, -m) 28063940 > open files (-n) 8192 > pipe size (512 bytes, -p) 8 > POSIX message queues (bytes, -q) 819200 > real-time priority (-r) 0 > stack size (kbytes, -s) 8192 > cpu time (seconds, -t) unlimited > max user processes (-u) 257869 > virtual memory (kbytes, -v) 27216080 > file locks (-x) unlimited/ > > > Best regards, > > Sebastian > > > > Yonik Seeley-2-2 wrote: >> >> OK, best guess is that you're going over some per-process address space >> limit. >> >> Try seeing what "ulimit -a" says. >> >> -Yonik >> http://www.lucidimagination.com >> >> On Fri, Jul 22, 2011 at 12:51 PM, mdz-munich >> <sebastian.lu...@bsb-muenchen.de> wrote: >>> Hi Yonik, >>> >>> thanks for your reply! >>> >>>> Are you specifically selecting MMapDirectory in solrconfig.xml? >>> >>> Nope. >>> >>> We installed Oracle's Runtime from >>> >>> http://java.com/de/download/linux_manual.jsp?locale=de >>> >>> /java.runtime.name = Java(TM) SE Runtime Environment >>> sun.boot.library.path = /usr/java/jdk1.6.0_26/jre/lib/amd64 >>> java.vm.version = 20.1-b02 >>> shared.loader = >>> java.vm.vendor = Sun Microsystems Inc. >>> enable.master = true >>> java.vendor.url = http://java.sun.com/ >>> path.separator = : >>> java.vm.name = Java HotSpot(TM) 64-Bit Server VM >>> tomcat.util.buf.StringCache.byte.enabled = true >>> file.encoding.pkg = sun.io >>> java.util.logging.config.file = >>> /local/master01_tomcat7x_solr33x/conf/logging.properties >>> user.country = DE >>> sun.java.launcher = SUN_STANDARD >>> sun.os.patch.level = unknown >>> java.vm.specification.name = Java Virtual Machine Specification >>> user.dir = /local/master01_tomcat7x_solr33x/logs >>> solr.abortOnConfigurationError = true >>> java.runtime.version = 1.6.0_26-b03 >>> java.awt.graphicsenv = sun.awt.X11GraphicsEnvironment >>> java.endorsed.dirs = /local/master01_tomcat7x_solr33x/endorsed >>> os.arch = amd64 >>> java.io.tmpdir = /local/master01_tomcat7x_solr33x/temp >>> line.separator = / >>> >>> But no success with 1000 docs/batch, this was thrown during optimize: >>> >>> / >>> 22.07.2011 18:44:05 org.apache.solr.core.SolrCore execute >>> INFO: [core.digi20] webapp=/solr path=/update params={} status=500 >>> QTime=87540 >>> 22.07.2011 18:44:05 org.apache.solr.common.SolrException log >>> SEVERE: java.io.IOException: Map failed >>> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:748) >>> at >>> org.apache.lucene.store.MMapDirectory$MMapIndexInput.<init>(MMapDirectory.java:303) >>> at >>> org.apache.lucene.store.MMapDirectory.openInput(MMapDirectory.java:217) >>> at >>> org.apache.lucene.index.FieldsReader.<init>(FieldsReader.java:129) >>> at >>> org.apache.lucene.index.SegmentCoreReaders.openDocStores(SegmentCoreReaders.java:245) >>> at >>> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:117) >>> at >>> org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:703) >>> at >>> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4196) >>> at >>> org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3863) >>> at >>> org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:37) >>> at >>> org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2715) >>> at >>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2525) >>> at >>> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:2462) >>> at >>> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:410) >>> at >>> org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:85) >>> at >>> org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:154) >>> at >>> org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:177) >>> at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:77) >>> at >>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:67) >>> at >>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) >>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) >>> at >>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) >>> at >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) >>> at >>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) >>> at >>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) >>> at >>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:240) >>> at >>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:164) >>> at >>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:462) >>> at >>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164) >>> at >>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100) >>> at >>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:563) >>> at >>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) >>> at >>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:403) >>> at >>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:301) >>> at >>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:162) >>> at >>> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:309) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) >>> at java.lang.Thread.run(Thread.java:662) >>> Caused by: java.lang.OutOfMemoryError: Map failed >>> at sun.nio.ch.FileChannelImpl.map0(Native Method) >>> at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:745) >>> ... 38 more >>> / >>> >>> >>> Best regards, >>> >>> Sebastian >>> >>> >>> -- >>> View this message in context: >>> http://lucene.472066.n3.nabble.com/Solr-3-3-Exception-in-thread-Lucene-Merge-Thread-1-tp3185248p3191933.html >>> Sent from the Solr - User mailing list archive at Nabble.com. >>> >> > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-3-3-Exception-in-thread-Lucene-Merge-Thread-1-tp3185248p3191972.html > Sent from the Solr - User mailing list archive at Nabble.com. >
