could you please use jstack to dump the call stacks?
On Thu, Jun 28, 2012 at 2:53 PM, Arkadi Colson <ark...@smartbit.be> wrote:
> It now hanging for 15 hour and nothing changes in the index directory.
>
> Tips for further debugging?
>
>
> On 06/27/2012 03:50 PM, Arkadi Colson wrote:
>>
>> I'm sending files to solr with the php Solr library. I'm doing a commit
>> every 1000 documents:
>> <autoCommit>
>> <maxDocs>1000</maxDocs>
>> <!-- <maxTime>1000</maxTime> -->
>> </autoCommit>
>>
>> Hard to say how long it's hanging. At least for 1 hour. After that I
>> restarted Tomcat to continue... I will have a look at the indexes next time
>> it's hanging. Thanks for the tip!
>>
>> SOLR: 3.6
>> TOMCAT: 7.0.28
>> JAVA: 1.7.0_05-b05
>>
>>
>> On 06/27/2012 03:13 PM, Erick Erickson wrote:
>>>
>>> How long is it hanging? And how are you sending files to Tika, and
>>> especially how often do you commit? One problem that people
>>> run into is that they commit too often, causing segments to be
>>> merged and occasionally that just takes a while and people
>>> think that Solr is hung.
>>>
>>> 18G isn't very large as indexes go, so it's unlikely that's your problem,
>>> except if merging is going on in which case you might be copying a bunch
>>> of data. So try seeing if you're getting a bunch of disk activity, you
>>> can get
>>> a crude idea of what's going on if you just look at the index directory
>>> on
>>> your Solr server while it's hung.
>>>
>>> What version of Solr are you using? Details matter
>>>
>>> Best
>>> Erick
>>>
>>> On Wed, Jun 27, 2012 at 7:51 AM, Arkadi Colson <ark...@smartbit.be>
>>> wrote:
>>>>
>>>> Anybody an idea?
>>>>
>>>> The thread Dump looks like this:
>>>>
>>>> Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.1-b02 mixed
>>>> mode):
>>>>
>>>> "http-8983-6" daemon prio=10 tid=0x0000000041126000 nid=0x5c1 in
>>>> Object.wait() [0x00007fa0ad197000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x000000070abf4ad0> (a
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
>>>> - locked <0x000000070abf4ad0> (a
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker)
>>>> at
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "pool-4-thread-1" prio=10 tid=0x00007fa0a054d800 nid=0x5be waiting on
>>>> condition [0x00007f9f962f4000]
>>>> java.lang.Thread.State: WAITING (parking)
>>>> at sun.misc.Unsafe.park(Native Method)
>>>> - parking to wait for <0x0000000702598b30> (a
>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>> at
>>>> java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
>>>> at
>>>>
>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
>>>> at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
>>>> at
>>>>
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
>>>> at
>>>>
>>>> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
>>>> at
>>>>
>>>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
>>>> at
>>>>
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "http-8983-5" daemon prio=10 tid=0x00000000412d2800 nid=0x5bd runnable
>>>> [0x00007f9f94171000]
>>>> java.lang.Thread.State: RUNNABLE
>>>> at java.net.SocketInputStream.socketRead0(Native Method)
>>>> at java.net.SocketInputStream.read(SocketInputStream.java:129)
>>>> at
>>>>
>>>> org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
>>>> at
>>>>
>>>> org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:814)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
>>>> at
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "http-8983-4" daemon prio=10 tid=0x0000000041036000 nid=0x5b1 in
>>>> Object.wait() [0x00007f9f966c9000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x000000070b6e4790> (a
>>>> org.apache.lucene.index.DocumentsWriter)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.lucene.index.DocumentsWriter.waitIdle(DocumentsWriter.java:986)
>>>> - locked <0x000000070b6e4790> (a
>>>> org.apache.lucene.index.DocumentsWriter)
>>>> at
>>>> org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:524)
>>>> - locked <0x000000070b6e4790> (a
>>>> org.apache.lucene.index.DocumentsWriter)
>>>> at
>>>> org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3580)
>>>> - locked <0x000000070b6e4858> (a
>>>> org.apache.solr.update.SolrIndexWriter)
>>>> at
>>>> org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2328)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2293)
>>>> at
>>>>
>>>> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240)
>>>> at
>>>>
>>>> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
>>>> at
>>>>
>>>> org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:141)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:146)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:236)
>>>> at
>>>>
>>>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
>>>> at
>>>>
>>>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>>>> at
>>>>
>>>> org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
>>>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
>>>> at
>>>>
>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>>>> at
>>>>
>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>>>> at
>>>>
>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>>>> at
>>>>
>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
>>>> at
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "http-8983-3" daemon prio=10 tid=0x00000000411ec000 nid=0x5b0 in
>>>> Object.wait() [0x00007f9f967cb000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x00000007024cdc38> (a
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
>>>> - locked <0x00000007024cdc38> (a
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker)
>>>> at
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "http-8983-2" daemon prio=10 tid=0x0000000041447800 nid=0x5ae runnable
>>>> [0x00007f9f968cb000]
>>>> java.lang.Thread.State: RUNNABLE
>>>> at
>>>>
>>>> org.apache.lucene.analysis.ngram.NGramTokenFilter.incrementToken(NGramTokenFilter.java:107)
>>>> at
>>>>
>>>> org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:197)
>>>> at
>>>>
>>>> org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:276)
>>>> at
>>>>
>>>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:766)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2321)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2293)
>>>> at
>>>>
>>>> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240)
>>>> at
>>>>
>>>> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
>>>> at
>>>>
>>>> org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:141)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:146)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:236)
>>>> at
>>>>
>>>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
>>>> at
>>>>
>>>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>>>> at
>>>>
>>>> org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
>>>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
>>>> at
>>>>
>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>>>> at
>>>>
>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>>>> at
>>>>
>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>>>> at
>>>>
>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
>>>> at
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "TP-Monitor" daemon prio=10 tid=0x00007fa0a0093800 nid=0x5ad in
>>>> Object.wait() [0x00007f9f969cd000]
>>>> java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x0000000703ff52c0> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
>>>> at
>>>>
>>>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:565)
>>>> - locked <0x0000000703ff52c0> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "TP-Processor4" daemon prio=10 tid=0x00007fa0a038c000 nid=0x5ac runnable
>>>> [0x00007f9f96ace000]
>>>> java.lang.Thread.State: RUNNABLE
>>>> at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
>>>> - locked <0x0000000702599120> (a java.net.SocksSocketImpl)
>>>> at java.net.ServerSocket.implAccept(ServerSocket.java:462)
>>>> at java.net.ServerSocket.accept(ServerSocket.java:430)
>>>> at
>>>> org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:311)
>>>> at
>>>>
>>>> org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:668)
>>>> at
>>>>
>>>> org.apache.jk.common.ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:879)
>>>> at
>>>>
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "TP-Processor3" daemon prio=10 tid=0x00007fa0a0048000 nid=0x5ab in
>>>> Object.wait() [0x00007f9f96bcf000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x0000000703ff5650> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:662)
>>>> - locked <0x0000000703ff5650> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "TP-Processor2" daemon prio=10 tid=0x00007fa0a0073800 nid=0x5aa in
>>>> Object.wait() [0x00007f9f96cd0000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x0000000703ff58c0> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:662)
>>>> - locked <0x0000000703ff58c0> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "TP-Processor1" daemon prio=10 tid=0x00007fa0a0162000 nid=0x5a9 in
>>>> Object.wait() [0x00007f9f96dd1000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x0000000703ff5b30> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:662)
>>>> - locked <0x0000000703ff5b30> (a
>>>> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "http-8983-1" daemon prio=10 tid=0x00000000410ab800 nid=0x5a8 in
>>>> Object.wait() [0x00007f9f96ed1000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x000000070b7198f0> (a
>>>> org.apache.lucene.index.IndexWriter$FlushControl)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter$FlushControl.waitUpdate(IndexWriter.java:4877)
>>>> - locked <0x000000070b7198f0> (a
>>>> org.apache.lucene.index.IndexWriter$FlushControl)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter$FlushControl.waitUpdate(IndexWriter.java:4871)
>>>> - locked <0x000000070b7198f0> (a
>>>> org.apache.lucene.index.IndexWriter$FlushControl)
>>>> at
>>>>
>>>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:751)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2321)
>>>> at
>>>>
>>>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2293)
>>>> at
>>>>
>>>> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240)
>>>> at
>>>>
>>>> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
>>>> at
>>>>
>>>> org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:141)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:146)
>>>> at
>>>>
>>>> org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:236)
>>>> at
>>>>
>>>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
>>>> at
>>>>
>>>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>>>> at
>>>>
>>>> org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
>>>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
>>>> at
>>>>
>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
>>>> at
>>>>
>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
>>>> at
>>>>
>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
>>>> at
>>>>
>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
>>>> at
>>>>
>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
>>>> at
>>>>
>>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
>>>> at
>>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "http-8983-Acceptor-0" daemon prio=10 tid=0x00007fa0a0012800 nid=0x5a7
>>>> runnable [0x00007f9f96fd3000]
>>>> java.lang.Thread.State: RUNNABLE
>>>> at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
>>>> - locked <0x00000007022e9320> (a java.net.SocksSocketImpl)
>>>> at java.net.ServerSocket.implAccept(ServerSocket.java:462)
>>>> at java.net.ServerSocket.accept(ServerSocket.java:430)
>>>> at
>>>>
>>>> org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
>>>> at
>>>>
>>>> org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:352)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon prio=10
>>>> tid=0x00007fa0a004e800 nid=0x5a6 waiting on condition
>>>> [0x00007fa0ad29f000]
>>>> java.lang.Thread.State: TIMED_WAITING (sleeping)
>>>> at java.lang.Thread.sleep(Native Method)
>>>> at
>>>>
>>>> org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1631)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "pool-1-thread-1" prio=10 tid=0x00007fa0a005c000 nid=0x5a4 waiting on
>>>> condition [0x00007fa0ad69b000]
>>>> java.lang.Thread.State: WAITING (parking)
>>>> at sun.misc.Unsafe.park(Native Method)
>>>> - parking to wait for <0x0000000702319730> (a
>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>>>> at
>>>> java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
>>>> at
>>>>
>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
>>>> at
>>>>
>>>> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
>>>> at
>>>>
>>>> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
>>>> at
>>>>
>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
>>>> at java.lang.Thread.run(Thread.java:662)
>>>>
>>>> "GC Daemon" daemon prio=10 tid=0x00007fa0a8633000 nid=0x5a3 in
>>>> Object.wait()
>>>> [0x00007fa0adb30000]
>>>> java.lang.Thread.State: TIMED_WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x0000000700082560> (a sun.misc.GC$LatencyLock)
>>>> at sun.misc.GC$Daemon.run(GC.java:100)
>>>> - locked <0x0000000700082560> (a sun.misc.GC$LatencyLock)
>>>>
>>>> "Low Memory Detector" daemon prio=10 tid=0x00007fa0a8002800 nid=0x5a1
>>>> runnable [0x0000000000000000]
>>>> java.lang.Thread.State: RUNNABLE
>>>>
>>>> "C2 CompilerThread1" daemon prio=10 tid=0x0000000040f71000 nid=0x5a0
>>>> waiting
>>>> on condition [0x0000000000000000]
>>>> java.lang.Thread.State: RUNNABLE
>>>>
>>>> "C2 CompilerThread0" daemon prio=10 tid=0x0000000040f6d800 nid=0x59f
>>>> waiting
>>>> on condition [0x0000000000000000]
>>>> java.lang.Thread.State: RUNNABLE
>>>>
>>>> "Signal Dispatcher" daemon prio=10 tid=0x0000000040f6b800 nid=0x59e
>>>> waiting
>>>> on condition [0x0000000000000000]
>>>> java.lang.Thread.State: RUNNABLE
>>>>
>>>> "Finalizer" daemon prio=10 tid=0x0000000040f4f000 nid=0x59d in
>>>> Object.wait()
>>>> [0x00007fa0ae3eb000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x000000070007a850> (a
>>>> java.lang.ref.ReferenceQueue$Lock)
>>>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
>>>> - locked <0x000000070007a850> (a
>>>> java.lang.ref.ReferenceQueue$Lock)
>>>> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
>>>> at
>>>> java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
>>>>
>>>> "Reference Handler" daemon prio=10 tid=0x0000000040f47800 nid=0x59c in
>>>> Object.wait() [0x00007fa0ae4ec000]
>>>> java.lang.Thread.State: WAITING (on object monitor)
>>>> at java.lang.Object.wait(Native Method)
>>>> - waiting on <0x0000000700082550> (a
>>>> java.lang.ref.Reference$Lock)
>>>> at java.lang.Object.wait(Object.java:485)
>>>> at
>>>> java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
>>>> - locked <0x0000000700082550> (a java.lang.ref.Reference$Lock)
>>>>
>>>> "main" prio=10 tid=0x0000000040ee3000 nid=0x596 runnable
>>>> [0x00007fa0b3d24000]
>>>> java.lang.Thread.State: RUNNABLE
>>>> at java.net.PlainSocketImpl.socketAccept(Native Method)
>>>> at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
>>>> - locked <0x0000000702599208> (a java.net.SocksSocketImpl)
>>>> at java.net.ServerSocket.implAccept(ServerSocket.java:462)
>>>> at java.net.ServerSocket.accept(ServerSocket.java:430)
>>>> at
>>>> org.apache.catalina.core.StandardServer.await(StandardServer.java:431)
>>>> at org.apache.catalina.startup.Catalina.await(Catalina.java:676)
>>>> at org.apache.catalina.startup.Catalina.start(Catalina.java:628)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>>
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>> at
>>>>
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>> at java.lang.reflect.Method.invoke(Method.java:597)
>>>> at
>>>> org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
>>>> at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
>>>>
>>>> "VM Thread" prio=10 tid=0x0000000040f40800 nid=0x59b runnable
>>>>
>>>> "GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000040ef6000 nid=0x597
>>>> runnable
>>>>
>>>> "GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000040ef7800 nid=0x598
>>>> runnable
>>>>
>>>> "GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000040ef9800 nid=0x599
>>>> runnable
>>>>
>>>> "GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000040efb800 nid=0x59a
>>>> runnable
>>>>
>>>> "VM Periodic Task Thread" prio=10 tid=0x00007fa0a8015800 nid=0x5a2
>>>> waiting
>>>> on condition
>>>>
>>>> JNI global references: 1660
>>>>
>>>> Heap
>>>> PSYoungGen total 802560K, used 144888K [0x00000007aaab0000,
>>>> 0x00000007f9c40000, 0x0000000800000000)
>>>> eden space 802432K, 18% used
>>>> [0x00000007aaab0000,0x00000007b381e190,0x00000007dba50000)
>>>> from space 128K, 50% used
>>>> [0x00000007f9c20000,0x00000007f9c30020,0x00000007f9c40000)
>>>> to space 8448K, 0% used
>>>> [0x00000007f8bc0000,0x00000007f8bc0000,0x00000007f9400000)
>>>> PSOldGen total 1398144K, used 867862K [0x0000000700000000,
>>>> 0x0000000755560000, 0x00000007aaab0000)
>>>> object space 1398144K, 62% used
>>>> [0x0000000700000000,0x0000000734f85980,0x0000000755560000)
>>>> PSPermGen total 54464K, used 54387K [0x00000006fae00000,
>>>> 0x00000006fe330000, 0x0000000700000000)
>>>> object space 54464K, 99% used
>>>> [0x00000006fae00000,0x00000006fe31cce8,0x00000006fe330000)
>>>>
>>>>
>>>>
>>>>
>>>> On 06/26/2012 02:36 PM, Arkadi Colson wrote:
>>>>>
>>>>> Hi,
>>>>>
>>>>>
>>>>> I'm indexing about 200.000 files (average size of 1 MB) with the tika
>>>>> processor. At some point Solr started hanging. The logs is only
>>>>> reporting:
>>>>>
>>>>> INFO: [] webapp=/solr path=/replication
>>>>> params={command=indexversion&wt=javabin} status=0 QTime=0
>>>>> Jun 26, 2012 2:34:00 PM org.apache.solr.core.SolrCore execute
>>>>>
>>>>> The index is already about 18 GB big. Could that be the problem? Is you
>>>>> need more information please let me know...
>>>>>
>>>>>
>>>>> Thanks in advance!
>>>>>
>>>> --
>>>> Smartbit bvba
>>>> Hoogstraat 13
>>>> B-3670 Meeuwen
>>>> T: +32 11 64 08 80
>>>> F: +32 89 46 81 10
>>>> W: http://www.smartbit.be
>>>> E: ark...@smartbit.be
>>>>
>>>>
>>>>
>>>
>>
>
> --
> Smartbit bvba
> Hoogstraat 13
> B-3670 Meeuwen
> T: +32 11 64 08 80
> F: +32 89 46 81 10
> W: http://www.smartbit.be
> E: ark...@smartbit.be
>
>
>
