Re: Solr seems to hang

2012-06-27 Thread Li Li
could you please use jstack to dump the call stacks? On Thu, Jun 28, 2012 at 2:53 PM, Arkadi Colson wrote: > It now hanging for 15 hour and nothing changes in the index directory. > > Tips for further debugging? > > > On 06/27/2012 03:50 PM, Arkadi Colson wrote: >> >> I'm sending files to solr wi

Re: Solr seems to hang

2012-06-27 Thread Arkadi Colson
It now hanging for 15 hour and nothing changes in the index directory. Tips for further debugging? On 06/27/2012 03:50 PM, Arkadi Colson wrote: I'm sending files to solr with the php Solr library. I'm doing a commit every 1000 documents: 1000 Hard to say how long it'

Re: Solr seems to hang

2012-06-27 Thread Arkadi Colson
I'm sending files to solr with the php Solr library. I'm doing a commit every 1000 documents: 1000 Hard to say how long it's hanging. At least for 1 hour. After that I restarted Tomcat to continue... I will have a look at the indexes next time it's hanging. Thanks for

Re: Solr seems to hang

2012-06-27 Thread Arkadi Colson
I've set the maxFieldLength to the maximum because I'm indexing documents which can be quite big: 2147483647 Load average is about 0.9 but CPU is running at 35% percent. Probably because tika has to extract the documents The virtual machine is having 4 CPU's (2.67GHz each) with 12 GB of

Re: Solr seems to hang

2012-06-27 Thread Erick Erickson
How long is it hanging? And how are you sending files to Tika, and especially how often do you commit? One problem that people run into is that they commit too often, causing segments to be merged and occasionally that just takes a while and people think that Solr is hung. 18G isn't very large as

Re: Solr seems to hang

2012-06-27 Thread Li Li
seems that the indexwriter wants to flush but need to wait others become idle. but i see you the n gram filter is working. is your field's value too long? you sould also tell us average load the system. the free memory and memory used by jvm 在 2012-6-27 晚上7:51,"Arkadi Colson" 写道: > Anybody an idea

Re: Solr seems to hang

2012-06-27 Thread Arkadi Colson
Anybody an idea? The thread Dump looks like this: Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.1-b02 mixed mode): "http-8983-6" daemon prio=10 tid=0x41126000 nid=0x5c1 in Object.wait() [0x7fa0ad197000] java.lang.Thread.State: WAITING (on object monitor) at jav

Solr seems to hang

2012-06-26 Thread Arkadi Colson
Hi, I'm indexing about 200.000 files (average size of 1 MB) with the tika processor. At some point Solr started hanging. The logs is only reporting: INFO: [] webapp=/solr path=/replication params={command=indexversion&wt=javabin} status=0 QTime=0 Jun 26, 2012 2:34:00 PM org.apache.solr.core