Re: StreamingUpdateSolrServer seems to hang on indexing big batches

2010-01-26 Thread Yonik Seeley
On Mon, Jan 25, 2010 at 7:27 PM, Jake Brownell wrote: > I swapped our indexing process over to the streaming update server, but now > I'm seeing places where our indexing code adds several documents, but > eventually hangs. It hangs just before the completion message, which comes > directly aft

Re: StreamingUpdateSolrServer seems to hang on indexing big batches

2010-01-26 Thread Erick Erickson
I'll have to defer that one for now. 2010/1/26 Tim Terlegård > 2010/1/26 Erick Erickson : > > > My indexing script has been running all > > > night and has accomplished nothing. I see lots of disk activity > > > though, which is weird. > > > > > > One explanation would be that you're memory-

Re: StreamingUpdateSolrServer seems to hang on indexing big batches

2010-01-26 Thread Tim Terlegård
2010/1/26 Erick Erickson : > > My indexing script has been running all > > night and has accomplished nothing. I see lots of disk activity > > though, which is weird. > > > One explanation would be that you're memory-starved and > the disk activity you see is thrashing. How much memory > do you all

Re: StreamingUpdateSolrServer seems to hang on indexing big batches

2010-01-26 Thread Erick Erickson
<<< My indexing script has been running all night and has accomplished nothing. I see lots of disk activity though, which is weird.>>> One explanation would be that you're memory-starved and the disk activity you see is thrashing. How much memory do you allocate to your JVM? A further indication

Re: StreamingUpdateSolrServer seems to hang on indexing big batches

2010-01-26 Thread Tim Terlegård
2010/1/26 Jake Brownell : > I swapped our indexing process over to the streaming update server, but now > I'm seeing places where our indexing code adds several documents, but > eventually hangs. It hangs just before the completion message, which comes > directly after sending to solr. I found

StreamingUpdateSolrServer seems to hang on indexing big batches

2010-01-25 Thread Jake Brownell
Hi, I swapped our indexing process over to the streaming update server, but now I'm seeing places where our indexing code adds several documents, but eventually hangs. It hangs just before the completion message, which comes directly after sending to solr. I found this issue in jira https://is