Re: Large-scale Solr publish - hanging at blockUntilFinished indefinitely - stuck on SocketInputStream.socketRead0

2013-05-22 Thread Justin Babuscio
wrote: > On 5/22/2013 9:08 AM, Justin Babuscio wrote: > >> We periodically rebuild our Solr index from scratch. We have built a >> custom publisher that horizontally scales to increase write throughput. >> On >> a given rebuild, we will have ~60 JVMs running with 5 thre

Large-scale Solr publish - hanging at blockUntilFinished indefinitely - stuck on SocketInputStream.socketRead0

2013-05-22 Thread Justin Babuscio
lly 600GB. *Releated Bugs:* My symptoms are most related to this bug but we are not executing any deletes so I have low confidence that it is 100% related https://issues.apache.org/jira/browse/SOLR-1990 Although we have similar stack traces, we are only ADDING docs. Thanks ahead for any input/help! -- Justin Babuscio

Solr replication hangs on multiple slave nodes

2012-10-04 Thread Justin Babuscio
After a large index rebuild (16-masters with ~15GB each), some slaves fail to completely replicate. We are running Solr v3.5 with 16 masters and 2 slaves each for a total of 48 servers. 4 of the 32 slaves sit in a stalled replication state with similar messages: Files Downloaded: 254/260 Downlo

Re: Solr v3.5.0 - numFound changes when paging through results on 8-shard cluster

2012-06-19 Thread Justin Babuscio
Found = 2866 > : Page5 - numFound = 2419 > : Page5 - numFound = 1898 > : Page6 - numFound = 1898 > : ... > : PageN - numFound = 1898 > > -Hoss > -- Justin Babuscio 571-210-0035 http://linchpinsoftware.com

Re: Solr v3.5.0 - numFound changes when paging through results on 8-shard cluster

2012-06-19 Thread Justin Babuscio
ning less results as I execute the query with a "start" URL param > 400. On Tue, Jun 19, 2012 at 5:05 PM, Shawn Heisey wrote: > On 6/19/2012 2:32 PM, Justin Babuscio wrote: > >> 2) For the shards, we use the URL >> parameters, shards=s1/solr,s2/solr,s3/**solr,...,s8/s

Re: Solr v3.5.0 - numFound changes when paging through results on 8-shard cluster

2012-06-19 Thread Justin Babuscio
the URL to move to the next page. On Tue, Jun 19, 2012 at 4:20 PM, Yury Kats wrote: > On 6/19/2012 4:06 PM, Justin Babuscio wrote: > > Solr v3.5.0 > > 8 Master Shards > > 2 Slaves Per Master > > > > Confirming that there are no active records being wri

Solr v3.5.0 - numFound changes when paging through results on 8-shard cluster

2012-06-19 Thread Justin Babuscio
ponds with total hits? I also increased start to higher than 1898 (made it 3000) and it returned 0 results with numCount = 1898. Thanks ahead, -- Justin Babuscio 571-210-0035 http://linchpinsoftware.com