Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-23 Thread S.L
Shawn , Just wanted to follow up , I still face this issue of inconsistent search results on Solr Cloud 4.1.0.1 , upon further looking into logs , I found out a few exceptions , what was obvious was zkConnection time out issues and other exceptions , please take a look . *Logs* /opt/tomcat1/logs

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-17 Thread S.L
Shawn, Just wondering if you have any other suggestions on what the next steps whould be ? Thanks. On Thu, Oct 16, 2014 at 11:12 PM, S.L wrote: > Shawn , > > >1. I will upgrade to 67 JVM shortly . >2. This is a new collection as , I was facing a similar issue in 4.7 >and based on

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-16 Thread S.L
Shawn , 1. I will upgrade to 67 JVM shortly . 2. This is a new collection as , I was facing a similar issue in 4.7 and based on Erick's recommendation I updated to 4.10.1 and created a new collection. 3. Yes, I am hitting the replicas of the same shard and I see the lists are

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-16 Thread Shawn Heisey
On 10/16/2014 6:27 PM, S.L wrote: 1. Java Version :java version "1.7.0_51" Java(TM) SE Runtime Environment (build 1.7.0_51-b13) Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode) I believe that build 51 is one of those that is known to have bugs related to Lucene. If you can upgr

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-16 Thread S.L
Shawn, Please find the answers to your questions. 1. Java Version :java version "1.7.0_51" Java(TM) SE Runtime Environment (build 1.7.0_51-b13) Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode) 2.OS CentOS Linux release 7.0.1406 (Core) 3. Everything is 64 bit , OS , Java , and CPU

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread Shawn Heisey
On 10/15/2014 10:24 PM, S.L wrote: Yes , I tried those two queries with distrib=false , I get 0 results for first and 1 result for the second query( (i.e. server 3 shard 2 replica 2) consistently. However if I run the same second query (i.e. server 3 shard 2 replica 2) with distrib=true, I som

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread S.L
Shawn, Yes , I tried those two queries with distrib=false , I get 0 results for first and 1 result for the second query( (i.e. server 3 shard 2 replica 2) consistently. However if I run the same second query (i.e. server 3 shard 2 replica 2) with distrib=true, I sometimes get a result and somet

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread Shawn Heisey
On 10/15/2014 9:26 PM, S.L wrote: Look at the logging information I provided below , looks like the results are only being returned back for this solrCloud cluster if the request goes to one of the two replicas of a shard. I have verified that numDocs in the replicas for a given shard is same b

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread S.L
cky perhaps ;)... >> > > >> > > Erick >> > > >> > > On Mon, Oct 6, 2014 at 8:04 PM, S.L >> wrote: >> > > > Erick, >> > > > >> > > > Thanks for the suggestion , I am not sure if I would be able to >>

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-15 Thread S.L
ouldn't be anything you need to do to keep these in synch, > so > > > >> if you can capture what happened when things got out of synch we'll > > > >> fix it. But a lot has changed in the last several months, so the > first > > > >> thing I'd

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-14 Thread Tim Potter
t; > Hi Erick, > > >> > > > >> > Before I tried your suggestion of issung a commit=true update, I > > >> realized that for eaach shard there was atleast a node that had its > > index > > >> directory named like index.. > > >> > >

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-13 Thread S.L
ow the index directory got syched with the other node and is properly > >> named as 'index' without any timestamp attached to it.This is now > giving me > >> consistent results for distrib=true using a load balancer.Also > >> distrib=false returns expexted r

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread Erick Erickson
gt;> > The underlying issue appears to be that in every shard the leader and >> the replica(follower) were out of sych. >> > >> > How can I avoid this from happening again? >> > >> > Thanks for your help! >> > >> > Sent from my HTC >

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread S.L
ns expexted results for a given shard. > > > > The underlying issue appears to be that in every shard the leader and > the replica(follower) were out of sych. > > > > How can I avoid this from happening again? > > > > Thanks for your help! > > > > S

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread Erick Erickson
> How can I avoid this from happening again? > > Thanks for your help! > > Sent from my HTC > > ----- Reply message ----- > From: "Erick Erickson" > To: > Subject: SolrCloud 4.7 not doing distributed search when querying from a load > balancer. > Date: Fri,

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-06 Thread S.L
leader and the replica(follower) were out of sych. How can I avoid this from happening again? Thanks for your help! Sent from my HTC - Reply message - From: "Erick Erickson" To: Subject: SolrCloud 4.7 not doing distributed search when querying from a load balancer. Date: Fri,

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread Erick Erickson
H. Assuming that you aren't re-indexing the doc you're searching for... Try issuing http://blah blah:8983/solr/collection/update?commit=true. That'll force all the docs to be searchable. Does <1> still hold for the document in question? Because this is exactly backwards of what I'd expect. I'd

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
Eirck, 0> Load balancer is out of the picture . 1>When I query with *distrib=false* , I get consistent results as expected for those shards that dont have the key i.e I dont get the results back for those shards, however I just realized that while *distrib=false* is present in the query for the sh

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread Erick Erickson
bq: Also ,the collection is being actively indexed as I query this, could that be an issue too ? Not if the documents you're searching aren't being added as you search (and all your autocommit intervals have expired). I would turn off indexing for testing, it's just one more variable that can get

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
Erick, I would like to add that the interesting behavior i.e point #2 that I mentioned in my earlier reply happens in all the shards , if this were to be a distributed search issue this should have not manifested itself in the shard that contains the key that I am searching for , looks like the s

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
Erick, Thanks for your reply, I tried your suggestions. 1 . When not using loadbalancer if *I have distrib=false* I get consistent results across the replicas. 2. However here's the insteresting part , while not using load balancer if I *dont have distrib=false* , then when I query a particular

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread Erick Erickson
Hmmm, nothing quite makes sense here Here are some experiments: 1> avoid the load balancer and issue queries like http://solr_server:8983/solr/collection/q=whatever&distrib=false the &distrib=false bit will cause keep SolrCloud from trying to send the queries anywhere, they'll be served only

SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-02 Thread S.L
Hi All, I am trying to query a 6 node Solr4.7 cluster with 3 shards and a replication factor of 2 . I have fronted these 6 Solr nodes using a load balancer , what I notice is that every time I do a search of the form q=*:*&fq=(id:9e78c064-919f-4ef3-b236-dc66351b4acf) it gives me a result only