Re: SolrCloud - leader updates not updating followers

2017-08-08 Thread Erick Erickson
ower in the log. > > It really seems like the data isn't being sent from the leader. As I said it > could easily be something stupid that I've done along the way but I can't see > what it is. > > Thanks again, > Peter. > > -Original Message- > Fr

RE: SolrCloud - leader updates not updating followers

2017-08-08 Thread Peter Lancaster
Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 08 August 2017 18:23 To: solr-user Subject: Re: SolrCloud - leader updates not updating followers This _better_ be a problem with your configuration or all my assumptions are false ;) What are you autocommit settings

Re: SolrCloud - leader updates not updating followers

2017-08-08 Thread Erick Erickson
This _better_ be a problem with your configuration or all my assumptions are false ;) What are you autocommit settings? The documents should be forwarded to each replica from the leader during ingestion. However, they are not visible on the follower until a hard commit(openSearcher=true) or soft c

Re: SolrCloud Leader Election

2015-05-22 Thread Ryan Steele
Restarting the node cleared out the problem and everything recovered. Thanks! On 5/21/15 5:42 AM, Ramkumar R. Aiyengar wrote: This shouldn't happen, but if it does, there's no good way currently for Solr to automatically fix it. There are a couple of issues being worked on to do that currently.

Re: SolrCloud Leader Election

2015-05-21 Thread Ramkumar R. Aiyengar
This shouldn't happen, but if it does, there's no good way currently for Solr to automatically fix it. There are a couple of issues being worked on to do that currently. But till then, your best bet is to restart the node which you expect to be the leader (you can look at ZK to see who is at the he

Re: SolrCloud leader

2013-07-14 Thread Shawn Heisey
On 7/14/2013 6:42 AM, kowish.adamosh wrote: > The problem is that I don't want to invoke data import on 8 server nodes but > to choose only one for scheduling. Of course if this server will shut down > then another one needs to take the scheduler role. I can see that there is > task for sheduling h

Re: SolrCloud leader

2013-07-14 Thread Jack Krupansky
. Scheduling is currently outside of the scope of Solr and SolrCloud. -- Jack Krupansky -Original Message- From: kowish.adamosh Sent: Sunday, July 14, 2013 8:42 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud leader The problem is that I don't want to invoke data import on 8 s

Re: SolrCloud leader

2013-07-14 Thread kowish.adamosh
The problem is that I don't want to invoke data import on 8 server nodes but to choose only one for scheduling. Of course if this server will shut down then another one needs to take the scheduler role. I can see that there is task for sheduling https://issues.apache.org/jira/browse/SOLR-2305 . I h

Re: SolrCloud leader

2013-07-13 Thread Jack Krupansky
ntage. This is an interesting issue to ponder. -- Jack Krupansky -Original Message- From: kowish.adamosh Sent: Saturday, July 13, 2013 10:51 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud leader Ya :-) I need it for different reason. I have 8 server nodes and one of them h

Re: SolrCloud leader

2013-07-13 Thread Jack Krupansky
lse optimization and that distracts attention from optimizing the full application architecture. -- Jack Krupansky -Original Message- From: Radim Kolar Sent: Saturday, July 13, 2013 10:32 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud leader Since SolrCloud is a master-free a

Re: SolrCloud leader

2013-07-13 Thread kowish.adamosh
Ya :-) I need it for different reason. I have 8 server nodes and one of them has to invoke scheduled data import (by invoking CloudSolrServer)... And that's why I need to identify exclusive server (it doesn't have to be leader but I think it is the simplest solution). I don't want to invoke schedu

Re: SolrCloud leader

2013-07-13 Thread Radim Kolar
Since SolrCloud is a master-free architecture, you can send both queries and updates to ANY node and SolrCloud will assure that the data gets to where it belongs its way faster to send them to right node

Re: SolrCloud leader

2013-07-13 Thread Jack Krupansky
Why do you think you need to know which node is "the leader"? Answer: You don't - SolrClound is NOT a master/slave architecture; there is no "master" node. Each shard has its own "leader", which can vary over time. It's called "leader election". But, there is no cosmic significance to being a

Re: SolrCloud Leader Response Mechanism

2013-04-16 Thread Furkan KAMACI
Replica asks to Zookeper and Leader does not do anything. Thanks for your answer Otis. 2013/4/17 Otis Gospodnetic > Oui, ZK holds "the map". > > Otis > -- > Solr & ElasticSearch Support > http://sematext.com/ > > > > > > On Tue, Apr 16, 2013 at 6:33 PM, Furkan KAMACI > wrote: > > Hi Otis; > > >

Re: SolrCloud Leader Response Mechanism

2013-04-16 Thread Otis Gospodnetic
Oui, ZK holds "the map". Otis -- Solr & ElasticSearch Support http://sematext.com/ On Tue, Apr 16, 2013 at 6:33 PM, Furkan KAMACI wrote: > Hi Otis; > > You said: > > "It can just do it because it knows where things are." > > Does it learn it from Zookeeper? > > 2013/4/17 Otis Gospodnetic >

Re: SolrCloud Leader Response Mechanism

2013-04-16 Thread Furkan KAMACI
Hi Otis; You said: "It can just do it because it knows where things are." Does it learn it from Zookeeper? 2013/4/17 Otis Gospodnetic > If query comes to shard X on some node and this shard X is NOT a > leader, but HAS data, it will just execute the query. If it needs to > query shards on ot

Re: SolrCloud Leader Response Mechanism

2013-04-16 Thread Otis Gospodnetic
If query comes to shard X on some node and this shard X is NOT a leader, but HAS data, it will just execute the query. If it needs to query shards on other nodes, it will have the info about which shards to query and will just do that and aggregate the results. It doesn't have to ask leader for p

Re: SolrCloud Leader Response Mechanism

2013-04-16 Thread Furkan KAMACI
Hi Mark; When I speak with proper terms I want to ask that: is there a data locality of spatial locality ( http://www.roguewave.com/portals/0/products/threadspotter/docs/2011.2/manual_html_linux/manual_html/ch_intro_locality.html - I mean if you have data on your machine, use it and don't search i

Re: SolrCloud Leader Response Mechanism

2013-04-16 Thread Mark Miller
Leaders don't have much to do with querying - the node that you query will determine what other nodes it has to query to search the whole index and do a scatter/gather for you. (Though in some cases that request can be proxied to another node) - Mark On Apr 16, 2013, at 7:48 AM, Furkan KAMACI

RE: SolrCloud leader to replica

2013-04-12 Thread Zhang, Lisheng
enormously valuable to us and we really appreciate your helps! Lisheng -Original Message- From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] Sent: Thursday, April 11, 2013 5:27 PM To: solr-user@lucene.apache.org Subject: Re: SolrCloud leader to replica Hi, I think Timothy is right

Re: SolrCloud leader to replica

2013-04-11 Thread Otis Gospodnetic
4 a little (I have not read solr4x fully yet) to >> compromise >> consistency (C) in order to increase availability (A), on a high level do >> you see >> serious problems in this approach (I am familiar with lucene/solr code to >> some >> extent)? >> >>

Re: SolrCloud leader to replica

2013-04-11 Thread Timothy Potter
gt; you see > serious problems in this approach (I am familiar with lucene/solr code to > some > extent)? > > Thanks and best regards, Lisheng > > -Original Message- > From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] > Sent: Thursday, April 11, 2013 2:50 PM >

Re: SolrCloud leader to replica

2013-04-11 Thread Shawn Heisey
On 4/11/2013 3:50 PM, Otis Gospodnetic wrote: But note that I misspoke, which I realized after re-reading the thread I pointed you to. Mark explains it nicely there: * the index call returns only when (and IF!) indexing to all replicas succeeds Does this actually mean "all active replicas" ...

RE: SolrCloud leader to replica

2013-04-11 Thread Zhang, Lisheng
@lucene.apache.org Subject: Re: SolrCloud leader to replica But note that I misspoke, which I realized after re-reading the thread I pointed you to. Mark explains it nicely there: * the index call returns only when (and IF!) indexing to all replicas succeeds BUT, that should not be mixed with what search

Re: SolrCloud leader to replica

2013-04-11 Thread Otis Gospodnetic
ssage- > From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] > Sent: Thursday, April 11, 2013 1:23 PM > To: solr-user@lucene.apache.org > Subject: Re: SolrCloud leader to replica > > > Yes, I *think* that is the case. Some distributed systems have the > option to re

RE: SolrCloud leader to replica

2013-04-11 Thread Zhang, Lisheng
Thanks very much for your helps! -Original Message- From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] Sent: Thursday, April 11, 2013 1:23 PM To: solr-user@lucene.apache.org Subject: Re: SolrCloud leader to replica Yes, I *think* that is the case. Some distributed systems have

Re: SolrCloud leader to replica

2013-04-11 Thread Otis Gospodnetic
m: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] > Sent: Thursday, April 11, 2013 8:11 AM > To: solr-user@lucene.apache.org > Subject: Re: SolrCloud leader to replica > > > I believe it indexes locally on leader first. Otherwise one could end > up with a situation wh

RE: SolrCloud leader to replica

2013-04-11 Thread Zhang, Lisheng
afer leader finishes his? Thanks and best regards, Lisheng -Original Message- From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com] Sent: Thursday, April 11, 2013 8:11 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud leader to replica I believe it indexes locally on leader

Re: SolrCloud leader to replica

2013-04-11 Thread Otis Gospodnetic
I believe it indexes locally on leader first. Otherwise one could end up with a situation where indexing to replica(s) succeeds and indexing to leader fails, which I suspect might create a mess. Otis -- Solr & ElasticSearch Support http://sematext.com/ On Thu, Apr 11, 2013 at 2:53 AM, Zhang,

Re: SolrCloud leader election on single node

2012-10-25 Thread Mark Miller
Thanks Alexey - Could you move this to a JIRA issue? - Mark On Oct 25, 2012, at 7:53 AM, AlexeyK wrote: > setup: > 1 node, 4 cores, 2 shards. > 15 documents indexed. > > problem: > init stage times out. > > probable cause: > According to the init flow, cores are initialized one by one synch