Connecting to one Zookeeper node is fine. Until that node fails. Then what does Solr do for cluster information?
The entire point of Zookeeper is to share that information in a reliable, fault-tolerant way. Solr can talk to any Zookeeper node and get the same information. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Nov 29, 2015, at 2:36 PM, Salman Ansari <salman.rah...@gmail.com> wrote: > > Correct me if I am wrong but my understanding is that even connecting to > one zookeeper should be enough as internally that zookeeper will sync Solr > server info to other zookeepers in the ensemble (as long as that zookeeper > belongs to an ensemble). Having said that, if that particular zookeeper > goes down, another one from the ensemble should be able to serve the Solr > instance. > > What made me even more leaning towards this understanding is that I tried > connecting 2 different solr instances to 2 different zookeepers (but both > belong to the same ensemble) and I realized both Solr servers can see each > other. I guess that does explain somehow that zookeepers are sharing solr > servers information among the ensemble. > > Regards, > Salman > > On Mon, Nov 30, 2015 at 1:07 AM, Walter Underwood <wun...@wunderwood.org> > wrote: > >> Why would that link answer the question? >> >> Each Solr connects to one Zookeeper node. If that node goes down, >> Zookeeper is still available, but the node will need to connect to a new >> node. >> >> Specifying only one zk node is a single point of failure. If that node >> goes down, Solr cannot continue operating. >> >> Specifying a list of all the zk nodes is robust. If one goes down, it >> tries another. >> >> wunder >> Walter Underwood >> wun...@wunderwood.org >> http://observer.wunderwood.org/ (my blog) >> >>> On Nov 29, 2015, at 12:19 PM, Don Bosco Durai <bo...@apache.org> wrote: >>> >>> This should answer your question: >> https://zookeeper.apache.org/doc/r3.2.2/zookeeperOver.html#sc_designGoals >>> >>> On 11/29/15, 12:04 PM, "Salman Ansari" <salman.rah...@gmail.com> wrote: >>> >>>> my point is that what is the exact difference between the whole list and >>>> one zookeeper? Moreover, I think this issue is related to Windows >> command >>>> as mentioned here >>>> >> http://stackoverflow.com/questions/28837827/solr-5-0-unable-to-start-solr-with-zookeeper-ensemble >>>> >>>> >>>> On Sun, Nov 29, 2015 at 10:55 PM, Don Bosco Durai <bo...@apache.org> >> wrote: >>>> >>>>> It is highly recommended to list all, but for testing, you might be >> able >>>>> to get away giving only one. >>>>> >>>>> If the list doesn’t work, then you might even want to look into >> zookeeper >>>>> and see whether they are setup properly. >>>>> >>>>> Bosco >>>>> >>>>> On 11/29/15, 11:51 AM, "Salman Ansari" <salman.rah...@gmail.com> >> wrote: >>>>> >>>>>> but the point is: do I really need to list all the zookeepers in the >>>>>> ensemble when starting solr or I can just specify one of them? >>>>>> >>>>>> On Sun, Nov 29, 2015 at 10:45 PM, Don Bosco Durai <bo...@apache.org> >>>>> wrote: >>>>>> >>>>>>> You might want to check the logs for why solr is not starting up. >>>>>>> >>>>>>> >>>>>>> Bosco >>>>>>> >>>>>>> >>>>>>> On 11/29/15, 11:30 AM, "Salman Ansari" <salman.rah...@gmail.com> >> wrote: >>>>>>> >>>>>>>> Thanks for your reply. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> Actually I am following the official guide to start solr using (on >>>>> Windows >>>>>>>> machines) >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> bin/solr start -e cloud -z zk1:2181,zk2:2182,zk3:2183 >>>>>>>> >>>>>>>> (it is listed here >>>>>>>> >>>>>>> >>>>> >> https://cwiki.apache.org/confluence/display/solr/Setting+Up+an+External+ZooKeeper+Ensemble >>>>>>>> ) >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> However, I am facing 2 issues >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> 1) If I specify the full list of ensemble (even with quotes around >> -z >>>>>>>> "zk1:2181,zk2:2182,zk3:2183") it does not start Solr on port 8983 >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> 2) Then I tried the workaround, which is specifying "localhost" on >> each >>>>>>>> Solr server to consult its local Zookeeper instance that is part of >> the >>>>>>>> ensemble, which worked as follows >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> bin/solr start -e cloud -z localhost:2181(on each machine that has >>>>>>>> zookeeper as well) >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> I followed the wizard (on each machine) to create 2 shards on 2 >> ports >>>>> and >>>>>>> 2 >>>>>>>> replicas. For the first machine I created "test" collection, but for >>>>> the >>>>>>>> second one I just reused the same collection. Now, Solr works on >> both >>>>>>>> machines but the issue is that when I see Solr admin page, it shows >> all >>>>>>> the >>>>>>>> shards and replicas of the collection on ONE MACHINE. >>>>>>>> >>>>>>>> >>>>>>>> Any ideas why I am facing these issues? >>>>>>>> >>>>>>>> >>>>>>>> Regards, >>>>>>>> >>>>>>>> Salman >>>>>>>> >>>>>>>> On Sun, Nov 29, 2015 at 10:07 PM, Erick Erickson < >>>>> erickerick...@gmail.com >>>>>>>> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> 1> I'll pass.... >>>>>>>>> >>>>>>>>> 2a> yes. >>>>>>>>> 2b> This should be automatic when you create the collection. You >>>>>>>>> should specify numShards=2, replicationFactor=2 and >>>>>>>>> maxShardsPerNode=2. Solr tries hard to distribute the shards and >>>>>>>>> replicas on different machines. >>>>>>>>> >>>>>>>>> If you _really_ require exact placement, you can specify >>>>> createNodeSet >>>>>>>>> which will assign shards round-robin to the specified list or even >>>>>>>>> EMPTY which will create no actual cores at all. In this latter case >>>>>>>>> you could then use ADDREPLICA to place each shard and replica >> exactly >>>>>>>>> where you want it to go. >>>>>>>>> >>>>>>>>> But I wouldn't bother first, just do what I outlined in 2b and it >>>>>>>>> should be fine. >>>>>>>>> >>>>>>>>> Best, >>>>>>>>> Erick >>>>>>>>> >>>>>>>>> On Sat, Nov 28, 2015 at 1:03 PM, Salman Ansari < >>>>> salman.rah...@gmail.com >>>>>>>> >>>>>>>>> wrote: >>>>>>>>>> I have started with one Zookeeper to test things and I have the >>>>>>> following >>>>>>>>>> questions >>>>>>>>>> >>>>>>>>>> 1) In my zoo.cfg I have defined >>>>>>>>>> tickTime=4000 >>>>>>>>>> dataDir=C:\\Solr\\Zookeeper\\zookeeper-3.4.6\\data >>>>>>>>>> clientPort=2183 >>>>>>>>>> >>>>>>>>>> the strange thing is that it picks up dataDir and clientPort but >>>>>>> always >>>>>>>>>> keeps tickTime = 3000. Any idea why? >>>>>>>>>> >>>>>>>>>> 2) It is clear from the documentation how to create an ensemble of >>>>>>>>>> Zookeepers on 3 machines but what I am not sure about is how to >>>>>>>>>> a) Setup actual Solr on 2 machines (is it just installing >>>>> Solr >>>>>>> on >>>>>>>>>> each server and then passing the same zookeeper ensemble)? >>>>>>>>>> b) How to (using Solr Cloud) create 2 shards spread on 2 >>>>>>> machines >>>>>>>>>> with each machine having a replica of the other for high >>>>>>> availability. So >>>>>>>>>> server1 will have shard1 and replica2 and server2 will have shard2 >>>>> and >>>>>>>>>> replica1? >>>>>>>>>> >>>>>>>>>> Comments and feedback are appreciated. >>>>>>>>>> >>>>>>>>>> Regards, >>>>>>>>>> Salman >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Fri, Nov 27, 2015 at 5:52 AM, Zheng Lin Edwin Yeo < >>>>>>>>> edwinye...@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Yes, the ZooKeeper is Windows compatible. >>>>>>>>>>> >>>>>>>>>>> You can follow the guide, just need to replace the Linux commands >>>>>>> with >>>>>>>>> the >>>>>>>>>>> Windows commands and paths >>>>>>>>>>> >>>>>>>>>>> Regards, >>>>>>>>>>> Edwin >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On 26 November 2015 at 20:56, Alessandro Benedetti < >>>>>>>>> abenede...@apache.org> >>>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> I think it should be straightforward following the Solr wiki : >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>> >> https://cwiki.apache.org/confluence/display/solr/Setting+Up+an+External+ZooKeeper+Ensemble >>>>>>>>>>>> >>>>>>>>>>>> I never played much in details with zookeeper ( never tried on a >>>>>>>>> windows >>>>>>>>>>>> machine), but I assume it is windows compatible ( I can see >>>>>>> binaries >>>>>>>>>>> .cmd ) >>>>>>>>>>>> >>>>>>>>>>>> Cheers >>>>>>>>>>>> >>>>>>>>>>>> On 26 November 2015 at 12:38, Salman Ansari < >>>>>>> salman.rah...@gmail.com> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi, >>>>>>>>>>>>> >>>>>>>>>>>>> I have seen the guide of setting up Solr on one machine as >>>>> well >>>>>>> as >>>>>>>>>>>> setting >>>>>>>>>>>>> it up on multiple machines on Liunx. Is there a good guide of >>>>>>> how to >>>>>>>>>>>> setup >>>>>>>>>>>>> Solr on multiple machines on Windows Server with Zookeeper >>>>>>>>> ensemble? My >>>>>>>>>>>>> structure is as follows >>>>>>>>>>>>> >>>>>>>>>>>>> 1) 3 machines will have Zookeeper to create an ensemble >>>>>>>>>>>>> 2) 2 of these machines will have Solr installed (with each >>>>>>> having a >>>>>>>>>>>> replica >>>>>>>>>>>>> of other to provide high availability) >>>>>>>>>>>>> >>>>>>>>>>>>> Any link/article that provides such a guide? >>>>>>>>>>>>> >>>>>>>>>>>>> Regards, >>>>>>>>>>>>> Salman >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> -------------------------- >>>>>>>>>>>> >>>>>>>>>>>> Benedetti Alessandro >>>>>>>>>>>> Visiting card : http://about.me/alessandro_benedetti >>>>>>>>>>>> >>>>>>>>>>>> "Tyger, tyger burning bright >>>>>>>>>>>> In the forests of the night, >>>>>>>>>>>> What immortal hand or eye >>>>>>>>>>>> Could frame thy fearful symmetry?" >>>>>>>>>>>> >>>>>>>>>>>> William Blake - Songs of Experience -1794 England >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>> >>>>>>> >>>>> >>>>> >>> >> >>
