Solr Cloud - How to maintain the addresses of the zookeeper servers
Hi all, I want to set up a solr cloud with x nodes and have 3 zookeepers servers. As i understand the following parties need to know all zookeeper servers: * All zookeeper servers * All solr cloud nodes * All solr4j cloud smart clients So let's say if i make it hard coded and then want to add 2 zookeeper nodes, I would have to update many places. This makes it hard to maintain it. How do you manage this? Is there a possibility to get the list of zookeeper services dynamically? Any other idea? I wanted to hear from your expereince how to achieve this task effectively. Thanks, David
Re: Solr Cloud - How to maintain the addresses of the zookeeper servers
Hi Markus and Jan, Thanks for the quick response and good ideas. I will look for the puppet direction. We already use puppet, so this is easy to add Thanks a lot, David On Thu, Jan 26, 2017 at 3:38 PM Markus Jelsma wrote: > Or you can administate the nodes via configuration management software > such as Salt, Puppet, etc. If we add a Zookeeper to our list of Zookeepers, > it is automatically updated in solr.in.sh file on all nodes and separate > clusters. > > If you're looking for easy maintenance that is :) > > Markus > > -Original message- > > From:Jan Høydahl > > Sent: Thursday 26th January 2017 14:34 > > To: solr-user@lucene.apache.org > > Subject: Re: Solr Cloud - How to maintain the addresses of the zookeeper > servers > > > > Hi, > > > > Hardcoding your zk server addresses is a key factor to stability in your > cluster. > > If this was some kind of magic, and the magic failed, EVERYTHING would > come to a halt :) > > And since changing ZK is something you do very seldom, I think it is not > too hard to > > > > 1. push new solr.in.sh file to all nodes > > 2. restart all ndoes > > > > -- > > Jan Høydahl, search solution architect > > Cominvent AS - www.cominvent.com > > > > > 26. jan. 2017 kl. 14.30 skrev David Michael Gang < > michaelg...@gmail.com>: > > > > > > Hi all, > > > > > > I want to set up a solr cloud with x nodes and have 3 zookeepers > servers. > > > As i understand the following parties need to know all zookeeper > servers: > > > * All zookeeper servers > > > * All solr cloud nodes > > > * All solr4j cloud smart clients > > > > > > So let's say if i make it hard coded and then want to add 2 zookeeper > > > nodes, I would have to update many places. This makes it hard to > maintain > > > it. > > > How do you manage this? Is there a possibility to get the list of > zookeeper > > > services dynamically? Any other idea? > > > I wanted to hear from your expereince how to achieve this task > effectively. > > > > > > Thanks, > > > David > > > > >
minimal solrconfig example
Hi all, I want to create my first solr collection I found an example of solrconfig here. https://github.com/apache/lucene-solr/blob/master/solr/example/files/conf/solrconfig.xml This is a file of more than thousand lines. As i understand this file shows all possible configurations possible. What i miss is the most minimal file. Where i can i find a minimal solrconfig.xml file with just the required options? Thanks, David
Re: minimal solrconfig example
I use the latest version. Solr 6.4.1 On Thu, Mar 2, 2017 at 9:15 AM Aravind Durvasula wrote: > Hi David, > > What is the solr version you are using? > To get started, it's better to use the config file that comes out of the > box. > > Thanks, > Aravind > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/minimal-solrconfig-example-tp4322977p4322978.html > Sent from the Solr - User mailing list archive at Nabble.com. >
Re: minimal solrconfig example
Thanks Charly. This is what i looked for. On Thu, Mar 2, 2017 at 11:07 AM David Michael Gang wrote: I use the latest version. Solr 6.4.1 On Thu, Mar 2, 2017 at 9:15 AM Aravind Durvasula wrote: Hi David, What is the solr version you are using? To get started, it's better to use the config file that comes out of the box. Thanks, Aravind -- View this message in context: http://lucene.472066.n3.nabble.com/minimal-solrconfig-example-tp4322977p4322978.html Sent from the Solr - User mailing list archive at Nabble.com.
messages in gc log not connected to gcs in indexing time
Hi all, When indexing data i get in the gc log messages like: 2017-03-02T10:43:17.872+: 1088.957: Total time for which application threads were stopped: 0.0002071 seconds, Stopping threads took: 0.888 seconds 2017-03-02T10:43:17.885+: 1088.970: Total time for which application threads were stopped: 0.0005521 seconds, Stopping threads took: 0.0003334 seconds 2017-03-02T10:43:18.886+: 1089.970: Total time for which application threads were stopped: 0.0003282 seconds, Stopping threads took: 0.0001287 seconds 2017-03-02T10:43:19.887+: 1090.972: Total time for which application threads were stopped: 0.0012858 seconds, Stopping threads took: 0.0010998 seconds 2017-03-02T10:43:20.204+: 1091.289: Total time for which application threads were stopped: 0.0005383 seconds, Stopping threads took: 0.0002524 seconds 2017-03-02T10:43:20.209+: 1091.294: Total time for which application threads were stopped: 0.0045521 seconds, Stopping threads took: 0.0044508 seconds 2017-03-02T10:43:20.210+: 1091.295: Total time for which application threads were stopped: 0.0005231 seconds, Stopping threads took: 0.0002992 seconds 2017-03-02T10:43:20.211+: 1091.295: Total time for which application threads were stopped: 0.0003368 seconds, Stopping threads took: 0.0002406 seconds 2017-03-02T10:43:20.211+: 1091.296: Total time for which application threads were stopped: 0.0003751 seconds, Stopping threads took: 0.0002424 seconds 2017-03-02T10:43:20.212+: 1091.297: Total time for which application threads were stopped: 0.0003600 seconds, Stopping threads took: 0.0002684 seconds 2017-03-02T10:43:20.212+: 1091.297: Total time for which application threads were stopped: 0.0004536 seconds, Stopping threads took: 0.0003420 seconds 2017-03-02T10:43:20.213+: 1091.298: Total time for which application threads were stopped: 0.0002759 seconds, Stopping threads took: 0.0001949 seconds 2017-03-02T10:43:20.213+: 1091.298: Total time for which application threads were stopped: 0.0001114 seconds, Stopping threads took: 0.558 seconds 2017-03-02T10:43:20.214+: 1091.299: Total time for which application threads were stopped: 0.0004253 seconds, Stopping threads took: 0.0002801 seconds 2017-03-02T10:43:20.214+: 1091.299: Total time for which application threads were stopped: 0.0002987 seconds, Stopping threads took: 0.0002093 seconds 2017-03-02T10:43:20.675+: 1091.760: Total time for which application threads were stopped: 0.0004817 seconds, Stopping threads took: 0.0002180 seconds 2017-03-02T10:43:20.676+: 1091.760: Total time for which application threads were stopped: 0.0003925 seconds, Stopping threads took: 0.0002443 seconds 2017-03-02T10:43:20.676+: 1091.761: Total time for which application threads were stopped: 0.0002973 seconds, Stopping threads took: 0.0001974 seconds 2017-03-02T10:43:20.704+: 1091.788: Total time for which application threads were stopped: 0.0002341 seconds, Stopping threads took: 0.771 seconds They are not connected to gcs, but to safepoints http://blog.ragozin.info/2012/10/safepoints-in-hotspot-jvm.html What are the reasons in solr regarding these safepoints? Do i have take care about this? If yes what can i do regarding this? Thanks, David
recommended zookeeper version for solr cloud
Hi all, Which version of external zookeper is recommended to use in production environments? 3.4.6 which is the version shipped with solr or 3.4.10 which is the latest stable? Thanks, David
