Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-15 Thread vicky desai
Hi, I got the solution to the above problem . Sharing the code so that it could help people in future PoolingClientConnectionManager poolingClientConnectionManager = new PoolingClientConnectionManager(); poolingClientConnectionManager.setMaxTotal(2); poolingClientConnectionManager.setDefaultMaxPe

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-12 Thread vicky desai
Hi, As per the suggestions above I shifted my focus to using CloudSolrServer. In terms of sending updates to the leaders and reducing network traffic it works great. But i faced one problem in using CloudSolrServer is that it opens too many connections as large as five thousand connections. My Cod

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-07 Thread Erick Erickson
uot; are very poor tools to >> lead a system design. Focus the energy on the data modeling and the overall >> application design. >> >> -- Jack Krupansky >> >> -Original Message- From: vicky desai >> Sent: Sunday, July 07, 2013 1:17 AM >> To:

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-06 Thread Shalin Shekhar Mangar
odeling and the overall > application design. > > -- Jack Krupansky > > -----Original Message----- From: vicky desai > Sent: Sunday, July 07, 2013 1:17 AM > To: solr-user@lucene.apache.org > Subject: Re: Is it possible to find a leader from a list of cores in solr > via

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-06 Thread Jack Krupansky
remature optimization" are very poor tools to lead a system design. Focus the energy on the data modeling and the overall application design. -- Jack Krupansky -Original Message- From: vicky desai Sent: Sunday, July 07, 2013 1:17 AM To: solr-user@lucene.apache.org Subject: Re: Is it

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-06 Thread vicky desai
Hi Erik, I just wanted to clarify if u got my concern right. If i send some documents to the replica core wont it first have to send the documents to the leader core which in turn would be sending it back to the replica cores. If yes then this will lead to additional network traffic which can be a

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-06 Thread Erick Erickson
bq: Reason being If a write request is sent to the replica it relays it to the leader and then the leader relays it to all the replicas. This will help me in saving some network traffic as my application performs continuous writes How are you indexing? SolrJ already is "leader aware" and sends up

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-03 Thread Aloke Ghoshal
One option could be to get the clusterstate.json via the following Solr url & figure out the leader from the response json: * http://server:port/solr/zookeeper?detail=true&path=%2Fclusterstate.json* On Wed, Jul 3, 2013 at 5:57 PM, vicky desai wrote: > Hi, > > I have a requirement where in I want

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-03 Thread vicky desai
Hi, I have a requirement where in I want to write to the leader and read from the replica. Reason being If a write request is sent to the replica it relays it to the leader and then the leader relays it to all the replicas. This will help me in saving some network traffic as my application perform

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-03 Thread Giovanni Bricconi
I have the same question. My purpose is to start the dih full process on the leader and not on a replica. I tried full import on a replica but watching logs it seemed to me that the replica was loading data to send it to the leader which in turn has to update all the replicas. At least this is what

Re: Is it possible to find a leader from a list of cores in solr via java code

2013-07-03 Thread Erick Erickson
You can always query Zookeeper and find that information out. Take a look at CloudSolrServer, maybe ZkCoreNodeProps etc. for examples since CloudSolrServer is "leader aware", it should have some clues... Or maybe ZkStateReader? I haven't been in that code much, so I can't be more specific... But