Re: SORLCLOUD

2020-02-10 Thread Erick Erickson
You’ve misconfigured the startup. Although looking at the script help it is a little confusing. The -z parameter should be the _ensemble_. Pointing each Solr instance three times at the same ZK instance is not at all what you need to do. You should start them up with the “-z” parameter set to so

SORLCLOUD

2020-02-10 Thread noman
I have created three different solrcloud instance running on three different ports with external zookeeper 3 instance link with them and when I load the data in one solrcloud instance, it successfully can be accessible from three different solrcloud instance. E.g: Zookeeper ./zkServer start zoo.cfg

Re: Re-register a deleted Collection SorlCloud

2016-11-08 Thread Chetas Joshi
I won't be able to achieve the correct mapping as I did not store the mapping info any where. I don't know if core-node1 was mapped to shard1_recplica1 or shard2_replica1 in my old collection. But I am not worried about that as I am not going to update any existing document. This is what I did.

Re: Re-register a deleted Collection SorlCloud

2016-11-07 Thread Erick Erickson
You've got it. You should be quite safe if you 1> create the same number of shards as you used to have 2> match the shard bits. I.e. collection1_shard1_replica1 as long as the collection1_shard# parts match you should be fine. If this isn't done correctly, the symptom will be that when you update a

Re: Re-register a deleted Collection SorlCloud

2016-11-07 Thread Chetas Joshi
Thanks Erick. I had replicationFactor=1 in my old collection and going to have the same config for the new collection. When I create a new collection with number of Shards =20 and max shards per node = 1, the shards are going to start on 20 hosts out of my 25 hosts Solr cluster. When you say "get

Re: Re-register a deleted Collection SorlCloud

2016-11-07 Thread Erick Erickson
That should work. The caveat here is that you need to get the each shards index to the corresponding shard on your new collection. Of course I'd back up _all_ of these indexes before even starting. And one other trick. First create your collection with 1 replica per shard (leader-only). Then copy

Re-register a deleted Collection SorlCloud

2016-11-07 Thread Chetas Joshi
I have a Solr Cloud deployed on top of HDFS. I accidentally deleted a collection using the collection API. So, ZooKeeper cluster has lost all the info related to that collection. I don't have a backup that I can restore from. However, I have indices and transaction logs on HDFS. If I create a new

Re: sorlcloud connection issue

2016-07-12 Thread Kent Mu
Dear Mr. Heisey. It seems that we can not send the picture or attachments to solr-user, so I send the screen shot to your personal email, sorry to disturb! Thanks! Kent 2016-07-13 8:13 GMT+08:00 Shawn Heisey : > On 7/12/2016 8:30 AM, Kent Mu wrote: > > We have configed the maxThreads in JBOSS,

Re: sorlcloud connection issue

2016-07-12 Thread Kent Mu
we have 5 shards and each shard with one leader and one replica. the "3300" connections is only for one JVM. please see the follow analysis in zabbix. ​ ​ and we the solrj code as follow: public synchronized static CloudSolrServer getSolrCloudReadServer() { if (reviewSolrCloudReadS

Re: sorlcloud connection issue

2016-07-12 Thread Shawn Heisey
On 7/12/2016 8:30 AM, Kent Mu wrote: > We have configed the maxThreads in JBOSS, and the good news is solrcloud > now running OK. but I another issue came across. We find the number of the > HTTP connections is very high, and the number can be around 3300. and > solrcloud does no release the connec

Re: sorlcloud connection issue

2016-07-12 Thread Kent Mu
Dear Mr. Heisey. We have configed the maxThreads in JBOSS, and the good news is solrcloud now running OK. but I another issue came across. We find the number of the HTTP connections is very high, and the number can be around 3300. and solrcloud does no release the connections. I understand that, t

Re: sorlcloud connection issue

2016-07-09 Thread Kent Mu
Dear Mr. Heisey! Thanks for your reply very much! as you said, I think this will be key to the issue, and I will config "maxThreads" next week. hope it will work. Thanks again! 2016-07-07 22:24 GMT+08:00 Shawn Heisey : > On 7/6/2016 5:26 AM, Kent Mu wrote: > > Hi friends! > > *solr version: 4.9

Re: sorlcloud connection issue

2016-07-09 Thread Kent Mu
Dear Mr. Mangar! Thanks for your reply. we have 3 cores with 5 shards, and each shard with one leader and one replication. now the data account goes to be 100 million, and it is still growing up.I see no connection timeout. actually we have schedule job to commit the data every 2 hours. so the acti

Re: sorlcloud connection issue

2016-07-07 Thread Shawn Heisey
On 7/6/2016 5:26 AM, Kent Mu wrote: > Hi friends! > *solr version: 4.9.0* > > I came across a problem when use solrcloud, it becomes dead lock, we got > the java core log, it looks like the http connection pool is exhausted and > most threads are waiting to get a free connection.. > > I posted the

Re: sorlcloud connection issue

2016-07-07 Thread Shalin Shekhar Mangar
Hi Kent, There is no point sending multiple emails for the same subject. It distracts people from the other messages, distributes the conversation and discourages people from helping you. Please provide more details about your cluster. 1. How many nodes? 2. How many collections? 3. How many shard

sorlcloud connection issue

2016-07-06 Thread Kent Mu
Hi friends! *solr version: 4.9.0* I came across a problem when use solrcloud, it becomes dead lock, we got the java core log, it looks like the http connection pool is exhausted and most threads are waiting to get a free connection.. I posted the problem in JIRA, the link is https://issues.apache

Re: Re: how to join search mutiple collection in sorlcloud

2015-11-17 Thread Paul Blanchaert
17 November 2015 at 09:05, soledede_w...@ehsy.com wrote: > > Yes,Thanks,But It just support (select * from A where A.id in(select id > from B where...)) or not > I hope It is (select a*,b.* from A a join B b on A.id = B.id) > How to merge the result of shards > > Thanks > >

Re: Re: how to join search mutiple collection in sorlcloud

2015-11-17 Thread soledede_w...@ehsy.com
: Re: Re: how to join search mutiple collection in sorlcloud You might want to take a look at/follow up upon SOLR-8297 <https://issues.apache.org/jira/browse/SOLR-8297> On Tue, 17 Nov 2015 at 04:14 soledede_w...@ehsy.com wrote: > > Thanks Erick > > I think if can use hash

Re: Re: how to join search mutiple collection in sorlcloud

2015-11-16 Thread Paul Blanchaert
the result in a node. > > > soledede_w...@ehsy.com > > From: Erick Erickson > Date: 2015-11-17 11:10 > To: solr-user > Subject: Re: how to join search mutiple collection in sorlcloud > In a word, no. At least probably not. > > There are some JIRA tickets dealing with d

Re: Re: how to join search mutiple collection in sorlcloud

2015-11-16 Thread soledede_w...@ehsy.com
Thanks Erick I think if can use hash for doc_id to all shards, then do join,Last merge the result in a node. soledede_w...@ehsy.com From: Erick Erickson Date: 2015-11-17 11:10 To: solr-user Subject: Re: how to join search mutiple collection in sorlcloud In a word, no. At least probably not

Re: how to join search mutiple collection in sorlcloud

2015-11-16 Thread Erick Erickson
In a word, no. At least probably not. There are some JIRA tickets dealing with distributed joins, and some with certain restrictions, specifically if the second (from) collection can be reproduced on every slice of the first (to) collection. In the trunk (6.0), there's the ParallelSQL stuff which

how to join search mutiple collection in sorlcloud

2015-11-16 Thread soledede_w...@ehsy.com
Dear @solr_lucene currently,I am using solr5.3.1,I have a requirement, I need search like in relation database(select * from A ,B where A.id=B.id),Can we implments with solr5.3 in SolrCloud mode,I have two collection,2 shards per collection. Help me please. Thanks soledede_w...@ehsy.

Re: SorlCloud recovery issue while search stress test

2013-11-12 Thread Erick Erickson
;s a writeup on tlogs etc. and how to control this. http://searchhub.org/2013/08/23/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/ Best, Erick On Tue, Nov 12, 2013 at 8:44 AM, Alejandro Marqués Rodríguez < amarq...@paradigmatecnologico.com> wrote: > Hi, > > We'

SorlCloud recovery issue while search stress test

2013-11-12 Thread Alejandro Marqués Rodríguez
Hi, We've been experiencing some problems during search stress tests and we don't even have a clue on why is this happening. We have the following: - 3 servers - Websphere 7 - Zookeeper 3.4.5 on each server - Solr 4.5.0 on each server - 1 shard (so it is one leader and 2 replicas) - The index con

Re: How to get a list of servers per collection in sorlcloud using java api?

2012-11-22 Thread Sami Siren
On Thu, Nov 22, 2012 at 7:20 PM, joe.cohe...@gmail.com < joe.cohe...@gmail.com> wrote: > Thanks Rakudten. > I had my question mis-phrased. > What I need is being able to get the solr servers storing a collection by > giving the zookeeper server as an input. > > something like: > > // returns a lis

Re: How to get a list of servers per collection in sorlcloud using java api?

2012-11-22 Thread Luis Cappa Banda
ble.com/How-to-get-a-list-of-servers-per-collection-in-sorlcloud-using-java-api-tp4021863p4021883.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- - Luis Cappa

Re: How to get a list of servers per collection in sorlcloud using java api?

2012-11-22 Thread Luis Cappa Banda
servers/urls that run a specific > collection? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-to-get-a-list-of-servers-per-collection-in-sorlcloud-using-java-api-tp4021863.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- - Luis Cappa

Re: How sorlcloud distribute data among shards of the same cluster?

2012-04-20 Thread Boon Low
pr 17, 2012, at 9:56 AM, emma1023 wrote: >>>>> >>>>> It hashes the id. The doc distribution is fairly even - but sizes may be >>>>> fairly different. >>>>> >>>>>> How solrcloud manage distri

Re: How sorlcloud distribute data among shards of the same cluster?

2012-04-19 Thread Mark Miller
>> It hashes the id. The doc distribution is fairly even - but sizes may be >>>> fairly different. >>>> >>>>> How solrcloud manage distribute data among shards of the same cluster >>>> when >>>>> you query? Is it distribute

Re: How sorlcloud distribute data among shards of the same cluster?

2012-04-19 Thread Boon Low
>>> fairly different. >>> >>>> How solrcloud manage distribute data among shards of the same cluster >>> when >>>> you query? Is it distribute the data equally? What is the basis? Which >>> part >>>> of the code that I can fin

Re: How sorlcloud distribute data among shards of the same cluster?

2012-04-18 Thread Erick Erickson
hards of the same cluster >> when >> > you query? Is it distribute the data equally? What is the basis? Which >> part >> > of the code that I can find about it?Thank you so much! >> > >> > >> > -- >> > View this message in context:

Re: How sorlcloud distribute data among shards of the same cluster?

2012-04-17 Thread emma1023
; View this message in context: > http://lucene.472066.n3.nabble.com/How-sorlcloud-distribute-data-among-shards-of-the-same-cluster-tp3917323p3917323.html > > Sent from the Solr - User mailing list archive at Nabble.com. > > - Mark Miller > lucidimagination.com > > > >

Re: How sorlcloud distribute data among shards of the same cluster?

2012-04-17 Thread Mark Miller
h part > of the code that I can find about it?Thank you so much! > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-sorlcloud-distribute-data-among-shards-of-the-same-cluster-tp3917323p3917323.html > Sent from the Solr - User mailing list archive at

How sorlcloud distribute data among shards of the same cluster?

2012-04-17 Thread emma1023
How solrcloud manage distribute data among shards of the same cluster when you query? Is it distribute the data equally? What is the basis? Which part of the code that I can find about it?Thank you so much! -- View this message in context: http://lucene.472066.n3.nabble.com/How-sorlcloud