Re: Solr Admin core status - Index is not "Current"

2014-04-11 Thread Chris W
Thanks, Shawn. On Fri, Apr 11, 2014 at 11:11 AM, Shawn Heisey wrote: > On 4/10/2014 2:50 PM, Chris W wrote: > >> Hi there >> >>I am using solrcloud (4.3). I am trying to get the status of a core >> from >> solr using (localhost:8000/solr/admin/cores?acti

Re: Solr Admin core status - Index is not "Current"

2014-04-11 Thread Chris W
Any help on this is much appreciated. I cannot find any documentation around this and would be good to understand what this means Thanks On Thu, Apr 10, 2014 at 1:50 PM, Chris W wrote: > Hi there > > I am using solrcloud (4.3). I am trying to get the status of a core from >

Solr Admin core status - Index is not "Current"

2014-04-10 Thread Chris W
Hi there I am using solrcloud (4.3). I am trying to get the status of a core from solr using (localhost:8000/solr/admin/cores?action=STATUS&core=) and i get the following output 100 102 2 20527 20 *false* What does current mean? A few of the cores are optimized (with segment count 1) and show

What is Overseer?

2014-03-31 Thread Chris W
What is the role of an overseer in solrcloud? The documentation does not offer full details about it. What if an overseer node goes down? -- Best -- C

Re: Block until replication finishes

2014-03-28 Thread Chris W
AM, Fermin Silva wrote: > Hi, > > that's what I'm trying. I'm however really cautious when it comes to a > while (somethingIsTrue) { doSomething; sleep; } > > Is that safe? What if the slave hungs up, the network is slow/fails, etc? > > Thanks > > &

Re: Block until replication finishes

2014-03-27 Thread Chris W
Hi You can use the "details" command to check the status of replication. http://localhost:8983/solr/core_name/replication?command=details The command returns an xml output and look out for the "isReplicating" field in the output. Keep running the command in a loop until the flag becomes false. T

Re: Limit on # of collections -SolrCloud

2014-03-22 Thread Chris W
(7) On Fri, Mar 21, 2014 at 1:05 PM, Chris W wrote: > Sorry for the piecemeal approach but had another question. I have a 3 zk > ensemble. Does making 2 zk as observer roles help speed up bootup of solr > (due to decrease in time it takes to decide leaders for shards)? > > &

Re: Limit on # of collections -SolrCloud

2014-03-21 Thread Chris W
Sorry for the piecemeal approach but had another question. I have a 3 zk ensemble. Does making 2 zk as observer roles help speed up bootup of solr (due to decrease in time it takes to decide leaders for shards)? On Fri, Mar 21, 2014 at 11:49 AM, Chris W wrote: > Thanks Tim. I would definit

Re: Limit on # of collections -SolrCloud

2014-03-21 Thread Chris W
Thanks Tim. I would definitely try that next time. I have seen a few instances where the overseer_queue not getting processed but that looks like an existing bug which got fixed in 4.6 (overseer doesnt process requests when reload collection fails) One question: Assuming our cluster can tolerate d

Re: Limit on # of collections -SolrCloud

2014-03-20 Thread Chris W
plicas? I'm not asking for a long list > > here, just if you have a bazillion replicas in aggregate. > > > > Hours is surprising. > > > > Best, > > Erick > > > > On Thu, Mar 20, 2014 at 2:17 PM, Chris W > wrote: > > > Thanks, Shalin

Re: Limit on # of collections -SolrCloud

2014-03-20 Thread Chris W
e available before leader > election happens > > You can't do much about 1 right now I think. For #2, you can keep your > transaction logs smaller by a hard commit before shutdown. For #3 > there is a leaderVoteWait settings but I'd rather not touch that > unless it become

Limit on # of collections -SolrCloud

2014-03-20 Thread Chris W
Hi there Is there a limit on the # of collections solrcloud can support? Can zk/solrcloud handle 1000s of collections? Also i see that the bootup time of solrcloud increases with increase in # of cores. I do not have any expensive warm up queries. How do i speedup solr startup? -- Best -- C

Re: Zookeeper exceptions - SEVERE

2014-03-19 Thread Chris W
its at all. I was mistaken. > > On Wed, Mar 19, 2014 at 10:06 AM, Chris W wrote: > > Thanks, Shawn and Shalin > > > > How does the frequency of commit affect zookeeper? > > > > > > Thanks > > > > > > On Tue, Mar 18, 2014 at 9:12 PM, Shali

Re: Zookeeper exceptions - SEVERE

2014-03-18 Thread Chris W
der election and during > collection API commands. It doesn't correlate directly with indexing > but is correlated with how frequently you call commit. > > On Wed, Mar 19, 2014 at 5:46 AM, Shawn Heisey wrote: > > On 3/18/2014 5:46 PM, Chris W wrote: > >> > >>

Zookeeper exceptions - SEVERE

2014-03-18 Thread Chris W
I am running a 3 node zookeeper 3.4.5 Quorum. I am running into issues with Zookeeper transaction logs [myid:2] - ERROR [main:QuorumPeer@453] - Unable to load database on disk java.io.IOException: Unreasonable length = 1048587 at org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.j

Re: Result merging takes too long

2014-03-16 Thread Chris W
Can you share a sample query ? Ensure you have filterquery, fl fields and query result cache settings well tuned To give you an example: A month ago I had an issue where a few of our queries were taking 3+seconds with 5 shards and as I added more shards the query was taking even longer. I figured

Re: Zookeeper latencies and pending requests - Solr 4.3

2014-03-13 Thread Chris W
Any help on this is much appreciated. Is it better to use more cores for zookeeper (as opposed to 1 core machine)? On Wed, Mar 12, 2014 at 4:28 PM, Chris W wrote: > Hi Furkan > > Load on the network is very low when read workload is on the cluster. > During indexing, a few of my &

Re: Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Chris W
t; about your infrastructure and Solr logs? (PS: 50 mb data *may *cause a > problem for your architecture) > > Thanks; > Furkan KAMACI > > > 2014-03-13 0:57 GMT+02:00 Chris W : > > > Hi > > > > I have a 3 node zk ensemble . I see a very high latency for zk &g

Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Chris W
Hi I have a 3 node zk ensemble . I see a very high latency for zk responses and also a lot of outstanding requests (in the order of 30-40) I also see that the requests are not going to all zookeeper nodes equally. One node has more requests/connections than the others. I see that CPU/Mem and di

Re: Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-12 Thread Chris W
We decided to go with the latest (it seems to have a lot more bug /performance fixes). The issue i mentioned was a red herring. I was able to successfully upgrade On Tue, Mar 11, 2014 at 2:09 PM, Chris W wrote: > Moving 4 versions ahead may need much additional tests from my side to >

Re: Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-11 Thread Chris W
and vetting requirements, but I thought I'd ask No use > going through this twice if you can avoid it. > > On Tue, Mar 11, 2014 at 12:49 PM, Chris W wrote: > > I am running solrcloud version 4.3.0 with a 10 m1.xlarge nodes and using > > zk to manage the state/data for coll

Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-11 Thread Chris W
I am running solrcloud version 4.3.0 with a 10 m1.xlarge nodes and using zk to manage the state/data for collections and configs.I want to upgrade to version 4.4.0. When i deploy a 4.4 version of solrcloud in my test environment, none of the collections/configs (created using the 4.3 version of