Disastor Scenario Question Regarding Tlog+pull solrcloud setup

Hi, My question is about the solrcloud cluster we are trying to have. We have a collection with Tlog and pull type replicas. We intend to keep all the tlogs on one node and use that for writing and pull replicas distributed on the remaining nodes. What we have noticed is that when the Tlog node g

Re: StreamingSolrClients intermittent Error SolrCloud setup

Hi Abhi, Are all your Solr nodes and ZooKeepers in different machine? Regards, Edwin On Wed, 27 Feb 2019 at 02:19, abhishek_itengg wrote: > Hi, > > I am using SolrCloud setup with 3 SolrNodes. Intermittently we see errors > of > streaming solr clients on individual solr node lo

StreamingSolrClients intermittent Error SolrCloud setup

Hi, I am using SolrCloud setup with 3 SolrNodes. Intermittently we see errors of streaming solr clients on individual solr node logs. These error do resolved automatically but it comes back every now and then. We have 3 zookeepers and I verified that they have always maintained quorum. Is there a

Re: Scoping SolrCloud setup

g.html <http://www.od-bits.com/2018/01/solrelasticsearch-capacity-planning.html> Thanks, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ On 14 Mar 2018, at 01:01, Scott Prentice wrote: We're in

Re: Scoping SolrCloud setup

t;>>> load to multiple servers. >>>> It seems to me that there is no high indexing throughput requirement and >>>> the main criteria should be query latency. >>>> Here is another blog post talking about this subject: >>>> http://www.o

Re: Scoping SolrCloud setup

t.com/ On 14 Mar 2018, at 01:01, Scott Prentice wrote: We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query fre

Re: Scoping SolrCloud setup

tection >> Solr & Elasticsearch Consulting Support Training - http://sematext.com/ >> >> >> >>> On 14 Mar 2018, at 01:01, Scott Prentice wrote: >>> >>> We're in the process of moving from 12 single-core collections (non-cloud >>> Solr

Re: Scoping SolrCloud setup

port Training - http://sematext.com/ On 14 Mar 2018, at 01:01, Scott Prentice wrote: We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M do

Re: Scoping SolrCloud setup

1, Scott Prentice wrote: We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query frequency is rather low .. probably no more

Re: Scoping SolrCloud setup

> We're in the process of moving from 12 single-core collections (non-cloud > Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in > size from 50K to 150K documents with one at 1.2M docs. Our max query > frequency is rather low .. probabl

Re: Scoping SolrCloud setup

ut I think one of the deciding factors is if your index can fit into RAM (not JVM Heap, but OS cache). What are the sizes of your indexes? On 14 March 2018 at 11:01, Scott Prentice wrote: > We're in the process of moving from 12 single-core collections (non-cloud > Solr) on 3 VMs to a

Scoping SolrCloud setup

We're in the process of moving from 12 single-core collections (non-cloud Solr) on 3 VMs to a SolrCloud setup. Our collections aren't huge, ranging in size from 50K to 150K documents with one at 1.2M docs. Our max query frequency is rather low .. probably no more than 10-20/min. We

Re: Solrcloud setup

Stop optimizing call and see if that resolves the problem. Also how are you indexing? (point 3 above). Are you using CloudSolrClient or manually sending requests to any node? Thanks, Susheel On Tue, Aug 22, 2017 at 9:27 AM, Shreya Kampli wrote: > Hi, > > I have setup a solrcloud with 1 shard a

Solrcloud setup

Hi, I have setup a solrcloud with 1 shard and 3 replicas on solr 6.6. Every index operation makes an explicit commit so that the documents are available immediately. The indexing happens every 5 minutes for few 100's of documents. My problem is that I see that the replica nodes are frequently goi

Re: SolrCloud setup

Regards, Preeti -Original Message- From: John Bickerstaff [mailto:j...@johnbickerstaff.com] Sent: Thursday, September 22, 2016 9:19 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup I found it to be way less than intuitive when I first started to get going. I wished for an example

RE: SolrCloud setup

, September 22, 2016 9:19 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup I found it to be way less than intuitive when I first started to get going. I wished for an example or step by step (including zookeeper) Pulling it all together from the docs wasn't straightforward altho

Re: SolrCloud setup

I found it to be way less than intuitive when I first started to get going. I wished for an example or step by step (including zookeeper) Pulling it all together from the docs wasn't straightforward although I guess the info is still there. I'll send you my rough notes in case they're helpful...

Re: SolrCloud setup

Setting up SolrCloud on multiple hosts is exactly the same as a single host. You just install Solr on all the hosts you care about and start it up. As long as the hosts can talk to each other via HTTP, it's all magic. The "glue" is Zookeeper. All the Solrs are started up with the same ZK ensemble

SolrCloud setup

Can someone point me to a tutorial or blog to setup SolrCloud on multiple hosts? LucidWorks just have a trivial single host example. I searched around but only found some blogs for older versions (2014 or earlier). thanks.

Re: how to change configurations in solrcloud setup

On 3/11/2015 10:45 PM, Aman Tandon wrote: >> You may need to manually remove the 127.0.1.1 entries from zookeeper >> after you fix the IP address problem. > > > How to do that? The zkcli script included with Solr should have everything you need -- getfile, putfile, and clear ... but that would b

Re: how to change configurations in solrcloud setup

Hi Shawn, As suggested i gave the -Dhost=192.168.5.236 in command line for the server which was showing 127.0.0.1. *./solr start -c -z 192.168.6.217:2181 ,192.168.5.81:2181 ,192.168.5.236:2181 -p 4567 -Dhost=192.168.

Re: how to change configurations in solrcloud setup

On 3/11/2015 6:32 AM, Aman Tandon wrote: > I restart my complete cluster but the problem still present. Please help. > > *Here is the screenshot url:* > > *http://i.imgur.com/QFdg89S.png > > http://i.imgur.com/tS0yTNh.png The first screenshot actually shows the problem, but it may not be immediate

Re: how to change configurations in solrcloud setup

Hi Shawn, I make the changes in my schema.xml & uploaded the configuration from one of my server, which is now visible in all other servers (I confirmed it by checking from admin interface). *My Solr Cloud arch is :* I have two collections, mcat & intent in my external zookeeper ensemble of 3.

Re: how to change configurations in solrcloud setup

Thanks Shawn. > > > except that you should reload the collection, which > will reload all cores for that collection So i could reload a collection via Collection API's http://localhost:8983/solr/admin/collections?action=RELOAD&name=newCollection right? With Regards Aman Tandon On Wed, Mar 1

Re: how to change configurations in solrcloud setup

On 3/11/2015 12:43 AM, Aman Tandon wrote: > Thanks Nitin for replying, isn't it will be costly operation to restart all > nodes. > > What i am doing in this is uploading the configurations again to zookeeper > and then reloading my core. And it is working well. So am i missing > something? Yes, t

Re: how to change configurations in solrcloud setup

Hi, Thanks Nitin for replying, isn't it will be costly operation to restart all nodes. What i am doing in this is uploading the configurations again to zookeeper and then reloading my core. And it is working well. So am i missing something? With Regards Aman Tandon On Wed, Mar 11, 2015 at 11:21

Re: how to change configurations in solrcloud setup

Hi Aman, You can apply configuration on solr cloud by using this command - sudo //example/scripts/cloud-scripts/zkcli.sh -zkhost localhost:9983 -cmd upconfig -confdir //example/solr/collection1/conf -confname default and then restart all nodes of solrcloud. On Mon, Mar 9, 2015 a

Re: how to change configurations in solrcloud setup

Please help. With Regards Aman Tandon On Sat, Mar 7, 2015 at 9:58 PM, Aman Tandon wrote: > Hi, > > Please tell me what is best way to apply configuration changes in solr > cloud and how to do that. > > Thanks in advance. > > With Regards > Aman Tandon >

how to change configurations in solrcloud setup

Hi, Please tell me what is best way to apply configuration changes in solr cloud and how to do that. Thanks in advance. With Regards Aman Tandon

Re: SolrCloud setup guidance

performance > > > is coming. Current memory 7 GB is really low. After that you may want > to > > > add another node to partition the index into 2 nodes/shards (assuming > you > > > have some partition strategy ) that index size of 150-200 GB can fit > into &g

Re: SolrCloud setup guidance

node to partition the index into 2 nodes/shards (assuming you > > have some partition strategy ) that index size of 150-200 GB can fit into > > two nodes memory. > > > > Thanks, > > Susheel > > > > -Original Message- > > From: Priti Solanki

Re: SolrCloud setup guidance

ssuming you > have some partition strategy ) that index size of 150-200 GB can fit into > two nodes memory. > > Thanks, > Susheel > > -Original Message- > From: Priti Solanki [mailto:pritiatw...@gmail.com] > Sent: Friday, March 07, 2014 12:50 AM > To: solr-

RE: SolrCloud setup guidance

have some partition strategy ) that index size of 150-200 GB can fit into two nodes memory. Thanks, Susheel -Original Message- From: Priti Solanki [mailto:pritiatw...@gmail.com] Sent: Friday, March 07, 2014 12:50 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud setup guidance

Re: SolrCloud setup guidance

d, are you able to upgrade > > your > > > single node to 128GB of memory(vertical scaling) to see the difference. > > > > > > Thanks, > > > Susheel > > > > > > -Original Message- > > > From: Priti Solanki [mailto:pritiat

Re: SolrCloud setup guidance

ailto:pritiatw...@gmail.com] > > Sent: Thursday, March 06, 2014 10:51 AM > > To: solr-user@lucene.apache.org > > Subject: SolrCloud setup guidance > > > > Hello Everyone, > > > > I would like to take you guidance of following > > > > I hav

Re: SolrCloud setup guidance

age- > From: Priti Solanki [mailto:pritiatw...@gmail.com] > Sent: Thursday, March 06, 2014 10:51 AM > To: solr-user@lucene.apache.org > Subject: SolrCloud setup guidance > > Hello Everyone, > > I would like to take you guidance of following > > I have a single core with 124 GB o

RE: SolrCloud setup guidance

[mailto:pritiatw...@gmail.com] Sent: Thursday, March 06, 2014 10:51 AM To: solr-user@lucene.apache.org Subject: SolrCloud setup guidance Hello Everyone, I would like to take you guidance of following I have a single core with 124 GB of index data size. Indexing and Reading both are very slow as I have 7

SolrCloud setup guidance

Hello Everyone, I would like to take you guidance of following I have a single core with 124 GB of index data size. Indexing and Reading both are very slow as I have 7 GB RAM to support this huge data. Almost 8 million of documents. Hence, we thought of going to SolrCloud so that we can accommo

Re: SolrCloud setup - any advice?

I think you're right, but you can specify a default value in your schema.xml to at least see if this is a good path to follow. Best, Erick On Fri, Sep 27, 2013 at 3:46 AM, Neil Prosser wrote: > Good point. I'd seen docValues and wondered whether they might be of use in > this situation. However,

Re: SolrCloud setup - any advice?

Good point. I'd seen docValues and wondered whether they might be of use in this situation. However, as I understand it they require a value to be set for all documents until Solr 4.5. Is that true or was I imagining reading that? On 25 September 2013 11:36, Erick Erickson wrote: > H, I con

Re: SolrCloud setup - any advice?

H, I confess I haven't had a chance to play with this yet, but have you considered docValues for some of your fields? See: http://wiki.apache.org/solr/DocValues And just to tantalize you: > Since Solr4.2 to build a forward index for a field, for purposes of sorting, > faceting, grouping, fun

Re: SolrCloud setup - any advice?

Shawn: unfortunately the current problems are with facet.method=enum! Erick: We already round our date queries so they're the same for at least an hour so thankfully our fq entries will be reusable. However, I'll take a look at reducing the cache and autowarming counts and see what the effect on h

Re: SolrCloud setup - any advice?

About caches. The queryResultCache is only useful when you expect there to be a number of _identical_ queries. Think of this cache as a map where the key is the query and the value is just a list of N document IDs (internal) where N is your window size. Paging is often the place where this is used.

Re: SolrCloud setup - any advice?

seconds at a time for garbage collection, the load balancer will temporarily drop that server from the available pool. I'm aware that this is your old setup, so we'll put it aside for now so we can concentrate on your SolrCloud setup. > Most of our documents have upwards of twenty f

Re: SolrCloud setup - any advice?

Sorry, my bad. For SolrCloud soft commits are enabled (every 15 seconds). I do a hard commit from an external cron task via curl every 15 minutes. The version I'm using for the SolrCloud setup is 4.4.0. Document cache warm-up times are 0ms. Filter cache warm-up times are between 3 and 7 se

Re: SolrCloud setup - any advice?

Hi Neil, Consider using G1 instead. See http://blog.sematext.com/?s=g1 If that doesn't help, we can play with various JVM parameters. The latest version of SPM for Solr exposes information about sizes and utilization of JVM memory pools, which may help you understand which JVM params you need t

Re: SolrCloud setup - any advice?

Hi Neil, Although you haven't mentioned it, just wanted to confirm - do you have soft commits enabled? Also what's the version of solr you are using for the solr cloud setup? 4.0.0 had lots of memory and zk related issues. What's the warmup time for your caches? Have you tried disabling the cache

SolrCloud setup - any advice?

Apologies for the giant email. Hopefully it makes sense. We've been trying out SolrCloud to solve some scalability issues with our current setup and have run into problems. I'd like to describe our current setup, our queries and the sort of load we see and am hoping someone might be able to spot t

Re: Schema/config changes and re-indexing in a SolrCloud setup

On Feb 7, 2013, at 5:23 PM, Steffen Elberg Godskesen wrote: > Re (1): Am I right in thinking that a given update is sent to every replica > of the shard to which it belongs for analysis and indexing? And that there is > no immediate way to separate indexing from queries within a collection?

Schema/config changes and re-indexing in a SolrCloud setup

Hi Solr community I'm in the process of getting my mind set straight on SolrCloud; more specifically: trying to design a feasible workflow for a use-case where we currently use master/slave replication. First, the use case: We want to 1. separate indexing workload from query workload 2. de

Re: solrcloud setup using tomcat, single machine

1 failure) > b. 4 solr nodes, running replicated (to allow up to 2 failures) > *. both choices should allow for querying across 2-3 nodes for higher > volume, with potentially several shards per node in case data grows to big > for a single box (entire index doesn't fit on 1 node) > > I know this is a lot to digest in a single post, but I'm trying to post what > I've done, what issues I've ran into, and where I'm going with this so that > you have enough information to base suggestions/answers on. > > Thanks! > - Jesse > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/solrcloud-setup-using-tomcat-single-machine-tp4006041.html > Sent from the Solr - User mailing list archive at Nabble.com. -- - Mark

solrcloud setup using tomcat, single machine

u have enough information to base suggestions/answers on. Thanks! - Jesse -- View this message in context: http://lucene.472066.n3.nabble.com/solrcloud-setup-using-tomcat-single-machine-tp4006041.html Sent from the Solr - User mailing list archive at Nabble.com.