Re: Taking Solr to production

2016-01-22 Thread Erick Erickson
ank you, > Aswath NS > > > -Original Message- > From: Jack Krupansky [mailto:jack.krupan...@gmail.com] > Sent: Friday, January 22, 2016 3:06 PM > To: solr-user@lucene.apache.org > Subject: Re: Taking Solr to production > > "1 Leader & 3 Replicas" > >

RE: Taking Solr to production

2016-01-22 Thread Aswath Srinivasan (TMS)
? I cannot thank you enough you guys!! Thank you, Aswath NS -Original Message- From: Jack Krupansky [mailto:jack.krupan...@gmail.com] Sent: Friday, January 22, 2016 3:06 PM To: solr-user@lucene.apache.org Subject: Re: Taking Solr to production "1 Leader & 3 Replicas" SolrC

Re: Taking Solr to production

2016-01-22 Thread Walter Underwood
I agree, sharding may hurt more than it helps. And estimate the text size after the documents are processed. We all love Solr Cloud, but this could be a good application for traditional master/slave Solr. That means no Zookeeper nodes and it is really easy to add a new query slave, just clone t

Re: Taking Solr to production

2016-01-22 Thread Jack Krupansky
"1 Leader & 3 Replicas" SolrCloud does not distinguish leaders from replicas - that's old master-slave terminology. The leader is just one of the replicas. So, are you really talking about 2 shards with 4 replicas each or 2 shards with 2 replicas each? Putting multiple replica instances on each

Re: Taking Solr to production

2016-01-22 Thread Toke Eskildsen
Aswath Srinivasan (TMS) wrote: > * Totally about 2.5 million documents to be indexed > * Documents average size is 512 KB - pdfs and htmls > This being said I was thinking I would take the Solr to production with, > * 2 shards, 1 Leader & 3 Replicas > Do you all think th

Re: Taking Solr to production with docker

2015-09-24 Thread Martijn Koster
> On 23 Sep 2015, at 15:13, Upayavira wrote: > > I'm wondering if there's anything specific that is needed to run Solr > inside Docker? Is there something you have in mind? There isn't really. See https://hub.docker.com/r/makuk66/docker-solr/ for

Re: Taking Solr to production with docker

2015-09-24 Thread Epo Jemba
Ugo Don't get me wrong I know Solr is already scaling by itself , But in some cases, Solr in order to be fully usable has to be integrated/extended with a bunch of other apps : Your own, load-balancers, frontends , etc In order ALL of those work together the right way, you come up with a higher s

Re: Taking Solr to production with docker

2015-09-24 Thread Joe Lawson
I think this sums up "what is docker": https://youtu.be/F44GtxHO2MI On Sep 24, 2015 4:37 AM, "Ugo Matrangolo" wrote: > Hi, > > still don't get it :) > > With Solr 5 it auto-installs itself as a supervised service and works > really nice in an AWS CloudFormation template. > > Best > Ugo > > > On W

Re: Taking Solr to production with docker

2015-09-24 Thread Ugo Matrangolo
Hi, still don't get it :) With Solr 5 it auto-installs itself as a supervised service and works really nice in an AWS CloudFormation template. Best Ugo On Wed, Sep 23, 2015 at 10:01 PM, Joe Lawson < jlaw...@opensourceconnections.com> wrote: > we get to run commands like, docker run solr and h

Re: Taking Solr to production with docker

2015-09-23 Thread Epo Jemba
Hi Ugo, I do not yet use Solr in docker, but for my case docker is not enough here, used in conjunction with kubernetes what I'am reaching is elasticity, I mean, adding removing nodes and leave scaling and fault tolerancy to kubernetes oob. All you have to do is well defined your blueprint, templa

Re: Taking Solr to production with docker

2015-09-23 Thread Joe Lawson
we get to run commands like, docker run solr and have solr working! containers make new application deployments a breeze. On Wed, Sep 23, 2015 at 4:35 PM, Ugo Matrangolo wrote: > Hi, > > just curious: what you get by running Solr into a Docker container ? > > Best > Ugo > > On Wed, Sep 23, 2015

Re: Taking Solr to production with docker

2015-09-23 Thread Ugo Matrangolo
Hi, just curious: what you get by running Solr into a Docker container ? Best Ugo On Wed, Sep 23, 2015 at 5:39 PM, Vincenzo D'Amore wrote: > Hi Doug, > > I have ported solrcloud to docker too, I hope you can found something > interesting here: > > https://github.com/freedev/solrcloud-zookeeper

Re: Taking Solr to production with docker

2015-09-23 Thread Joe Lawson
Hi Epo, We aren't using Zookeeper or the SolrCloud stuff on docker yet but it looks like Vincenzo was using three ZK containers, each with a different port. Sincerely, Joe Lawson On Wed, Sep 23, 2015 at 1:28 PM, Epo Jemba wrote: > Hi Doug, > > thank you for your git repo. I am planning a kube

Re: Taking Solr to production with docker

2015-09-23 Thread Epo Jemba
Hi Doug, thank you for your git repo. I am planning a kubernetes + solr integration as well, can you tell us how do you organize your pods and services (or else) regarding zookeeper management. How do you organize your pods/services/etc along with solr instances, ZK nodes etc .. Thanks in advance

Re: Taking Solr to production with docker

2015-09-23 Thread Doug Turnbull
Nice! starred. We'll keep that in mind should we go to docker beyond one instance. Cheers -Doug On Wed, Sep 23, 2015 at 12:39 PM, Vincenzo D'Amore wrote: > Hi Doug, > > I have ported solrcloud to docker too, I hope you can found something > interesting here: > > https://github.com/freedev/solrc

Re: Taking Solr to production with docker

2015-09-23 Thread Vincenzo D'Amore
Hi Doug, I have ported solrcloud to docker too, I hope you can found something interesting here: https://github.com/freedev/solrcloud-zookeeper-docker This project runs an zookeeper ensemble and a sorlcloud cluster within many containers. Now, in my spare time, I'm trying to port this project t

Re: Taking Solr to production with docker

2015-09-23 Thread Christopher Bradford
Hi Doug, The Dockerfiles we use have been pushed up to a GitHub repo https://github.com/o19s/solr-docker. I'm happy to answer any questions about them. ~Chris On Wed, Sep 23, 2015 at 8:47 AM Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > Our test Solr and Elasticsearch instances

Re: Taking Solr to production with docker

2015-09-23 Thread Doug Turnbull
Our test Solr and Elasticsearch instances for Quepid(http://quepid.com) are now hosted on docker (specifically kubernetes) It's worked pretty well. I'd suggest if you're curious to speak to my devops focussed colleague Chris Bradford that has a great deal of experience here. I haven't encountered

Re: Taking Solr to production with docker

2015-09-23 Thread Upayavira
On Wed, Sep 23, 2015, at 02:00 PM, aurelien.mazo...@francelabs.com wrote: > Hi Solr community, > > I can find many blog posts on how to deploy Solr with docker but I am > wondering if Solr/Docker is really ready for production. > Has anybody ever ran Solr in production with Docker? Hi Aurelien