Re: deploy solr on cloud providers

2016-07-07 Thread Lorenzo Fundaró
my systems guys just don't > > want > > > to > > > > > give me real disk. Although RAID-5 or LVM on-top of JBOD may be > > > better > > > > > than Amazon EBS, Amazon EBS is still much closer to real disk in > > terms > >

Re: deploy solr on cloud providers

2016-07-06 Thread Tomás Fernández Löbbe
response time for random reads to be > better. > > > > > > > > If you are a young/smallish company, this may be all in the cloud, > but > > if > > > > you are in a large organization like mine, you may also need to allow > > for > > >

Re: deploy solr on cloud providers

2016-07-06 Thread Lorenzo Fundaró
gt; > > communicates with a physical Netapp on-premises, and the > > throughput/latency > > > of that. The most important thing is to actually measure the numbers > > you > > > are getting, both for search and for simply raw I/O, or to get your > > > systems/storage guys to measure th

Re: deploy solr on cloud providers

2016-07-05 Thread Steven Bower
are getting, both for search and for simply raw I/O, or to get your > > > systems/storage guys to measure those numbers. If you get your > > > systems/storage guys to just measure storage - you will want to care > > about > > > three things for indexing primaril

Re: deploy solr on cloud providers

2016-07-05 Thread Tomás Fernández Löbbe
l Write Throughput > > Random Read Throughput > > Random Read Response Time/Latency > > > > Hope this helps, > > > > Dan Davis, Systems/Applications Architect (Contractor), > > Office of Computer and Communications Systems, > > National Library

Re: deploy solr on cloud providers

2016-07-05 Thread Lorenzo Fundaró
t (Contractor), > Office of Computer and Communications Systems, > National Library of Medicine, NIH > > > > -----Original Message- > From: Lorenzo Fundaró [mailto:lorenzo.fund...@dawandamail.com] > Sent: Tuesday, July 05, 2016 3:20 AM > To: solr-user@lucene.apache.or

RE: deploy solr on cloud providers

2016-07-05 Thread Davis, Daniel (NIH/NLM) [C]
of Computer and Communications Systems, National Library of Medicine, NIH -Original Message- From: Lorenzo Fundaró [mailto:lorenzo.fund...@dawandamail.com] Sent: Tuesday, July 05, 2016 3:20 AM To: solr-user@lucene.apache.org Subject: Re: deploy solr on cloud providers Hi Shawn. Actually wh

Re: deploy solr on cloud providers

2016-07-05 Thread Tomás Fernández Löbbe
I think there are two parts to this question: * If a node just disappears you should be fine in terms of data availability, since Solr in "SolrCloud" replicates the data as it comes it (before sending the http response). Even if the leader disappears and never comes back as long as you have one rep

Re: deploy solr on cloud providers

2016-07-05 Thread Steven Bower
You shouldn't "need" to move the storage as SolrCloud will replicate all data to the new node and anything in the transaction log will already be distributed through the rest of the machines.. One option to keep all your data attached to nodes might be to use Amazon EFS (pretty new) to store your

Re: deploy solr on cloud providers

2016-07-05 Thread Lorenzo Fundaró
On 5 July 2016 at 15:55, Shawn Heisey wrote: > On 7/5/2016 1:19 AM, Lorenzo Fundaró wrote: > > Hi Shawn. Actually what im trying to find out is whether this is the best > > approach for deploying solr in the cloud. I believe solrcloud solves a > lot > > of problems in terms of High Availability b

Re: deploy solr on cloud providers

2016-07-05 Thread Shawn Heisey
On 7/5/2016 1:19 AM, Lorenzo Fundaró wrote: > Hi Shawn. Actually what im trying to find out is whether this is the best > approach for deploying solr in the cloud. I believe solrcloud solves a lot > of problems in terms of High Availability but when it comes to storage > there seems to be a limitat

Re: deploy solr on cloud providers

2016-07-05 Thread Lorenzo Fundaró
Hi Shawn. Actually what im trying to find out is whether this is the best approach for deploying solr in the cloud. I believe solrcloud solves a lot of problems in terms of High Availability but when it comes to storage there seems to be a limitation that can be workaround of course but it's a bit

Re: deploy solr on cloud providers

2016-07-04 Thread Shawn Heisey
On 7/4/2016 10:18 AM, Lorenzo Fundaró wrote: > when deploying solr (in solrcloud mode) in the cloud one has to take > care of storage, and as far as I understand it can be a problem > because the storage should go wherever the node is created. If we have > for example, a node on EC2 with its own pe