Re: autoscaling cassandra cluster

2014-05-22 Thread Jabbar Azam
Netflix uses Scryer http://techblog.netflix.com/2013/11/scryer-netflixs-predictive-auto-scaling.htmlfor predictive and reactive autoscaling but they only refer to EC2 instances. They don't mention anything about cassandra scaling or adding and removing nodes. I've just looked at the priam wiki and

Re: autoscaling cassandra cluster

2014-05-22 Thread Robert Coli
On Wed, May 21, 2014 at 4:35 AM, Jabbar Azam wrote: > Has anybody got a cassandra cluster which autoscales depending on load or > times of the day? > Netflix probably does, managed with Priam. In general I personally do not consider Cassandra's mechanisms for joining and parting nodes to curren

Re: autoscaling cassandra cluster

2014-05-21 Thread James Horey
You normally don't (ferry auto-generates the IP addresses). Let's move this conversation to the ferry-user google group so that we don't pollute this mailing list... James Sent from my iPhone > On May 21, 2014, at 3:15 PM, Jabbar Azam wrote: > > Hello James, > > How do you alter your cassan

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
Hello Ben, I''m looking forward to reading the netflix links. Thanks :) Thanks Jabbar Azam On 21 May 2014 18:08, Ben Bromhead wrote: > The mechanics for it are simple compared to figuring out when to scale, > especially when you want to be scaling before peak load on your cluster > (adding

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
Hello James, How do you alter your cassandra.yaml file with each nodes IP address? I want to use the scaling software(which I've not got yet) to create and destroy the GCE instances. I want to use fleet to deploy and undeploy the cassandra nodes inside the docker instances. I do realise I will ha

Re: autoscaling cassandra cluster

2014-05-21 Thread Ben Bromhead
The mechanics for it are simple compared to figuring out when to scale, especially when you want to be scaling before peak load on your cluster (adding and removing nodes puts additional load on your cluster). We are currently building our own in-house solution for this for our customers. If yo

Re: autoscaling cassandra cluster

2014-05-21 Thread James Horey
If you're interested and/or need some Cassandra docker images let me know I'll shoot you a link. James Sent from my iPhone > On May 21, 2014, at 10:19 AM, Jabbar Azam wrote: > > That sounds interesting. I was thinking of using coreos with docker > containers for the business logic, fronten

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
That sounds interesting. I was thinking of using coreos with docker containers for the business logic, frontend and Cassandra. I'll also have a look at cassandra-mesos Thanks Jabbar Azam On 21 May 2014 14:04, "Panagiotis Garefalakis" wrote: > I agree with Prem, but recently a guy send this pr

Re: autoscaling cassandra cluster

2014-05-21 Thread Panagiotis Garefalakis
I agree with Prem, but recently a guy send this promising project called Mesos in this list. https://github.com/mesosphere/cassandra-mesos One of its goals is to make scaling easier. I don’t have any personal opinion yet but maybe you could give it a try. Regards, Panagiotis On Wed, May 21, 201

Re: autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
Hello Prem, I'm trying to find out whether people are autoscaling up and down automatically, not manually. I'm also interested in whether they are using a cloud based solution and creating and destroying instances. I've found the following regarding GCE https://cloud.google.com/developers/article

Re: autoscaling cassandra cluster

2014-05-21 Thread Prem Yadav
Hi Jabbar, with vnodes, scaling up should not be a problem. You could just add a machines with the cluster/seed/datacenter conf and it should join the cluster. Scaling down has to be manual where you drain the node and decommission it. thanks, Prem On Wed, May 21, 2014 at 12:35 PM, Jabbar Azam

autoscaling cassandra cluster

2014-05-21 Thread Jabbar Azam
Hello, Has anybody got a cassandra cluster which autoscales depending on load or times of the day? I've seen the documentation on the datastax website and that only mentioned adding and removing nodes, unless I've missed something. I want to know how to do this for the google compute engine. Thi