Re: failing bootstraps with OOM

2016-11-07 Thread Carlos Alonso
If what you need is a replacement node, to increase the hardware specs I'd recommend an 'immediate node replacement' like described here: http://mrcalonso.com/cassandra-instantaneous-in-place-node-replacement/ Basically the process just rsyncs the relevant data (data + configuration) from one node

Re: failing bootstraps with OOM

2016-11-03 Thread Oleksandr Shulgin
On Thu, Nov 3, 2016 at 2:32 PM, Mike Torra wrote: > Hi Alex - I do monitor sstable counts and pending compactions, but > probably not closely enough. In 3/4 regions the cluster is running in, both > counts are very high - ~30-40k sstables for one particular CF, and on many > nodes >1k pending com

Re: failing bootstraps with OOM

2016-11-03 Thread Mike Torra
o:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Wednesday, November 2, 2016 at 1:07 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Re: failing bootstraps with OOM On Wed, Nov 2, 2016 at 3:

Re: failing bootstraps with OOM

2016-11-02 Thread Vladimir Yudovin
Hi, probably you can try to start new node with auto_bootstrap: false and then repair keypaces or even tables one by one with nodetool repair Best regards, Vladimir Yudovin, Winguzone - Hosted Cloud Cassandra Launch your cluster in minutes. On Wed, 02 Nov 2016 10:35:45 -0400Mike

Re: failing bootstraps with OOM

2016-11-02 Thread Oleksandr Shulgin
On Wed, Nov 2, 2016 at 3:35 PM, Mike Torra wrote: > > Hi All - > > I am trying to bootstrap a replacement node in a cluster, but it consistently fails to bootstrap because of OOM exceptions. For almost a week I've been going through cycles of bootstrapping, finding errors, then restarting / resumi

failing bootstraps with OOM

2016-11-02 Thread Mike Torra
Hi All - I am trying to bootstrap a replacement node in a cluster, but it consistently fails to bootstrap because of OOM exceptions. For almost a week I've been going through cycles of bootstrapping, finding errors, then restarting / resuming bootstrap, and I am struggling to move forward. Some