Re: Huge number of sstables after adding server to existing cluster

2015-04-04 Thread Anuj Wadehra
We faced compaction issue with SCTS in 2.0.3. Till we upgrade, we added a dummy read every 1000 writes as workaround . Compaction started happenning in Write only heavy loads. Anuj Wadehra From:"graham sanderson" Date:Sun, 5 Apr, 2015 at 9:35 am Subject:Re: Huge number of ssta

Re: Huge number of sstables after adding server to existing cluster

2015-04-04 Thread graham sanderson
I have not thought thru why adding a node would cause this behavior, but https://issues.apache.org/jira/browse/CASSANDRA-8860 https://issues.apache.org/jira/browse/CASSANDRA-8635 relate

Re: Huge number of sstables after adding server to existing cluster

2015-04-04 Thread Mantas Klasavičius
Thanks a lot for all to your responses I should mention we are running 2.1.3 and I have set setcompactionthroughput 0 already nodetool enableautocompaction keyspace table command/bug is new to me I will definitely will try this out and let you know One more thing I wan't to clarify did I unders

Re: Huge number of sstables after adding server to existing cluster

2015-04-03 Thread graham sanderson
As does 2.1.3 > On Apr 3, 2015, at 5:36 PM, Robert Coli wrote: > > On Fri, Apr 3, 2015 at 1:04 PM, Thomas Borg Salling > wrote: > I agree with Pranay. I have experienced exactly the same on C* 2.1.2. > > 2.1.2 had a serious bug which resulted in extra files, whic

Re: Huge number of sstables after adding server to existing cluster

2015-04-03 Thread Robert Coli
On Fri, Apr 3, 2015 at 1:04 PM, Thomas Borg Salling wrote: > I agree with Pranay. I have experienced exactly the same on C* 2.1.2. > 2.1.2 had a serious bug which resulted in extra files, which is different from the overall issue I am referring to. =Rob

Re: Huge number of sstables after adding server to existing cluster

2015-04-03 Thread Thomas Borg Salling
I agree with Pranay. I have experienced exactly the same on C* 2.1.2. /Thomas. 2015-04-03 19:33 GMT+02:00 Pranay Agarwal : > I remember once that happening to me. The SStables were way beyond the > limit (32 default) but the compaction were still not starting. All I did > was "nodetool enableauto

Re: Huge number of sstables after adding server to existing cluster

2015-04-03 Thread Pranay Agarwal
I remember once that happening to me. The SStables were way beyond the limit (32 default) but the compaction were still not starting. All I did was "nodetool enableautocompaction keyspace table" and the compaction immediately started and count of SSTables were down to normal level. It was little su

Re: Huge number of sstables after adding server to existing cluster

2015-04-03 Thread Robert Coli
On Fri, Apr 3, 2015 at 4:57 AM, Mantas Klasavičius < mantas.klasavic...@gmail.com> wrote: > Q1:is that what we should expect to happen? > A known problem with the current streaming paradigm when combined with vnodes is that newly bootstrapped nodes do a bunch of compaction. > Q2:what could be th

Huge number of sstables after adding server to existing cluster

2015-04-03 Thread Mantas Klasavičius
Hi, we are running test cassandra cluster of 8 nodes running in single DC using Simple snitch and DateTieredCompactionStrategy after adding new node(9th) to the cluster we see that number of sstables on newly joined server roughly equals to sum of all sstables on all servers in the cluster. and th