Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Jai Bheemsen Rao Dhanwada
current streaming from that >> node (only future). You can use nodetool getstreamthroughput to see the >> current value. >> >> >> >> >> >> Sean Durity >> >> >> >> *From:* Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] >

Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Jai Bheemsen Rao Dhanwada
> future). You can use nodetool getstreamthroughput to see the current value. > > > > > > Sean Durity > > > > *From:* Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com > ] > *Sent:* Thursday, June 29, 2017 6:39 PM > *To:* user@cassandra.apache.org >

Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Subroto Barua
put to see the current value.     Sean Durity   From: Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] Sent: Thursday, June 29, 2017 6:39 PM To: user@cassandra.apache.org Subject: Re: nodetool removenode causing the schema out of sync   Thanks Jeff,   Can you please suggest wha

Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Jai Bheemsen Rao Dhanwada
Thursday, June 29, 2017 6:39 PM > *To:* user@cassandra.apache.org > *Subject:* Re: nodetool removenode causing the schema out of sync > > > > Thanks Jeff, > > > > Can you please suggest what value to tweak from the Cassandra side? > > > > On Thu, J

RE: nodetool removenode causing the schema out of sync

2017-07-13 Thread Durity, Sean R
] Sent: Thursday, June 29, 2017 6:39 PM To: user@cassandra.apache.org Subject: Re: nodetool removenode causing the schema out of sync Thanks Jeff, Can you please suggest what value to tweak from the Cassandra side? On Thu, Jun 29, 2017 at 2:53 PM, Jeff Jirsa mailto:jji...@apache.org>> wrote

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jai Bheemsen Rao Dhanwada
Thanks Jeff, Can you please suggest what value to tweak from the Cassandra side? On Thu, Jun 29, 2017 at 2:53 PM, Jeff Jirsa wrote: > > > On 2017-06-29 13:45 (-0700), Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello Jeff, > > > > Sorry the Version I am using 2.1.16, my firs

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jeff Jirsa
On 2017-06-29 13:45 (-0700), Jai Bheemsen Rao Dhanwada wrote: > Hello Jeff, > > Sorry the Version I am using 2.1.16, my first email had typo. > When I say schema out of sync > > 1. nodetool descriebcluster shows Schema versions same for all nodes. Ok got it, this is what I was most concerne

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jai Bheemsen Rao Dhanwada
Hello Jeff, Sorry the Version I am using 2.1.16, my first email had typo. When I say schema out of sync 1. nodetool descriebcluster shows Schema versions same for all nodes. 2. nodetool removenode, shows the node down messages in the logs 3. nodetool describecluster during this 1-2 mins shows sev

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jeff Jirsa
2.1.16 is old, but it's not as old as 2.1.6, which is what you originally put, and would be much more concerning. It is true, however, that 'removenode' involves streaming data, and streaming data can be GC intensive (especially with compression enabled), which means if your cluster is on the

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jai Bheemsen Rao Dhanwada
Hello Jeff, Yes 2.1.16 is old version, and we are planning to upgrade in few months. Only the gossiper info is logged stating that it marked several nodes down and nothing else. On Wed, Jun 28, 2017 at 8:15 PM, Jeff Jirsa wrote: > > > On 2017-06-28 18:51 (-0700), Jai Bheemsen Rao Dhanwada < >

Re: nodetool removenode causing the schema out of sync

2017-06-28 Thread Jeff Jirsa
On 2017-06-28 18:51 (-0700), Jai Bheemsen Rao Dhanwada wrote: > Hello, > > We are using C* version 2.1.6 and lately we are seeing an issue where, > nodetool removenode causing the schema to go out of sync and causing client > to fail for 2-3 minutes. > > C* cluster is in 8 Datacenters with R