Re: Re: streaming stuck on joining a node with TBs of data

2020-08-05 Thread onmstester onmstester
t;<mailto:user@cassandra.apache.org> Date: Sun, 02 Aug 2020 08:35:30 +0430 Subject: Re: streaming stuck on joining a node with TBs of data Forwarded message Thanks Jeff, Already used netstats and it only shows that streaming from a single node remained and stuck

Re: Re: streaming stuck on joining a node with TBs of data

2020-08-04 Thread onmstester onmstester
;mailto:user@cassandra.apache.org> Date: Sun, 02 Aug 2020 08:35:30 +0430 Subject: Re: streaming stuck on joining a node with TBs of data Forwarded message Thanks Jeff, Already used netstats and it only shows that streaming from a single node remained and stuck and

Re: Re: streaming stuck on joining a node with TBs of data

2020-08-03 Thread Jeff Jirsa
> From: onmstester onmstester > To: "user" > Date: Sun, 02 Aug 2020 08:35:30 +0430 > Subject: Re: streaming stuck on joining a node with TBs of data > Forwarded message > > Thanks Jeff, > > Already used netstats and it on

Fwd: Re: streaming stuck on joining a node with TBs of data

2020-08-03 Thread onmstester onmstester
0 +0430 Subject: Re: streaming stuck on joining a node with TBs of data Forwarded message Thanks Jeff, Already used netstats and it only shows that streaming from a single node remained and stuck and bunch of dropped messages, next time i will check tpstats too. Curr

Re: streaming stuck on joining a node with TBs of data

2020-08-01 Thread onmstester onmstester
Thanks Jeff, Already used netstats and it only shows that streaming from a single node remained and stuck and bunch of dropped messages, next time i will check tpstats too. Currently i stopped the joining/stucked node, make the auto_bootstrap false and started the node and its UN now, is thi

Re: streaming stuck on joining a node with TBs of data

2020-08-01 Thread Jeff Jirsa
Nodetool tpstats and netstats should give you a hint why it’s not joining If you don’t care about consistency and you just want it joined in its current form (which is likely strictly incorrect but I get it), “nodetool disablegossip && nodetool enablegossip” in rapid succession (must be less th

Re: streaming stuck on joining a node with TBs of data

2020-07-31 Thread onmstester onmstester
No Secondary index, No SASI, No materialized view Sent using https://www.zoho.com/mail/ On Sat, 01 Aug 2020 11:02:54 +0430 Jeff Jirsa wrote Are there secondary indices involved?  On Jul 31, 2020, at 10:51 PM, onmstester onmstester wrot

Re: streaming stuck on joining a node with TBs of data

2020-07-31 Thread Jeff Jirsa
Are there secondary indices involved? > On Jul 31, 2020, at 10:51 PM, onmstester onmstester > wrote: > >  > Hi, > > I'm going to join multiple new nodes to already existed and running cluster. > Each node should stream in >2TB of data, and it took a few days (with 500Mb > streaming) to alm

streaming stuck on joining a node with TBs of data

2020-07-31 Thread onmstester onmstester
Hi, I'm going to join multiple new nodes to already existed and running cluster. Each node should stream in >2TB of data, and it took a few days (with 500Mb streaming) to almost get finished. But it stuck on streaming-in from one final node, but i can not see any bottleneck on any side (sourc