Re: Repair Hangs while requesting Merkle Trees

2015-11-29 Thread Anuj Wadehra
, 18/11/15, Anuj Wadehra wrote:  Subject: Re: Repair Hangs while requesting Merkle Trees  To: "user@cassandra.apache.org"  Date: Wednesday, 18 November, 2015, 7:57 AM  Thanks Bryan !!  Connection  is in ESTBLISHED state on on end and completely missing a

Re: Repair Hangs while requesting Merkle Trees

2015-11-29 Thread Anuj Wadehra
its public IP. Thanks Anuj On Tue, 24/11/15, Paulo Motta wrote: Subject: Re: Repair Hangs while requesting Merkle Trees To: "user@cassandra.apache.org" , "Anuj Wadehra" Date: Tuesday, 24 November, 2015, 12:38 AM The issue might be related to the ESTABLISH

Re: Repair Hangs while requesting Merkle Trees

2015-11-29 Thread Anuj Wadehra
via its public IP. Thanks Anuj On Tue, 24/11/15, Paulo Motta wrote: Subject: Re: Repair Hangs while requesting Merkle Trees To: "user@cassandra.apache.org" , "Anuj Wadehra" Date: Tuesday, 24 November, 2015, 12:38 AM The is

Re: Repair Hangs while requesting Merkle Trees

2015-11-23 Thread Paulo Motta
k team to capture netstats and tcpdump > too.. > > Thanks > Anuj > > > > On Wed, 18/11/15, Anuj Wadehra wrote: > > Subject: Re: Repair Hangs while requesting Merkle Trees > To: "user@cassandra.apache.org"

Re: Repair Hangs while requesting Merkle Trees

2015-11-23 Thread Anuj Wadehra
: Repair Hangs while requesting Merkle Trees To: "user@cassandra.apache.org" Date: Wednesday, 18 November, 2015, 7:57 AM Thanks Bryan !! Connection is in ESTBLISHED state on on end and completely missing at other end (in another dc). Yes, we can revisit TCP tuning.But the probl

Re: Repair Hangs while requesting Merkle Trees

2015-11-17 Thread Anuj Wadehra
Cheng" Date:Wed, 18 Nov, 2015 at 2:04 am Subject:Re: Repair Hangs while requesting Merkle Trees Ah OK, might have misunderstood you. Streaming socket should not be in play during merkle tree generation (validation compaction). They may come in play during merkle tree exchange- that I'm not

Re: Repair Hangs while requesting Merkle Trees

2015-11-17 Thread Bryan Cheng
s > Anuj > > > > > > > > > Sent from Yahoo Mail on Android > <https://overview.mail.yahoo.com/mobile/?.src=Android> > -- > *From*:"Bryan Cheng" > *Date*:Tue, 17 Nov, 2015 at 5:54 am > > *Subject*:Re: Repair Hangs while requesting Merkle Tr

Re: Repair Hangs while requesting Merkle Trees

2015-11-16 Thread Anuj Wadehra
different?  Thanks Anuj Sent from Yahoo Mail on Android From:"Bryan Cheng" Date:Tue, 17 Nov, 2015 at 5:54 am Subject:Re: Repair Hangs while requesting Merkle Trees Hi Anuj, Did you mean streaming_socket_timeout_in_ms? If not, then you definitely want that set. Even the be

Re: Repair Hangs while requesting Merkle Trees

2015-11-16 Thread Bryan Cheng
gt; Anuj > > Sent from Yahoo Mail on Android > <https://overview.mail.yahoo.com/mobile/?.src=Android> > -- > *From*:"Anuj Wadehra" > *Date*:Sat, 14 Nov, 2015 at 11:59 pm > > *Subject*:Re: Repair Hangs while requesting Merkle Trees

Re: Repair Hangs while requesting Merkle Trees

2015-11-14 Thread Anuj Wadehra
roid From:"Anuj Wadehra" Date:Sat, 14 Nov, 2015 at 11:59 pm Subject:Re: Repair Hangs while requesting Merkle Trees Thanks Daemeon !! I wil capture the output of netstats and share in next few days. We were thinking of taking tcp dumps also. If its a network issue and increasing request

Re: Repair Hangs while requesting Merkle Trees

2015-11-14 Thread Anuj Wadehra
. Is it related some how? Thanks Anuj Sent from Yahoo Mail on Android From:"daemeon reiydelle" Date:Thu, 12 Nov, 2015 at 10:34 am Subject:Re: Repair Hangs while requesting Merkle Trees Have you checked the network statistics on that machine? (netstats -tas) while attempting to rep

Re: Repair Hangs while requesting Merkle Trees

2015-11-11 Thread daemeon reiydelle
Have you checked the network statistics on that machine? (netstats -tas) while attempting to repair ... if netstats show ANY issues you have a problem. If you can put the command in a loop running every 60 seconds for maybe 15 minutes and post back? Out of curiousity, how many remote DC nodes are

Re: Repair Hangs while requesting Merkle Trees

2015-11-11 Thread Anuj Wadehra
Hi, we are using 2.0.14. We have 2 DCs at remote locations with 10GBps connectivity.We are able to complete repair (-par -pr) on 5 nodes. On only one node in DC2, we are unable to complete repair as it always hangs. Node sends Merkle Tree requests, but one or more nodes in DC1 (remote) never sho

Repair Hangs while requesting Merkle Trees

2015-11-11 Thread Anuj Wadehra
Hi, We have 2 DCs at remote locations with 10GBps connectivity.We are able to complete repair (-par -pr) on 5 nodes. On only one node in DC2, we are unable to complete repair as it always hangs. Node sends Merkle Tree requests, but one or more nodes in DC1 (remote) never show that they sent the