RE: Help with sudden spike in read requests

2019-02-01 Thread Kenneth Brotman
changed since it started happening? Kenneth Brotman From: Subroto Barua [mailto:sbarua...@yahoo.com.INVALID] Sent: Friday, February 01, 2019 10:13 AM To: user@cassandra.apache.org Subject: Re: Help with sudden spike in read requests Vnode is 256 C*: 3.0.15 on m4.4xlarge gp2 vol There

Re: Help with sudden spike in read requests

2019-02-01 Thread Subroto Barua
; happening? What changed since it started happening? > > Kenneth Brotman > > From: Subroto Barua [mailto:sbarua...@yahoo.com.INVALID] > Sent: Friday, February 01, 2019 10:13 AM > To: user@cassandra.apache.org > Subject: Re: Help with sudden spike in read requests > >

RE: Help with sudden spike in read requests

2019-02-01 Thread Kenneth Brotman
, February 01, 2019 10:13 AM To: user@cassandra.apache.org Subject: Re: Help with sudden spike in read requests Vnode is 256 C*: 3.0.15 on m4.4xlarge gp2 vol There are 2 more DCs on bare metal (raid 10 and older machines) attached to this cluster and we have not seen this behavior on on-prem

Re: Help with sudden spike in read requests

2019-02-01 Thread Subroto Barua
day, February 01, 2019 8:45 AM > To: User cassandra.apache.org > Subject: Help with sudden spike in read requests > > In our production cluster, we observed sudden spike (over 160 MB/s) in read > requests on *all* Cassandra nodes for a very short period (less than a min); > th

RE: Help with sudden spike in read requests

2019-02-01 Thread Kenneth Brotman
If you had a query that went across the partitions and especially if you had vNodes set high, that would do it. Kenneth Brotman From: Subroto Barua [mailto:sbarua...@yahoo.com.INVALID] Sent: Friday, February 01, 2019 8:45 AM To: User cassandra.apache.org Subject: Help with sudden spike

Help with sudden spike in read requests

2019-02-01 Thread Subroto Barua
In our production cluster, we observed sudden spike (over 160 MB/s) in read requests on *all* Cassandra nodes for a very short period (less than a min); this event happens few times a day. I am not able to get to the bottom of this issue, nothing interesting in system.log or from app level; repa