Hi All,
We are facing problems of failure of Read-Repair stages with error Digest
Mismatch and count is 300+ per day per node.
At the same time, we are experiencing node is getting overloaded for a
quick couple of seconds due to long GC pauses (of around 7-8 seconds). We
are not running a repair o
h. Our 50th percentile was
>> great under 3ms.
>>
>> Any suggestion is very much appreciated.
>>
>> Thanks.
>> -Wei
>>
>> - Original Message -
>> From: "aaron morton"
>> To: "Cassandra User"
>> Sent: Thursday
lient side and we see the 95th
> percentile response time averages at 40ms which is a bit high. Our 50th
> percentile was great under 3ms.
>
> Any suggestion is very much appreciated.
>
> Thanks.
> -Wei
>
> - Original Message -
> From: "aaron morton"
th percentile was
> great under 3ms.
>
> Any suggestion is very much appreciated.
>
> Thanks.
> -Wei
>
> - Original Message -
> From: "aaron morton"
> To: "Cassandra User"
> Sent: Thursday, February 21, 2013 9:20:49 AM
> Subject:
bit high. Our 50th percentile was
great under 3ms.
Any suggestion is very much appreciated.
Thanks.
-Wei
- Original Message -
From: "aaron morton"
To: "Cassandra User"
Sent: Thursday, February 21, 2013 9:20:49 AM
Subject: Re: Mutation dropped
> What does rpc_ti
s.
> -Wei
>
> From: aaron morton
> To: user@cassandra.apache.org
> Sent: Tuesday, February 19, 2013 7:32 PM
> Subject: Re: Mutation dropped
>
>> Does the rpc_timeout not control the client timeout ?
> No it is how long a node will wait for a response from other nodes before
>
umber, say 20ms?
Thanks.
-Wei
From: aaron morton
To: user@cassandra.apache.org
Sent: Tuesday, February 19, 2013 7:32 PM
Subject: Re: Mutation dropped
Does the rpc_timeout not control the client timeout ?No it is how long a node
will wait for a response from
; which is configurable to control the replication timeout between nodes ? Or
> the same param is used to control that since the other node is also like a
> client ?
>
>
>
> From: aaron morton [mailto:aa...@thelastpickle.com]
> Sent: 17 February 2013 11:26
> To: user@ca
...@thelastpickle.com]
Sent: 17 February 2013 11:26
To: user@cassandra.apache.org
Subject: Re: Mutation dropped
You are hitting the maximum throughput on the cluster.
The messages are dropped because the node fails to start processing them before
rpc_timeout.
However the request is still a success because the
.x.x 880.77 GB 256 100.0%
> 95d59054-be99-455f-90d1-f43981d3d778 rack1
>
> Once we hit a very high TPS (around 50k/sec of inserts), the nodes start
> falling behind and we see the mutation dropped messages. But there are no
> failures on the client. Do
:08
To: user@cassandra.apache.org
Subject: Mutation dropped
Hi - I am doing a load test using YCSB across 2 nodes in a cluster and seeing a
lot of mutation dropped messages. I understand that this is due to the replica
not being written to the
other node ? RF = 2, CL =1.
>From the wiki -
Hi - I am doing a load test using YCSB across 2 nodes in a cluster and seeing a
lot of mutation dropped messages. I understand that this is due to the replica
not being written to the
other node ? RF = 2, CL =1.
>From the wiki -
For MUTATION messages this means that the mutation was
...@thelastpickle.com]
> Sent: Monday, March 05, 2012 11:07 PM
> To: user@cassandra.apache.org
> Subject: Re: Mutation Dropped Messages
>
> I increased the size of the cluster also the concurrent_writes parameter.
> Still there is a node which keeps on dropping the mutation m
Subject: Re: Mutation Dropped Messages
I increased the size of the cluster also the concurrent_writes parameter. Still
there is a node which keeps on dropping the mutation messages.
Ensure all the nodes have the same spec, and the nodes have the same config. In
a virtual environment consider moving the
; Thanks,
> Dushyant
>
> From: aaron morton [mailto:aa...@thelastpickle.com]
> Sent: Monday, March 05, 2012 4:15 PM
> To: user@cassandra.apache.org
> Subject: Re: Mutation Dropped Messages
>
> 1. Which parameters to tune in the config files? – Especially looking
> f
orton [mailto:aa...@thelastpickle.com]
Sent: Monday, March 05, 2012 4:15 PM
To: user@cassandra.apache.org
Subject: Re: Mutation Dropped Messages
1. Which parameters to tune in the config files? - Especially looking for
heavy writes
The node is overloaded. It may be because there are no enough node
...@thelastpickle.com]
Sent: Monday, March 05, 2012 4:15 PM
To: user@cassandra.apache.org
Subject: Re: Mutation Dropped Messages
1. Which parameters to tune in the config files? - Especially looking for
heavy writes
The node is overloaded. It may be because there are no enough nodes, or the
node is
ing Cassandra I found “Mutation Dropped” messages in the logs.
> Now I know this is a good old question. It will be really great if someone
> can provide a check list to recover when such a thing happens. I am looking
> for answers of the following questions -
>
> 1. Wh
Hi All,
While benchmarking Cassandra I found "Mutation Dropped" messages in the logs.
Now I know this is a good old question. It will be really great if someone can
provide a check list to recover when such a thing happens. I am looking for
answers of the following questi
19 matches
Mail list logo
