High load, low IO wait, moderate CPU usage

2018-06-15 Thread Igor Leão
Hi there, I have a Cassandra cluster running on Kubernetes. This cluster has 8 running instances with 8Gb of memory and 5 CPU cores. I can see a high load avg in multiple instances, but no IO wait and moderate CPU usage. Do you know how I can solve this issue? Best, Igor

Re: Cassandra 3.11 is compacting forever

2017-09-06 Thread Igor Leão
but > hopefully shouldn't be related. Has that stuck compaction moved since last > week? > > > On 1 September 2017 at 22:54, Fay Hou [Storage Service] ­ < > fay...@coupang.com> wrote: > >> try to do a rolling restart for the cluster before doing a compation

Re: Cassandra 3.11 is compacting forever

2017-09-01 Thread Igor Leão
Some generic errors: *[aladdin@ip-172-16-1-10 cassandra]$ tail cassandra.log | grep -i error* *[aladdin@ip-172-16-1-10 cassandra]$ tail cassandra.log | grep -i excep* *[aladdin@ip-172-16-1-10 cassandra]$ tail cassandra.log | grep -i fail* *[aladdin@ip-172-16-1-10 cassandra]$ tail debug.log | grep

Re: Cassandra 3.11 is compacting forever

2017-08-31 Thread Igor Leão
Hey Kurt, Thanks for your reply. Soon as the whole cluster was upgraded (using existing nodes) it worked pretty well. After a while, the high cpu usage/ pending compactions was back affecting all cluster. It's still an open problem. 2017-08-21 20:24 GMT-03:00 kurt greaves : > Why are you adding

Cassandra 3.11 is compacting forever

2017-08-21 Thread Igor Leão
Hi there, I've been trying to upgrade a Cassandra 3.9 cluster to Cassandra 3.11. Whenever I try to add a new Cassandra 3.11 node to the main datacenter, using `-Dcassandra.force_3_0_protocol_version=true` on the new node, this new node uses almost 100% of its CPU. Checking `nodetool compactionstat

Re: Upgrading from Cassandra 3.9 to Cassandra 3.11

2017-08-04 Thread Igor Leão
> Hi Igor, > Have a look into that document. ;-) > https://github.com/apache/cassandra/blob/cassandra-3.11/NEWS.txt > Thanks, > Petrus Silva > > On Fri, Aug 4, 2017 at 10:15 AM, Igor Leão wrote: > >> Hi there, >> >> Is it possible to add a Cassandra 3.11

Upgrading from Cassandra 3.9 to Cassandra 3.11

2017-08-04 Thread Igor Leão
Hi there, Is it possible to add a Cassandra 3.11 node into a Cassandra 3.9 cluster? I wish I could upgrade this cluster without uninstalling and installing Cassandra on existing nodes, just by adding and removing nodes. Thanks in advance!

Re: Replication issue with Multi DC setup in cassandra

2017-05-24 Thread Igor Leão
t; >>> Do you see data on other DC or just directory structure? Directory >>> structure would populate because it is DDL but inserts shouldn’t populate, >>> ideally. >>> >>> On May 16, 2017, at 3:19 PM, suraj pasuparthy < >>> suraj.pasupar...@gmail

Re: Node containing all data of the cluster

2017-05-11 Thread Igor Leão
as input. As well as add DC2 node in ignore nodes, so > request never goes to that node. > > Thanks, > Varun > > On Wed, May 10, 2017 at 1:21 PM, Igor Leão wrote: > >> Hey everyone, >> >> Imagine a have Cassandra cluster with 4 nodes. >> >> Is it pos

Node containing all data of the cluster

2017-05-10 Thread Igor Leão
Hey everyone, Imagine a have Cassandra cluster with 4 nodes. Is it possible to have a separate node which would not receive requests but would by in sync with the rest of the cluster? Ideally this super node would have all data of the cluster. I want to take a snapshot of this node from time to

Re: Logging queries

2017-02-18 Thread Igor Leão
gt; copy system_traces.events TO 'traces_dump.csv'; > > Also do make sure you dont set trace probability to a high number if > working on a production database as it can adversely impact performance. > > Regards, > > On Sun, Feb 19, 2017 at 1:28 AM, Igor Leão wrote: > >

Re: Logging queries

2017-02-18 Thread Igor Leão
iver/2.1/manual/logging/ > > Slow Query logger for server was introduced in C* 3.10 version. Details: > https://issues.apache.org/jira/browse/CASSANDRA-12403 > > Regards, > Bhuvan > > On Sun, Feb 19, 2017 at 12:59 AM, Igor Leão wrote: > >> Hi there, >> >

Logging queries

2017-02-18 Thread Igor Leão
Hi there, I'm wondering how to log queries from Cassandra. These queries can be either slow queries or all queries. The only constraint is that I should do this on server side. I tried using `nodetool settraceprobability`, which writes all queries to the keyspace `system_traces`. When I try to se