Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread Harikrishnan Pillai
I assume you are using open source cassandra and you can look at Prometheus grafana for cassandra monitoring and lot information available in internet regarding how to setup the Prometheus monitoring for cassandra . Sent from my iPhone > On May 25, 2018, at 9:23 AM, ANEESH KUMAR K.M wrote: >

Re: Re: Tuning bootstrap new node

2017-10-31 Thread Harikrishnan Pillai
There is no magic in speeding up the node addition other than increasing stream throughput and compaction throughput. it has been noticed that with heavy compactions the latency may go up if the node also start serving data. if you really don't want this node to service traffic till all compac

Re: Moving from DSE to Cassandra.

2017-07-18 Thread Harikrishnan Pillai
yes. From: Harikrishnan Pillai Sent: Tuesday, July 18, 2017 12:30 PM To: user@cassandra.apache.org Subject: EXT: Re: Moving from DSE to Cassandra. Moving away from DSE to apache cassandra is easy. If there are any keyspace with "EverywhereStrategy"

Re: Moving from DSE to Cassandra.

2017-07-18 Thread Harikrishnan Pillai
Moving away from DSE to apache cassandra is easy. If there are any keyspace with "EverywhereStrategy" strategies, change them to "NetworkTopologyStrategy" first. particularly DSE system. Start in opensource mode and run sstable upgrade if needed. Regards Hari __

Re: EXT: Start Cassandra with Gossip disabled ?

2017-04-14 Thread Harikrishnan Pillai
Yes , you can disable gossip and disable binary to cut off All traffic but process like compactions can still continue . Sent from my iPhone > On Apr 11, 2017, at 9:21 AM, Biscuit Ninja wrote: > > We run an 8 node Cassandra v2.1.16 cluster (4 nodes in two discrete > datacentres) and we're cur

Re: compaction falling behind

2017-02-13 Thread Harikrishnan Pillai
If your compaction strategy is Leveled the number of sstables in each level is a good indication that compactions are keeping up. From: Ben Bromhead Sent: Monday, February 13, 2017 1:49:05 PM To: user Subject: Re: compaction falling behind You can do so in two

Re: Error when running nodetool cleanup after adding a new node to a cluster

2017-02-08 Thread Harikrishnan Pillai
The cleanup has to run on other nodes Sent from my iPhone On Feb 8, 2017, at 9:14 PM, Srinath Reddy mailto:ksre...@gmail.com>> wrote: Hi, Trying to re-balacne a Cassandra cluster after adding a new node and I'm getting this error when running nodetool cleanup. The Cassandra cluster is runnin

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
DOUBLE", "name":"Longitude", "attributes":{ "Id":"1" }, "category":"REAL", "value":1.390692, "timestamp":1485923271718, "quality":"GOOD" }'); No

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
wrote: Yes. I know that. My intension is to do an aggregate query on value field (in json). Will that be possible if I store the entire json as String? I will have to parse it according to my need right? Regards, Rajeswari From: Harikrishnan Pillai [mailto:hpil...@walmartlabs.com] Sent: 02 Fe

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
You can use text type in Cassandra and store the full Json string . Sent from my iPhone On Feb 1, 2017, at 8:30 PM, Rajeswari Menon mailto:rajeswar...@thinkpalm.com>> wrote: Yes. Is there any way to define value to accept any data type as the json value data may vary? Or is there any way to d

Re: Re : Decommissioned nodes show as DOWN in Cassandra versions 2.1.12 - 2.1.16

2017-01-27 Thread Harikrishnan Pillai
Please remove the ips from the system.peer table of all nodes or you can use unsafeassasinate from JMX. From: Agrawal, Pratik Sent: Friday, January 27, 2017 9:05:43 AM To: user@cassandra.apache.org; k...@instaclustr.com; pskraj...@gmail.com Cc: Sun, Guan Subjec

Re: Has anyone deployed a production cluster with less than 6 nodes per DC?

2016-12-26 Thread Harikrishnan Pillai
1 million write per hour is around 250 writes per second .its easily achievable with 3 nodes .make sure that you have a good gc tuning and compaction tunings. Sent from my iPhone On Dec 26, 2016, at 1:27 PM, Ney, Richard mailto:richard@aspect.com>> wrote: My company has a product we're abo

Re: Handling Leap second delay

2016-12-20 Thread Harikrishnan Pillai
http://www.datastax.com/dev/blog/preparing-for-the-leap-second-2017 [http://www.datastax.com/wp-content/themes/datastax-2013/images/common/logo.png] Preparing for the Leap Second, 2017 Jan 1 Edition | DataStax

Re: Cassandra Different cluster gossiping to each other

2016-12-14 Thread Harikrishnan Pillai
This is possible if some of the nodes are available in system peer table of the other cluster.this usually occurs when we decommission nodes from one cluster and add to another cluster.also make sure that before adding a node newly to a cluster all data in drives are properly wiped out . Sent f

Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-07 Thread Harikrishnan Pillai
This can happen as part of node bootstrap,repair or rebuild node. From: Sotirios Delimanolis Sent: Wednesday, December 7, 2016 4:35:45 PM To: User Subject: Huge files in level 1 and level 0 of LeveledCompactionStrategy I have a couple of SSTables that are humongo

Re: Which version is stable enough for production environment?

2016-11-30 Thread Harikrishnan Pillai
ting intensively. 2016-11-30 3:11 GMT+01:00 Harikrishnan Pillai mailto:hpil...@walmartlabs.com>>: 3.0 has "off the heap memtable" impl removed and if you have a requirement for this,its not available.If you don't have the requirement 3.0.9 can be tried out. 3.9 version we di

Re: Which version is stable enough for production environment?

2016-11-29 Thread Harikrishnan Pillai
Regards Hari From: Discovery Sent: Tuesday, November 29, 2016 5:59 PM To: user Subject: Re: Which version is stable enough for production environment? Why version 3.x is not recommended? Thanks. -- Original -- From: "Harikrishnan Pillai";; Date: W

Re: Which version is stable enough for production environment?

2016-11-29 Thread Harikrishnan Pillai
Cassandra 2.1.16 From: Discovery Sent: Tuesday, November 29, 2016 5:42 PM To: user Subject: Which version is stable enough for production environment? Hi Cassandra Experts, We prepare to deploy Cassandra in production env, but we can not conf

Re: Java GC pauses, reality check

2016-11-28 Thread Harikrishnan Pillai
? Thanks, kant On Sun, Nov 27, 2016 at 9:57 PM, Harikrishnan Pillai mailto:hpil...@walmartlabs.com>> wrote: Hi @Kant Kodali, We have multiple clusters running zing . One cluster has 11/11 and another one also has 11/11.(190 GB mem,6TB hard disk and 16 Physical core machines) The averag

Re: Java GC pauses, reality check

2016-11-27 Thread Harikrishnan Pillai
Pillai: How many nodes you guys are running? and what is an approximate read size and an approximate write size? On Fri, Nov 25, 2016 at 7:32 PM, Harikrishnan Pillai mailto:hpil...@walmartlabs.com>> wrote: We are running azul zing in prod with 1 million reads/s and 100 K writes/s with az

Re: Java GC pauses, reality check

2016-11-25 Thread Harikrishnan Pillai
We are running azul zing in prod with 1 million reads/s and 100 K writes/s with azul .we never had a major gc above 10 ms . Sent from my iPhone > On Nov 25, 2016, at 3:49 PM, Martin Schröder wrote: > > 2016-11-25 23:38 GMT+01:00 Kant Kodali : >> I would also restate the following sentence "jav

Re: Java GC pauses, reality check

2016-11-25 Thread Harikrishnan Pillai
Zing jvm reduces the pause under 10ms for most use cases. Sent from my iPhone On Nov 25, 2016, at 2:44 PM, Kant Kodali mailto:k...@peernova.com>> wrote: +1 Chris Lohfink response I would also restate the following sentence "java GC pauses are pretty much a fact of life" to "Any GC based syste

Re: Cannot set TTL in COPY command

2016-10-26 Thread Harikrishnan Pillai
i have created a Jira for Cassandra version 3.9.Anyone have seen this scenario before in any 3.X version. https://issues.apache.org/jira/browse/CASSANDRA-12844 Regards Hari From: Lahiru Gamathige Sent: Wednesday, October 26, 2016 10:46:51 AM To: user@cassandra

Node tool drain causing hint corruption

2016-10-26 Thread Harikrishnan Pillai
Changing the subject Sent from my iPhone On Oct 26, 2016, at 12:28 PM, Harikrishnan Pillai mailto:hpil...@walmartlabs.com>> wrote: i have created a Jira for Cassandra version 3.9.Anyone have seen this scenario before in any 3.X version. https://issues.apache.org/jira/browse/CASSANDRA

Re: Does anyone store larger values in Cassandra E.g. 500 KB?

2016-10-20 Thread Harikrishnan Pillai
We use Cassandra to store images .any data above 2 mb we chunk it and store.it works perfectly . Sent from my iPhone > On Oct 20, 2016, at 12:09 PM, Vikas Jaiman wrote: > > Hi, > > Normally people would like to store smaller values in Cassandra. Is there > anyone using it to store for larger

Re: Repair in Multi Datacenter - Should you use -dc Datacenter repair or repair with -pr

2016-10-12 Thread Harikrishnan Pillai
In my experience dc local repair node by node with Pr and par options is best .full repair increased sstables A lot and take days to compact it back or another Easy option for repair is use a spark job ,read all data with Consistency all and increase read repair chance to 100 % or use Netflix tickl