Re: vnodes: high availability

2018-01-15 Thread Rahul Neelakantan
Not necessarily. It depends on how the token ranges for the vNodes are assigned to them. For example take a look at this diagram http://docs.datastax.com/en/archived/cassandra/2.0/cassandra/architecture/architectureDataDistributeDistribute_c.html In the vNode part of the diagram, you will see that

Re: Data sync between 2 clusters in single DC

2017-10-30 Thread Rahul Neelakantan
Why wouldnt you set it up as a single cluster that spans 2 DCs? On Mon, Oct 30, 2017 at 4:09 PM, Vincent Lee wrote: > For high availability in a single DC region, I would like to install one > Cassandra cluster on one AZ and a second cluster on a different AZ. > The data between them needs to be

Re: calculation of disk size

2015-04-30 Thread Rahul Neelakantan
Here is a calculator someone has put together http://btoddb-cass-storage.blogspot.com/2012/01/ive-been-asked-for-spreadsheet-to-help.html?m=1 Rahul > On Apr 30, 2015, at 12:53 AM, arun sirimalla wrote: > > Hi Rahul, > > If you are expecting 15 GB of data per day, here is the calculation. >

Re: How to use nodetool ring only for one data center

2015-04-28 Thread Rahul Neelakantan
Do you want this for some sort of reporting requirement? If so you may be able to write a quick she'll script using grep to remove the unwanted data Rahul > On Apr 28, 2015, at 7:24 PM, Surbhi Gupta wrote: > > Hi, > > I wanted to know, how can we get the information of the token rings only fo

Re: Drawbacks of Major Compaction now that Automatic Tombstone Compaction Exists

2015-04-13 Thread Rahul Neelakantan
Rob, Does that mean once you split it back into small ones, automatic compaction a will continue to happen on a more frequent basis now that it's no longer a single large monolith? Rahul > On Apr 13, 2015, at 3:23 PM, Robert Coli wrote: > >> On Mon, Apr 13, 2015 at 10:52 AM, Anuj Wadehra >>

Re: Adding new node to Cassandra cluster is too slow

2015-03-20 Thread Rahul Neelakantan
You won't lose data unless you have run nodetool cleanup on the existing nodes. Rahul > On Mar 19, 2015, at 9:16 PM, Pranay Agarwal wrote: > > Also, the new nodes (3 of them, in UJ state) are showing some data size > (~10g). Is there any data loss chances with stopping the cassandra on them?

Re: best way to measure repair times?

2015-03-19 Thread Rahul Neelakantan
Wouldn't GC Grace set to 34 days increase the bloat in the DB? Rahul > On Mar 19, 2015, at 3:02 PM, Robert Coli wrote: > >> On Thu, Mar 19, 2015 at 10:30 AM, Ian Rose wrote: >> I'd like to (a) monitor how long my repairs are taking, and (b) know when a >> repair is finished so that I can take

Re: nodetool compact cannot remove tombstone in system keyspace

2015-01-13 Thread Rahul Neelakantan
I am not sure about the tombstone_failure_threshold, but the tombstones will only get removed during compaction if they are older than GC_Grace_Seconds for that CF. How old are these tombstones? Rahul > On Jan 12, 2015, at 11:27 PM, Xu Zhongxing wrote: > > Hi, > > When I connect to C* with d

Re: problem in exporting large table

2015-01-13 Thread Rahul Neelakantan
Why can't you use sstable2json? Rahul > On Jan 12, 2015, at 11:24 PM, Rahul Bhardwaj > wrote: > > Hi All, > > We are using C* 2.1. we need to export data of one table (consist 10 lacs > records) using COPY command. After executing copy command cqlsh hangs and get > stuck . Please help in r

Re: 2 Cassandra nodes slow

2015-01-13 Thread Rahul Neelakantan
Is the data distribution OK? Have you tried running repairs? Rahul > On Jan 13, 2015, at 5:01 AM, Batranut Bogdan wrote: > > Hello, > > I have a cluster of 6 C* nodes. All machines have the same hardware. I have > noticed in opscenter that when I start reading a lot from the cluster 2 nodes

Re: Hinted handoff not working

2014-12-14 Thread Rahul Neelakantan
http://www.datastax.com/documentation/cassandra/2.0/cassandra/configuration/configCassandra_yaml_r.html?scroll=reference_ds_qfg_n1r_1k__hinted_handoff_enabled Rahul > On Dec 14, 2014, at 9:46 AM, Robert Wille wrote: > > I have a cluster with RF=3. If I shut down one node, add a bunch of data to

Data not replicating consistently

2014-11-21 Thread Rahul Neelakantan
I have a setup that looks like this Dc1: 9 nodes Dc2: 9 nodes Dc3: 9 nodes C* version: 2.0.10 RF: 2 in each DC Empty CF with no data at the beginning of the test Scenario 1 (happy path): I connect to a node in DC1 using CQLsh, validate that I am using CL=1, insert 10 rows. Then using CQLsh conne

Re: any way to get nodetool proxyhistograms data for an entire cluster?

2014-11-19 Thread Rahul Neelakantan
So what do use as a good alternate to it? Rahul Neelakantan > On Nov 19, 2014, at 8:48 PM, Robert Coli wrote: > >> On Wed, Nov 19, 2014 at 3:22 PM, Clint Kelly wrote: >> Is there any way (other than me cooking up a little script) to automatically >> get the proxyhisto

Re: Force purging of tombstones

2014-11-18 Thread Rahul Neelakantan
g the normal compaction and repair processes" Rahul > On Nov 17, 2014, at 6:57 PM, Robert Coli wrote: > >> On Mon, Nov 17, 2014 at 3:10 PM, Rahul Neelakantan wrote: >> Doesn't repair also get rid of tombstones? > > Repair is a non-destructive activity

Re: Force purging of tombstones

2014-11-17 Thread Rahul Neelakantan
Doesn't repair also get rid of tombstones? Rahul Neelakantan > On Nov 17, 2014, at 5:53 PM, Robert Coli wrote: > >> On Mon, Nov 17, 2014 at 1:40 PM, Ken Hancock wrote: >> You can use the JMX forceUserDefinedCompaction operation to compact each >> SSTab

Re: "Did not get positive replies from all endpoints" error on incremental repair

2014-10-30 Thread Rahul Neelakantan
It appears to come from the ActiveRepairService.prepareForRepair portion of the Code. Are you sure all nodes are reachable from the node you are initiating repair on, at the same time? Any Node up/down/died messages? Rahul Neelakantan > On Oct 30, 2014, at 6:37 AM, Juho Mäkinen wr

Re: opscenter with community cassandra

2014-10-28 Thread Rahul Neelakantan
You can turn off the phone home function in the opscenterd.conf file [stat_reporter] interval = 0 Rahul Neelakantan > On Oct 28, 2014, at 11:08 AM, Colin wrote: > > I cant run opscenter in a secure environment for a couple of reasons, one - > it phones home, two - lack o

Re: Looking for a cassandra web interface

2014-10-21 Thread Rahul Neelakantan
It is not web based, you can try Helenos, but I don't think it is ready for newer versions. Rahul Neelakantan > On Oct 21, 2014, at 12:26 AM, Vishanth Balasubramaniam > wrote: > > I believe DevCenter is not a 'web' interface, isn't it? > >> On

Re: Deleting data in 1.2.8 based on time stamp

2014-10-16 Thread Rahul Neelakantan
So this would need me to know the partition keys, what if I simply wanted to say delete all rows where the timestamp was older than 123456789? Rahul Neelakantan > On Oct 16, 2014, at 6:27 PM, Tyler Hobbs wrote: > > For each partition in the table, run: > > DELETE FRO

Deleting data in 1.2.8 based on time stamp

2014-10-16 Thread Rahul Neelakantan
Does anyone know of a way to delete rows from C* 1.2.8 based on the timestamp (time from epoch) that is present on each column in the triplet of name, value and timestamp? (I do not have a separate date/timestamp column that I insert) Rahul Neelakantan

Re: Repair taking long time

2014-09-29 Thread Rahul Neelakantan
What is the recommendation on the number of tokens value? I am asking because of the issue with sequential repairs on token range after token range. Rahul Neelakantan > On Sep 29, 2014, at 2:29 PM, Robert Coli wrote: > >> On Fri, Sep 26, 2014 at 9:52 AM, Gene Robichaux >&

Re: ava.lang.OutOfMemoryError: unable to create new native thread

2014-09-17 Thread Rahul Neelakantan
What is your sstable size set to for each of the sstables, using LCS? Are you at the default of 5 MB? Rahul Neelakantan > On Sep 17, 2014, at 10:58 AM, Yatong Zhang wrote: > > sorry, about 300k+ > >> On Wed, Sep 17, 2014 at 10:56 PM, Yatong Zhang wrote: >> no, I am r

Re: Questions about cleaning up/purging Hinted Handoffs

2014-09-10 Thread Rahul Neelakantan
Will try... Thank you Rahul Neelakantan > On Sep 10, 2014, at 12:01 AM, Rahul Menon wrote: > > I use jmxterm. http://wiki.cyclopsgroup.org/jmxterm/ attach it to your c* > process and then use the org.apache.cassandra.db:HintedHandoffManager bean > and run deleteHintsforEn

Re: Questions about cleaning up/purging Hinted Handoffs

2014-09-09 Thread Rahul Neelakantan
On Mon, Sep 8, 2014 at 11:09 PM, Robert Coli wrote: >> On Fri, Sep 5, 2014 at 3:20 PM, Rahul Neelakantan wrote: >>> The reason I asked about he hints is because I see hints being replayed but >>> the large compacted hints stable still sticks around, perhaps it is a bug >&g

Re: hardware sizing for cassandra

2014-09-09 Thread Rahul Neelakantan
Why not more than 32gb of RAM/node? Rahul Neelakantan > On Sep 9, 2014, at 3:52 PM, Paolo Crosato > wrote: > > Every node should have at least 4 cores, with a maximum of 8. Memory > shouldn't be higher than 32g, 16gb is good for a start. Every node should be > a

Re: Questions about cleaning up/purging Hinted Handoffs

2014-09-05 Thread Rahul Neelakantan
Yup... Upgrades are in the works.. Thanks for the response. The reason I asked about he hints is because I see hints being replayed but the large compacted hints stable still sticks around, perhaps it is a bug with that version . Rahul Neelakantan > On Sep 5, 2014, at 1:03 PM, Robert C

Questions about cleaning up/purging Hinted Handoffs

2014-09-05 Thread Rahul Neelakantan
The questions are for Cassandra 1.0.8 but may apply to later versions too. 1) When the coordinator notices that a node it is collecting hints for is down for more than the max hint window, it stops collecting hints for that node - Does it automatically purge the hints it collected so far, or d

Re: Question about EC2 and SSDs

2014-09-04 Thread Rahul Neelakantan
With SSD one drive should be sufficient for both data and commitLogs. Rahul Neelakantan > On Sep 4, 2014, at 8:05 PM, Steve Robenalt wrote: > > Hi all, > > We are migrating a small cluster on AWS from instances based on spinning > disks (using instance store) to SSD-ba

Re: disk space and tombstones

2014-08-18 Thread Rahul Neelakantan
Is that GC_grace 300 days? Rahul Neelakantan > On Aug 18, 2014, at 5:51 AM, Dimetrio wrote: > > In our Twitter-like application users have their own timelines with news from > subscriptions. To populate timelines we're using fanout on write. But we > forced to trim it to

Re: A question about using 'update keyspace with strategyoptions' command

2014-08-05 Thread Rahul Neelakantan
Try running "describe cluster" from Cassandra-CLI to see if all nodes have the same schema version. Rahul Neelakantan > On Aug 5, 2014, at 6:13 AM, Sylvain Lebresne wrote: > >> On Tue, Aug 5, 2014 at 11:40 AM, Lu, Boying wrote: >> What I want to know is “are t

Re: How to get rid of stale info in gossip

2014-08-04 Thread Rahul Neelakantan
It no longer shows up, but I will definitely investigate that option. What exactly does it do? Rahul Neelakantan > On Aug 4, 2014, at 7:49 PM, Patricia Gorla wrote: > > Rahul, > > If the removed node is still showing up in gossip state, you can remove it > with 'unsaf

Authentication for Mx4j

2014-07-31 Thread Rahul Neelakantan
Does anyone know how to enable basic authentication of MX4J with Cassandra? Mx4j supports it but not sure how to pass the variables to enable it. I was able to set the listen address and port for the http server, but can't get authentication to work. Rahul Neelakantan

Re: Migration from Cassandra 1.2.5 to Cassandra 2.0.8 with changed partitioner settings

2014-07-31 Thread Rahul Neelakantan
You said you tried restoring a snapshot via bulk loader, did you actually run sstableloader? Rahul Neelakantan > On Jul 31, 2014, at 2:54 AM, tsi wrote: > > Well, the new Cassandra cluster is already setup with the different > partitioner settings and there are already other

Question about Vnodes

2014-07-30 Thread Rahul Neelakantan
? Do I just reduce it in the cassandra.yaml and start removing tokens via nodetool? Rahul Neelakantan

Re: Measuring WAN replication latency

2014-07-30 Thread Rahul Neelakantan
Agreed... This is what we are trying right now. Rahul Neelakantan > On Jul 30, 2014, at 1:43 PM, Jeremy Jongsma wrote: > > Yes, the results should definitely not be relied on as a future performance > indicator for key app functionality. but knowing roughly what your current &

Re: Measuring WAN replication latency

2014-07-30 Thread Rahul Neelakantan
Rob, Any ideas you can provide on how to do this will be appreciated, we would like to build a latency monitoring tool/dashboard that shows how long it takes for data to get sent across various DCs. Rahul Neelakantan > On Jul 29, 2014, at 8:53 PM, Robert Coli wrote: > >> On Tue,

Re: Measuring WAN replication latency

2014-07-29 Thread Rahul Neelakantan
to increase the time it takes for writes to be acknowledged. What I am looking for is a way to monitor either using some statistic exposed by Cassandra or using some sort of synthetic transaction of how my Cassandra replication looks and alert if there is slowness noticed. Rahul Neelakantan

Measuring WAN replication latency

2014-07-29 Thread Rahul Neelakantan
Does anyone know of a way to measure/monitor WAN replication latency for Cassandra? For example I make a write to DC 1 of a multi DC setup using local_quorum , how long before that write is available for a read either locally in DC1 or remotely in DC2 using local_quorum. Rahul Neelakantan

Re: unable to load data using sstableloader

2014-07-29 Thread Rahul Neelakantan
-data-to-cassandra-using.html?m=1 Rahul Neelakantan > On Jul 29, 2014, at 4:55 AM, Akshay Ballarpure > wrote: > > Thanks Duncan for quick help > now i am trying sstableloader but its not loading data...any suggestion ? > > > [root@CSL-simulation conf]# p

Re: unable to load data using sstableloader

2014-07-29 Thread Rahul Neelakantan
Is SStable loader being run on the same host as the Cassandra node 127.0.0.1 (I see your ring is made up of all loop back IPs). Rahul Neelakantan 678-451-4545 > On Jul 29, 2014, at 4:55 AM, Akshay Ballarpure > wrote: > > Thanks Duncan for quick help > now i am trying ss

Cassandra version upgrade path

2014-07-26 Thread Rahul Neelakantan
version while upgrading Rahul Neelakantan 678-451-4545

Re: Changing IPs of all nodes in a ring

2014-07-25 Thread Rahul Neelakantan
Normal. Rahul Neelakantan 678-451-4545 > On Jul 25, 2014, at 9:06 PM, Robert Coli wrote: > >> On Fri, Jul 25, 2014 at 4:42 PM, Rahul Neelakantan wrote: >> I am ok with taking upto 2 hours of planned downtime. The problem is all the >> IPs will change at the same time a

Re: Changing IPs of all nodes in a ring

2014-07-25 Thread Rahul Neelakantan
I am ok with taking upto 2 hours of planned downtime. The problem is all the IPs will change at the same time and the previous IPs will no longer be available. So it's either all old IPs or all new IPs. Rahul Neelakantan 678-451-4545 > On Jul 25, 2014, at 7:23 PM, Robert Coli wrote:

Changing IPs of all nodes in a ring

2014-07-25 Thread Rahul Neelakantan
All, I need to change the IPs of all nodes in my ring in a flash cut, at the same time. Any recommendations on how to do this? Rahul Neelakantan

Re: How to get rid of stale info in gossip

2014-07-25 Thread Rahul Neelakantan
Yes, and this is a really old version of casandra 1.0.8. Rahul Neelakantan 678-451-4545 > On Jul 25, 2014, at 7:29 AM, Mark Reddy wrote: > > After removing a node, it's information can persist in the Gossiper for up to > 3 days, after which time it should be removed. &g

How to get rid of stale info in gossip

2014-07-25 Thread Rahul Neelakantan
Is there a way to get rid of stale information that shows up for removed/dead nodes in gossip, without a complete cluster bounce? Rahul Neelakantan