Re: Cassandra Data migration from 2.2.3 to 3.7

> others is strictly prohibited. If you are not the intended recipient (or > authorized to receive for the recipient), please contact the sender by reply > email and delete all copies of this message. > Please click here for Company Registration Information. > > From: Jeff Jirsa [mail

RE: Cassandra Data migration from 2.2.3 to 3.7

legal/cri/index.html> for Company Registration Information. From: Jeff Jirsa [mailto:jji...@gmail.com] Sent: Tuesday, August 1, 2017 5:13 PM To: cassandra Subject: Re: Cassandra Data migration from 2.2.3 to 3.7 Roughly that approach should work, modulo copying data in/out to the right paths

Re: Cassandra Data migration from 2.2.3 to 3.7

://www.cisco.com/web/about/doing_business/legal/cri/index.html> for > Company Registration Information. > > > > *From:* Jeff Jirsa [mailto:jji...@gmail.com] > *Sent:* Tuesday, August 1, 2017 3:36 PM > > *To:* user@cassandra.apache.org > *Subject:* Re: Cassandra Data mig

Re: Cassandra Data migration from 2.2.3 to 3.7

you are not the intended recipient (or > authorized to receive for the recipient), please contact the sender by reply > email and delete all copies of this message. > Please click here > <http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for > Company Re

RE: Cassandra Data migration from 2.2.3 to 3.7

ex.html> for Company Registration Information. From: Jeff Jirsa [mailto:jji...@gmail.com] Sent: Tuesday, August 1, 2017 3:36 PM To: user@cassandra.apache.org Subject: Re: Cassandra Data migration from 2.2.3 to 3.7 You can't stream across versions, so you either need to use the native protocol

Re: Cassandra Data migration from 2.2.3 to 3.7

e for the recipient), please contact the sender by reply > email and delete all copies of this message. > Please click here for Company Registration Information. > > From: Jeff Jirsa [mailto:jji...@gmail.com] > Sent: Tuesday, August 1, 2017 2:48 PM > To: user@cassandra.apache.o

RE: Cassandra Data migration from 2.2.3 to 3.7

2017 2:48 PM To: user@cassandra.apache.org Subject: Re: Cassandra Data migration from 2.2.3 to 3.7 If you upgrade in place: Stop each node one at a time Swap binaries Start each node Run upgradesstables when all nodes are bounced If you want to take data from 2.2 and put it into a 3.x cluster, yo

Re: Cassandra Data migration from 2.2.3 to 3.7

;re using a 3.7 lts branch (like instaclustr had at one point - and may still have). -- Jeff Jirsa > On Aug 1, 2017, at 2:24 PM, Harika Vangapelli -T (hvangape - AKRAYA INC at > Cisco) wrote: > > Please help me understand data migration path from 2.2.3 to 3.7. > > 1.

Cassandra Data migration from 2.2.3 to 3.7

Please help me understand data migration path from 2.2.3 to 3.7. 1. Tried to take snapshot and load the snapshot using sstableloader; but it is throwing Streaming Exception. Please advise. Thanks, Harika [http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool

Re: Data migration from Oracle to Cassandra

58 PM, Chidambaran Subramanian wrote: > More curious than answering the question. Would it be possible to even > design something generic here? Would it not depend on the schema? > > On Thu, Nov 17, 2016 at 8:21 PM, Shashidhar Rao < > raoshashidhar...@gmail.com> wrote: > >

Re: Data migration from Oracle to Cassandra

More curious than answering the question. Would it be possible to even design something generic here? Would it not depend on the schema? On Thu, Nov 17, 2016 at 8:21 PM, Shashidhar Rao wrote: > Hi, > > Has anyone done data migration from Oracle to Cassandra taking care of > Change

Data migration from Oracle to Cassandra

Hi, Has anyone done data migration from Oracle to Cassandra taking care of Change data capture. Kindly share the experience about the tools used. Golden Gate, IBM CDC or any tools. Recommendation of any Open Source tools would be highly useful. I need to constantly capture the commits from

Re: Can Sqoop be used in cassandra only cluster for data migration?

You can look into using the open Talend big data package. -- Enviado do aplicação myMail para Android Terça-feira, 30 Agosto 2016, 09:42PM +01:00 de Amit Trivedi tria...@gmail.com: I am working on a POC and would like to move data from a relational database to Cassand

Can Sqoop be used in cassandra only cluster for data migration?

I am working on a POC and would like to move data from a relational database to Cassandra. I was wondering if I can use Sqoop for this since it is one time thing and it would be easy to just give a select query to Sqoop to pull data from relational database. However, it looks like I need to setup a

Re: C* Table Changed and Data Migration with new primary key

appen. I also try use : getLongOption, but this exception still happen. https://github.com/datastax/spark-cassandra-connector/blob/master/doc/5_saving.md at first I want to ask issue on spark-case-connector project, but there are no issues there, so I ask here. Tks, qihuang.zheng 原始邮件 发

Re: C* Table Changed and Data Migration with new primary key

Changed and Data Migration with new primary key Use Spark to distribute the job of copying data all over the cluster and help accelerating the migration. The Spark connector does auto paging in the background with the Java Driver Le 22 oct. 2015 11:03, "qihuang.zheng"

Re: C* Table Changed and Data Migration with new primary key

; qihuang.zheng > > 原始邮件 > *发件人:* Jeff Jirsa > *收件人:* user@cassandra.apache.org > *发送时间:* 2015年10月22日(周四) 13:52 > *主题:* Re: C* Table Changed and Data Migration with new primary key > > Because the data format has changed, you’ll need to read it out and write > it back

Re: C* Table Changed and Data Migration with new primary key

clustering key. > But sql like this: > select * from test1 where attribute=? order by partner desc,app desc, > timestamp desc > can’t query the right global data by ts desc. > After Split table we could do globa data query right: select * from > test_global where attribute=? order

Re: C* Table Changed and Data Migration with new primary key

...@crowdstrike.com 收件人:user@cassandra.apache.orgu...@cassandra.apache.org 发送时间:2015年10月22日(周四) 13:52 主题:Re: C* Table Changed and Data Migration with new primary key Because the data format has changed, you’ll need to read it out and write it back in again. This means using either a driver (java

Re: C* Table Changed and Data Migration with new primary key

: "qihuang.zheng" Reply-To: "user@cassandra.apache.org" Date: Wednesday, October 21, 2015 at 6:18 PM To: user Subject: C* Table Changed and Data Migration with new primary key Hi All: We have a table defined only one partition key and some cluster key. CREATE TABLE test

C* Table Changed and Data Migration with new primary key

an’t fit our situation because our data is two large. (10Nodes, one nodes has 400G data) I alos try JavaAPI by query the origin table and then insert into 3 different splited table.But seems too slow Any Solution aboult quick data migration? TKS!! PS: Cass version: 2.0.15 Thanks Regards， qihuang.zheng

Re: Validation of Data after data migration from RDBMS to Cassandra

astax.com/en/cql/3.1/cql/cql_intro_c.html > > > > Roger > > > > *From:* Huang, Roger [mailto:rohu...@visa.com] > *Sent:* Thursday, August 06, 2015 11:39 AM > *To:* user@cassandra.apache.org > *Subject:* RE: Validation of Data after data migration from RDBMS to &

RE: Validation of Data after data migration from RDBMS to Cassandra

Surbhi Sorry I meant to send the CQL link http://docs.datastax.com/en/cql/3.1/cql/cql_intro_c.html Roger From: Huang, Roger [mailto:rohu...@visa.com] Sent: Thursday, August 06, 2015 11:39 AM To: user@cassandra.apache.org Subject: RE: Validation of Data after data migration from RDBMS to

RE: Validation of Data after data migration from RDBMS to Cassandra

/cassandra/2.1 Roger From: Surbhi Gupta [mailto:surbhi.gupt...@gmail.com] Sent: Thursday, August 06, 2015 11:31 AM To: user@cassandra.apache.org Subject: Validation of Data after data migration from RDBMS to Cassandra Hi, We have to migrate the data from Oracle/mysql to Cassandra. I wanted to

Validation of Data after data migration from RDBMS to Cassandra

Hi, We have to migrate the data from Oracle/mysql to Cassandra. I wanted to understand, if we have any tool/utilitiy which can help in validation the data after the data migration to Cassandra. Thanks Surbhi

Re: Data migration

Use SSTableloader it comes with Cassandra and is designed for moving data between clusters and is far simpler than sqoop. it "should" even work with a schema change like you described (changing columns). It would probably/definitely break if you were dropping tables. Mind you I've never tried ssta

Re: Data migration

Look into sqoop. I believe using sqoop you can transfer data between C* clusters. I haven't tested it though. other option is to write a program to read from one cluster and write the required data to another. On Tue, Apr 14, 2015 at 12:27 PM, skrynnikov_m wrote: > Hello!!! > Need to migrate dat

Data migration

Hello!!! Need to migrate data from one C* cluster to another periodically. During migration schema can change(add or remove one, two fields). Could you please suggest some tool?

Re: Which files should I backup for data restoring/data migration?

arenow <http://weibo.com/herewearenow>--* 2015-01-18 21:06 GMT+08:00 孔嘉林 : > Hi, > I want to backup the files needed for data restoring/data migration. There > are several directories: > /var/lib/cassandra/ >- commitlog/

Which files should I backup for data restoring/data migration?

Hi, I want to backup the files needed for data restoring/data migration. There are several directories: /var/lib/cassandra/ - commitlog/ - data/ - mytable/ - system/ - system_traces

Re: Cassandra data migration from 1.9.8 to 2.0.2

Thanks Robert. I wrongly mentioned the source Cassandra version. Actual source version is 1.2.9. Regards, LakshmiKanth On Tue, Mar 18, 2014 at 12:06 PM, Robert Coli wrote: > On Mon, Mar 17, 2014 at 6:19 PM, Lakshmi Kanth wrote: > >> Cassandra 1.9.8 >> > > No? This version does not exist. >

Re: Cassandra data migration from 1.9.8 to 2.0.2

On Mon, Mar 17, 2014 at 6:19 PM, Lakshmi Kanth wrote: > Cassandra 1.9.8 > No? This version does not exist. > Cassandra 2.0.2 > Cassandra 2.0.x versions up to and including 2.0.5 have serious issues. Including this one, which randomly tombstones your data when you use SSTableloader. https://i

Cassandra data migration from 1.9.8 to 2.0.2

Hi I am trying to migrate data from a 3 node cluster to a new 5 node cluster. After completion of the migration I am seeing few additional records in new system. After analysis, I found that these records were already deleted in the source system just few days before the migration. It seems li

Cassandra data migration from 1.9.8 to 2.0.0

Hi I am trying to migrate data from a 3 node cluster to a new 5 node cluster. After completion of the migration I am seeing few additional records in new system. After analysis, I found that these records were already deleted in the source system just few days before the migration. It seems li

Re: Issue with leveled compaction and data migration

Thanks for the response Rob, And yes, the relevel helped the bloom filter issue quite a bit, although it took a couple of days for the relevel to complete on a single node (so if anyone tried this, be prepared) -Mike Sent from my iPhone On Sep 23, 2013, at 6:34 PM, Robert Coli wrote: > On F

Re: Issue with leveled compaction and data migration

On Fri, Sep 13, 2013 at 4:27 AM, Michael Theroux wrote: > Another question on [the topic of row fragmentation when old rows get a > large append to their "end" resulting in larger-than-expected bloom > filters]. > > Would forcing the table to relevel help this situation? I believe the > process t

Re: Issue with leveled compaction and data migration

Another question on this topic. Would forcing the table to relevel help this situation? I believe the process to do this on 1.1.X would be to stop cassandra, remove .json file, and restart cassandra. Is this true? Any help would be appreciated, Thanks, -Mike On Sep 12, 2013, at 6:47 PM, Mich

Issue with leveled compaction and data migration

Hello, We've been undergoing a migration on Cassandra 1.1.9 where we are combining two column families. We are incrementally moving data from one column family into another, where the columns in a row in the source column family are being appended to columns in a row in the target column famil

Help: Data Migration Errors

Hi - Can anyone help me with some Cas data migration issues I'm having? I'm attempting to migrate a dev ring (5 nodes) to a larger production one (6 nodes). Both are hosted on EC2. Cluster Info: Small: Cas v.1.2.6, Rep Factor 1, vnodes enabled Larger: Cas v.1.2.9, Rep Factor 3, vnod

Re: Recommended way of data migration

That's a good approach. You could also migrate in-place if you're confident your migration algorithm is correct, but for more safety having another CF is better. If you have a huge volume of data to be migrated (millions of rows or more), I'd suggest you to use Hadoop to perform these migrations (

Re: Recommended way of data migration

I would do something like you are suggesting. I would not do the delete until all the rows are moved. Since writes in cassandra are idempotent you can even run the migration process multiple times without harm. On Sat, Sep 7, 2013 at 5:31 PM, Renat Gilfanov wrote: > Hello, > > Let's say we have

Recommended way of data migration

Hello, Let's say we have a simple CQL3 table CREATE TABLE example (     id UUID PRIMARY KEY,     timestamp TIMESTAMP,     data ASCII ); And I need to mutate  (for example encrypt) column values in the "data" column for all rows. What's the recommended approach to perform such migration progr

Re: Data migration between clusters

Hi Rob, Thank you for your reply. Our scenario is like this, we have 3 clusters, each has 1 or 2 keyspaces in it, and each cluster has 3 nodes. Now we're considering integrating these 3 clusters of 9 nodes to a single cluster of 9 nodes. This new cluster will contain all keyspaces and their da

Re: Data migration between clusters

On Tue, Oct 30, 2012 at 4:18 AM, 張　睿 wrote: > Does anyone here know if there is an efficient way to migrate multiple > cassandra clusters' data > to a single cassandra cluster without any dataloss. Yes. 1) create schema which is superset of all columnfamilies and all keyspaces 2) if all source c

Data migration between clusters

Hi, We have several Cassandra clusters in our department, each for a single application. Now we're considering merge these clusters to a single one, and this single one will serve all applications using cassandra, each with a single keyspace. We tried unifying all cluster names to a same one, but

RE: Are data migration tools for Cassandra exist?

Thank you for your answer. We made investigation of Cassandra architecture, and we interested in approaches for solving this problem. From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Sunday, June 12, 2011 5:51 AM To: user@cassandra.apache.org Subject: Re: Are data migration tools for

Re: Are data migration tools for Cassandra exist?

Depends on your scale, you can either code something yourself through the API or take advantage of the Hadoop integration and run jobs that read and write the data back. In either case you can change the code first to write to the new column as well as the old, then update all existing data, the

Are data migration tools for Cassandra exist?

If my application works in production and I change structure of my data (e.g. type of column name) I will need to process all my stored data. As variant I can create new column family and import legacy data. I think, that is typical task, so tool for doing this should exist, but I can't find an

Re: live data migration from mysql to cassandra

gosh, sorry for the mistakes I am tired ! Victor K. 2011/1/14 Victor Kabdebon > I personnally did it the other way around : from Cassandra to PostGreSQL, I > needed an hybrid system : Cassandra solidly holds all data while PostGreSQL > holds fewer data but request are simple and efficient ( wit

Re: live data migration from mysql to cassandra

I personnally did it the other way around : from Cassandra to PostGreSQL, I needed an hybrid system : Cassandra solidly holds all data while PostGreSQL holds fewer data but request are simple and efficient ( with SELECT WHERE). This is pretty easy once you master key browsing and iterating. I thin

Re: live data migration from mysql to cassandra

On Fri, Jan 14, 2011 at 10:40 AM, ruslan usifov wrote: > Hello > > Dear community please share your experience, home you make live(without > stop) migration from mysql or other RDBM to cassandra > There is no built in way to do this. I remember hearing at hadoop world this year that the hbase guy

live data migration from mysql to cassandra

Hello Dear community please share your experience, home you make live(without stop) migration from mysql or other RDBM to cassandra

Re: Data migration from mysql to cassandra

No. On Wed, May 19, 2010 at 4:12 PM, Beier Cai wrote: > Thanks Jonathan, using mysql as an id sequence generator definitely is a > good options. One thing though, does using sequential ids defeat the purpose > of random partitioner? > > On Tue, May 18, 2010 at 11:25 PM, Jonathan Ellis wrote: >>

Re: Data migration from mysql to cassandra

Thanks Jonathan, using mysql as an id sequence generator definitely is a good options. One thing though, does using sequential ids defeat the purpose of random partitioner? On Tue, May 18, 2010 at 11:25 PM, Jonathan Ellis wrote: > Those are 2 of the 3 options (the other one being, continue to >

Re: Data migration from mysql to cassandra

Those are 2 of the 3 options (the other one being, continue to generate incrementing IDs either by continuing to use mysql solely for that purpose, or by using another system like redis for that). On Mon, May 17, 2010 at 10:48 PM, Beier Cai wrote: > I'm currently moving my existing mysql database

Data migration from mysql to cassandra

I'm currently moving my existing mysql database to cassandra. One particular problem I have is to migrate all those integer auto-increment ids to cassandra's code generated keys (like UUID). One way I can do is to dump all the existing records into Cassandra and start with UUID for new records, but