Re: Cassandra backup to alternate location

2018-06-28 Thread Jeff Jirsa
No - they'll hardlink into the snapshot folder on each data directory. They are true hardlinks, so even if you could move it, it'd still be on the same filesystem. Typical behavior is to issue a snapshot, and then copy the data out as needed (using something like https://github.com/JeremyGrosser/t

Cassandra backup to alternate location

2018-06-28 Thread Lohchab, Sanjeev
Hi All, I am trying to backup Cassandra DB, but by default it is saving the snapshots in the default location. Is there any way we can specific the location where we want to store the snapshots. Regards Sanjeev

RE: [EXTERNAL] Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-27 Thread Durity, Sean R
: user@cassandra.apache.org Subject: [EXTERNAL] Re: Any Cassandra Backup and Restore tool like Cassandra Reaper? Tablesnap assumes S3, and tableslurp can set up the stage for restoring by downloading the relevant SSTables (but then it's up to the operator to complete the restore from

Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Lerh Chuan Low
ssandra.yaml. And I'm thinking of >> setting up a replication strategy so that one rack contains 1 replica of >> each keyspace and then using r1soft to image each of those servers to tape >> for offsite backup. >> >> >> On Thu, Dec 14, 2017 at 1:30 PM Harika

Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Rutvij Bhatt
o image each of those servers to tape > for offsite backup. > > > On Thu, Dec 14, 2017 at 1:30 PM Harika Vangapelli -T (hvangape - AKRAYA > INC at Cisco) wrote: > >> Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? >> >> >> &

Re: Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Roger Brown
trategy so that one rack contains 1 replica of each keyspace and then using r1soft to image each of those servers to tape for offsite backup. On Thu, Dec 14, 2017 at 1:30 PM Harika Vangapelli -T (hvangape - AKRAYA INC at Cisco) wrote: > Any Cassandra Backup and Restore tool like Cassandra Reape

Any Cassandra Backup and Restore tool like Cassandra Reaper?

2017-12-14 Thread Harika Vangapelli -T (hvangape - AKRAYA INC at Cisco)
Any Cassandra Backup and Restore tool like Cassandra Reaper for Repairs? [http://wwwin.cisco.com/c/dam/cec/organizations/gmcc/services-tools/signaturetool/images/logo/logo_gradient.png] Harika Vangapelli Engineer - IT hvang...@cisco.com<mailto:hvang...@cisco.com> Tel: Cisco System

RE: AWS Cassandra backup/Restore tools

2017-09-12 Thread Durity, Sean R
snapshot are usually not worth it. Sean Durity From: Alexander Dejanovski [mailto:a...@thelastpickle.com] Sent: Friday, May 12, 2017 12:14 PM To: Manikandan Srinivasan ; Nitan Kainth Cc: Blake Eggleston ; cass savy ; user@cassandra.apache.org Subject: Re: AWS Cassandra backup/Restore tools Hi

Re: AWS Cassandra backup/Restore tools

2017-05-12 Thread Alexander Dejanovski
Hi, here are the main techniques that I know of to perform backups for Cassandra : - Tablesnap (https://github.com/JeremyGrosser/tablesnap) : performs continuous backups on S3. Comes with tableslurp to restore backups (one table at a time only) and tablechop to delete outdated sstables f

Re: AWS Cassandra backup/Restore tools

2017-05-11 Thread Manikandan Srinivasan
Blake is correct. OpsCenter 6.0 and up doesn't work with OSS C*. @Nitan: We have made some substantial changes to the Opscenter 6.1 backup service, specifically when it comes to S3 backups. Having said this, I am not going to be sale-sy here. If folks need some help or need more clarity to know mor

Re: AWS Cassandra backup/Restore tools

2017-05-11 Thread Nitan Kainth
Also , Opscenter backup/restore does not work for large databases Sent from my iPhone > On May 11, 2017, at 3:41 PM, Blake Eggleston wrote: > > OpsCenter 6.0 and up don't work with Cassandra. > >> On May 11, 2017 at 12:31:08 PM, cass savy (casss...@gmail.com) wrote: >> >> AWS Backup/Restore

Re: AWS Cassandra backup/Restore tools

2017-05-11 Thread Blake Eggleston
OpsCenter 6.0 and up don't work with Cassandra. On May 11, 2017 at 12:31:08 PM, cass savy (casss...@gmail.com) wrote: AWS Backup/Restore process/tools for C*/DSE C*: Has anyone used Opscenter 6.1 backup tool to backup/restore data for larger datasets online ? If yes, did you run into issues us

AWS Cassandra backup/Restore tools

2017-05-11 Thread cass savy
AWS Backup/Restore process/tools for C*/DSE C*: Has anyone used Opscenter 6.1 backup tool to backup/restore data for larger datasets online ? If yes, did you run into issues using that tool to backup/restore data in PROD that caused any performance or any other impact to the cluster? If no, what

Re: Verify cassandra backup and restore in C * 2.1

2016-08-09 Thread Riccardo Ferrari
* 2.1 > Copy commands sometimes fails as well. > > So any better easy mechanism? > > *Thanks and regards,* > *-- Indranil Basu* > > > -- > *From:* Rajath Subramanyam > *To:* user@cassandra.apache.org; INDRANIL BASU > *Sent:* Monday, 8 Aug

Re: Verify cassandra backup and restore in C * 2.1

2016-08-08 Thread INDRANIL BASU
,-- Indranil Basu From: Rajath Subramanyam To: user@cassandra.apache.org; INDRANIL BASU Sent: Monday, 8 August 2016 11:41 PM Subject: Re: Verify cassandra backup and restore in C * 2.1 Hi Indranil,  One approach is to do a row count on the original source table and the table that is

Re: Verify cassandra backup and restore in C * 2.1

2016-08-08 Thread Rajath Subramanyam
Hi Indranil, One approach is to do a row count on the original source table and the table that is restored from backup. How are you backing up data ? I am assuming you are issuing snapshot commands (either incremental or otherwise). I hope this helps. - Rajath Rajath Su

Verify cassandra backup and restore in C * 2.1

2016-08-08 Thread INDRANIL BASU
Hello,    How can we verify that cassandra data is backed up and restored correctly? -- IB

Re: Cassandra backup via snapshots in production

2014-12-01 Thread Jens Rantil
On Mon, Dec 1, 2014 at 8:39 PM, Robert Coli wrote: > Why not use the much more robustly designed and maintained community based > project, tablesnap? For two reasons: - Because I am tired of the deployment model of Python apps which require me to set up virtual environments. - Because

Re: Cassandra backup via snapshots in production

2014-12-01 Thread Robert Coli
On Thu, Nov 27, 2014 at 2:34 AM, Jens Rantil wrote: > Late answer; You can find my backup script here: > https://gist.github.com/JensRantil/a8150e998250edfcd1a3 > Why not use the much more robustly designed and maintained community based project, tablesnap? https://github.com/JeremyGrosser/tabl

Re: Cassandra backup via snapshots in production

2014-11-27 Thread Jens Rantil
Late answer; You can find my backup script here: https://gist.github.com/JensRantil/a8150e998250edfcd1a3 Basically you need to set S3_BUCKET, PGP_KEY_RECIPIENT, configure s3cmd (using s3cmd --configure) and then issue `./backup-keyspace.sh your-keyspace` to backup it to S3. We run the script i

RE: Cassandra backup via snapshots in production

2014-11-27 Thread Ngoc Minh VO
D-5 and D o bring the cluster online Do you think it would work? From: Jens Rantil [mailto:jens.ran...@tink.se] Sent: mardi 25 novembre 2014 10:03 To: user@cassandra.apache.org Subject: Re: Cassandra backup via snapshots in production > Truncate does trigger snapshot creation though Does

Re: Cassandra backup via snapshots in production

2014-11-25 Thread Jens Rantil
> Truncate does trigger snapshot creation though Doesn’t it? With “auto_snapshot: true” it should. ——— Jens Rantil Backend engineer Tink AB Email: jens.ran...@tink.se Phone: +46 708 84 18 32 Web: www.tink.se Facebook Linkedin Twitter On Tue, Nov 25, 2014 at 9:21 AM, DuyHai Doan wrote:

Re: Cassandra backup via snapshots in production

2014-11-25 Thread DuyHai Doan
True Delete in CQL just create tombstone so from the storage engine pov it's just adding some physical columns Truncate does trigger snapshot creation though Le 21 nov. 2014 19:29, "Robert Coli" a écrit : > On Fri, Nov 21, 2014 at 8:40 AM, Jens Rantil wrote: > >> > The main purpose is to prote

Re: Cassandra backup via snapshots in production

2014-11-21 Thread Robert Coli
On Fri, Nov 21, 2014 at 8:40 AM, Jens Rantil wrote: > > The main purpose is to protect us from human errors (eg. unexpected > manipulations: delete, drop tables, …). > > If that is the main purpose, having "auto_snapshot: true” in > cassandra.yaml will be enough to protect you. > OP includes "de

Re: Cassandra backup via snapshots in production

2014-11-21 Thread Jens Rantil
> The main purpose is to protect us from human errors (eg. unexpected > manipulations: delete, drop tables, …). If that is the main purpose, having "auto_snapshot: true” in cassandra.yaml will be enough to protect you. Regarding backup, I have a small script that creates a named snapshot

Re: Cassandra backup via snapshots in production

2014-11-19 Thread Robert Coli
On Tue, Nov 18, 2014 at 6:50 AM, Ngoc Minh VO wrote: > We are looking for a solution to backup data in our C* cluster (v2.0.x, > 16 nodes, 4 x 500GB SSD, RF = 6 over 2 datacenters). > > The main purpose is to protect us from human errors (eg. unexpected > manipulations: delete, drop tables, …).

Cassandra backup via snapshots in production

2014-11-18 Thread Ngoc Minh VO
Hello all, We are looking for a solution to backup data in our C* cluster (v2.0.x, 16 nodes, 4 x 500GB SSD, RF = 6 over 2 datacenters). The main purpose is to protect us from human errors (eg. unexpected manipulations: delete, drop tables, …). We are thinking of: - Backup: add a 2TB H

Re: cassandra backup

2013-12-06 Thread Robert Coli
On Fri, Dec 6, 2013 at 5:13 AM, Marcelo Elias Del Valle < marc...@s1mbi0se.com.br> wrote: > I am trying to create backups of my data on AWS. My goal is to store > the backups on S3 or glacier, as it's cheap to store this kind of data. So, > if I have a cluster with N nodes, I would like to cop

Re: cassandra backup

2013-12-06 Thread Jonathan Haddad
I believe SSTables are written to a temporary file then moved. If I remember correctly, tools like tablesnap listen for the inotify event IN_MOVED_TO. This should handle the "try to back up sstable while in mid-write" issue. On Fri, Dec 6, 2013 at 5:39 AM, Michael Theroux wrote: > Hi Marcelo,

Re: cassandra backup

2013-12-06 Thread Rahul Menon
You should look at this - https://github.com/amorton/cassback i dont believe its setup to use 1.2.10 and above but i believe is just small tweeks to get it running. Thanks Rahul On Fri, Dec 6, 2013 at 7:09 PM, Michael Theroux wrote: > Hi Marcelo, > > Cassandra provides and eventually consisten

Re: cassandra backup

2013-12-06 Thread Michael Theroux
Hi Marcelo, Cassandra provides and eventually consistent model for backups.  You can do staggered backups of data, with the idea that if you restore a node, and then do a repair, your data will be once again consistent.  Cassandra will not automatically copy the data to other nodes (other than

cassandra backup

2013-12-06 Thread Marcelo Elias Del Valle
Hello everyone, I am trying to create backups of my data on AWS. My goal is to store the backups on S3 or glacier, as it's cheap to store this kind of data. So, if I have a cluster with N nodes, I would like to copy data from all N nodes to S3 and be able to restore later. I know Priam does th

Re: Cassandra backup

2013-02-20 Thread aaron morton
a to be on SSD and the rest to be on the HDD, how will that > work. > > From: Michael Kjellman [mailto:mkjell...@barracuda.com] > Sent: 18 February 2013 20:08 > To: user@cassandra.apache.org > Subject: Re: Cassandra backup > > There is this: > > http://www.datas

RE: Cassandra backup

2013-02-18 Thread Kanwar Sangha
@cassandra.apache.org Subject: Re: Cassandra backup There is this: http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-1-flexible-data-file-placement But you'll need to design your data model around the fact that this is only as granular as 1 column family Best, michael From: Kanwar S

Re: Cassandra backup

2013-02-18 Thread Michael Kjellman
y-To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Date: Monday, February 18, 2013 6:06 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Cassa

Cassandra backup

2013-02-18 Thread Kanwar Sangha
Hi - We have a req to store around 90 days of data per user. Last 7 days of data is going to be accessed frequently. Is there a way we can have the recent data (7 days) in SSD and the rest of the data in the HDD ? Do we take a snapshot every 7 days and use a separate 'archive' cluster to serve t

Re: Cassandra backup question regarding commitlogs

2012-05-11 Thread Vijay
> start to restore the data in commitlog files? > > Thanks. > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-question-regarding-commitlogs-tp7511918.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com. >

Re: Cassandra backup queston regarding commitlogs

2012-05-01 Thread Roshan
Many thanks Aaron. I will post a support issue for them. But will keep the snapshot + incremental backups + commitlogs to recover any failure situation. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs

Re: Cassandra backup queston regarding commitlogs

2012-05-01 Thread aaron morton
-- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp7508823p7518544.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread Roshan
http://www.datastax.com/docs/1.0/operations/backup_restore -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp7508823p7515679.html Sent from the cassandra-u...@incubator.apache.org mailing list archive

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread aaron morton
er-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp7508823p7515217.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread Roshan
message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp7508823p7515217.html Sent from the cassandra-u...@incubator.apache.org mailing list archive at Nabble.com.

Re: Cassandra backup queston regarding commitlogs

2012-04-30 Thread aaron morton
When the server starts it reads the SSTables then applies the Commit Logs. There is nothing you need to do other than leave the commit logs where they are. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 30/04/2012, at 6:02 PM, Roshan wr

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread Roshan
Hi Aaron Thanks for the comments. Yes for the durability will keep them in a safe place. But such crash situation, how can I restore the data (because those are not in a SSTable and only in commit log). Do I need to replay only that commit log when server starts after crash? Will it override the

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread aaron morton
s case how can I backup/restore data? > > Do I need to backup the commitlogs as well and and replay during the server > start to restore the data in commitlog files? > > Thanks. > > > > -- > View this message in context: > http://cassandra-user-incubator-apache-

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread aaron morton
logs as well and and replay during the server > start to restore the data in commitlog files? > > Thanks. > > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp75088

Cassandra backup question regarding commitlogs

2012-04-29 Thread Roshan
well and and replay during the server start to restore the data in commitlog files? Thanks. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-question-regarding-commitlogs-tp7511918.html Sent from the cassandra-u

Re: Cassandra backup queston regarding commitlogs

2012-04-29 Thread Roshan
Tamar Please don't jump to other users discussions. If you want to ask any issue, create a new one, please. Thanks. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-question-regarding-commitlogs-tp7508823p7511913.html

Re: Cassandra backup queston regarding commitlogs

2012-04-28 Thread Tamar Fraenkel
ta? > > Do I need to backup the commitlogs as well and and replay during the server > start to restore the data in commitlog files? > > Thanks. > > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-bac

Cassandra backup queston regarding commitlogs

2012-04-28 Thread Roshan
well and and replay during the server start to restore the data in commitlog files? Thanks. -- View this message in context: http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cassandra-backup-queston-regarding-commitlogs-tp7508823.html Sent from the cassandra-u