RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-21 Thread JOHN, BIBIN
, 2020 2:15 PM To: user@cassandra.apache.org Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis Question: would daily deltas be a good use of CDC? (Rather than export entire tables.) (I can understand that this might make analytics hard if you need to span multiple resultant

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-21 Thread Peter Corless
ruary 19, 2020 5:25 PM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] RE: Mechanism to Bulk Export from Cassandra on > daily Basis > > > > Thank you for suggestion. Full refresh is currently designed because with > delta we cannot identify what got deleted. So downstr

RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-21 Thread Durity, Sean R
, 2020 3:14 PM To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis To the question of ‘best approach’, so far the comments have been about alternatives in tools. Another axis you might want to consider is from th

RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread JOHN, BIBIN
g>> Date: Wednesday, February 19, 2020 at 1:13 PM To: "user@cassandra.apache.org<mailto:user@cassandra.apache.org>" mailto:user@cassandra.apache.org>> Subject: Mechanism to Bulk Export from Cassandra on daily Basis Message from External Sender Team, We have a requirem

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Reid Pinchback
the ongoing operations of the cluster while you are pulling that data. R From: "JOHN, BIBIN" Reply-To: "user@cassandra.apache.org" Date: Wednesday, February 19, 2020 at 1:13 PM To: "user@cassandra.apache.org" Subject: Mechanism to Bulk Export from Cassandra on dail

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Aakash Pandhi
application. There are 137 tables and 30 of them are have 300M+ records. So “COPY TO” taking lot of time.   Thank you Bibin John   From: Aakash Pandhi Sent: Wednesday, February 19, 2020 12:51 PM To: user@cassandra.apache.org Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Amanda Moran
y, February 19, 2020 12:51 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Mechanism to Bulk Export from Cassandra on daily Basis > > > > John, > > > > Greetings, > > > > Requirement is to just export data from table and stage it somewhere? OR > export

RE: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread JOHN, BIBIN
@cassandra.apache.org Subject: Re: Mechanism to Bulk Export from Cassandra on daily Basis John, Greetings, Requirement is to just export data from table and stage it somewhere? OR export it and load them in another cluster/table? sstableloader is a utility which can help you as it is designed for

Re: Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread Aakash Pandhi
John, Greetings,  Requirement is to just export data from table and stage it somewhere? OR export it and load them in another cluster/table? sstableloader is a utility which can help you as it is designed for bulk loading.   Sincerely, Aakash Pandhi On Wednesday, February 19, 2020, 10:13:

Mechanism to Bulk Export from Cassandra on daily Basis

2020-02-19 Thread JOHN, BIBIN
Team, We have a requirement to bulk export data from Cassandra on daily basis? Table contain close to 600M records and cluster is having 12 nodes. What is the best approach to do this? Thanks Bibin John