Re: What is there in the commit-log

2019-02-11 Thread Sreenivasulu Nallapati
s-commit-log > > > Regards, > Horia > > On Mon, Feb 11, 2019 at 1:17 AM Sreenivasulu Nallapati < > sreeni.nallap...@gmail.com> wrote: > > > Hi, > > > > I was wondering what is there in the commit-log. May be some examples > with > > below

How to identify inserts/deletes/updates from CDC data

2019-02-11 Thread Sreenivasulu Nallapati
Hi, I am parsing the commit log files and I could not able to segregate the inserts/deletes/updates from the mutations. Is there any way that we can identify the event that is executed from commit logs? Here is the partial code: public class CustomCommitLogReadHandler implements CommitLogReadHand

Best way to capture and process change log in cassandra

2019-02-10 Thread Sreenivasulu Nallapati
Hello folks, I am working on a assignment which need to load data from cassandra and put it it in Hive. The Hive is true to the source (cassandra). Means, all the data in cassandra will be captured in Hive (batch/near real time). Looking for a generic high level solution that will work for multip

What is there in the commit-log

2019-02-10 Thread Sreenivasulu Nallapati
Hi, I was wondering what is there in the commit-log. May be some examples with below events 1. Insert - only inserting data? 2. Update - will it have before after change? 3. Delete - will it have before and after change? 4. DDL - ? Please help me to understand Thanks Sreeni

Capturing all events from a given timestamp

2019-02-10 Thread Sreenivasulu Nallapati
Hi, I have a requirement to be capture any changes to tables, inserts deletes or updates from a given timestamp. However, with CDC enabled, I want to know if there is yet a way to read the data inserts,updates or deletes to a table through CQL. I want to know if it is possible to read the changes

Re: Commit-log structure changes - versions

2019-02-09 Thread Sreenivasulu Nallapati
On Thursday, February 7, 2019, 11:34:35 PM PST, Sreenivasulu Nallapati > wrote: > > Hello folks, > > I am exploring the CDC option to move data from cassandra to Hive on > periodic basis. > While exploring this option, I overheard saying that the internal > commit-log st

Commit-log structure changes - versions

2019-02-07 Thread Sreenivasulu Nallapati
Hello folks, I am exploring the CDC option to move data from cassandra to Hive on periodic basis. While exploring this option, I overheard saying that the internal commit-log structure will change form version to version. Is this correct? As per this link