Hi, Yes, the commit-log format may change, here is the current version of commit-log: https://github.com/apache/cassandra/blob/06209037ea56b5a2a49615a99f1542d6ea1b2947/src/java/org/apache/cassandra/db/commitlog/CommitLogDescriptor.java#L69 You need to look into git log to find out the changes. But if you use Cassandra lib to read the files, CommitLogReader is able to read the current and previous version of commit-logs: https://github.com/apache/cassandra/blob/06209037ea56b5a2a49615a99f1542d6ea1b2947/src/java/org/apache/cassandra/db/commitlog/CommitLogReader.java#L168 If you implement that by yourself (maybe in other languages), you should do the similar thing. Thanks,Jay On Thursday, February 7, 2019, 11:34:35 PM PST, Sreenivasulu Nallapati <sreeni.nallap...@gmail.com> wrote: Hello folks,
I am exploring the CDC option to move data from cassandra to Hive on periodic basis. While exploring this option, I overheard saying that the internal commit-log structure will change form version to version. Is this correct? As per this link <http://cassandra.apache.org/doc/latest/architecture/storage_engine.html#sstable-versions>, sstables have changed in multiple times in multiple versions. I want to understand about the commit-log internal structure as well. Is there any change in the commit-log file structure in different cassandra versions? If so, can someone please redirect me to the docs/change log? Please help me to understand more on this. Thanks in advance Thanks Sreeni
