Re: Cassandra doesn't flush any commit log files into cdc_raw directory

2021-04-29 Thread Bingqin Zhou
Hi Ahmed, Thank you for your insights! I don't think the write rates are slow for the tables I enable CDC on, otherwise, the commit log sizes won't go over the cdc_total_space_in_mb (4096) quickly. I'll try to dig more into what affects the speed of memtable flushes. Bingqin Zhou On Thu, Apr 29,

Re: Cassandra doesn't flush any commit log files into cdc_raw directory

2021-04-29 Thread Ahmed Eljami
Hi Bingqin, When cdc_raw directory is full, Cassandra rejects new writes on this node with the following message in the log: - Rejecting Mutation containing CDC-enabled table. https://github.com/apache/cassandra/blob/cassandra-3.11.9/src/java/org/apache/cassandra/db/commitlog/CommitLogSegmen

Cassandra doesn't flush any commit log files into cdc_raw directory

2021-04-28 Thread Bingqin Zhou
Hi all, We're working on a Kafka connector to capture data changes in Cassandra by processing commit log files in the cdc_raw directory. After we enabled CDC on a few tables, we didn't observe any commit log files getting flushed into cdc_raw directory as expected, but got WriteTimeoutException in