PeterCorless commented on issue #10573: URL: https://github.com/apache/pinot/issues/10573#issuecomment-2471031766
Change Data Capture (CDC) is non-trivial functionality. Do you just provide the latest version of the record? Do you provide the pre-image? Can you just show the diffs? Is it queryable in-band like any other SQL query, or does it require some out-of-band method to access the change logs? When at ScyllaDB I was pretty impressed by the level of attention to detail to make sure their CDC implementation was performant, flexible and consumable. - [ScyllaDB Change Data Capture](https://www.scylladb.com/product/tools/scylladb-cdc/) Note that CDC is a separate issue/solution from implementing continuous queries. ClickHouse is experimenting with a new WATCH statement in that regard: - [WATCH Statement (Experimental)](https://clickhouse.com/docs/en/sql-reference/statements/watch) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
