Re: [I] Flink SQL with Iceberg snapshots doesn't react if table has upsert [iceberg]

pvary commented on issue #9948: URL: https://github.com/apache/iceberg/issues/9948#issuecomment-2373226159 @CJDrew: There’s an open PR (#10935) for the planning part of the incremental reads. That could be a good foundation for implementing CDC reads in Flink. On the row lineage to

Re: [I] Flink SQL with Iceberg snapshots doesn't react if table has upsert [iceberg]

CJDrew commented on issue #9948: URL: https://github.com/apache/iceberg/issues/9948#issuecomment-2372401940 @pvary Hi Peter, I am also interested in this feature. I see in iceberg-spark we have the ability to use the procedure "create_changelog_view" and I wonder how difficult it wou

Re: [I] Flink SQL with Iceberg snapshots doesn't react if table has upsert [iceberg]

pvary commented on issue #9948: URL: https://github.com/apache/iceberg/issues/9948#issuecomment-1999013848 @VidakM: I suggest to bring this up on the mailing list. I would also love to see this feature in Flink. I checked myself a few months ago, and the main blocker is that the plann

Re: [I] Flink SQL with Iceberg snapshots doesn't react if table has upsert [iceberg]

VidakM commented on issue #9948: URL: https://github.com/apache/iceberg/issues/9948#issuecomment-1996740393 Thanks for getting back to me. Looking at the docs I also see that Spark Structured Streaming has a similar warning of only supporting appends. A bit too bad, as it would unl

[I] Flink SQl with Iceberg snapshots doesn't react if table has upsert [iceberg]

VidakM opened a new issue, #9948: URL: https://github.com/apache/iceberg/issues/9948 ### Query engine Flink 1.17.2 with Iceberg 1.4.2 libraries ### Question I have a few Iceberg v2 tables defined and a Flink job that reads them in a streaming fashion before transforming