pvary commented on issue #9138: URL: https://github.com/apache/iceberg/issues/9138#issuecomment-1824274267
@jonathf: Always good to know if somebody is interested in a feature, so feel free to ask your questions! > 1. Which versions of Flink will this support? Or is it agnostic to the flink version? I will create a backport PR soon, which will add the feature to Flink 1.15, and Flink 1.16 too. That said, the next task on my list is #8930, which will enable Flink 1.18 support, but it will also drop 1.15 support. So I expect that in the next release of Iceberg the feature will be supported for Flink 1.16, 1.17 and 1.18 > 2. Is this code required both client and server side to work? In other words, is it enough to update the iceberg dependency in the flink application to the newest version (when it is ready), or do we also have to update the iceberg storage code aswell? The only server side of Iceberg is the REST Catalog implementation, which are not affected by this change (and you might use a different Catalog anyway). So Flink dependency upgrade is enough. > 3. Is using this feature as simple as assigning the watermark column in the table api, or do we have to do anything more to get it to work. You need column metrics for your tables, so please make sure that the file statistics are there for the given column (you might need to rewrite the files, if they are missing). If the metrics are there, then just enable the watermark generation using `watermarkColumn`, and you are ready. If your column type is long, you might want to use `watermarkTimeUnit` to define which time unit is used to store your event time. If you have missing statistics, you will get the following exception: ``` Missing statistics for column name = %s in file = %s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
