jonathf commented on issue #9138: URL: https://github.com/apache/iceberg/issues/9138#issuecomment-1824362361
> @jonathf: Always good to know if somebody is interested in a feature, so feel free to ask your questions! I am glad to hear that! And thank you for the swift and in-depth answer. > [...] I expect that in the next release of Iceberg the feature will be supported for Flink 1.16, 1.17 and 1.18 We are on AWS managed Flink application which is currently limited upward to 1.15. Do you know anything about if or when AWS will update their support? > The only server side of Iceberg is the REST Catalog implementation, which are not affected by this change (and you might use a different Catalog anyway). So Flink dependency upgrade is enough. Good to know. > You need column metrics for your tables, so please make sure that the file statistics are there for the given column (you might need to rewrite the files, if they are missing). If the metrics are there, then just enable the watermark generation using `watermarkColumn`, and you are ready. If your column type is long, you might want to use `watermarkTimeUnit` to define which time unit is used to store your event time. > > If you have missing statistics, you will get the following exception: > > ``` > Missing statistics for column name = %s in file = %s > ``` Thank you. I am not familiar with column metrics in flink. Is there documentation on the topic that you can point me to so I may read up on the topic? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
