pvary commented on issue #8754: URL: https://github.com/apache/iceberg/issues/8754#issuecomment-1757006236
> * Will [Flink: Emit watermarks from the IcebergSource #8553](https://github.com/apache/iceberg/pull/8553) support some sort of ordering guaranty? Could you please elaborate on the question? In #8553 The splits/files will ordered by watermarks, and the streaming api will fetch new splits based on the `monitor-interval`. In an ideal world the `monitor-interval` is much shorter than the commit frequency. On startup we read the splits/files ordered based on the Iceberg column metrics for the given column, and after that we the commits 1-by-1. This does not entirely prevent out of order reads, but if the timestamps are written in order, then they are most likely read in order as well. > * Is the streaminig feature associated with icebergs tagging features? This might be a weird question, but I have heared some people mentioning it, though I can not see it written anywhere. If you ask, whether the braches are supported in streaming reads, then the answer is "yes" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
