jonathf commented on issue #8754: URL: https://github.com/apache/iceberg/issues/8754#issuecomment-1757017829
> Could you please elaborate on the question? In #8553 The splits/files will ordered by watermarks, and the streaming api will fetch new splits based on the `monitor-interval`. > > In an ideal world the `monitor-interval` is much shorter than the commit frequency. On startup we read the splits/files ordered based on the Iceberg column metrics for the given column, and after that we the commits 1-by-1. This does not entirely prevent out of order reads, but if the timestamps are written in order, then they are most likely read in order as well. Excellent! That is what I was wondering about. > > > * Is the streaminig feature associated with icebergs tagging features? This might be a weird question, but I have heared some people mentioning it, though I can not see it written anywhere. > > If you ask, whether the braches are supported in streaming reads, then the answer is "yes" Not really. I was wondering if tagging was required to get this functionality. Sounds to me that the answer to that it is not. Thank you for your feedback. I will be keeping an eye on for #8553 and trying it out when/if it gets released. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
