davidrobbo commented on issue #12444: URL: https://github.com/apache/iceberg/issues/12444#issuecomment-2694460203
After a bit more investigation, I'm wondering if https://github.com/apache/iceberg/issues/8902 is relevant. The 79th snapshot does contain in the region of Integer.MAX_VALUE records. Attempting to set the following now fails understandably as the configured value exceeds Integer.MAX_VALUE: ``` .option("streaming-max-files-per-micro-batch", 10000) .option("streaming-max-rows-per-micro-batch", 10000000000L) ``` Curious as to whether there is a snag that prevents me attempting to backfill using readStream+trigger.AvailableNow if record count >= Integer.MAX_VALUE and whether an initial batch load should be the path forward currently. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
