pvary commented on PR #13082: URL: https://github.com/apache/iceberg/pull/13082#issuecomment-2894268057
Merged to main. Thanks for the backport @coderfender and @RussellSpitzer for the review! Also thanks for the fight with the whitespaces 😄 @coderfender, @RussellSpitzer: Do you think that the `maxRewriteBytes` configuration option would be useful for Spark as well? https://github.com/apache/iceberg/blob/09a531740ccec41d69c166ec484be6da16a09947/flink/v2.0/flink/src/main/java/org/apache/iceberg/flink/maintenance/api/RewriteDataFiles.java#L79-L85 If you find the feature would be useful in Spark as well, then we could move the filtering from Flink to the core. @coderfender : If you have time, I would be happy to review it, or we could find someone else who has more time to do this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
