jzhuge commented on PR #8922: URL: https://github.com/apache/iceberg/pull/8922#issuecomment-1789421862
> I am not sure it is a good idea too, we always avoided respecting Spark configs for the built-in file sources. Iceberg split planning is different. Thanks for the feedback. If you feel strongly, we can drop this. However, if Spark "maxPartitionsBytes" and SPLIT_SIZE_DEFAULT have close enough semantics, the benefit of this PR may out-weigh the down sides? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
