Neuw84 commented on issue #10674: URL: https://github.com/apache/iceberg/issues/10674#issuecomment-2434843285
As @hsiang-c made another pull request building a table https://github.com/apache/iceberg/pull/11321 I didn't want to collide. Therefore, I focused on: - Added Amazon MSK Connect as option. - Added HTTP client advice when high throughput scenarios (not just tune the retries but also number of connections). - Added specific configs for data prefetching on EMR 7.1.0 As personal opinion, if using AWS SDKs most of the properties shouldn't be there ( there is a standard way of configure them, prioritize them, etc). However, is clear that using 3rd party libraries in different languages would require info like the tables @hsiang-c has built. The problem with this is that different libraries will have different configs ( on the same language). In my personal opinion instead of dividing by language, maybe by library (but here maybe just adding a link to the corresponding doc page should be enough)? And having a separate section/table for AWS SDKs supported ones (anything using official libraries will have the same config, no matter the language)? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
