MonkeyCanCode commented on PR #1609: URL: https://github.com/apache/polaris/pull/1609#issuecomment-2892816662
> @snazy - not sure if we're on the same page here but these bundle JARs aren't the ones from AWS/Azure/GCP but rather ones that are compiled by Apache Iceberg to solve this exact problem of duplicated classpaths. I had the same concerns when I was introducing the GCP and Azure bundle JARs when rewriting the Quickstart but found them incredibly helpful and rather solving my class path issues. @adnanhemani Exactly. @snazy So I ran into this issue long time back when I was trying to hook spark with iceberg and AWS jars...it took me a while to figure out all of the needed pieces and class path issues mentioned above. For an end-user who is not familiar with those version dependencies, blindly bump the version to the next one can introduce class path issues as certain needed classes got removed even between minor version. Also, keeping 2-3 AWS JARs with arbitrary versioning seems very hard to manage in the long run as oppose to use the one compiled by iceberg for the needed pieces when integrated with various cloud vendor. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
