steveloughran commented on PR #10233: URL: https://github.com/apache/iceberg/pull/10233#issuecomment-2767307590
yeah, classpaths are mess in places, primarily due to downstream things * spark pulling in 3.3.6. These need to be excluded and then the new versions pulled in. * hive-metastore pulling in some hadoop-2.7.6 server artifacts (!!). those can just be excluded, as iceberg-kafka already does. It does highlight the problem though: there are versions of spark where the installations may be 3.3.6 even though iceberg is building against 3.4.1. That bulk delete API is about the only thing which has changed filesystem-wise. What to do? 1. I'm doing the bulk delete without reflection as requested 2. catch all failures invoking it and downgrade to classic invocation -and disabling future attempts to use 3. Leave those spark imports of 3.3.6 alone, on the basis they reflect real-world deployments -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
