atinvento100 commented on issue #13358: URL: https://github.com/apache/iceberg/issues/13358#issuecomment-3273253110
@wypoon , I see the Pyspark 4.0 uses hive 2.3.10 jars if i'm right, and using the same as mentioned here in this issue(which i had raised following this - #14021), it fails and not quit sure whats wrong. However using pyspark 3.5.6 with hive 2.3.9 jars and hadoop-aws 3.34 jar and the iceberg-spark-runtime(3.5_2.12:1.8.1) works for us, just that when upgrading to pyspark 4.0 **need guidance** on the expected jar versions(hive and hadoop-aws). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
