opendoc-tree commented on issue #12878: URL: https://github.com/apache/iceberg/issues/12878#issuecomment-3079792165
> [@opendoc-tree](https://github.com/opendoc-tree) where does the `HiveMetaStoreClient` comes from? it's not from `hive-standalone-metastore-common-4.0.1.jar` https://github.com/apache/hive/blob/rel/release-4.0.1/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java#L2795 > > you are using `hive-metastore-2.3.10` jar, that is not correct https://github.com/apache/hive/blob/rel/release-2.3.10/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStoreClient.java#L1360 inside spark jars had this hive jars ``` $ ls | grep hive hive-beeline-2.3.10.jar hive-cli-2.3.10.jar hive-common-2.3.10.jar hive-exec-2.3.10-core.jar hive-jdbc-2.3.10.jar hive-metastore-2.3.10.jar hive-serde-2.3.10.jar hive-service-rpc-4.0.0.jar hive-shims-0.23-2.3.10.jar hive-shims-2.3.10.jar hive-shims-common-2.3.10.jar hive-shims-scheduler-2.3.10.jar hive-storage-api-2.8.1.jar spark-hive_2.13-4.0.0.jar spark-hive-thriftserver_2.13-4.0.0.jar ``` after replace to hive 4.0 jars ``` $ ls | grep hive hive-beeline-4.0.1.jar hive-cli-4.0.1.jar hive-common-4.0.1.jar hive-exec-4.0.1.jar hive-jdbc-4.0.1.jar hive-jdbc-handler-4.0.1.jar hive-metastore-4.0.1.jar hive-serde-4.0.1.jar hive-service-4.0.1.jar hive-service-rpc-4.0.1.jar hive-shims-0.23-4.0.1.jar hive-shims-4.0.1.jar hive-shims-common-4.0.1.jar hive-standalone-metastore-common-4.0.1.jar hive-storage-api-4.0.1.jar spark-hive_2.13-4.0.0.jar spark-hive-thriftserver_2.13-4.0.0.jar ``` got this error ``` WARNING: Using incubator modules: jdk.incubator.vector Exception in thread "main" java.lang.NoSuchFieldError: JAVA_21 at org.apache.spark.util.Utils$.<clinit>(Utils.scala:1873) at org.apache.spark.deploy.SparkSubmitArguments.handle(SparkSubmitArguments.scala:433) at org.apache.spark.launcher.SparkSubmitOptionParser.parse(SparkSubmitOptionParser.java:169) at org.apache.spark.deploy.SparkSubmitArguments.<init>(SparkSubmitArguments.scala:93) at org.apache.spark.deploy.SparkSubmit$$anon$2$$anon$3.<init>(SparkSubmit.scala:1101) at org.apache.spark.deploy.SparkSubmit$$anon$2.parseArguments(SparkSubmit.scala:1101) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:72) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1132) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1141) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
