RussellSpitzer commented on issue #15870:
URL: https://github.com/apache/iceberg/issues/15870#issuecomment-4178723431
You have a few issues
Root cause - The Extensions aren't being loaded
There are a few things I see that could be the cause
1. I don't see any evidence of how you are actually putting these jars on
the classpath.
This is usually done with spark packages or spark jars, (this may be the
most important issue)
2. You should only be including the iceberg-spark-runtime jar
Don't include other Iceberg jars. Those are just gonna cause classpath
issues with shading
3. You should be using only one version of Scala amongst your dependencies
Some are using 2.12 some are on 2.13. Use the version of the Spark
environment. Once you have the classpath right this should break until you
match versions.
4. You are using a very old version of Iceberg (1.5) we are currently on 1.10
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
