chovy-3012 opened a new issue #6957:
URL: https://github.com/apache/incubator-doris/issues/6957


   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Version
   
   master
   
   ### What's Wrong?
   
   I build the spark connector using master branch , and spark-submit a example 
app.
   
   It run failed , following is error message:
   
   ```shell
   java.lang.ExceptionInInitializerError
        at org.apache.spark.rdd.RDD.withScope(RDD.scala:363)
        at org.apache.spark.rdd.RDD.map(RDD.scala:370)
        at 
org.apache.doris.spark.sql.TestSparkReaderConnector.rddTest(TestSparkReaderConnector.scala:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
        at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
        at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
        at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
        at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
        at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
        at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
        at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
        at org.junit.runner.JUnitCore.run(JUnitCore.java:160)
        at 
com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:69)
        at 
com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33)
        at 
com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:220)
        at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:53)
   Caused by: com.fasterxml.jackson.databind.JsonMappingException: Incompatible 
Jackson version: 2.10.0
        at 
com.fasterxml.jackson.module.scala.JacksonModule$class.setupModule(JacksonModule.scala:64)
        at 
com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:19)
        at 
com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:808)
        at 
org.apache.spark.rdd.RDDOperationScope$.<init>(RDDOperationScope.scala:82)
        at 
org.apache.spark.rdd.RDDOperationScope$.<clinit>(RDDOperationScope.scala)
        ... 25 more
   ```
   
   my cluster info:
   spark version:2.3.4  (same as dependence)
   
   
   I  checked the error message and found that the version of 
```jackson-databind``` used by ```jackson-module-scala``` in  ```spark2.3.4``` 
is ```2.6.7.1``` , while the version of ```spark connector``` dependence is 
```2.10.0``` . 
   So  the ```jackson-module-scala``` throw a incompatible version error.
   
   
   
   ### What You Expected?
   
   I think it's unnecessary to add these three 
dependencies(```jackson-bind/jackson-core/netty-all```) , ```spark``` contains 
all these dependencies.
   
   So I want to remove these three 
dependencies(```jackson-bind/jackson-core/netty-all```)
   
   ### How to Reproduce?
   
   build spark connector and spark-submit a app.
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to