GitHub user Kontinuation added a comment to the discussion: RS_MapAlgebra for 
raster processing

> @Kontinuation looks like Spark 3.X still uses Janino 3.0.16 so Jiffle won't 
> work on Spark 3.3 at all: #1966
> 
> I wonder how our current jiffle tests passed on Spark 3.3 since the Janino 
> versions are incompatible.

It only happens when using Janino 3.0.16 and Spark ExecutorClassLoader at the 
same time. This only happens when running Apache Spark 3.3.x in scala repl mode 
(when running spark-shell for example). Running in pyspark mode or running JVM 
tests in scalatest won't trigger this problem.

Databricks runtime runs notebooks in scala repl mode, so we observed this 
problem on Databricks runtime. We can also reproduce this in Spark 3.3.x by 
running RS_MapAlgebra in spark-shell.

GitHub link: 
https://github.com/apache/sedona/discussions/1945#discussioncomment-13340525

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to