[
https://issues.apache.org/jira/browse/TOREE-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ricardo Gaspar updated TOREE-535:
---------------------------------
Description:
*Currently in v 0.5.0* there's no way to configure spark properties before
spark initialization.
Especially adding jars to spark driver and executors and then import the
functions. `%Addjar` doesn't do that.
Whereas with *spylon-kernel* one can invoke `%init_spark` to load the jars and
it works fine when importing in other cells. e.g.
{code:java}
%%init_spark
launcher.jars = ["/home/rgaspar/myjar-1.5.1.jar"]{code}
was:
*Currently* there's no way to configure spark properties, especially adding
jars to spark driver and executors and then import the functions. `%Addjar`
doesn't do that Whereas with spylon one can invoke `%init_spark` to load the
jars and it works fine when importing in other cells. e.g.
{code:java}
%%init_spark
launcher.jars = ["/home/rgaspar/myjar-1.5.1.jar"]{code}
> Spark init configurations (jars to driver and executors)
> --------------------------------------------------------
>
> Key: TOREE-535
> URL: https://issues.apache.org/jira/browse/TOREE-535
> Project: TOREE
> Issue Type: Improvement
> Reporter: Ricardo Gaspar
> Priority: Trivial
> Fix For: 0.5.0
>
>
> *Currently in v 0.5.0* there's no way to configure spark properties before
> spark initialization.
> Especially adding jars to spark driver and executors and then import the
> functions. `%Addjar` doesn't do that.
> Whereas with *spylon-kernel* one can invoke `%init_spark` to load the jars
> and it works fine when importing in other cells. e.g.
> {code:java}
> %%init_spark
> launcher.jars = ["/home/rgaspar/myjar-1.5.1.jar"]{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
