[
https://issues.apache.org/jira/browse/PIG-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15907384#comment-15907384
]
Adam Szita commented on PIG-5177:
---------------------------------
[~kellyzly] We can do that as well. I've uploaded [^PIG-5177.3.patch] which
uses a different approach. It uses JarManager to create a jar file and put the
script files into it, just like MR and Tez. This enables us on the backend to
use the classloader to retrieve these scripts.
I guess this is a better solution and it requires less code change.
> Scripting and StreamingPythonUDFs fail with Spark exec type
> -----------------------------------------------------------
>
> Key: PIG-5177
> URL: https://issues.apache.org/jira/browse/PIG-5177
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Adam Szita
> Assignee: Adam Szita
> Fix For: spark-branch
>
> Attachments: PIG-5177.0.patch, PIG-5177.1.patch, PIG-5177.2.patch,
> PIG-5177.3.patch
>
>
> We are thrown an exception because the Python script file is not found on the
> backend side (on spark executors).
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
