[
https://issues.apache.org/jira/browse/PIG-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929440#comment-15929440
]
Jeff Zhang edited comment on PIG-5189 at 3/17/17 5:32 AM:
----------------------------------------------------------
I mean pig should be able to set any property that is supported by spark.
SPARK_JAR is actually optional property for spark. It is not a mandatory
option. I don't think pig should enforce user to set that. If user want to set
spark property, either he could set it in spark-defaults.conf or pig can
support any spark configuration through set command or pig.properties.
was (Author: zjffdu):
I mean pig should be able to set any configuration that is supported by spark.
SPARK_JAR is actually optional property for spark. It is not a mandatory
option. I don't think pig should enforce user to set that. If user want to set
spark property, either he could set it in spark-defaults.conf or pig can
support any spark configuration through set command or pig.properties.
> Support spark.yarn.archive for spark branch
> -------------------------------------------
>
> Key: PIG-5189
> URL: https://issues.apache.org/jira/browse/PIG-5189
> Project: Pig
> Issue Type: Bug
> Reporter: liyunzhang_intel
>
> spark.yarn.archive is a configuration item in spark2.0 which is a similar as
> SPARK_JAR in spark1.6. The detail use we can refer SPARK-13955. After we
> upgrade to spark2.0, we can use this configuration item.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
