[
https://issues.apache.org/jira/browse/PIO-116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156537#comment-16156537
]
ASF GitHub Bot commented on PIO-116:
------------------------------------
Github user dszeto commented on the issue:
https://github.com/apache/incubator-predictionio/pull/427
@marevol Looks like Python 3 is also a hard requirement? This does not work
when I run `pyspark` with Python 2.
> PySpark Support
> ---------------
>
> Key: PIO-116
> URL: https://issues.apache.org/jira/browse/PIO-116
> Project: PredictionIO
> Issue Type: New Feature
> Components: Core
> Reporter: Shinsuke Sugaya
> Assignee: Shinsuke Sugaya
>
> This provides PySpark support with minimum PIO changes.
> 1. Support pyspark on pio-shell
> 2. Add python files to use pyspark
> 3. Add --main-py-file option to "pio train" to submit .py file to spark
> Note that this provides only fixes for Spark 2.x.
> (because this fixes expect to use SparkML)
> Sample project is:
> https://github.com/jpioug/predictionio-template-iris
> (For prediction API, Scala code is used.)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
