Shinsuke Sugaya created PIO-116:
-----------------------------------
Summary: PySpark Support
Key: PIO-116
URL: https://issues.apache.org/jira/browse/PIO-116
Project: PredictionIO
Issue Type: New Feature
Components: Core
Reporter: Shinsuke Sugaya
Assignee: Shinsuke Sugaya
This provides PySpark support with minimum PIO changes.
1. Support pyspark on pio-shell
2. Add python files to use pyspark
3. Add --main-py-file option to "pio train" to submit .py file to spark
Note that this provides only fixes for Spark 2.x.
(because this fixes expect to use SparkML)
Sample project is:
https://github.com/jpioug/predictionio-template-iris
(For prediction API, Scala code is used.)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
