Marcin Ziemiński created PIO-36:
-----------------------------------

             Summary: Use Spark standalone cluster in integration tests
                 Key: PIO-36
                 URL: https://issues.apache.org/jira/browse/PIO-36
             Project: PredictionIO
          Issue Type: Bug
            Reporter: Marcin Ziemiński
            Priority: Minor


Although Spark master and worker are executed inside the docker image that run 
integration tests, no tests actually make use of them. Only a default local 
spark implementation is used. Setting a --master to a living cluster would 
resemble a real world cases better and also be more reliable.

The python framework has to be updated to fix this issue, which should be just 
a matter of adding a few lines. We can make it an option in the tests to set up 
the master.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to