Github user pferrel commented on the issue:
https://github.com/apache/incubator-predictionio/pull/328
@dszeto asked: "Do you currently have any production deployments that rely
heavily on engine IDs and versions? That would be a bigger immediate concern
regarding this change."
Yes. That is why so many questions above. We create a pio driver machine
that runs training and is then taken down. This is in sync with bringing up
Spark and taking it down. The pio driver machine is really part of the cluster
and for the UR (and other PIO templates we have) the predict part runs without
Spark. So this requires we use some engine instance id across machines to find
data in the metastore. We also have deployments with 2 EventServers and 2
PredictionServers behind a load balancer. This requires that the same metadata
is available to several different machines running, what I've come to see as 3
independent processes, ES, PS, train. They are independent except for the
metadata.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
