Repository: spark Updated Branches: refs/heads/branch-1.1 460fad817 -> 5ef828273
[SPARK-2797] [SQL] SchemaRDDs don't support unpersist() The cause is explained in https://issues.apache.org/jira/browse/SPARK-2797. Author: Yin Huai <[email protected]> Closes #1745 from yhuai/SPARK-2797 and squashes the following commits: 7b1627d [Yin Huai] The unpersist method of the Scala RDD cannot be called without the input parameter (blocking) from PySpark. (cherry picked from commit d210022e96804e59e42ab902e53637e50884a9ab) Signed-off-by: Michael Armbrust <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5ef82827 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/5ef82827 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/5ef82827 Branch: refs/heads/branch-1.1 Commit: 5ef828273deb4713a49700c56d51bdd980917cfd Parents: 460fad8 Author: Yin Huai <[email protected]> Authored: Sat Aug 2 17:55:22 2014 -0700 Committer: Michael Armbrust <[email protected]> Committed: Sat Aug 2 17:55:32 2014 -0700 ---------------------------------------------------------------------- python/pyspark/sql.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/5ef82827/python/pyspark/sql.py ---------------------------------------------------------------------- diff --git a/python/pyspark/sql.py b/python/pyspark/sql.py index e7c35ac..36e50e4 100644 --- a/python/pyspark/sql.py +++ b/python/pyspark/sql.py @@ -1589,9 +1589,9 @@ class SchemaRDD(RDD): self._jschema_rdd.persist(javaStorageLevel) return self - def unpersist(self): + def unpersist(self, blocking=True): self.is_cached = False - self._jschema_rdd.unpersist() + self._jschema_rdd.unpersist(blocking) return self def checkpoint(self): --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
