Repository: spark Updated Branches: refs/heads/master 866cf1f82 -> d210022e9
[SPARK-2797] [SQL] SchemaRDDs don't support unpersist() The cause is explained in https://issues.apache.org/jira/browse/SPARK-2797. Author: Yin Huai <[email protected]> Closes #1745 from yhuai/SPARK-2797 and squashes the following commits: 7b1627d [Yin Huai] The unpersist method of the Scala RDD cannot be called without the input parameter (blocking) from PySpark. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d210022e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d210022e Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d210022e Branch: refs/heads/master Commit: d210022e96804e59e42ab902e53637e50884a9ab Parents: 866cf1f Author: Yin Huai <[email protected]> Authored: Sat Aug 2 17:55:22 2014 -0700 Committer: Michael Armbrust <[email protected]> Committed: Sat Aug 2 17:55:22 2014 -0700 ---------------------------------------------------------------------- python/pyspark/sql.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/d210022e/python/pyspark/sql.py ---------------------------------------------------------------------- diff --git a/python/pyspark/sql.py b/python/pyspark/sql.py index e7c35ac..36e50e4 100644 --- a/python/pyspark/sql.py +++ b/python/pyspark/sql.py @@ -1589,9 +1589,9 @@ class SchemaRDD(RDD): self._jschema_rdd.persist(javaStorageLevel) return self - def unpersist(self): + def unpersist(self, blocking=True): self.is_cached = False - self._jschema_rdd.unpersist() + self._jschema_rdd.unpersist(blocking) return self def checkpoint(self): --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
