spark git commit: [SPARK-20922][CORE][HOTFIX] Don't use Java 8 lambdas in older branches.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 772a9b969 -> 0b25a7d93 [SPARK-20922][CORE][HOTFIX] Don't use Java 8 lambdas in older branches. Author: Marcelo Vanzin Closes #18178 from vanzin/SPARK-20922-hotfix. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: h

spark git commit: [SPARK-20922][CORE][HOTFIX] Don't use Java 8 lambdas in older branches.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 f7cbf90a7 -> 9952b53b5 [SPARK-20922][CORE][HOTFIX] Don't use Java 8 lambdas in older branches. Author: Marcelo Vanzin Closes #18178 from vanzin/SPARK-20922-hotfix. (cherry picked from commit 0b25a7d93359e348e11b2e8698990a53436b3c5d)

spark git commit: [SPARK-20854][SQL] Extend hint syntax to support expressions

2017-06-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 4cba3b5a3 -> bb3d900b4 [SPARK-20854][SQL] Extend hint syntax to support expressions SQL hint syntax: * support expressions such as strings, numbers, etc. instead of only identifiers as it is currently. * support multiple hints, which w

spark git commit: [SPARK-20854][SQL] Extend hint syntax to support expressions

2017-06-01 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 8efc6e986 -> 2134196a9 [SPARK-20854][SQL] Extend hint syntax to support expressions ## What changes were proposed in this pull request? SQL hint syntax: * support expressions such as strings, numbers, etc. instead of only identifiers as i

spark git commit: [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 cd870c0c9 -> f7cbf90a7 [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher. Blindly deserializing classes using Java serialization opens the code up to issues in other libraries, since just deserializi

spark git commit: [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 dade85f7f -> 772a9b969 [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher. Blindly deserializing classes using Java serialization opens the code up to issues in other libraries, since just deserializi

spark git commit: [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 b81a702f4 -> 4cba3b5a3 [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher. Blindly deserializing classes using Java serialization opens the code up to issues in other libraries, since just deserializi

spark git commit: [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 640afa49a -> 8efc6e986 [SPARK-20922][CORE] Add whitelist of classes that can be deserialized by the launcher. Blindly deserializing classes using Java serialization opens the code up to issues in other libraries, since just deserializing d

spark git commit: [SPARK-20365][YARN] Remove local scheme when add path to ClassPath.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.2 6a4e023b2 -> b81a702f4 [SPARK-20365][YARN] Remove local scheme when add path to ClassPath. In Spark on YARN, when configuring "spark.yarn.jars" with local jars (jars started with "local" scheme), we will get inaccurate classpath for AM

spark git commit: [SPARK-20365][YARN] Remove local scheme when add path to ClassPath.

2017-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/master f7cf2096f -> 640afa49a [SPARK-20365][YARN] Remove local scheme when add path to ClassPath. In Spark on YARN, when configuring "spark.yarn.jars" with local jars (jars started with "local" scheme), we will get inaccurate classpath for AM and

spark git commit: [SPARK-20941][SQL] Fix SubqueryExec Reuse

2017-06-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 4ab7b820b -> 6a4e023b2 [SPARK-20941][SQL] Fix SubqueryExec Reuse Before this PR, Subquery reuse does not work. Below are three issues: - Subquery reuse does not work. - It is sharing the same `SQLConf` (`spark.sql.exchange.reuse`) with

spark git commit: [SPARK-20941][SQL] Fix SubqueryExec Reuse

2017-06-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0975019cd -> f7cf2096f [SPARK-20941][SQL] Fix SubqueryExec Reuse ### What changes were proposed in this pull request? Before this PR, Subquery reuse does not work. Below are three issues: - Subquery reuse does not work. - It is sharing the

spark git commit: [SPARK-20109][MLLIB] Rewrote toBlockMatrix method on IndexedRowMatrix

2017-06-01 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6d05c1c1d -> 0975019cd [SPARK-20109][MLLIB] Rewrote toBlockMatrix method on IndexedRowMatrix ## What changes were proposed in this pull request? - ~~I added the method `toBlockMatrixDense` to the IndexedRowMatrix class. The current implem

spark git commit: [SPARK-20910][SQL] Add build-in SQL function - UUID

2017-06-01 Thread ueshin
Repository: spark Updated Branches: refs/heads/master c8045f8b4 -> 6d05c1c1d [SPARK-20910][SQL] Add build-in SQL function - UUID ## What changes were proposed in this pull request? Add build-int SQL function - UUID. ## How was this patch tested? unit tests Author: Yuming Wang Closes #181