spark git commit: [SPARK-24574][SQL] array_contains, array_position, array_remove and element_at functions deal with Column type

2018-06-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 54fcaafb0 -> 7236e759c [SPARK-24574][SQL] array_contains, array_position, array_remove and element_at functions deal with Column type ## What changes were proposed in this pull request? For the function ```def array_contains(column: Colum

spark git commit: [SPARK-24571][SQL] Support Char literals

2018-06-20 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 9de11d3f9 -> 54fcaafb0 [SPARK-24571][SQL] Support Char literals ## What changes were proposed in this pull request? In the PR, I propose to automatically convert a `Literal` with `Char` type to a `Literal` of `String` type. Currently, the

spark git commit: [SPARK-23912][SQL] add array_distinct

2018-06-20 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 15747cfd3 -> 9de11d3f9 [SPARK-23912][SQL] add array_distinct ## What changes were proposed in this pull request? Add array_distinct to remove duplicate value from the array. ## How was this patch tested? Add unit tests Author: Huaxin Ga

svn commit: r27610 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_20_20_01-15747cf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-20 Thread pwendell
Author: pwendell Date: Thu Jun 21 03:15:55 2018 New Revision: 27610 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_20_20_01-15747cf docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r27609 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_20_18_03-8928de3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-20 Thread pwendell
Author: pwendell Date: Thu Jun 21 01:17:24 2018 New Revision: 27609 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_20_18_03-8928de3 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24547][K8S] Allow for building spark on k8s docker images without cache and don't forget to push spark-py container.

2018-06-20 Thread foxish
Repository: spark Updated Branches: refs/heads/master 3f4bda728 -> 15747cfd3 [SPARK-24547][K8S] Allow for building spark on k8s docker images without cache and don't forget to push spark-py container. ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/S

svn commit: r27606 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_20_16_01-3f4bda7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-20 Thread pwendell
Author: pwendell Date: Wed Jun 20 23:15:27 2018 New Revision: 27606 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_20_16_01-3f4bda7 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24578][CORE] Cap sub-region's size of returned nio buffer

2018-06-20 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.3 d687d97b1 -> 8928de3cd [SPARK-24578][CORE] Cap sub-region's size of returned nio buffer ## What changes were proposed in this pull request? This PR tries to fix the performance regression introduced by SPARK-21517. In our production jo

spark git commit: [SPARK-24578][CORE] Cap sub-region's size of returned nio buffer

2018-06-20 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master c5a0d1132 -> 3f4bda728 [SPARK-24578][CORE] Cap sub-region's size of returned nio buffer ## What changes were proposed in this pull request? This PR tries to fix the performance regression introduced by SPARK-21517. In our production job, w

svn commit: r27593 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_20_12_01-c5a0d11-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-20 Thread pwendell
Author: pwendell Date: Wed Jun 20 19:16:36 2018 New Revision: 27593 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_20_12_01-c5a0d11 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24575][SQL] Prohibit window expressions inside WHERE and HAVING clauses

2018-06-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master c8ef9232c -> c5a0d1132 [SPARK-24575][SQL] Prohibit window expressions inside WHERE and HAVING clauses ## What changes were proposed in this pull request? As discussed [before](https://github.com/apache/spark/pull/19193#issuecomment-393726

spark git commit: [MINOR][SQL] Remove invalid comment from SparkStrategies

2018-06-20 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master bc111463a -> c8ef9232c [MINOR][SQL] Remove invalid comment from SparkStrategies ## What changes were proposed in this pull request? This patch is removing invalid comment from SparkStrategies, given that TODO-like comment is no longer pre

svn commit: r27577 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_20_00_01-bc11146-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-20 Thread pwendell
Author: pwendell Date: Wed Jun 20 07:17:51 2018 New Revision: 27577 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_20_00_01-bc11146 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---