svn commit: r27693 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_23_20_01-a5849ad-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-23 Thread pwendell
Author: pwendell Date: Sun Jun 24 03:16:36 2018 New Revision: 27693 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_23_20_01-a5849ad docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24324][PYTHON] Pandas Grouped Map UDF should assign result columns by name

2018-06-23 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 98f363b77 -> a5849ad9a [SPARK-24324][PYTHON] Pandas Grouped Map UDF should assign result columns by name ## What changes were proposed in this pull request? Currently, a `pandas_udf` of type `PandasUDFType.GROUPED_MAP` will assign the re

spark git commit: [SPARK-24206][SQL] Improve FilterPushdownBenchmark benchmark code

2018-06-23 Thread lixiao
Repository: spark Updated Branches: refs/heads/master c7e2742f9 -> 98f363b77 [SPARK-24206][SQL] Improve FilterPushdownBenchmark benchmark code ## What changes were proposed in this pull request? This pr added benchmark code `FilterPushdownBenchmark` for string pushdown and updated performance

spark git commit: [SPARK-24190][SQL] Allow saving of JSON files in UTF-16 and UTF-32

2018-06-23 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 4e7d8678a -> c7e2742f9 [SPARK-24190][SQL] Allow saving of JSON files in UTF-16 and UTF-32 ## What changes were proposed in this pull request? Currently, restrictions in JSONOptions for `encoding` and `lineSep` are the same for read and fo