svn commit: r28121 - in /release/spark: spark-1.6.3/ spark-2.0.2/ spark-2.1.2/ spark-2.2.1/ spark-2.3.0/

Author: srowen Date: Sun Jul 15 06:14:36 2018 New Revision: 28121 Log: Remove non-current Spark releases 1.6.3, 2.0.2, 2.1.2, 2.2.1, 2.3.0 from dist Removed: release/spark/spark-1.6.3/ release/spark/spark-2.0.2/ release/spark/spark-2.1.2/ release/spark/spark-2.2.1/ release/spa

spark-website git commit: Point to archive site for non-current releases; remove old releases from dropdown

Repository: spark-website Updated Branches: refs/heads/asf-site 85c47b705 -> f5d7dfafe Point to archive site for non-current releases; remove old releases from dropdown Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-web

svn commit: r28120 - in /dev/spark/2.3.3-SNAPSHOT-2018_07_14_22_01-f9a2b0a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sun Jul 15 05:15:27 2018 New Revision: 28120 Log: Apache Spark 2.3.3-SNAPSHOT-2018_07_14_22_01-f9a2b0a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24807][CORE] Adding files/jars twice: output a warning and add a note

Repository: spark Updated Branches: refs/heads/master 3e7dc8296 -> 69993217f [SPARK-24807][CORE] Adding files/jars twice: output a warning and add a note ## What changes were proposed in this pull request? In the PR, I propose to output an warning if the `addFile()` or `addJar()` methods are

spark git commit: [SPARK-24776][SQL] Avro unit test: deduplicate code and replace deprecated methods

Repository: spark Updated Branches: refs/heads/master 43e4e851b -> 3e7dc8296 [SPARK-24776][SQL] Avro unit test: deduplicate code and replace deprecated methods ## What changes were proposed in this pull request? Improve Avro unit test: 1. use QueryTest/SharedSQLContext/SQLTestUtils, instead

spark git commit: [SPARK-24718][SQL] Timestamp support pushdown to parquet data source

Repository: spark Updated Branches: refs/heads/master 8aceb961c -> 43e4e851b [SPARK-24718][SQL] Timestamp support pushdown to parquet data source ## What changes were proposed in this pull request? `Timestamp` support pushdown to parquet data source. Only `TIMESTAMP_MICROS` and `TIMESTAMP_MIL

svn commit: r28118 - /dev/spark/v2.3.2-rc3-bin/

Author: jshao Date: Sun Jul 15 03:04:30 2018 New Revision: 28118 Log: Apache Spark v2.3.2-rc3 Added: dev/spark/v2.3.2-rc3-bin/ dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz (with props) dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz.asc dev/spark/v2.3.2-rc3-bin/SparkR_2.3.2.tar.gz.

[1/2] spark git commit: Preparing Spark release v2.3.2-rc3

Repository: spark Updated Branches: refs/heads/branch-2.3 9cf375f5b -> f9a2b0a87 Preparing Spark release v2.3.2-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b3726dad Tree: http://git-wip-us.apache.org/repos/asf/spar

[2/2] spark git commit: Preparing development version 2.3.3-SNAPSHOT

Preparing development version 2.3.3-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f9a2b0a8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f9a2b0a8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f9a

[spark] Git Push Summary

Repository: spark Updated Tags: refs/tags/v2.3.2-rc3 [created] b3726dadc - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r28117 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_14_16_01-8aceb96-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Jul 14 23:15:42 2018 New Revision: 28117 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_14_16_01-8aceb96 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24754][ML] Minhash integer overflow

Repository: spark Updated Branches: refs/heads/master e1de34113 -> 8aceb961c [SPARK-24754][ML] Minhash integer overflow ## What changes were proposed in this pull request? Use longs in calculating min hash to avoid bias due to int overflow. ## How was this patch tested? Existing tests. Aut

svn commit: r28112 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_14_04_02-e1de341-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Jul 14 11:17:47 2018 New Revision: 28112 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_14_04_02-e1de341 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-17091][SQL] Add rule to convert IN predicate to equivalent Parquet filter

Repository: spark Updated Branches: refs/heads/master f1a99ad58 -> e1de34113 [SPARK-17091][SQL] Add rule to convert IN predicate to equivalent Parquet filter ## What changes were proposed in this pull request? The original pr is: https://github.com/apache/spark/pull/18424 Add a new optimizer