svn commit: r27639 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_21_18_01-a1e9640-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Fri Jun 22 01:15:20 2018 New Revision: 27639 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_21_18_01-a1e9640 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r27638 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_21_16_01-dc8a6be-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Thu Jun 21 23:15:30 2018 New Revision: 27638 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_21_16_01-dc8a6be docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24588][SS] streaming join should require HashClusteredPartitioning from children

2018-06-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 3a4b6f3be -> a1e964007 [SPARK-24588][SS] streaming join should require HashClusteredPartitioning from children ## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/19080 we simplified the distri

spark git commit: [SPARK-24588][SS] streaming join should require HashClusteredPartitioning from children

2018-06-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b9a6f7499 -> dc8a6befa [SPARK-24588][SS] streaming join should require HashClusteredPartitioning from children ## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/19080 we simplified the distributi

svn commit: r27637 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_21_14_01-3a4b6f3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Thu Jun 21 21:15:21 2018 New Revision: 27637 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_21_14_01-3a4b6f3 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r27631 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_21_12_02-b9a6f74-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Thu Jun 21 19:18:12 2018 New Revision: 27631 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_21_12_02-b9a6f74 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24589][CORE] Correctly identify tasks in output commit coordinator.

2018-06-21 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.2 7bfefc928 -> 751b00820 [SPARK-24589][CORE] Correctly identify tasks in output commit coordinator. When an output stage is retried, it's possible that tasks from the previous attempt are still running. In that case, there would be a new

spark git commit: [SPARK-24589][CORE] Correctly identify tasks in output commit coordinator.

2018-06-21 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.3 8928de3cd -> 3a4b6f3be [SPARK-24589][CORE] Correctly identify tasks in output commit coordinator. When an output stage is retried, it's possible that tasks from the previous attempt are still running. In that case, there would be a new

spark git commit: [SPARK-24613][SQL] Cache with UDF could not be matched with subsequent dependent caches

2018-06-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master c8e909cd4 -> b9a6f7499 [SPARK-24613][SQL] Cache with UDF could not be matched with subsequent dependent caches ## What changes were proposed in this pull request? Wrap the logical plan with a `AnalysisBarrier` for execution plan compilati

spark git commit: [SPARK-24589][CORE] Correctly identify tasks in output commit coordinator.

2018-06-21 Thread tgraves
Repository: spark Updated Branches: refs/heads/master b56e9c613 -> c8e909cd4 [SPARK-24589][CORE] Correctly identify tasks in output commit coordinator. When an output stage is retried, it's possible that tasks from the previous attempt are still running. In that case, there would be a new task

svn commit: r27625 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_21_08_02-b56e9c6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Thu Jun 21 15:19:05 2018 New Revision: 27625 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_21_08_02-b56e9c6 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-16630][YARN] Blacklist a node if executors won't launch on it

2018-06-21 Thread irashid
Repository: spark Updated Branches: refs/heads/master c0cad596b -> b56e9c613 [SPARK-16630][YARN] Blacklist a node if executors won't launch on it ## What changes were proposed in this pull request? This change extends YARN resource allocation handling with blacklisting functionality. This ha

svn commit: r27622 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_21_04_02-c0cad59-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Thu Jun 21 11:17:40 2018 New Revision: 27622 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_21_04_02-c0cad59 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24614][PYSPARK] Fix for SyntaxWarning on tests.py

2018-06-21 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 7236e759c -> c0cad596b [SPARK-24614][PYSPARK] Fix for SyntaxWarning on tests.py ## What changes were proposed in this pull request? Fix for SyntaxWarning on tests.py ## How was this patch tested? ./dev/run-tests Author: Rekha Joshi Clos

svn commit: r27612 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_21_00_01-7236e75-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-21 Thread pwendell
Author: pwendell Date: Thu Jun 21 07:16:48 2018 New Revision: 27612 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_21_00_01-7236e75 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---