spark git commit: [SPARK-9371][SQL] fix the support for special chars in column names for hive context

2015-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master aa80c64fc -> 4ffd3a1db [SPARK-9371][SQL] fix the support for special chars in column names for hive context Author: Wenchen Fan Closes #7684 from cloud-fan/hive and squashes the following commits: da21ffe [Wenchen Fan] fix the support f

spark git commit: [SPARK-9368][SQL] Support get(ordinal, dataType) generic getter in UnsafeRow.

2015-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 945d8bcbf -> aa80c64fc [SPARK-9368][SQL] Support get(ordinal, dataType) generic getter in UnsafeRow. Author: Reynold Xin Closes #7682 from rxin/unsaferow-generic-getter and squashes the following commits: 3063788 [Reynold Xin] Reset the

spark git commit: [SPARK-9352] [SPARK-9353] [HOTFIX] Reverts PR #7668 on branch-1.4

2015-07-26 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.4 5aed92613 -> 2b1973dd2 [SPARK-9352] [SPARK-9353] [HOTFIX] Reverts PR #7668 on branch-1.4 `MasterSuite.makeMaster()` doesn't compile under 1.4. `Master` is still an actor in branch-1.4, and can only be created via `ActorSystem.actorOf`,

spark git commit: [SPARK-9306] [SQL] Don't use SortMergeJoin when joining on unsortable columns

2015-07-26 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 1efe97dc9 -> 945d8bcbf [SPARK-9306] [SQL] Don't use SortMergeJoin when joining on unsortable columns JIRA: https://issues.apache.org/jira/browse/SPARK-9306 Author: Liang-Chi Hsieh Closes #7645 from viirya/smj_unsortable and squashes the

spark git commit: [HOTFIX] Fix compile in MasterSuite

2015-07-26 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 d0ef42c4e -> 5aed92613 [HOTFIX] Fix compile in MasterSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5aed9261 Tree: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: [SPARK-8867][SQL] Support list / describe function usage

2015-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master c025c3d0a -> 1efe97dc9 [SPARK-8867][SQL] Support list / describe function usage As Hive does, we need to list all of the registered UDF and its usage for user. We add the annotation to describe a UDF, so we can get the literal description

[2/3] spark git commit: [SPARK-9095] [SQL] Removes the old Parquet support

2015-07-26 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark/blob/c025c3d0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.scala -- diff --git a/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableSupport.sca

[1/3] spark git commit: [SPARK-9095] [SQL] Removes the old Parquet support

2015-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6b2baec04 -> c025c3d0a http://git-wip-us.apache.org/repos/asf/spark/blob/c025c3d0/sql/hive/src/test/scala/org/apache/spark/sql/hive/parquetSuites.scala -- diff --git a/sql/

[3/3] spark git commit: [SPARK-9095] [SQL] Removes the old Parquet support

2015-07-26 Thread rxin
[SPARK-9095] [SQL] Removes the old Parquet support This PR removes the old Parquet support: - Removes the old `ParquetRelation` together with related SQL configuration, plan nodes, strategies, utility classes, and test suites. - Renames `ParquetRelation2` to `ParquetRelation` - Renames `RowRea

spark git commit: [SPARK-9326] Close lock file used for file downloads.

2015-07-26 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.4 a4b80e6db -> d0ef42c4e [SPARK-9326] Close lock file used for file downloads. A lock file is used to ensure multiple executors running on the same machine don't download the same file concurrently. Spark never closes these lock files (re

spark git commit: [SPARK-9326] Close lock file used for file downloads.

2015-07-26 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 1cf19760d -> 6b2baec04 [SPARK-9326] Close lock file used for file downloads. A lock file is used to ensure multiple executors running on the same machine don't download the same file concurrently. Spark never closes these lock files (releas

spark git commit: [SPARK-9352] [SPARK-9353] Add tests for standalone scheduling code

2015-07-26 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 a37796be7 -> a4b80e6db [SPARK-9352] [SPARK-9353] Add tests for standalone scheduling code This also fixes a small issue in the standalone Master that was uncovered by the new tests. For more detail, read the description of SPARK-9353.

spark git commit: [SPARK-9352] [SPARK-9353] Add tests for standalone scheduling code

2015-07-26 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master fb5d43fb2 -> 1cf19760d [SPARK-9352] [SPARK-9353] Add tests for standalone scheduling code This also fixes a small issue in the standalone Master that was uncovered by the new tests. For more detail, read the description of SPARK-9353. Aut

svn commit: r1692749 - in /spark: site/sql/index.html sql/index.md

2015-07-26 Thread matei
Author: matei Date: Sun Jul 26 19:11:45 2015 New Revision: 1692749 URL: http://svn.apache.org/r1692749 Log: Fix Python Modified: spark/site/sql/index.html spark/sql/index.md Modified: spark/site/sql/index.html URL: http://svn.apache.org/viewvc/spark/site/sql/index.html?rev=1692749&r1=16

svn commit: r1692748 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

2015-07-26 Thread matei
Author: matei Date: Sun Jul 26 19:10:57 2015 New Revision: 1692748 URL: http://svn.apache.org/r1692748 Log: Further improvements to site Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.h

spark git commit: [SPARK-9356][SQL]Remove the internal use of DecimalType.Unlimited

2015-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master 6c400b4f3 -> fb5d43fb2 [SPARK-9356][SQL]Remove the internal use of DecimalType.Unlimited JIRA: https://issues.apache.org/jira/browse/SPARK-9356 Author: Yijie Shen Closes #7671 from yjshen/deprecated_unlimit and squashes the following com

spark git commit: [SPARK-9354][SQL] Remove InternalRow.get generic getter call in Hive integration code.

2015-07-26 Thread rxin
Repository: spark Updated Branches: refs/heads/master b79bf1df6 -> 6c400b4f3 [SPARK-9354][SQL] Remove InternalRow.get generic getter call in Hive integration code. Replaced them with get(ordinal, datatype) so we can use UnsafeRow here. I passed the data types throughout. Author: Reynold Xin

spark git commit: [SPARK-9337] [MLLIB] Add an ut for Word2Vec to verify the empty vocabulary check

2015-07-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4a01bfc2a -> b79bf1df6 [SPARK-9337] [MLLIB] Add an ut for Word2Vec to verify the empty vocabulary check jira: https://issues.apache.org/jira/browse/SPARK-9337 Word2Vec should throw exception when vocabulary is empty Author: Yuhao Yang C