spark git commit: [SPARK-9294][SQL] cleanup comments, code style, naming typo for the new aggregation

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master d4d762f27 -> 408e64b28 [SPARK-9294][SQL] cleanup comments, code style, naming typo for the new aggregation fix some comments and code style for https://github.com/apache/spark/pull/7458 Author: Wenchen Fan Closes #7619 from cloud-fan/ag

spark git commit: [SPARK-8092] [ML] Allow OneVsRest Classifier feature and label column names to be configurable.

2015-07-23 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master d249636e5 -> d4d762f27 [SPARK-8092] [ML] Allow OneVsRest Classifier feature and label column names to be configurable. The base classifier input and output columns are ignored in favor of the ones specified in OneVsRest. Author: Ram Sri

spark git commit: [SPARK-9216] [STREAMING] Define KinesisBackedBlockRDDs

2015-07-23 Thread tdas
Repository: spark Updated Branches: refs/heads/master 52de3acca -> d249636e5 [SPARK-9216] [STREAMING] Define KinesisBackedBlockRDDs For more information see master JIRA: https://issues.apache.org/jira/browse/SPARK-9215 Design Doc: https://docs.google.com/document/d/1k0dl270EnK7uExrsCE7jYw7PY

spark git commit: [SPARK-9122] [MLLIB] [PySpark] spark.mllib regression support batch predict

2015-07-23 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 8a94eb23d -> 52de3acca [SPARK-9122] [MLLIB] [PySpark] spark.mllib regression support batch predict spark.mllib support batch predict for LinearRegressionModel, RidgeRegressionModel and LassoModel. Author: Yanbo Liang Closes #7614 from y

[1/2] spark git commit: [SPARK-9069] [SPARK-9264] [SQL] remove unlimited precision support for DecimalType

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master bebe3f7b4 -> 8a94eb23d http://git-wip-us.apache.org/repos/asf/spark/blob/8a94eb23/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/UnsafeFixedWidthAggregationMapSuite.scala ---

[2/2] spark git commit: [SPARK-9069] [SPARK-9264] [SQL] remove unlimited precision support for DecimalType

2015-07-23 Thread rxin
[SPARK-9069] [SPARK-9264] [SQL] remove unlimited precision support for DecimalType Romove Decimal.Unlimited (change to support precision up to 38, to match with Hive and other databases). In order to keep backward source compatibility, Decimal.Unlimited is still there, but change to Decimal(38

spark git commit: [SPARK-9207] [SQL] Enables Parquet filter push-down by default

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master b2f3aca1e -> bebe3f7b4 [SPARK-9207] [SQL] Enables Parquet filter push-down by default PARQUET-136 and PARQUET-173 have been fixed in parquet-mr 1.7.0. It's time to enable filter push-down by default now. Author: Cheng Lian Closes #7612

spark git commit: [SPARK-9286] [SQL] Methods in Unevaluable should be final and AlgebraicAggregate should extend Unevaluable.

2015-07-23 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 662d60db3 -> b2f3aca1e [SPARK-9286] [SQL] Methods in Unevaluable should be final and AlgebraicAggregate should extend Unevaluable. This patch marks the Unevaluable.eval() and UnevaluablegenCode() methods as final and fixes two cases where

spark git commit: [SPARK-5447][SQL] Replace reference 'schema rdd' with DataFrame @rxin.

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master ecfb31276 -> 662d60db3 [SPARK-5447][SQL] Replace reference 'schema rdd' with DataFrame @rxin. Author: David Arroyo Cazorla Closes #7618 from darroyocazorla/master and squashes the following commits: 5f91379 [David Arroyo Cazorla] [SPARK-

spark git commit: [SPARK-9243] [Documentation] null -> zero in crosstab doc

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master d2666a3c7 -> ecfb31276 [SPARK-9243] [Documentation] null -> zero in crosstab doc We forgot to update doc. brkyvz Author: Xiangrui Meng Closes #7608 from mengxr/SPARK-9243 and squashes the following commits: 0ea3236 [Xiangrui Meng] null

spark git commit: [SPARK-9183] confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 19aeab57c -> d2666a3c7 [SPARK-9183] confusing error message when looking up missing function in Spark SQL JIRA: https://issues.apache.org/jira/browse/SPARK-9183 cc rxin Author: Yijie Shen Closes #7613 from yjshen/npe_udf and squashes t

spark git commit: [Build][Minor] Fix building error & performance

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master 52ef76de2 -> 19aeab57c [Build][Minor] Fix building error & performance 1. When build the latest code with sbt, it throws exception like: [error] /home/hcheng/git/catalyst/core/src/main/scala/org/apache/spark/ui/jobs/AllJobsPage.scala:78:

spark git commit: [SPARK-9082] [SQL] [FOLLOW-UP] use `partition` in `PushPredicateThroughProject`

2015-07-23 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 26ed22aec -> 52ef76de2 [SPARK-9082] [SQL] [FOLLOW-UP] use `partition` in `PushPredicateThroughProject` a follow up of https://github.com/apache/spark/pull/7446 Author: Wenchen Fan Closes #7607 from cloud-fan/tmp and squashes the followin

spark git commit: [SPARK-9212] [CORE] upgrade Netty version to 4.0.29.Final

2015-07-23 Thread srowen
Repository: spark Updated Branches: refs/heads/master fb36397b3 -> 26ed22aec [SPARK-9212] [CORE] upgrade Netty version to 4.0.29.Final related JIRA: [SPARK-9212](https://issues.apache.org/jira/browse/SPARK-9212) and [SPARK-8101](https://issues.apache.org/jira/browse/SPARK-8101) Author: Zhang

spark git commit: Revert "[SPARK-8579] [SQL] support arbitrary object in UnsafeRow"

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master ac3ae0f2b -> fb36397b3 Revert "[SPARK-8579] [SQL] support arbitrary object in UnsafeRow" Reverts ObjectPool. As it stands, it has a few problems: 1. ObjectPool doesn't work with spilling and memory accounting. 2. I don't think in the long

spark git commit: [SPARK-9266] Prevent "managed memory leak detected" exception from masking original exception

2015-07-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master b983d493b -> ac3ae0f2b [SPARK-9266] Prevent "managed memory leak detected" exception from masking original exception When a task fails with an exception and also fails to properly clean up its managed memory, the `spark.unsafe.exceptionOn