Repository: spark
Updated Tags: refs/tags/v1.4.0-rc1 [created] 38ccef36c
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 1.4.1-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/40190ce2
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/40190ce2
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/401
Repository: spark
Updated Branches:
refs/heads/branch-1.4 152b0291c -> 40190ce22
Preparing Spark release v1.4.0-rc1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/38ccef36
Tree: http://git-wip-us.apache.org/repos/asf/spar
Revert "Preparing Spark release v1.4.0-rc1"
This reverts commit e8e97e3a630dea3c68702e26bc56f61044b2db71.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/152b0291
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/152b02
Repository: spark
Updated Branches:
refs/heads/branch-1.4 be1fc938f -> 152b0291c
Revert "Preparing development version 1.4.1-SNAPSHOT"
This reverts commit 758ca74bab7c342f94442f69476c6b9543ac1228.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org
Repository: spark
Updated Tags: refs/tags/v1.4.0-rc1 [deleted] e8e97e3a6
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.4 758ca74ba -> be1fc938f
[HOTFIX]: Java 6 Build Breaks
These were blocking RC1 so I fixed them manually.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/be1fc938
Tre
Repository: spark
Updated Branches:
refs/heads/master c9fa870a6 -> 9ebb44f8a
[HOTFIX]: Java 6 Build Breaks
These were blocking RC1 so I fixed them manually.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9ebb44f8
Tree: h
Repository: spark
Updated Branches:
refs/heads/branch-1.4 99436bd04 -> 758ca74ba
Preparing development version 1.4.1-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/758ca74b
Tree: http://git-wip-us.apache.org/repo
Preparing Spark release v1.4.0-rc1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e8e97e3a
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e8e97e3a
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e8e97e3a
Bra
Repository: spark
Updated Tags: refs/tags/v1.4.0-rc1 [created] e8e97e3a6
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.4 914ecd050 -> 99436bd04
[SPARK-7687] [SQL] DataFrame.describe() should cast all aggregates to String
In `DataFrame.describe()`, the `count` aggregate produces an integer, the `avg`
and `stdev` aggregates produce doubles, and `min` and `
Repository: spark
Updated Branches:
refs/heads/master c2437de18 -> c9fa870a6
[SPARK-7687] [SQL] DataFrame.describe() should cast all aggregates to String
In `DataFrame.describe()`, the `count` aggregate produces an integer, the `avg`
and `stdev` aggregates produce doubles, and `min` and `max`
Repository: spark
Updated Branches:
refs/heads/branch-1.4 7fcbb2cca -> 914ecd050
http://git-wip-us.apache.org/repos/asf/spark/blob/914ecd05/dev/create-release/generate-changelist.py
--
diff --git a/dev/create-release/generate-c
CHANGES.txt and changelist updaets for Spark 1.4.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/914ecd05
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/914ecd05
Diff: http://git-wip-us.apache.org/repos/asf/spark/dif
http://git-wip-us.apache.org/repos/asf/spark/blob/914ecd05/CHANGES.txt
--
diff --git a/CHANGES.txt b/CHANGES.txt
new file mode 100644
index 000..3680d94
--- /dev/null
+++ b/CHANGES.txt
@@ -0,0 +1,14606 @@
+Spark Change Log
+---
Repository: spark
Updated Branches:
refs/heads/branch-1.4 9d0b7fb71 -> 7fcbb2cca
[SPARK-7150] SparkContext.range() and SQLContext.range()
This PR is based on #6081, thanks adrian-wang.
Closes #6081
Author: Daoyuan Wang
Author: Davies Liu
Closes #6230 from davies/range and squashes the fol
Repository: spark
Updated Branches:
refs/heads/master d03638cc2 -> c2437de18
[SPARK-7150] SparkContext.range() and SQLContext.range()
This PR is based on #6081, thanks adrian-wang.
Closes #6081
Author: Daoyuan Wang
Author: Davies Liu
Closes #6230 from davies/range and squashes the followi
Repository: spark
Updated Branches:
refs/heads/branch-1.4 dd9f873be -> 9d0b7fb71
Version updates for Spark 1.4.0
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9d0b7fb7
Tree: http://git-wip-us.apache.org/repos/asf/spark/t
Repository: spark
Updated Branches:
refs/heads/branch-1.4 9c485484f -> dd9f873be
[SPARK-7681] [MLLIB] Add SparseVector support for gemv
JIRA: https://issues.apache.org/jira/browse/SPARK-7681
Author: Liang-Chi Hsieh
Closes #6209 from viirya/sparsevector_gemv and squashes the following commit
Repository: spark
Updated Branches:
refs/heads/master 3a6003866 -> d03638cc2
[SPARK-7681] [MLLIB] Add SparseVector support for gemv
JIRA: https://issues.apache.org/jira/browse/SPARK-7681
Author: Liang-Chi Hsieh
Closes #6209 from viirya/sparsevector_gemv and squashes the following commits:
Repository: spark
Updated Branches:
refs/heads/branch-1.4 9188ad8dd -> 9c485484f
[SPARK-7692] Updated Kinesis examples
- Updated Kinesis examples to use stable API
- Cleaned up comments, etc.
- Renamed KinesisWordCountProducerASL to KinesisWordProducerASL
Author: Tathagata Das
Closes #6249
Repository: spark
Updated Branches:
refs/heads/master 0a7a94eab -> 3a6003866
[SPARK-7692] Updated Kinesis examples
- Updated Kinesis examples to use stable API
- Cleaned up comments, etc.
- Renamed KinesisWordCountProducerASL to KinesisWordProducerASL
Author: Tathagata Das
Closes #6249 from
Repository: spark
Updated Branches:
refs/heads/branch-1.3 0d4cd30b8 -> fc1b4a414
[SPARK-7621] [STREAMING] Report Kafka errors to StreamingListeners
PR per [SPARK-7621](https://issues.apache.org/jira/browse/SPARK-7621), which
makes both `KafkaReceiver` and `ReliableKafkaReceiver` report its er
Repository: spark
Updated Branches:
refs/heads/branch-1.4 60cb33d12 -> 9188ad8dd
[SPARK-7621] [STREAMING] Report Kafka errors to StreamingListeners
PR per [SPARK-7621](https://issues.apache.org/jira/browse/SPARK-7621), which
makes both `KafkaReceiver` and `ReliableKafkaReceiver` report its er
Repository: spark
Updated Branches:
refs/heads/master 4fb52f954 -> 0a7a94eab
[SPARK-7621] [STREAMING] Report Kafka errors to StreamingListeners
PR per [SPARK-7621](https://issues.apache.org/jira/browse/SPARK-7621), which
makes both `KafkaReceiver` and `ReliableKafkaReceiver` report its errors
Repository: spark
Updated Branches:
refs/heads/branch-1.3 0a6310373 -> 0d4cd30b8
[SPARK-7566][SQL] Add type to HiveContext.analyzer
This makes HiveContext.analyzer overrideable.
Author: Santiago M. Mola
Closes #6177 from smola/patch-batch-1.3 and squashes the following commits:
c11a428 [Sa
Repository: spark
Updated Branches:
refs/heads/branch-1.4 f8f23c48a -> 60cb33d12
[SPARK-7624] Revert #4147
Author: Davies Liu
Closes #6172 from davies/revert_4147 and squashes the following commits:
3bfbbde [Davies Liu] Revert #4147
(cherry picked from commit 4fb52f9545ae338fae2d3aeea4bfc3
Repository: spark
Updated Branches:
refs/heads/master eb4632f28 -> 4fb52f954
[SPARK-7624] Revert #4147
Author: Davies Liu
Closes #6172 from davies/revert_4147 and squashes the following commits:
3bfbbde [Davies Liu] Revert #4147
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
C
Repository: spark
Updated Branches:
refs/heads/master 6525fc0ab -> eb4632f28
[SQL] Fix serializability of ORC table scan
A follow-up to #6244.
Author: Michael Armbrust
Closes #6247 from marmbrus/fixOrcTests and squashes the following commits:
e39ee1b [Michael Armbrust] [SQL] Fix serializab
Repository: spark
Updated Branches:
refs/heads/branch-1.4 a475cbc97 -> f8f23c48a
[SQL] Fix serializability of ORC table scan
A follow-up to #6244.
Author: Michael Armbrust
Closes #6247 from marmbrus/fixOrcTests and squashes the following commits:
e39ee1b [Michael Armbrust] [SQL] Fix serial
Repository: spark
Updated Branches:
refs/heads/master b93c97d79 -> 6525fc0ab
[SPARK-7063] when lz4 compression is used, it causes core dump
this fix is to solve one issue found in lz4 1.2.0, which caused core dump in
Spark Core with IBM JDK. that issue is fixed in lz4 1.3.0 version.
Author:
Repository: spark
Updated Branches:
refs/heads/branch-1.4 ba502ab20 -> a475cbc97
http://git-wip-us.apache.org/repos/asf/spark/blob/a475cbc9/core/src/main/scala/org/apache/spark/SparkContext.scala
--
diff --git a/core/src/main/s
Repository: spark
Updated Branches:
refs/heads/master fcf90b75c -> b93c97d79
http://git-wip-us.apache.org/repos/asf/spark/blob/b93c97d7/core/src/main/scala/org/apache/spark/SparkContext.scala
--
diff --git a/core/src/main/scala
[SPARK-7501] [STREAMING] DAG visualization: show DStream operations
This is similar to #5999, but for streaming. Roughly 200 lines are tests.
One thing to note here is that we already do some kind of scoping thing for
call sites, so this patch adds the new RDD operation scoping logic in the same
http://git-wip-us.apache.org/repos/asf/spark/blob/a475cbc9/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js
--
diff --git a/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js
b/core/src/main/resou
http://git-wip-us.apache.org/repos/asf/spark/blob/b93c97d7/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js
--
diff --git a/core/src/main/resources/org/apache/spark/ui/static/dagre-d3.min.js
b/core/src/main/resou
[SPARK-7501] [STREAMING] DAG visualization: show DStream operations
This is similar to #5999, but for streaming. Roughly 200 lines are tests.
One thing to note here is that we already do some kind of scoping thing for
call sites, so this patch adds the new RDD operation scoping logic in the same
Repository: spark
Updated Branches:
refs/heads/branch-1.4 39add3dd5 -> ba502ab20
[HOTFIX] Fix ORC build break
Fix break caused by merging #6225 and #6194.
Author: Michael Armbrust
Closes #6244 from marmbrus/fixOrcBuildBreak and squashes the following commits:
b10e47b [Michael Armbrust] [HO
Repository: spark
Updated Branches:
refs/heads/master 0b6f503d5 -> fcf90b75c
[HOTFIX] Fix ORC build break
Fix break caused by merging #6225 and #6194.
Author: Michael Armbrust
Closes #6244 from marmbrus/fixOrcBuildBreak and squashes the following commits:
b10e47b [Michael Armbrust] [HOTFIX
Repository: spark
Updated Branches:
refs/heads/branch-1.4 a8332098c -> 39add3dd5
[SPARK-7658] [STREAMING] [WEBUI] Update the mouse behaviors for the timeline
graphs
1. If the user click one point of a batch, scroll down to the corresponding
batch row and highlight it. And recovery the batch
Repository: spark
Updated Branches:
refs/heads/master 32fbd297d -> 0b6f503d5
[SPARK-7658] [STREAMING] [WEBUI] Update the mouse behaviors for the timeline
graphs
1. If the user click one point of a batch, scroll down to the corresponding
batch row and highlight it. And recovery the batch row
Repository: spark
Updated Branches:
refs/heads/branch-1.4 39623481f -> a8332098c
[SPARK-6216] [PYSPARK] check python version of worker with driver
This PR revert #5404, change to pass the version of python in driver into JVM,
check it in worker before deserializing closure, then it can works
Repository: spark
Updated Branches:
refs/heads/master 9dadf019b -> 32fbd297d
[SPARK-6216] [PYSPARK] check python version of worker with driver
This PR revert #5404, change to pass the version of python in driver into JVM,
check it in worker before deserializing closure, then it can works with
Repository: spark
Updated Branches:
refs/heads/branch-1.4 a385f4b8d -> 39623481f
[SPARK-7673] [SQL] WIP: HadoopFsRelation and ParquetRelation2 performance
optimizations
This PR introduces several performance optimizations to `HadoopFsRelation` and
`ParquetRelation2`:
1. Moving `FileStatus`
Repository: spark
Updated Branches:
refs/heads/master 530397ba2 -> 9dadf019b
[SPARK-7673] [SQL] WIP: HadoopFsRelation and ParquetRelation2 performance
optimizations
This PR introduces several performance optimizations to `HadoopFsRelation` and
`ParquetRelation2`:
1. Moving `FileStatus` lis
Repository: spark
Updated Branches:
refs/heads/branch-1.4 d6f5f3791 -> a385f4b8d
[SPARK-7567] [SQL] [follow-up] Use a new flag to set output committer based on
mapreduce apis
cc liancheng marmbrus
Author: Yin Huai
Closes #6130 from yhuai/directOutput and squashes the following commits:
31
Repository: spark
Updated Branches:
refs/heads/master 103c863c2 -> 530397ba2
[SPARK-7567] [SQL] [follow-up] Use a new flag to set output committer based on
mapreduce apis
cc liancheng marmbrus
Author: Yin Huai
Closes #6130 from yhuai/directOutput and squashes the following commits:
312b07
Repository: spark
Updated Branches:
refs/heads/branch-1.4 dbd4ec807 -> d6f5f3791
[SPARK-7269] [SQL] Incorrect analysis for aggregation(use semanticEquals)
A modified version of https://github.com/apache/spark/pull/6110, use
`semanticEquals` to make it more efficient.
Author: Wenchen Fan
Cl
Repository: spark
Updated Branches:
refs/heads/master fc2480ed1 -> 103c863c2
[SPARK-7269] [SQL] Incorrect analysis for aggregation(use semanticEquals)
A modified version of https://github.com/apache/spark/pull/6110, use
`semanticEquals` to make it more efficient.
Author: Wenchen Fan
Closes
Repository: spark
Updated Branches:
refs/heads/branch-1.4 65d71bd9f -> dbd4ec807
[SPARK-7631] [SQL] treenode argString should not print children
spark-sql>
> explain extended
> select * from (
> select key from src union all
> select key from src) t;
now the spark plan will print children in
Repository: spark
Updated Branches:
refs/heads/master aa31e431f -> fc2480ed1
[SPARK-7631] [SQL] treenode argString should not print children
spark-sql>
> explain extended
> select * from (
> select key from src union all
> select key from src) t;
now the spark plan will print children in argS
Repository: spark
Updated Branches:
refs/heads/branch-1.4 cf4e04a0c -> 65d71bd9f
[SPARK-2883] [SQL] ORC data source for Spark SQL
This PR updates PR #6135 authored by zhzhan from Hortonworks.
This PR implements a Spark SQL data source for accessing ORC files.
> **NOTE**
>
> Although OR
Repository: spark
Updated Branches:
refs/heads/master 9c7e802a5 -> aa31e431f
[SPARK-2883] [SQL] ORC data source for Spark SQL
This PR updates PR #6135 authored by zhzhan from Hortonworks.
This PR implements a Spark SQL data source for accessing ORC files.
> **NOTE**
>
> Although ORC is
Repository: spark
Updated Branches:
refs/heads/branch-1.4 7d44c01c5 -> cf4e04a0c
[SPARK-7380] [MLLIB] pipeline stages should be copyable in Python
This PR makes pipeline stages in Python copyable and hence simplifies some
implementations. It also includes the following changes:
1. Rename `pa
Repository: spark
Updated Branches:
refs/heads/master 010a1c278 -> 56ede8848
[SQL] [MINOR] [THIS] use private for internal field in ScalaUdf
Author: Wenchen Fan
Closes #6235 from cloud-fan/tmp and squashes the following commits:
8f16367 [Wenchen Fan] use private[this]
Project: http://git-
Repository: spark
Updated Branches:
refs/heads/master 56ede8848 -> 9c7e802a5
[SPARK-7380] [MLLIB] pipeline stages should be copyable in Python
This PR makes pipeline stages in Python copyable and hence simplifies some
implementations. It also includes the following changes:
1. Rename `paramM
Repository: spark
Updated Branches:
refs/heads/branch-1.4 c7623a20a -> 7d44c01c5
[SQL] [MINOR] [THIS] use private for internal field in ScalaUdf
Author: Wenchen Fan
Closes #6235 from cloud-fan/tmp and squashes the following commits:
8f16367 [Wenchen Fan] use private[this]
(cherry picked fr
Repository: spark
Updated Branches:
refs/heads/branch-1.4 b41301a13 -> c7623a20a
[SPARK-7570] [SQL] Ignores _temporary during partition discovery
[https://reviewable.io/review_button.png"; height=40 alt="Review on
Reviewable"/>](https://reviewable.io/reviews/apache/spark/6091)
Author: Chen
Repository: spark
Updated Branches:
refs/heads/master e1ac2a955 -> 010a1c278
[SPARK-7570] [SQL] Ignores _temporary during partition discovery
[https://reviewable.io/review_button.png"; height=40 alt="Review on
Reviewable"/>](https://reviewable.io/reviews/apache/spark/6091)
Author: Cheng Li
Repository: spark
Updated Branches:
refs/heads/branch-1.4 a0ae8ce01 -> b41301a13
[SPARK-6888] [SQL] Make the jdbc driver handling user-definable
Replace the DriverQuirks with JdbcDialect(s) (and MySQLDialect/PostgresDialect)
and allow developers to change the dialects on the fly (for new JDBCR
Repository: spark
Updated Branches:
refs/heads/master 563bfcc1a -> e1ac2a955
[SPARK-6888] [SQL] Make the jdbc driver handling user-definable
Replace the DriverQuirks with JdbcDialect(s) (and MySQLDialect/PostgresDialect)
and allow developers to change the dialects on the fly (for new JDBCRRDs
Repository: spark
Updated Branches:
refs/heads/master 814b3dabd -> 563bfcc1a
[SPARK-7627] [SPARK-7472] DAG visualization: style skipped stages
This patch fixes two things:
**SPARK-7627.** Cached RDDs no longer light up on the job page. This is a
simple fix.
**SPARK-7472.** Display skipped st
Repository: spark
Updated Branches:
refs/heads/branch-1.4 a95d4e18f -> a0ae8ce01
[SPARK-7627] [SPARK-7472] DAG visualization: style skipped stages
This patch fixes two things:
**SPARK-7627.** Cached RDDs no longer light up on the job page. This is a
simple fix.
**SPARK-7472.** Display skippe
Repository: spark
Updated Branches:
refs/heads/master 1ecfac6e3 -> 814b3dabd
[SPARK-7272] [MLLIB] User guide for PMML model export
https://issues.apache.org/jira/browse/SPARK-7272
Author: Vincenzo Selvaggio
Closes #6219 from selvinsource/mllib_pmml_model_export_SPARK-7272 and squashes
the
Repository: spark
Updated Branches:
refs/heads/branch-1.4 2c94ffe7e -> a95d4e18f
[SPARK-7272] [MLLIB] User guide for PMML model export
https://issues.apache.org/jira/browse/SPARK-7272
Author: Vincenzo Selvaggio
Closes #6219 from selvinsource/mllib_pmml_model_export_SPARK-7272 and squashes
Repository: spark
Updated Branches:
refs/heads/branch-1.4 0e7cd8ff8 -> 2c94ffe7e
[SPARK-6657] [PYSPARK] Fix doc warnings
Fixed the following warnings in `make clean html` under `python/docs`:
~~~
/Users/meng/src/spark/python/pyspark/mllib/evaluation.py:docstring of
pyspark.mllib.evaluation.R
Repository: spark
Updated Branches:
refs/heads/master e32c0f69f -> 1ecfac6e3
[SPARK-6657] [PYSPARK] Fix doc warnings
Fixed the following warnings in `make clean html` under `python/docs`:
~~~
/Users/meng/src/spark/python/pyspark/mllib/evaluation.py:docstring of
pyspark.mllib.evaluation.Ranki
Repository: spark
Updated Branches:
refs/heads/master 775e6f990 -> e32c0f69f
[SPARK-7299][SQL] Set precision and scale for Decimal according to JDBC
metadata instead of returned BigDecimal
JIRA: https://issues.apache.org/jira/browse/SPARK-7299
When connecting with oracle db through jdbc, the
Repository: spark
Updated Branches:
refs/heads/branch-1.4 0b6bc8a23 -> 0e7cd8ff8
[SPARK-7299][SQL] Set precision and scale for Decimal according to JDBC
metadata instead of returned BigDecimal
JIRA: https://issues.apache.org/jira/browse/SPARK-7299
When connecting with oracle db through jdbc,
70 matches
Mail list logo
