Repository: spark
Updated Branches:
refs/heads/master 010b03ed5 -> bc9a0e032
[SPARK-9967] [SPARK-10099] [STREAMING] Renamed conf
spark.streaming.backpressure.{enable-->enabled} and fixed deprecated annotations
Small changes
- Renamed conf spark.streaming.backpressure.{enable --> enabled}
- Ch
Repository: spark
Updated Branches:
refs/heads/branch-1.5 3ceee5572 -> 392bd19d6
[SPARK-9967] [SPARK-10099] [STREAMING] Renamed conf
spark.streaming.backpressure.{enable-->enabled} and fixed deprecated annotations
Small changes
- Renamed conf spark.streaming.backpressure.{enable --> enabled}
Repository: spark
Updated Branches:
refs/heads/branch-1.5 416392697 -> 3ceee5572
[SPARK-9952] Fix N^2 loop when DAGScheduler.getPreferredLocsInternal accesses
cacheLocs
In Scala, `Seq.fill` always seems to return a List. Accessing a list by index
is an O(N) operation. Thus, the following cod
Repository: spark
Updated Branches:
refs/heads/master 1c843e284 -> 010b03ed5
[SPARK-9952] Fix N^2 loop when DAGScheduler.getPreferredLocsInternal accesses
cacheLocs
In Scala, `Seq.fill` always seems to return a List. Accessing a list by index
is an O(N) operation. Thus, the following code wi
Repository: spark
Updated Branches:
refs/heads/master de3223872 -> 1c843e284
[SPARK-9508] GraphX Pregel docs update with new Pregel code
SPARK-9436 simplifies the Pregel code. graphx-programming-guide needs to be
modified accordingly since it lists the old Pregel code
Author: Alexander Ulano
Repository: spark
Updated Branches:
refs/heads/branch-1.5 03a8a889a -> 416392697
[SPARK-9508] GraphX Pregel docs update with new Pregel code
SPARK-9436 simplifies the Pregel code. graphx-programming-guide needs to be
modified accordingly since it lists the old Pregel code
Author: Alexander U
Repository: spark
Updated Branches:
refs/heads/master 1ff0580ed -> de3223872
[SPARK-9705] [DOC] fix docs about Python version
cc JoshRosen
Author: Davies Liu
Closes #8245 from davies/python_doc.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.or
Repository: spark
Updated Branches:
refs/heads/branch-1.5 3c33931aa -> 03a8a889a
[SPARK-9705] [DOC] fix docs about Python version
cc JoshRosen
Author: Davies Liu
Closes #8245 from davies/python_doc.
(cherry picked from commit de3223872a217c5224ba7136604f6b7753b29108)
Signed-off-by: Reynold
Repository: spark
Updated Branches:
refs/heads/master 270ee6777 -> 1ff0580ed
[SPARK-10093] [SPARK-10096] [SQL] Avoid transformation on executors & fix UDFs
on complex types
This is kind of a weird case, but given a sufficiently complex query plan (in
this case a TungstenProject with an Excha
Repository: spark
Updated Branches:
refs/heads/branch-1.5 11c933505 -> 3c33931aa
[SPARK-10093] [SPARK-10096] [SQL] Avoid transformation on executors & fix UDFs
on complex types
This is kind of a weird case, but given a sufficiently complex query plan (in
this case a TungstenProject with an E
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ebaeb1892 -> 11c933505
[SPARK-10095] [SQL] use public API of BigInteger
In UnsafeRow, we use the private field of BigInteger for better performance,
but it actually didn't contribute much (3% in one benchmark) to end-to-end
runtime, a
Repository: spark
Updated Branches:
refs/heads/master bf32c1f7f -> 270ee6777
[SPARK-10095] [SQL] use public API of BigInteger
In UnsafeRow, we use the private field of BigInteger for better performance,
but it actually didn't contribute much (3% in one benchmark) to end-to-end
runtime, and m
Repository: spark
Updated Branches:
refs/heads/branch-1.5 bb2fb59f9 -> ebaeb1892
[SPARK-10075] [SPARKR] Add `when` expressino function in SparkR
- Add `when` and `otherwise` as `Column` methods
- Add `When` as an expression function
- Add `%otherwise%` infix as an alias of `otherwise`
Since R
Repository: spark
Updated Branches:
refs/heads/master a5b5b9365 -> bf32c1f7f
[SPARK-10075] [SPARKR] Add `when` expressino function in SparkR
- Add `when` and `otherwise` as `Column` methods
- Add `When` as an expression function
- Add `%otherwise%` infix as an alias of `otherwise`
Since R doe
Repository: spark
Updated Branches:
refs/heads/branch-1.5 a6f8979c8 -> bb2fb59f9
[SPARK-9939] [SQL] Resorts to Java process API in CliSuite,
HiveSparkSubmitSuite and HiveThriftServer2 test suites
Scala process API has a known bug ([SI-8768] [1]), which may be the reason why
several test suit
Repository: spark
Updated Branches:
refs/heads/master 90273eff9 -> a5b5b9365
[SPARK-9939] [SQL] Resorts to Java process API in CliSuite,
HiveSparkSubmitSuite and HiveThriftServer2 test suites
Scala process API has a known bug ([SI-8768] [1]), which may be the reason why
several test suites w
Repository: spark
Updated Branches:
refs/heads/branch-1.5 08c5962a2 -> a6f8979c8
[SPARK-10102] [STREAMING] Fix a race condition that startReceiver may happen
before setting trackerState to Started
Test failure:
https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PR
Repository: spark
Updated Branches:
refs/heads/master 1aeae05bb -> 90273eff9
[SPARK-10102] [STREAMING] Fix a race condition that startReceiver may happen
before setting trackerState to Started
Test failure:
https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFIL
Repository: spark
Updated Branches:
refs/heads/master b4b35f133 -> 1aeae05bb
[SPARK-10072] [STREAMING] BlockGenerator can deadlock when the queue of
generate blocks fills up to capacity
Generated blocks are inserted into an ArrayBlockingQueue, and another thread
pulls stuff from the ArrayBlo
Repository: spark
Updated Branches:
refs/heads/branch-1.5 0a1385e31 -> 08c5962a2
[SPARK-10072] [STREAMING] BlockGenerator can deadlock when the queue of
generate blocks fills up to capacity
Generated blocks are inserted into an ArrayBlockingQueue, and another thread
pulls stuff from the Arra
Repository: spark
Updated Branches:
refs/heads/branch-1.5 9b42e2404 -> 0a1385e31
[SPARKR] [MINOR] Get rid of a long line warning
```
R/functions.R:74:1: style: lines should not be more than 100 characters.
jc <- callJStatic("org.apache.spark.sql.functions", "lit",
ifelse(class(x)
Repository: spark
Updated Branches:
refs/heads/master 1f8902964 -> b4b35f133
[SPARKR] [MINOR] Get rid of a long line warning
```
R/functions.R:74:1: style: lines should not be more than 100 characters.
jc <- callJStatic("org.apache.spark.sql.functions", "lit",
ifelse(class(x) == "
Repository: spark
Updated Branches:
refs/heads/master 04e0fea79 -> 1f8902964
[SPARK-9969] [YARN] Remove old MR classpath API support
Here propose to remove old MRJobConfig#DEFAULT_APPLICATION_CLASSPATH support,
since we now move to Yarn stable API.
vanzin and sryza , any opinion on this? If
Repository: spark
Updated Branches:
refs/heads/branch-1.5 4ee225af8 -> 9b42e2404
Bump SparkR version string to 1.5.0
This patch is against master, but we need to apply it to 1.5 branch as well.
cc shivaram and rxin
Author: Hossein
Closes #8291 from falaki/SparkRVersion1.5.
(cherry picked
Repository: spark
Updated Branches:
refs/heads/master badf7fa65 -> 04e0fea79
Bump SparkR version string to 1.5.0
This patch is against master, but we need to apply it to 1.5 branch as well.
cc shivaram and rxin
Author: Hossein
Closes #8291 from falaki/SparkRVersion1.5.
Project: http://g
Repository: spark
Updated Branches:
refs/heads/master 9108eff74 -> badf7fa65
[SPARK-8473] [SPARK-9889] [ML] User guide and example code for DCT
mengxr jkbradley
Author: Feynman Liang
Closes #8184 from feynmanliang/SPARK-9889-DCT-docs.
Project: http://git-wip-us.apache.org/repos/asf/spark/
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e1b50c7d2 -> 4ee225af8
[SPARK-8473] [SPARK-9889] [ML] User guide and example code for DCT
mengxr jkbradley
Author: Feynman Liang
Closes #8184 from feynmanliang/SPARK-9889-DCT-docs.
(cherry picked from commit badf7fa650f9801c70515907
Repository: spark
Updated Branches:
refs/heads/master c635a16f6 -> 9108eff74
[SPARK-10098] [STREAMING] [TEST] Cleanup active context after test in
FailureSuite
Failures in streaming.FailureSuite can leak StreamingContext and SparkContext
which fails all subsequent tests
Author: Tathagata Da
Repository: spark
Updated Branches:
refs/heads/branch-1.5 fb207b245 -> e1b50c7d2
[SPARK-10098] [STREAMING] [TEST] Cleanup active context after test in
FailureSuite
Failures in streaming.FailureSuite can leak StreamingContext and SparkContext
which fails all subsequent tests
Author: Tathagat
Repository: spark
Updated Branches:
refs/heads/master 1dbffba37 -> c635a16f6
[SPARK-10012] [ML] Missing test case for Params#arrayLengthGt
Currently there is no test case for `Params#arrayLengthGt`.
Author: lewuathe
Closes #8223 from Lewuathe/SPARK-10012.
Project: http://git-wip-us.apache
Repository: spark
Updated Branches:
refs/heads/branch-1.5 56f4da263 -> fb207b245
[SPARK-10012] [ML] Missing test case for Params#arrayLengthGt
Currently there is no test case for `Params#arrayLengthGt`.
Author: lewuathe
Closes #8223 from Lewuathe/SPARK-10012.
(cherry picked from commit c63
Repository: spark
Updated Branches:
refs/heads/branch-1.5 8b0df5a5e -> 56f4da263
[SPARK-8924] [MLLIB, DOCUMENTATION] Added @since tags to mllib.tree
Added since tags to mllib.tree
Author: Bryan Cutler
Closes #7380 from BryanCutler/sinceTag-mllibTree-8924.
(cherry picked from commit 1dbffba
Repository: spark
Updated Branches:
refs/heads/master 492ac1fac -> 1dbffba37
[SPARK-8924] [MLLIB, DOCUMENTATION] Added @since tags to mllib.tree
Added since tags to mllib.tree
Author: Bryan Cutler
Closes #7380 from BryanCutler/sinceTag-mllibTree-8924.
Project: http://git-wip-us.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.5 74a6b1a13 -> 8b0df5a5e
[SPARK-10088] [SQL] Add support for "stored as avro" in HiveQL parser.
Author: Marcelo Vanzin
Closes #8282 from vanzin/SPARK-10088.
(cherry picked from commit 492ac1facbc79ee251d45cff315598ec9935a0e2)
Signed-of
Repository: spark
Updated Branches:
refs/heads/master fa41e0242 -> 492ac1fac
[SPARK-10088] [SQL] Add support for "stored as avro" in HiveQL parser.
Author: Marcelo Vanzin
Closes #8282 from vanzin/SPARK-10088.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip
Repository: spark
Updated Branches:
refs/heads/branch-1.5 80a6fb521 -> 74a6b1a13
[SPARK-10089] [SQL] Add missing golden files.
Author: Marcelo Vanzin
Closes #8283 from vanzin/SPARK-10089.
(cherry picked from commit fa41e0242f075843beff7dc600d1a6bac004bdc7)
Signed-off-by: Michael Armbrust
Repository: spark
Updated Branches:
refs/heads/master 9b731fad2 -> fa41e0242
[SPARK-10089] [SQL] Add missing golden files.
Author: Marcelo Vanzin
Closes #8283 from vanzin/SPARK-10089.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/
Repository: spark
Updated Branches:
refs/heads/master 80cb25b22 -> 9b731fad2
[SPARK-9782] [YARN] Support YARN application tags via SparkConf
Add a new test case in yarn/ClientSuite which checks how the various SparkConf
and ClientArguments propagate into the ApplicationSubmissionContext.
Auth
Repository: spark
Updated Branches:
refs/heads/branch-1.5 2bccd918f -> 80a6fb521
[SPARK-10080] [SQL] Fix binary incompatibility for $ column interpolation
Turns out that inner classes of inner objects are referenced directly, and thus
moving it will break binary compatibility.
Author: Michae
Repository: spark
Updated Branches:
refs/heads/master bf1d6614d -> 80cb25b22
[SPARK-10080] [SQL] Fix binary incompatibility for $ column interpolation
Turns out that inner classes of inner objects are referenced directly, and thus
moving it will break binary compatibility.
Author: Michael Ar
Repository: spark
Updated Branches:
refs/heads/branch-1.5 9bd2e6f7c -> 2bccd918f
[SPARK-9574] [STREAMING] Remove unnecessary contents of
spark-streaming-XXX-assembly jars
Removed contents already included in Spark assembly jar from
spark-streaming-XXX-assembly jars.
Author: zsxwing
Closes
Repository: spark
Updated Branches:
refs/heads/master 8bae9015b -> bf1d6614d
[SPARK-9574] [STREAMING] Remove unnecessary contents of
spark-streaming-XXX-assembly jars
Removed contents already included in Spark assembly jar from
spark-streaming-XXX-assembly jars.
Author: zsxwing
Closes #80
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ec7079f9c -> 9bd2e6f7c
[SPARK-10085] [MLLIB] [DOCS] removed unnecessary numpy array import
See https://issues.apache.org/jira/browse/SPARK-10085
Author: Piotr Migdal
Closes #8284 from stared/spark-10085.
(cherry picked from commit 8
Repository: spark
Updated Branches:
refs/heads/master 747c2ba80 -> 8bae9015b
[SPARK-10085] [MLLIB] [DOCS] removed unnecessary numpy array import
See https://issues.apache.org/jira/browse/SPARK-10085
Author: Piotr Migdal
Closes #8284 from stared/spark-10085.
Project: http://git-wip-us.apac
Repository: spark
Updated Branches:
refs/heads/master f4fa61eff -> 747c2ba80
[SPARK-10032] [PYSPARK] [DOC] Add Python example for mllib LDAModel user guide
Add Python example for mllib LDAModel user guide
Author: Yanbo Liang
Closes #8227 from yanboliang/spark-10032.
Project: http://git-wi
Repository: spark
Updated Branches:
refs/heads/branch-1.5 80debff12 -> ec7079f9c
[SPARK-10032] [PYSPARK] [DOC] Add Python example for mllib LDAModel user guide
Add Python example for mllib LDAModel user guide
Author: Yanbo Liang
Closes #8227 from yanboliang/spark-10032.
(cherry picked from
Repository: spark
Updated Branches:
refs/heads/branch-1.5 7ff0e5d2f -> 80debff12
[SPARK-10029] [MLLIB] [DOC] Add Python examples for mllib IsotonicRegression
user guide
Add Python examples for mllib IsotonicRegression user guide
Author: Yanbo Liang
Closes #8225 from yanboliang/spark-10029.
Repository: spark
Updated Branches:
refs/heads/master f5ea39129 -> f4fa61eff
[SPARK-10029] [MLLIB] [DOC] Add Python examples for mllib IsotonicRegression
user guide
Add Python examples for mllib IsotonicRegression user guide
Author: Yanbo Liang
Closes #8225 from yanboliang/spark-10029.
P
Repository: spark
Updated Branches:
refs/heads/master c1840a862 -> f5ea39129
[SPARK-9900] [MLLIB] User guide for Association Rules
Updates FPM user guide to include Association Rules.
Author: Feynman Liang
Closes #8207 from feynmanliang/SPARK-9900-arules.
Project: http://git-wip-us.apache
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b86378cf2 -> 7ff0e5d2f
[SPARK-9900] [MLLIB] User guide for Association Rules
Updates FPM user guide to include Association Rules.
Author: Feynman Liang
Closes #8207 from feynmanliang/SPARK-9900-arules.
(cherry picked from commit f5e
Repository: spark
Updated Branches:
refs/heads/master 354f4582b -> c1840a862
[SPARK-7736] [CORE] Fix a race introduced in PythonRunner.
The fix for SPARK-7736 introduced a race where a port value of "-1"
could be passed down to the pyspark process, causing it to fail to
connect back to the JVM
Repository: spark
Updated Branches:
refs/heads/branch-1.5 20a760a00 -> b86378cf2
[SPARK-9028] [ML] Add CountVectorizer as an estimator to generate
CountVectorizerModel
jira: https://issues.apache.org/jira/browse/SPARK-9028
Add an estimator for CountVectorizerModel. The estimator will extract
Repository: spark
Updated Branches:
refs/heads/master 1968276af -> 354f4582b
[SPARK-9028] [ML] Add CountVectorizer as an estimator to generate
CountVectorizerModel
jira: https://issues.apache.org/jira/browse/SPARK-9028
Add an estimator for CountVectorizerModel. The estimator will extract a
Repository: spark
Updated Branches:
refs/heads/branch-1.5 a512250cd -> 20a760a00
[SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters
functions
### JIRA
[[SPARK-10007] Update `NAMESPACE` file in SparkR for simple parameters
functions - ASF JIRA](https://issues.apach
Repository: spark
Updated Branches:
refs/heads/master 5723d26d7 -> 1968276af
[SPARK-10007] [SPARKR] Update `NAMESPACE` file in SparkR for simple parameters
functions
### JIRA
[[SPARK-10007] Update `NAMESPACE` file in SparkR for simple parameters
functions - ASF JIRA](https://issues.apache.or
Repository: spark
Updated Branches:
refs/heads/branch-1.5 42a0b4890 -> a512250cd
[SPARK-8118] [SQL] Redirects Parquet JUL logger via SLF4J
Parquet hard coded a JUL logger which always writes to stdout. This PR
redirects it via SLF4j JUL bridge handler, so that we can control Parquet logs
via
Repository: spark
Updated Branches:
refs/heads/master c34e9ff0e -> 5723d26d7
[SPARK-8118] [SQL] Redirects Parquet JUL logger via SLF4J
Parquet hard coded a JUL logger which always writes to stdout. This PR
redirects it via SLF4j JUL bridge handler, so that we can control Parquet logs
via `lo
Repository: spark
Updated Branches:
refs/heads/master dd0614fd6 -> c34e9ff0e
[MINOR] fix the comments in IndexShuffleBlockResolver
it might be a typo introduced at the first moment or some leftover after some
renaming..
the name of the method accessing the index file is called `getBlock
Repository: spark
Updated Branches:
refs/heads/branch-1.5 40b89c38a -> 42a0b4890
[MINOR] fix the comments in IndexShuffleBlockResolver
it might be a typo introduced at the first moment or some leftover after some
renaming..
the name of the method accessing the index file is called `getB
59 matches
Mail list logo
