Repository: spark Updated Branches: refs/heads/branch-2.3 3c0af793f -> 1cba0505e
[SPARK-24507][DOCUMENTATION] Update streaming guide ## What changes were proposed in this pull request? Updated streaming guide for direct stream and link to integration guide. ## How was this patch tested? jekyll build Author: Rekha Joshi <[email protected]> Closes #21683 from rekhajoshm/SPARK-24507. (cherry picked from commit f599cde69506a5aedeeec449cba9a8b5ab128282) Signed-off-by: hyukjinkwon <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1cba0505 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/1cba0505 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1cba0505 Branch: refs/heads/branch-2.3 Commit: 1cba0505ef36b83611c1f2ba0ad5e638980670ac Parents: 3c0af79 Author: Rekha Joshi <[email protected]> Authored: Mon Jul 2 22:39:00 2018 +0800 Committer: hyukjinkwon <[email protected]> Committed: Mon Jul 2 22:39:22 2018 +0800 ---------------------------------------------------------------------- docs/streaming-programming-guide.md | 2 ++ 1 file changed, 2 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/1cba0505/docs/streaming-programming-guide.md ---------------------------------------------------------------------- diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index ffda36d..9efa9fc 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -2176,6 +2176,8 @@ the input data stream (using `inputStream.repartition(<number of partitions>)`). This distributes the received batches of data across the specified number of machines in the cluster before further processing. +For direct stream, please refer to [Spark Streaming + Kafka Integration Guide](streaming-kafka-integration.html) + ### Level of Parallelism in Data Processing {:.no_toc} Cluster resources can be under-utilized if the number of parallel tasks used in any stage of the --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
