Author: lidong
Date: Fri Aug 18 07:02:56 2017
New Revision: 1805369
URL: http://svn.apache.org/viewvc?rev=1805369&view=rev
Log:
Add description for this release Update spark doc
Modified:
kylin/site/docs21/index.html
kylin/site/docs21/tutorial/cube_spark.html
kylin/site/download/index.html
kylin/site/feed.xml
Modified: kylin/site/docs21/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs21/index.html?rev=1805369&r1=1805368&r2=1805369&view=diff
==============================================================================
--- kylin/site/docs21/index.html (original)
+++ kylin/site/docs21/index.html Fri Aug 18 07:02:56 2017
@@ -2751,7 +2751,7 @@
<li><a href="tutorial/cube_streaming.html">Build Cube with Streaming
Data</a></li>
<li><a href="tutorial/cube_spark.html">Build Cube with Spark Engine
(beta)</a></li>
<li><a href="tutorial/cube_build_performance.html">Cube Build Tuning Step by
Step</a></li>
- <li><a href="tutorial/query_pushdown.html">Enable Querysush Down</a></li>
+ <li><a href="tutorial/query_pushdown.html">Enable Query Pushdown</a></li>
</ol>
<h2 id="connectivity-and-apis">Connectivity and APIs</h2>
Modified: kylin/site/docs21/tutorial/cube_spark.html
URL:
http://svn.apache.org/viewvc/kylin/site/docs21/tutorial/cube_spark.html?rev=1805369&r1=1805368&r2=1805369&view=diff
==============================================================================
--- kylin/site/docs21/tutorial/cube_spark.html (original)
+++ kylin/site/docs21/tutorial/cube_spark.html Fri Aug 18 07:02:56 2017
@@ -2722,6 +2722,8 @@
<article
class="post-content" >
<p>Kylin v2.0
introduces the Spark cube engine, it uses Apache Spark to replace MapReduce in
the build cube step; You can check <a
href="/blog/2017/02/23/by-layer-spark-cubing/">this blog</a> for an overall
picture. The current document uses the sample cube to demo how to try the new
engine.</p>
+<p><strong>Please note, this toturial is based on Kylin 2.0 + Spark 1.6; Now
Kylin v2.1 has upgraded Spark to 2.1.1. This document is out of date but the
main steps are very similar.</strong></p>
+
<h2 id="preparation">Preparation</h2>
<p>To finish this tutorial, you need a Hadoop environment which has Kylin
v2.0.0 or above installed. Here we will use Hortonworks HDP 2.4 Sandbox VM, the
Hadoop components as well as Hive/HBase has already been started.</p>
@@ -2847,7 +2849,7 @@ $KYLIN_HOME/bin/kylin.sh start</code></p
<h2 id="go-further">Go further</h2>
-<p>If youâre a Kylin administrator but new to Spark, suggest you go through
<a href="https://spark.apache.org/docs/1.6.3/";>Spark documents</a>, and donât
forget to update the configurations accordingly. You can enable Spark <a
href="https://spark.apache.org/docs/1.6.1/configuration.html#dynamic-allocation";>Dynamic
Resource Allocation</a> so that it can auto scale/shrink for different work
load. Sparkâs performance relies on Clusterâs memory and CPU resource,
while Kylinâs Cube build is a heavy task when having a complex data model and
a huge dataset to build at one time. If your cluster resource couldnât
fulfill, errors like âOutOfMemorryâ will be thrown in Spark executors, so
please use it properly. For Cube which has UHC dimension, many combinations
(e.g, a full cube with more than 12 dimensions), or memory hungry measures
(Count Distinct, Top-N), suggest to use the MapReduce engine. If your Cube
model is simple, all measures are SUM/MIN/MAX
/COUNT, source data is small to medium scale, Spark engine would be a good
choice. Besides, Streaming build isnât supported in this engine so far
(KYLIN-2484).</p>
+<p>If youâre a Kylin administrator but new to Spark, suggest you go through
<a href="https://spark.apache.org/docs/2.1.0/";>Spark documents</a>, and donât
forget to update the configurations accordingly. You can enable Spark <a
href="https://spark.apache.org/docs/2.1.0/job-scheduling.html#dynamic-resource-allocation";>Dynamic
Resource Allocation</a> so that it can auto scale/shrink for different work
load. Sparkâs performance relies on Clusterâs memory and CPU resource,
while Kylinâs Cube build is a heavy task when having a complex data model and
a huge dataset to build at one time. If your cluster resource couldnât
fulfill, errors like âOutOfMemorryâ will be thrown in Spark executors, so
please use it properly. For Cube which has UHC dimension, many combinations
(e.g, a full cube with more than 12 dimensions), or memory hungry measures
(Count Distinct, Top-N), suggest to use the MapReduce engine. If your Cube
model is simple, all measures are S
UM/MIN/MAX/COUNT, source data is small to medium scale, Spark engine would be
a good choice. Besides, Streaming build isnât supported in this engine so far
(KYLIN-2484).</p>
<p>Now the Spark engine is in public beta; If you have any question, comment,
or bug fix, welcome to discuss in d...@kylin.apache.org.</p>
Modified: kylin/site/download/index.html
URL:
http://svn.apache.org/viewvc/kylin/site/download/index.html?rev=1805369&r1=1805368&r2=1805369&view=diff
==============================================================================
--- kylin/site/download/index.html (original)
+++ kylin/site/download/index.html Fri Aug 18 07:02:56 2017
@@ -182,7 +182,7 @@
<h2 id="section">2.1.0</h2>
<ul>
- <li>This is a bug fix and enhancement release after 2.0.0.</li>
+ <li>This is a major release after 2.0, with more than 100 bug fixes and
enhancements. For the detail list please check release notes.</li>
<li><a href="/docs21/release_notes.html">Release notes</a> and <a
href="/docs21/howto/howto_upgrade.html">upgrade guide</a></li>
<li>Source download: <a
href="http://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-2.1.0/apache-kylin-2.1.0-src.tar.gz";>apache-kylin-2.1.0-src.tar.gz</a>
[<a
href="https://dist.apache.org/repos/dist/release/kylin/apache-kylin-2.1.0/apache-kylin-2.1.0-src.tar.gz.asc";>asc</a>]
[<a
href="https://dist.apache.org/repos/dist/release/kylin/apache-kylin-2.1.0/apache-kylin-2.1.0-src.tar.gz.md5";>md5</a>]</li>
<li>Binary download:
Modified: kylin/site/feed.xml
URL:
http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1805369&r1=1805368&r2=1805369&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Fri Aug 18 07:02:56 2017
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml"; rel="self"
type="application/rss+xml"/>
- <pubDate>Thu, 17 Aug 2017 23:40:24 -0700</pubDate>
- <lastBuildDate>Thu, 17 Aug 2017 23:40:24 -0700</lastBuildDate>
+ <pubDate>Fri, 18 Aug 2017 00:01:08 -0700</pubDate>
+ <lastBuildDate>Fri, 18 Aug 2017 00:01:08 -0700</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>
