Author: lidong Date: Thu Jan 20 14:13:27 2022 New Revision: 1897252 URL: http://svn.apache.org/viewvc?rev=1897252&view=rev Log: Added some tips on spark
Modified: kylin/site/cn/development/index.html kylin/site/cn/docs/install/index.html kylin/site/development/index.html kylin/site/docs/install/index.html kylin/site/feed.xml Modified: kylin/site/cn/development/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/development/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff ============================================================================== --- kylin/site/cn/development/index.html (original) +++ kylin/site/cn/development/index.html Thu Jan 20 14:13:27 2022 @@ -192,7 +192,7 @@ var _hmt = _hmt || []; <h3 id="section-1">æºä»åº</h3> <p>Apache Kylin⢠æºç ä½¿ç¨ Git version control è¿è¡çæ¬æ§å¶ï¼<br /> Commits <a href="https://github.com/apache/kylin/commits/master">æ»ç»</a> <br /> -æºä»åºï¼<a href="https://github.com/apache/kylin">https://github.com/apache/kylin </a> <br /> +æºä»åºï¼<a href="https://github.com/apache/kylin">https://github.com/apache/kylin</a><br /> Gitbox çéåï¼<a href="https://gitbox.apache.org/repos/asf?p=kylin.git">https://gitbox.apache.org/repos/asf?p=kylin.git </a></p> <h3 id="ci-">CI å代ç åæ</h3> Modified: kylin/site/cn/docs/install/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/install/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff ============================================================================== --- kylin/site/cn/docs/install/index.html (original) +++ kylin/site/cn/docs/install/index.html Thu Jan 20 14:13:27 2022 @@ -185,8 +185,8 @@ var _hmt = _hmt || []; <ul> <li>Hadoop: cdh5.x, cdh6.x, hdp2.x, EMR5.x, EMR6.x, HDI4.x</li> <li>Hive: 0.13 - 1.2.1+</li> - <li>Spark: 2.4.7</li> - <li>Mysql: 5.1.17å以ä¸</li> + <li>Spark: 2.4.7/3.1.1</li> + <li>Mysql: 5.1.17 å以ä¸</li> <li>JDK: 1.8+</li> <li>OS: Linux only, CentOS 6.5+ or Ubuntu 16.0.4+</li> </ul> @@ -235,7 +235,9 @@ wget http://mirror.bit.edu.cn/apache/kyl </code></pre> </div> -<p>æè é ç½® SPARK_HOME æåç¯å¢ä¸ç spark2.4.7 çè·¯å¾ã</p> +<p>download-spark.sh èæ¬åªè½ä¸è½½ spark2.4.7, 妿æ¨ä½¿ç¨ç kylin äºè¿å¶å 以 spark3 为åç¼ï¼æ¨éè¦ä»<a href="https://spark.apache.org/">Spark 宿¹ç½ç«</a>ä¸è½½ spark3.1.1 çäºè¿å¶å ã<br /> +å»ºè®®å° spark äºè¿å¶å è§£ååæ¾ç½®å¨ ${KYLIN_HOME} ç®å½ä¸ï¼å¹¶éå½å为 sparkï¼ä»¥é¿å å ¼å®¹æ§é®é¢ã详æ 请æ¥çï¼<a href="https://cwiki.apache.org/confluence/display/KYLIN/KIP+10+refactor+hive+and+hadoop+dependency">Refactor hive and hadoop dependency</a><br /> +妿æ¨èªå®ä¹é ç½®äº ${SPARK_HOME} æåç¯å¢ä¸ç spark2.4.7/spark3.1.1ï¼è¯·ä¿è¯ç¯å¢ä¸ç spark æ¯å¯ä»¥æ£å¸¸æäº¤ä»¥åæ§è¡ä»»å¡çã</p> <ul> <li>é ç½® Mysql å æ°æ®</li> @@ -248,7 +250,7 @@ kylin.env.zookeeper-connect-string<span </code></pre> </div> -<p>ä½ éè¦ä¿®æ¹å ¶ä¸ç Mysql ç¨æ·ååå¯ç ï¼ä»¥ååå¨å æ°æ®çdatabaseåtableãå¹¶å° mysql jdbc connector æ¾å¨ <code class="highlighter-rouge">$KYLIN_HOME/ext</code> ç®å½ä¸ï¼æ²¡æè¯¥ç®å½æ¶è¯·èªè¡å建ã<br /> +<p>ä½ éè¦ä¿®æ¹å ¶ä¸ç Mysql ç¨æ·ååå¯ç ï¼ä»¥ååå¨å æ°æ®ç database å tableãå¹¶å° mysql jdbc connector æ¾å¨ <code class="highlighter-rouge">$KYLIN_HOME/ext</code> ç®å½ä¸ï¼æ²¡æè¯¥ç®å½æ¶è¯·èªè¡å建ã<br /> 请åè <a href="/_docs40/tutorial/mysql_metastore.html">é ç½® Mysql 为 Metastore</a> äºè§£ Mysql ä½ä¸º Metastore ç详ç»é ç½®ã</p> <h3 id="kylin-tarball-">Kylin tarball ç®å½</h3> @@ -265,8 +267,8 @@ kylin.env.zookeeper-connect-string<span <h3 id="section-2">为æäºç¯å¢æ§è¡é¢å¤æ¥éª¤</h3> <p>å¯¹äº CDH6.x, EMR5.x, EMR6.x ç hadoop ç¯å¢ï¼å¨å¯å¨ kylin ä¹åéè¦æ§è¡ä¸äºé¢å¤çæ¥éª¤ã<br /> -CDH6.x ç¯å¢è¯·æ¥çææ¡£: https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6<br /> -EMR ç¯å¢è¯·æ¥çææ¡£: https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+AWS+EMR</p> +CDH6.x ç¯å¢è¯·æ¥çææ¡£: <a href="https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+CDH+6">Deploy Kylin4 on CDH6</a><br /> +EMR ç¯å¢è¯·æ¥çææ¡£: <a href="https://cwiki.apache.org/confluence/display/KYLIN/Deploy+Kylin+4+on+AWS+EMR">Deploy Kylin4 on AWS EMR</a></p> <h3 id="section-3">æ£æ¥è¿è¡ç¯å¢</h3> Modified: kylin/site/development/index.html URL: http://svn.apache.org/viewvc/kylin/site/development/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff ============================================================================== --- kylin/site/development/index.html (original) +++ kylin/site/development/index.html Thu Jan 20 14:13:27 2022 @@ -197,7 +197,7 @@ var _hmt = _hmt || []; <h3 id="source-repository">Source Repository</h3> <p>Apache Kylin⢠source code is version controlled using Git version control:<br /> Commits <a href="https://github.com/apache/kylin/commits/main">Summary</a><br /> -Source Repo: <a href="https://github.com/apache/kylin">https://github.com/apache/kylin </a> <br /> +Source Repo: <a href="https://github.com/apache/kylin">https://github.com/apache/kylin</a><br /> Mirrored to Gitbox: <a href="https://gitbox.apache.org/repos/asf?p=kylin.git">https://gitbox.apache.org/repos/asf?p=kylin.git </a></p> <h3 id="ci-and-code-analysis">CI and Code Analysis</h3> Modified: kylin/site/docs/install/index.html URL: http://svn.apache.org/viewvc/kylin/site/docs/install/index.html?rev=1897252&r1=1897251&r2=1897252&view=diff ============================================================================== --- kylin/site/docs/install/index.html (original) +++ kylin/site/docs/install/index.html Thu Jan 20 14:13:27 2022 @@ -192,8 +192,8 @@ var _hmt = _hmt || []; <ul> <li>Hadoop: cdh5.x, cdh6.x, hdp2.x, EMR5.x, EMR6.x, HDI4.x</li> <li>Hive: 0.13 - 1.2.1+</li> - <li>Spark: 2.4.7</li> - <li>Mysql: 5.1.17å以ä¸</li> + <li>Spark: 2.4.7/3.1.1</li> + <li>Mysql: 5.1.7 and above</li> <li>JDK: 1.8+</li> <li>OS: Linux only, CentOS 6.5+ or Ubuntu 16.0.4+</li> </ul> @@ -242,7 +242,13 @@ wget http://mirror.bit.edu.cn/apache/kyl </code></pre> </div> -<p>Or configure SPARK_HOME points to the path of spark2.4.7/3.1.1 in the environment.</p> +<p>The script <code class="highlighter-rouge">download-spark.sh</code> can only download <code class="highlighter-rouge">spark2.4.7</code>.</p> + +<p>If the kylin binary package you use is suffixed with spark3, you need to download <code class="highlighter-rouge">spark3.1.1</code> binary package from <a href="https://spark.apache.org/">spark website</a>.</p> + +<p>It is recommended to unzip the spark binary package and put it into ${KYLIN_HOME} directory, then rename it <code class="highlighter-rouge">spark</code> to avoid compatibility problems. For details, please check:</p> + +<p>If you customize the configuration of <code class="highlighter-rouge">SPARK_HOME</code> points to spark2.4.7/spark3.1.1 in your environment. Please ensure that your SPARK_HOME in the environment can submit and execute tasks normally.</p> <ul> <li>Configure MySQL metastore</li> Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1897252&r1=1897251&r2=1897252&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Thu Jan 20 14:13:27 2022 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Wed, 19 Jan 2022 03:07:12 -0800</pubDate> - <lastBuildDate>Wed, 19 Jan 2022 03:07:12 -0800</lastBuildDate> + <pubDate>Thu, 20 Jan 2022 05:59:54 -0800</pubDate> + <lastBuildDate>Thu, 20 Jan 2022 05:59:54 -0800</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item>