Author: lidong Date: Wed Dec 25 14:08:46 2019 New Revision: 1871971 URL: http://svn.apache.org/viewvc?rev=1871971&view=rev Log: Add KYLIN-4143,4098,4175,4178 doc
Modified: kylin/site/cn/docs30/howto/howto_use_restapi.html kylin/site/cn/docs30/install/configuration.html kylin/site/docs30/howto/howto_use_restapi.html kylin/site/docs30/install/configuration.html kylin/site/feed.xml Modified: kylin/site/cn/docs30/howto/howto_use_restapi.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs30/howto/howto_use_restapi.html?rev=1871971&r1=1871970&r2=1871971&view=diff ============================================================================== --- kylin/site/cn/docs30/howto/howto_use_restapi.html (original) +++ kylin/site/cn/docs30/howto/howto_use_restapi.html Wed Dec 25 14:08:46 2019 @@ -200,6 +200,7 @@ var _hmt = _hmt || []; <li><a href="#disable-cube">Disable cube</a></li> <li><a href="#purge-cube">Purge cube</a></li> <li><a href="#delete-segment">Delete segment</a></li> + <li><a href="#auto-merge-segment">Auto-Merge segment</a></li> </ul> </li> <li>MODEL @@ -1062,6 +1063,9 @@ Get descriptor for specified cube instan <h2 id="delete-segment">Delete Segment</h2> <p><code class="highlighter-rouge">DELETE /kylin/api/cubes/{cubeName}/segs/{segmentName}</code></p> +<h2 id="auto-merge-segment">Auto-merge Segment</h2> +<p><code class="highlighter-rouge">PUT /kylin/api/cubes/{cubeName}/automerge</code></p> + <hr /> <h2 id="create-model">Create Model</h2> Modified: kylin/site/cn/docs30/install/configuration.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs30/install/configuration.html?rev=1871971&r1=1871970&r2=1871971&view=diff ============================================================================== --- kylin/site/cn/docs30/install/configuration.html (original) +++ kylin/site/cn/docs30/install/configuration.html Wed Dec 25 14:08:46 2019 @@ -229,6 +229,9 @@ var _hmt = _hmt || []; <li><a href="#email-notification">å¯ç¨é®ä»¶éç¥</a></li> <li><a href="#cube-planner">å¯ç¨ Cube Planner</a></li> <li><a href="#hbase-config">HBase åå¨</a></li> + <li><a href="#secondary-hbase">å¤ç¨ Hbase åå¨</a></li> + <li><a href="#safe-mode">ä»»å¡è°åº¦å®å ¨æ¨¡å¼</a></li> + <li><a href="#job-output">ä»»å¡è¾åº</a></li> <li><a href="#compress-config">å¯ç¨å缩</a></li> <li><a href="#realtime-olap">宿¶ OLAP</a></li> </ul> @@ -711,6 +714,33 @@ var _hmt = _hmt || []; <li><code class="highlighter-rouge">kylin.storage.hbase.scan-cache-rows</code>ï¼æå®æ«æç¼åè¡æ°ï¼é»è®¤å¼ä¸º 1024</li> </ul> +<h3 id="secondary-hbase">å¤ç¨ Hbase åå¨</h3> + +<p>Kylinæ¯æç¨æ·é ç½®å¤ç¨Hbaseï¼è¿æ ·å¨é群è¿ç§»æ¶ï¼Kylinä»ç¶å¯ä»¥ä»æ§éç¾¤ä¸æ¥è¯¢å°æå»ºå¥½çCubeæ°æ®ã</p> + +<ul> + <li><code class="highlighter-rouge">kylin.secondary.storage.url</code>: æå®å¤ç¨Hbaseçé群å°å以åmetadata url. ä¾å¦ <em>kylin.secondary.storage.url=hostname:kylin_metadata@hbase</em>.</li> + <li><code class="highlighter-rouge">hbase.zookeeper.quorum</code>: æå®å¤ç¨Hbaseæå¨é群çZookeeperä¿¡æ¯. ä¾å¦ <em>hbase.zookeeper.quorum=hostname:11000,zookeeper.znode.parent=/hbase/</em>, å¦æè¿æå ¶ä»çé 置项ï¼å¯ä»¥ä»¥<key> = <value>ç形弿·»å å¨åé¢.</value></key></li> +</ul> + +<h3 id="safe-mode">ä»»å¡è°åº¦å®å ¨æ¨¡å¼</h3> + +<p>为äºä¿è¯å®å ¨ç对Hbaseé群ä½åºæ´æ¹ï¼ç¨æ·å¯ä»¥ä¸ºKylinå¼å¯å®å ¨æ¨¡å¼ãå¨å®å ¨æ¨¡å¼ä¸ï¼æªå建Htableçä»»å¡å°ä¸ä¼è¢«è°åº¦ï¼å ¶ä»ä»»å¡åä¼ç»§ç»æ§è¡è³ç»æãææå¯ä»¥æ§è¡çä»»å¡å®æåï¼ç¨æ·å¯ä»¥æ´æ¹é ç½®å°ä¸ä¸ªæ°çHbaseé群ï¼ç¶ååè°åº¦æ§è¡å ¶ä»ä»»å¡ã</p> + +<ul> + <li><code class="highlighter-rouge">kylin.job.scheduler.safemode</code>: æ¯å¦å¼å¯å®å ¨æ¨¡å¼. é»è®¤å¼ä¸ºFALSE.</li> + <li><code class="highlighter-rouge">kylin.job.scheduler.safemode.runnable-projects</code>: ä¸åå®å ¨æ¨¡å¼å½±åçProject. ä¾å¦ <em>kylin.job.scheduler.safemode.runnable-projects=learn_kylin</em>.</li> +</ul> + +<h3 id="job-output">ä»»å¡è¾åº</h3> + +<p>为äºé¿å job outputçå 容太å¤ï¼ç¨æ·å¯ä»¥è®¾ç½®outputçæå¤§é¿åº¦ã</p> + +<ul> + <li><code class="highlighter-rouge">kylin.job.execute-output.max-size</code>: Job outputçæå¤§é¿åº¦. é»è®¤å¼ä¸º10484760.</li> + <li><code class="highlighter-rouge">kylin.engine.spark.output.max-size</code>: Spark job outputçæå¤§é¿åº¦. é»è®¤å¼ä¸º10484760.</li> +</ul> + <h3 id="compress-config">å¯ç¨å缩</h3> <p>Kylin å¨é»è®¤ç¶æä¸ä¸ä¼å¯ç¨å缩ï¼ä¸æ¯æçåç¼©ç®æ³ä¼é»ç¢ Kylin çæå»ºä»»å¡ï¼ä½æ¯ä¸ä¸ªåéçåç¼©ç®æ³å¯ä»¥åå°åå¨å¼éåç½ç»å¼éï¼æé«æ´ä½ç³»ç»è¿è¡æçã<br /> Modified: kylin/site/docs30/howto/howto_use_restapi.html URL: http://svn.apache.org/viewvc/kylin/site/docs30/howto/howto_use_restapi.html?rev=1871971&r1=1871970&r2=1871971&view=diff ============================================================================== --- kylin/site/docs30/howto/howto_use_restapi.html (original) +++ kylin/site/docs30/howto/howto_use_restapi.html Wed Dec 25 14:08:46 2019 @@ -7067,6 +7067,7 @@ var _hmt = _hmt || []; <li><a href="#disable-cube">Disable cube</a></li> <li><a href="#purge-cube">Purge cube</a></li> <li><a href="#delete-segment">Delete segment</a></li> + <li><a href="#auto-merge-segment">Auto-Merge segment</a></li> </ul> </li> <li>MODEL @@ -7929,6 +7930,9 @@ Get descriptor for specified cube instan <h2 id="delete-segment">Delete Segment</h2> <p><code class="highlighter-rouge">DELETE /kylin/api/cubes/{cubeName}/segs/{segmentName}</code></p> +<h2 id="auto-merge-segment">Auto-merge Segment</h2> +<p><code class="highlighter-rouge">PUT /kylin/api/cubes/{cubeName}/automerge</code></p> + <hr /> <h2 id="create-model">Create Model</h2> Modified: kylin/site/docs30/install/configuration.html URL: http://svn.apache.org/viewvc/kylin/site/docs30/install/configuration.html?rev=1871971&r1=1871970&r2=1871971&view=diff ============================================================================== --- kylin/site/docs30/install/configuration.html (original) +++ kylin/site/docs30/install/configuration.html Wed Dec 25 14:08:46 2019 @@ -7096,6 +7096,9 @@ var _hmt = _hmt || []; <li><a href="#email-notification">Enable Email Notification</a></li> <li><a href="#cube-planner">Enable Cube Planner</a></li> <li><a href="#hbase-config">HBase Storage</a></li> + <li><a href="#secondary-hbase">Secondary Hbase Storage</a></li> + <li><a href="#safe-mode">Job Scheduler Safe Mode</a></li> + <li><a href="#job-output">Job Output</a></li> <li><a href="#compress-config">Enable Compression</a></li> <li><a href="#realtime-olap">Real-time OLAP</a></li> </ul> @@ -7580,6 +7583,33 @@ The default setting use relatively less <li><code class="highlighter-rouge">kylin.storage.hbase.scan-cache-rows</code>: specifies the number of scan cache lines. The default value is 1024.</li> </ul> +<h3 id="secondary-hbase">Secondary Hbase Storage</h3> + +<p>Kylin support secondary hbase storage and made the kylin cluster can query cube data from the old hbase cluster during the cluster migration.</p> + +<ul> + <li><code class="highlighter-rouge">kylin.secondary.storage.url</code>: specifies the secondary hbase cluster and metadata path. Such as <em>kylin.secondary.storage.url=hostname:kylin_metadata@hbase</em>.</li> + <li><code class="highlighter-rouge">hbase.zookeeper.quorum</code>: specifies the zookeeper information where secondary hbase cluster located. Such as <em>hbase.zookeeper.quorum=hostname:11000,zookeeper.znode.parent=/hbase/</em>, if there are other parameters, they can be added in the form of <key> = <value>.</value></key></li> +</ul> + +<h3 id="safe-mode">Job Scheduler Safe Mode</h3> + +<p>In order to change HBase cluster safely, user can turn on the safe mode for kylin. In safe mode, the job have not create htable cannot be scheduled, and the other jobs can run continuous. After all running job finished, user can change the cluster config to the new one, and rest of job can be scheduled again.</p> + +<ul> + <li><code class="highlighter-rouge">kylin.job.scheduler.safemode</code>: Whether to turn on safe mode. The default value is FALSE.</li> + <li><code class="highlighter-rouge">kylin.job.scheduler.safemode.runnable-projects</code>: Projects not affected by safe mode. Such as <em>kylin.job.scheduler.safemode.runnable-projects=learn_kylin</em>.</li> +</ul> + +<h3 id="job-output">Job Output</h3> + +<p>In order to avoid job output content is too large, user could set the max length of output.</p> + +<ul> + <li><code class="highlighter-rouge">kylin.job.execute-output.max-size</code>: The max length of job output. The default value is 10484760.</li> + <li><code class="highlighter-rouge">kylin.engine.spark.output.max-size</code>: The max length of spark job output. The default value is 10484760.</li> +</ul> + <h3 id="compress-config">Enable Compression</h3> <p>Kylin does not enable Enable Compression by default. Unsupported compression algorithms can hinder Kylinâs build jobs, but a suitable compression algorithm can reduce storage overhead and network overhead and improve overall system operation efficiency.<br /> Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1871971&r1=1871970&r2=1871971&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Wed Dec 25 14:08:46 2019 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Tue, 24 Dec 2019 05:59:19 -0800</pubDate> - <lastBuildDate>Tue, 24 Dec 2019 05:59:19 -0800</lastBuildDate> + <pubDate>Wed, 25 Dec 2019 05:59:19 -0800</pubDate> + <lastBuildDate>Wed, 25 Dec 2019 05:59:19 -0800</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item>