Author: lidong Date: Thu Feb 28 01:48:46 2019 New Revision: 1854493 URL: http://svn.apache.org/viewvc?rev=1854493&view=rev Log: Update poweredby, faq and events
Added: kylin/site/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8 measure-topn.PNG (with props) Modified: kylin/site/cn/community/index.html kylin/site/cn/community/poweredby.html kylin/site/cn/docs/gettingstarted/faq.html kylin/site/cn/docs/install/advance_settings.html kylin/site/cn/docs/install/configuration.html kylin/site/cn/docs/install/index.html kylin/site/cn/docs/tutorial/create_cube.html kylin/site/cn/docs/tutorial/kylin_sample.html kylin/site/community/index.html kylin/site/community/poweredby.html kylin/site/docs/gettingstarted/events.html kylin/site/docs/gettingstarted/faq.html kylin/site/docs/install/configuration.html kylin/site/docs/install/index.html kylin/site/docs/tutorial/create_cube.html kylin/site/docs/tutorial/kylin_sample.html kylin/site/feed.xml Modified: kylin/site/cn/community/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/community/index.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/community/index.html (original) +++ kylin/site/cn/community/index.html Thu Feb 28 01:48:46 2019 @@ -171,7 +171,7 @@ var _hmt = _hmt || []; <div class="row"> <div class="col-sm-6 col-md-6"> <h2> Apache Kylin ç¨æ·æ¡ä¾ </h2> - <p>æ³è¦äºè§£è°å¨ä½¿ç¨ Apache Kylinï¼è¯·åè <a href="/cn/community/poweredby.html">powered by</a> 页é¢ã</p> + <p>æ³è¦äºè§£è°å¨ä½¿ç¨ Apache Kylinï¼è¯·åè <a href="/cn/community/poweredby.html">powered by</a> 页é¢ã<b>注æï¼å¦ææ¨å¨ç» mail list åéé®ä»¶åæ²¡ææ¶å°ç¡®è®¤é®ä»¶ï¼ç¡®è®¤é®ä»¶å¯è½ä¼å¨åå¾é®ä»¶ä¸ã</b></p> </div> <div class="col-sm-6 col-md-6"> Modified: kylin/site/cn/community/poweredby.html URL: http://svn.apache.org/viewvc/kylin/site/cn/community/poweredby.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/community/poweredby.html (original) +++ kylin/site/cn/community/poweredby.html Thu Feb 28 01:48:46 2019 @@ -179,7 +179,7 @@ var _hmt = _hmt || []; <ul> <li><a href="https://www.telecoming.com/">Telecoming</a>, 2019-01-21 <ul> - <li>Telecoming éç¨äº Apache Kylinï¼å ä¸ºå®æ¯ä¸ä¸ªé常æç¨çå䏿ºè½å·¥å ·ãKylin 缩çäºæ¥è¯¢æ¶é´ï¼æ¹è¿äºæ¥è¡¨çæï¼æéè¦çæ¯å®æå©äºä¸å¡å³çã</li> + <li>Telecoming éç¨äº Apache Kylinï¼å ä¸ºå®æ¯ä¸ä¸ªé常æç¨çå䏿ºè½å·¥å ·ãKylin 缩çäºæ¥è¯¢æ¶é´ï¼æ¹è¿äºæ¥è¡¨çæï¼æéè¦çæ¯å®æå©äºä¸å¡å³çãå ³äºæ´å¤ä¿¡æ¯ï¼è¯·åè<a href="http://www.stratebi.com/-/big-data-marketing-telecoming">æ¤é¡µé¢</a>ã</li> </ul> </li> <li><a href="https://www.cisco.com/">Cisco Systems, Inc. æç§</a>, 2019-01-17 Modified: kylin/site/cn/docs/gettingstarted/faq.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/gettingstarted/faq.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/docs/gettingstarted/faq.html (original) +++ kylin/site/cn/docs/gettingstarted/faq.html Thu Feb 28 01:48:46 2019 @@ -6555,7 +6555,11 @@ vi $KYLIN_HOME/tomcat/webapps/kylin/WEB- <p>HDFS ä¸çå·¥ä½ç®å½ä¸çæ°æ®å æ¬äºä¸é´æ°æ® (å°è¢«å徿¸ çææ¸ é¤) å Cuboid æ°æ® (ä¸ä¼è¢«å徿¸ çææ¸ é¤)ï¼Cuboid æ°æ®å°ä¸ºä¹åç Segment åå¹¶èä¿çãæä»¥å¦æç¨æ·ç¡®è®¤è¿äº Segment å¨ä¹åä¸ä¼è¢«åå¹¶ï¼å¯ä»¥å° Cuboid æ°æ®ç§»å¨å°å ¶ä»è·¯å¾çè³å é¤ã</p> -<p>å¦å¤ï¼è¯·çæ HDFS å·¥ä½ç®å½ä¸ç âresourcesâ åç®å½ä¸ä¼åæ¾ä¸äºå¤§çå æ°æ®ï¼å¦åå ¸æä»¶å维表çå¿«ç §ï¼è¿äºæä»¶ä¸è½è¢«å é¤ã</p> +<p>å¦å¤ï¼è¯·çæ HDFS å·¥ä½ç®å½ä¸ç âresourcesâ æ âjdbc-resourcesâ åç®å½ä¸ä¼åæ¾ä¸äºå¤§çå æ°æ®ï¼å¦åå ¸æä»¶å维表çå¿«ç §ï¼è¿äºæä»¶ä¸è½è¢«å é¤ã</p> + +<h4 id="like-">å¦ä½å¯¹ like è¯å¥ä¸çå ³é®åè¿è¡è½¬ä¹ï¼</h4> +<p>â%â, â<em>â æ¯ âlikeâ è¯å¥ä¸çä¿çå ³é®å; â%â å¯ä»¥å¹é ä»»æä¸ªå符, â</em>â å¹é å个å符; å¦æä½ æ³å¹é å ³é®åå¦ â<em>â, éè¦ä½¿ç¨å¦ä¸ä¸ªå符å¨åé¢è¿è¡è½¬ä¹; ä¸é¢æ¯ä¸ä¸ªä½¿ç¨ â/â è¿è¡è½¬ä¹çä¾å, æ¤æ¥è¯¢è¯å¾å¹é âxiao</em>â:<br /> +âselect username from gg_user where username like â%xiao/_%â escape â/â; â</p> </article> </div> Modified: kylin/site/cn/docs/install/advance_settings.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/install/advance_settings.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/docs/install/advance_settings.html (original) +++ kylin/site/cn/docs/install/advance_settings.html Thu Feb 28 01:48:46 2019 @@ -357,7 +357,6 @@ kylin.source.hive.sparksql-beeline-param <p>éå¯ Kylin ä»¤å ¶çæãéè¿å° <code class="highlighter-rouge">kylin.source.hive.enable-sparksql-for-table-ops</code> 设置为 <code class="highlighter-rouge">false</code> æ¥ä»¤å ¶å¤±æ</p> - </article> </div> </div> Modified: kylin/site/cn/docs/install/configuration.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/install/configuration.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/docs/install/configuration.html (original) +++ kylin/site/cn/docs/install/configuration.html Thu Feb 28 01:48:46 2019 @@ -238,6 +238,7 @@ var _hmt = _hmt || []; <li><a href="#zookeeper-acl">å¯ç¨ ZooKeeper ACL</a></li> </ul> </li> + <li><a href="#distributed-cache">å¯ç¨ Memcached ååå¸å¼æ¥è¯¢ç¼å</a></li> </ul> <h3 id="kylin-config">é ç½®æä»¶ååæ°éå</h3> @@ -861,6 +862,61 @@ Kylin å¯ä»¥ä½¿ç¨ä¸ç§ <li><code class="highlighter-rouge">kylin.env.zookeeper.zk-acl</code>ï¼ä½¿ç¨å个 ID ä½ä¸º ACL æ è¯ï¼é»è®¤å¼ä¸º <code class="highlighter-rouge">world:anyone:rwcda</code>ï¼<code class="highlighter-rouge">anyone</code> 表示任ä½äºº</li> </ul> +<h3 id="distributed-cache">ä½¿ç¨ Memcached ä½ä¸º Kylin æ¥è¯¢ç¼å</h3> + +<p>ä» v2.6.0ï¼Kylin å¯ä»¥ä½¿ç¨ Memcached ä½ä¸ºæ¥è¯¢ç¼åãæ³è¦å¯ç¨è¯¥åè½ï¼æ¨éè¦æ§è¡ä»¥ä¸æ¥éª¤ï¼</p> + +<ol> + <li> + <p>å¨ä¸ä¸ªæå¤ä¸ªèç¹ä¸å®è£ Memcached;</p> + </li> + <li> + <p>æç §å¦ä¸æç¤ºæ¹å¼ä¿®æ¹ $KYLIN_HOME/tomcat/webapps/kylin/WEB-INF/classes ç®å½ä¸ç applicationContext.xml çå 容ï¼</p> + </li> +</ol> + +<p>注éå¦ä¸ä»£ç ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff"><bean id="ehcache" + class="org.springframework.cache.ehcache.EhCacheManagerFactoryBean" + p:configLocation="classpath:ehcache-test.xml" p:shared="true"/> + +<bean id="cacheManager" class="org.springframework.cache.ehcache.EhCacheCacheManager" + p:cacheManager-ref="ehcache"/></code></pre></div> + +<p>åæ¶å¦ä¸ä»£ç çæ³¨éï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff"><bean id="ehcache" class="org.springframework.cache.ehcache.EhCacheManagerFactoryBean" + p:configLocation="classpath:ehcache-test.xml" p:shared="true"/> + +<bean id="remoteCacheManager" class="org.apache.kylin.cache.cachemanager.MemcachedCacheManager" /> +<bean id="localCacheManager" class="org.apache.kylin.cache.cachemanager.InstrumentedEhCacheCacheManager" + p:cacheManager-ref="ehcache"/> +<bean id="cacheManager" class="org.apache.kylin.cache.cachemanager.RemoteLocalFailOverCacheManager" /> + +<bean id="memcachedCacheConfig" class="org.apache.kylin.cache.memcached.MemcachedCacheConfig"> + <property name="timeout" value="500" /> + <property name="hosts" value="${kylin.cache.memcached.hosts}" /> +</bean></code></pre></div> + +<p>applicationContext.xml ä¸ <code class="highlighter-rouge">${kylin.cache.memcached.hosts}</code> çå¼å°±æ¯å¨ conf/kylin.properties 䏿å®ç <code class="highlighter-rouge">kylin.cache.memcached.hosts</code> çå¼ã</p> + +<p>3.å¨ <code class="highlighter-rouge">conf/kylin.properties</code> 䏿·»å å¦ä¸åæ°ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.cache-enabled=true +kylin.query.lazy-query-enabled=true +kylin.query.cache-signature-enabled=true +kylin.query.segment-cache-enabled=true +kylin.cache.memcached.hosts=memcached1:11211,memcached2:11211,memcached3:11211</code></pre></div> + +<ul> + <li><code class="highlighter-rouge">kylin.query.cache-enabled</code> æ¯å¦å¼å¯æ¥è¯¢ç¼åçæ»å¼å ³ï¼é»è®¤å¼ä¸º <code class="highlighter-rouge">true</code>ã</li> + <li><code class="highlighter-rouge">kylin.query.lazy-query-enabled</code> æ¯å¦ä¸ºçæ¶é´å éå¤åéçæ¥è¯¢ï¼çå¾ å¹¶éç¨å次æ¥è¯¢çç»æï¼é»è®¤ä¸º falseã</li> + <li><code class="highlighter-rouge">kylin.query.cache-signature-enabled</code> æ¯å¦ä¸ºç¼åè¿è¡ç¾åæ£æ¥ï¼ä¾æ®ç¾åå忥å³å®ç¼åçæææ§ãç¼åçç¾åç±é¡¹ç®ä¸ç cube / hybrid çç¶æä»¥åå®ä»¬çæåæå»ºæ¶é´çæ¥å¨æè®¡ç®ï¼å¨ç¼åè¢«è®°å½æ¶ï¼ã</li> + <li><code class="highlighter-rouge">kylin.query.segment-cache-enabled</code> æ¯å¦å¨ segment 级å«ç¼åä» åå¨å¼æ(HBase)è¿åçæ°æ®ï¼é»è®¤ä¸ºfalseï¼è®¾ç½®ä¸º trueï¼ä¸å¯ç¨ memcached åå¸å¼ç¼åå¼å¯çæ¶åï¼æ¤åè½æä¼çæãå¯ä¸ºé¢ç¹æå»ºç cube ï¼å¦ streaming cubeï¼æåç¼åå½ä¸çï¼ä»èæåæ§è½ã</li> + <li><code class="highlighter-rouge">kylin.cache.memcached.hosts</code> ææäº memcached çæºå¨åå端å£ã</li> +</ul> + </article> </div> </div> Modified: kylin/site/cn/docs/install/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/install/index.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/docs/install/index.html (original) +++ kylin/site/cn/docs/install/index.html Thu Feb 28 01:48:46 2019 @@ -214,6 +214,18 @@ wget http://mirror.bit.edu.cn/apache/kyl </code></pre> </div> +<h3 id="kylin-tarball-">Kylin tarball ç®å½</h3> +<ul> + <li><code class="highlighter-rouge">bin</code>: shell èæ¬ï¼ç¨äºå¯å¨ï¼åæ¢ Kylinï¼å¤ä»½ï¼æ¢å¤ Kylin å æ°æ®ï¼ä»¥åä¸äºæ£æ¥ç«¯å£ãè·å Hive/HBase ä¾èµçæ¹æ³çï¼</li> + <li><code class="highlighter-rouge">conf</code>: Hadoop ä»»å¡ç XML é ç½®æä»¶ï¼è¿äºæä»¶çä½ç¨å¯åè<a href="/docs/install/configuration.html">é 置页é¢</a></li> + <li><code class="highlighter-rouge">lib</code>: ä¾å¤é¢åºç¨ä½¿ç¨ç jar æä»¶ï¼ä¾å¦ Hadoop ä»»å¡ jar, JDBC 驱å¨, HBase coprocessor ç.</li> + <li><code class="highlighter-rouge">meta_backups</code>: æ§è¡ <code class="highlighter-rouge">bin/metastore.sh backup</code> åçé»è®¤çå¤ä»½ç®å½;</li> + <li><code class="highlighter-rouge">sample_cube</code> ç¨äºåå»ºæ ·ä¾ Cube å表çæä»¶ã</li> + <li><code class="highlighter-rouge">spark</code>: èªå¸¦ç sparkã</li> + <li><code class="highlighter-rouge">tomcat</code>: èªå¸¦ç tomcatï¼ç¨äºå¯å¨ Kylin æå¡ã</li> + <li><code class="highlighter-rouge">tool</code>: ç¨äºæ§è¡ä¸äºå½ä»¤è¡çjaræä»¶ã</li> +</ul> + <h3 id="section-2">æ£æ¥è¿è¡ç¯å¢</h3> <p>Kylin è¿è¡å¨ Hadoop é群ä¸ï¼å¯¹å个ç»ä»¶ççæ¬ãè®¿é®æéå CLASSPATH ç齿ä¸å®çè¦æ±ï¼ä¸ºäºé¿å éå°åç§ç¯å¢é®é¢ï¼æ¨å¯ä»¥è¿è¡ <code class="highlighter-rouge">$KYLIN_HOME/bin/check-env.sh</code> èæ¬æ¥è¿è¡ç¯å¢æ£æµï¼å¦ææ¨çç¯å¢åå¨ä»»ä½çé®é¢ï¼èæ¬å°æå°åºè¯¦ç»æ¥éä¿¡æ¯ãå¦ææ²¡ææ¥éä¿¡æ¯ï¼ä»£è¡¨æ¨çç¯å¢éå Kylin è¿è¡ã</p> @@ -252,6 +264,16 @@ Kylin with pid 25964 has been stopped. <p>æ¨å¯ä»¥è¿è¡ <code class="highlighter-rouge">ps -ef | grep kylin</code> æ¥æ¥ç Kylin è¿ç¨æ¯å¦å·²åæ¢ã</p> +<h3 id="hdfs-">HDFS ç®å½ç»æ</h3> +<p>Kylin ä¼å¨ HDFS ä¸çææä»¶ï¼æ ¹ç®å½æ¯ â/kylin/â, ç¶åä¼ä½¿ç¨ Kylin é群çå æ°æ®è¡¨åä½ä¸ºç¬¬äºå±ç®å½åï¼é»è®¤ä¸º âkylin_metadataâ (å¯ä»¥å¨<code class="highlighter-rouge">conf/kylin.properties</code>ä¸å®å¶).</p> + +<p>é常, <code class="highlighter-rouge">/kylin/kylin_metadata</code> ç®å½ä¸ä¼æè¿ä¹å ç§åç®å½ï¼<code class="highlighter-rouge">cardinality</code>, <code class="highlighter-rouge">coprocessor</code>, <code class="highlighter-rouge">kylin-job_id</code>, <code class="highlighter-rouge">resources</code>, <code class="highlighter-rouge">jdbc-resources</code>. <br /> +1. <code class="highlighter-rouge">cardinality</code>: Kylin å è½½ Hive 表æ¶ï¼ä¼å¯å¨ä¸ä¸ª MR 任塿¥è®¡ç®å个åçåºæ°ï¼è¾åºç»æä¼æå卿¤ç®å½ãæ¤ç®å½å¯ä»¥å®å ¨æ¸ é¤ã<br /> +2. <code class="highlighter-rouge">coprocessor</code>: Kylin ç¨äºåæ¾ HBase coprocessor jar çç®å½ï¼è¯·å¿å é¤ã<br /> +3. <code class="highlighter-rouge">kylin-job_id</code>: Cube 计ç®è¿ç¨çæ°æ®åå¨ç®å½ï¼è¯·å¿å é¤ã å¦éè¦æ¸ çï¼è¯·éµå¾ª <a href="/docs/howto/howto_cleanup_storage.html">storage cleanup guide</a>. <br /> +4. <code class="highlighter-rouge">resources</code>: Kylin é»è®¤ä¼å°å æ°æ®åæ¾å¨ HBaseï¼ä½å¯¹äºå¤ªå¤§çæä»¶ï¼å¦åå ¸æå¿«ç §ï¼ï¼ä¼è½¬åå° HDFS ç该ç®å½ä¸ï¼è¯·å¿å é¤ãå¦éè¦æ¸ çï¼è¯·éµå¾ª <a href="/docs/howto/howto_backup_metadata.html">cleanup resources from metadata</a> <br /> +5. <code class="highlighter-rouge">jdbc-resources</code>ï¼æ§è´¨åä¸ï¼åªå¨ä½¿ç¨ MySQL åå æ°æ®å卿¶ååºç°ã</p> + </article> </div> </div> Modified: kylin/site/cn/docs/tutorial/create_cube.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/tutorial/create_cube.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/docs/tutorial/create_cube.html (original) +++ kylin/site/cn/docs/tutorial/create_cube.html Thu Feb 28 01:48:46 2019 @@ -365,7 +365,8 @@ var _hmt = _hmt || []; TopN 度é卿¯ä¸ªç»´åº¦ç»åæ¶é¢è®¡ç®ï¼å®æ¯æªé¢è®¡ç®ç卿¥è¯¢æ¶é´ä¸æ§è½æ´å¥½ï¼éè¦ä¸¤ä¸ªåæ°ï¼ä¸æ¯è¢«ç¨æ¥ä½ä¸º Top è®°å½ç度éåï¼Kylin å°è®¡ç®å®ç SUM å¼å¹¶åååºæåï¼äºæ¯ literal IDï¼ä»£è¡¨æ Top çè®°å½ï¼ä¾å¦ seller_idï¼</li> </ul> - <p>åççéæ©è¿åç±»åï¼å°å³å®å¤å° top è®°å½è¢«çå¯ï¼top 10, top 100, top 500, top 1000, top 5000 or top 10000ã</p> + <p>åççéæ©è¿åç±»åï¼å°å³å®å¤å° top è®°å½è¢«çå¯ï¼top 10, top 100, top 500, top 1000, top 5000 or top 10000ã<br /> +<strong>注æ</strong>ï¼å¦ææ¨æ³è¦ä½¿ç¨ <code class="highlighter-rouge">TOP_N</code>ï¼æ¨éè¦ä¸º âORDER | SUM by Columnâ æ·»å ä¸ä¸ª <code class="highlighter-rouge">SUM</code> 度éãä¾å¦ï¼å¦ææ¨å建äºä¸ä¸ªæ ¹æ®ä»·æ ¼çæ»åéåº top100 çåå®¶ç度éï¼é£ä¹ä¹åºè¯¥å建ä¸ä¸ª SUM(price) 度éã</p> <p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8 measure-topn.png" alt="" /></p> Modified: kylin/site/cn/docs/tutorial/kylin_sample.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/tutorial/kylin_sample.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/cn/docs/tutorial/kylin_sample.html (original) +++ kylin/site/cn/docs/tutorial/kylin_sample.html Thu Feb 28 01:48:46 2019 @@ -166,36 +166,44 @@ var _hmt = _hmt || []; <div id="pjax"> <h1 class="post-title">æ ·ä¾ Cube å¿«éå ¥é¨</h1> <article class="post-content" > - <p>Kylin æä¾äºä¸ä¸ªåå»ºæ ·ä¾ Cube èæ¬ï¼èæ¬ä¼å建äºä¸ªæ ·ä¾ hive 表:</p> + <p>Kylin æä¾äºä¸ä¸ªåå»ºæ ·ä¾ Cube èæ¬ï¼èæ¬ä¼å建äºä¸ªæ ·ä¾ Hive 表:</p> <ol> - <li>è¿è¡ ${KYLIN_HOME}/bin/sample.sh ï¼éå¯ kylin æå¡å¨å·æ°ç¼å;</li> - <li>ç¨é»è®¤çç¨æ·ååå¯ç ADMIN/KYLIN ç»é Kylin ç½ç«ï¼éæ© project 䏿æ¡ï¼å·¦ä¸è§ï¼ä¸ç âlearn_kylinâ å·¥ç¨;</li> - <li>éæ©å为 âkylin_sales_cubeâ çæ ·ä¾ cubeï¼ç¹å» âActionsâ -> âBuildâï¼éæ©ä¸ä¸ªå¨ 2014-01-01 ä¹åçæ¥æï¼è¦çææç 10000 æ ·ä¾è®°å½);</li> + <li>è¿è¡ <code class="highlighter-rouge">${KYLIN_HOME}/bin/sample.sh</code>ï¼éå¯ Kylin æå¡å¨å·æ°ç¼å;</li> + <li>ç¨é»è®¤çç¨æ·ååå¯ç ADMIN/KYLIN ç»é Kylin ç½ç«ï¼éæ© project 䏿æ¡ï¼å·¦ä¸è§ï¼ä¸ç <code class="highlighter-rouge">learn_kylin</code> å·¥ç¨;</li> + <li>éæ©å为 <code class="highlighter-rouge">kylin_sales_cube</code> çæ ·ä¾ Cubeï¼ç¹å» âActionsâ -> âBuildâï¼éæ©ä¸ä¸ªå¨ 2014-01-01 ä¹åçæ¥æï¼è¦çææç 10000 æ ·ä¾è®°å½);</li> <li>ç¹å» âMonitorâ æ ç¾ï¼æ¥ç build è¿åº¦ç´è³ 100%;</li> - <li>ç¹å» âInsightâ æ ç¾ï¼æ§è¡ SQLsï¼ä¾å¦:<br /> - <code class="highlighter-rouge">select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt</code></li> - <li>æ¨å¯ä»¥éªè¯æ¥è¯¢ç»æä¸ä¸ hive çååºæ¶é´è¿è¡æ¯è¾;</li> + <li>ç¹å» âInsightâ æ ç¾ï¼æ§è¡ SQLsï¼ä¾å¦:</li> </ol> +<div class="highlighter-rouge"><pre class="highlight"><code>select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt +</code></pre> +</div> + +<p>6.æ¨å¯ä»¥éªè¯æ¥è¯¢ç»æä¸ä¸ Hive çååºæ¶é´è¿è¡æ¯è¾;</p> + <h2 id="streaming--cube-">Streaming æ ·ä¾ Cube å¿«éå ¥é¨</h2> -<p>Kylin 乿ä¾äº streaming æ ·ä¾ cube èæ¬ãè¯¥èæ¬å°ä¼å建 Kafka topic ä¸ä¸æçåçæç topic åééæº messagesã</p> +<p>Kylin 乿ä¾äº streaming æ ·ä¾ Cube èæ¬ãè¯¥èæ¬å°ä¼å建 Kafka topic ä¸ä¸æçåçæç topic åééæº messagesã</p> <ol> <li>é¦å 设置 KAFKA_HOMEï¼ç¶åå¯å¨ Kylinã</li> - <li>è¿è¡ ${KYLIN_HOME}/bin/sample.shï¼å®ä¼å¨ learn_kylin å·¥ç¨ä¸çæ DEFAULT.KYLIN_STREAMING_TABLE 表ï¼kylin_streaming_model 模åï¼Cube kylin_streaming_cubeã</li> - <li>è¿è¡ ${KYLIN_HOME}/bin/sample-streaming.shï¼å®ä¼å¨ localhost:9092 broker ä¸å建å为 kylin_streaming_topic ç Kafka Topicãå®ä¹ä¼æ¯ç§éæºåé 100 æ¡ messages å° kylin_streaming_topicã</li> - <li>éµå¾ªæ å cube build è¿ç¨ï¼å¹¶è§¦å Cube kylin_streaming_cube buildã</li> - <li>ç¹å» âMonitorâ æ ç¾ï¼æ¥ç build è¿åº¦ç´è³è³å°æä¸ä¸ª job è¾¾å° 100%ã</li> - <li>ç¹å» âInsightâ æ ç¾ï¼æ§è¡ SQLsï¼ä¾å¦:<br /> - <code class="highlighter-rouge">select count(*), HOUR_START from kylin_streaming_table group by HOUR_START</code></li> - <li>éªè¯æ¥è¯¢ç»æã</li> + <li>è¿è¡ <code class="highlighter-rouge">${KYLIN_HOME}/bin/sample.sh</code>ï¼å®ä¼å¨ <code class="highlighter-rouge">learn_kylin</code> å·¥ç¨ä¸çæ <code class="highlighter-rouge">DEFAULT.KYLIN_STREAMING_TABLE</code> 表ï¼<code class="highlighter-rouge">kylin_streaming_model</code> 模åå <code class="highlighter-rouge">kylin_streaming_cube</code> Cubeã</li> + <li>è¿è¡ <code class="highlighter-rouge">${KYLIN_HOME}/bin/sample-streaming.sh</code>ï¼å®ä¼å¨ localhost:9092 broker ä¸å建å为 <code class="highlighter-rouge">kylin_streaming_topic</code> ç Kafka Topicãå®ä¹ä¼æ¯ç§éæºåé 100 æ¡ messages å° <code class="highlighter-rouge">kylin_streaming_topic</code>ã</li> + <li>éµå¾ªæ å Cube build è¿ç¨ï¼å¹¶è§¦åå为 <code class="highlighter-rouge">kylin_streaming_cube</code> ç Cube çæå»ºã</li> + <li>ç¹å» âMonitorâ æ ç¾ï¼æ¥ç build è¿åº¦ãç´è³è³å°æä¸ä¸ª job è¾¾å° 100%ã</li> + <li>ç¹å» âInsightâ æ ç¾ï¼æ§è¡ SQLsï¼ä¾å¦:</li> </ol> +<div class="highlighter-rouge"><pre class="highlight"><code>select count(*), HOUR_START from kylin_streaming_table group by HOUR_START +</code></pre> +</div> + +<p>7.éªè¯æ¥è¯¢ç»æã</p> + <h2 id="section">ä¸ä¸æ¥å¹²ä»ä¹</h2> -<p>æ¨å¯ä»¥éè¿æ¥ä¸æ¥çæç¨ç¨åä¸å¼ 表å建å¦ä¸ä¸ª cubeã</p> +<p>æ¨å¯ä»¥éè¿æ¥ä¸æ¥çæç¨ç¨åä¸å¼ 表å建å¦ä¸ä¸ª Cubeã</p> </article> </div> Modified: kylin/site/community/index.html URL: http://svn.apache.org/viewvc/kylin/site/community/index.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/community/index.html (original) +++ kylin/site/community/index.html Thu Feb 28 01:48:46 2019 @@ -6361,7 +6361,7 @@ var _hmt = _hmt || []; <div class="col-sm-6 col-md-6"> <h2> Apache Kylin Mailing List </h2> - <p>These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link.</p> + <p>These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link. <b>Note: If you do not receive the confirmation email after sending email to the mail list, the email maybe is shown in your trash mail.</b></p> <table> <tr height="50px"> Modified: kylin/site/community/poweredby.html URL: http://svn.apache.org/viewvc/kylin/site/community/poweredby.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/community/poweredby.html (original) +++ kylin/site/community/poweredby.html Thu Feb 28 01:48:46 2019 @@ -6356,7 +6356,7 @@ Send a quick description of your organiz <ul> <li><a href="https://www.telecoming.com/">Telecoming</a>, 2019-01-21 <ul> - <li>Telecoming has adopted Apache Kylin, since itâs an extremely useful business intelligence tool. It has encouraged lower consultation time, it has improved report generation and above all it contributes to improving business decisions.</li> + <li>Telecoming has adopted Apache Kylin, since itâs an extremely useful business intelligence tool. It has encouraged lower consultation time, it has improved report generation and above all it contributes to improving business decisions. Read more at <a href="http://www.stratebi.com/-/big-data-marketing-telecoming">this blog</a></li> </ul> </li> <li><a href="https://www.cisco.com/">Cisco Systems, Inc.</a>, 2019-01-17 Modified: kylin/site/docs/gettingstarted/events.html URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/events.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/docs/gettingstarted/events.html (original) +++ kylin/site/docs/gettingstarted/events.html Thu Feb 28 01:48:46 2019 @@ -6363,6 +6363,7 @@ var _hmt = _hmt || []; </ul> <p><strong>Meetup</strong><br /> +* <a href="http://www.huodongxing.com/event/4476570217900">Apache Kylin Meetup @Shanghai</a>, <a href="https://www.slidestalk.com/x/241/apache_kylin_innovation_meetup">slides</a> Shangai, China; 1:00 PM - 4:30 PM, Saturday, 2019-02-23 <br /> * <a href="https://www.eventbrite.com/e/thursday-nov-29-meetup-apache-kylin-for-extreme-olap-and-big-data-tickets-52275347973?aff=estw">Apache Kylin for Extreme OLAP and Big Data @eBay South Campus</a>, Sanjose, CA, US; 6:30 PM - 8:30 PM, Thursday, 2018-11-29 <br /> * <a href="http://www.huodongxing.com/event/7461326621900">Apache Kylin Meetup @Hangzhou</a>, China; 1:30PM - 17:00PM, Saturday, 2018-10-26<br /> * <a href="https://www.meetup.com/BigDataApps/events/253429041/">CDAP in Cloud, Extreme OLAP w Apache Kylin, Twitter Reviews & DataStax</a> @ Google Cloud, US; 6:00PM to 8:00PM, 2018-8-29<br /> Modified: kylin/site/docs/gettingstarted/faq.html URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/faq.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/docs/gettingstarted/faq.html (original) +++ kylin/site/docs/gettingstarted/faq.html Thu Feb 28 01:48:46 2019 @@ -6775,10 +6775,14 @@ $2a$10$A7.J.GIEOQknHmJhEeXUdOnj2wrdG4jho <p>The data in âhdfs-working-dirâ (âhdfs:///kylin/kylin_metadata/â by default) includes intermediate files (will be GC) and Cuboid data (wonât be GC). The Cuboid data is kept for the further segmentsâ merge, as Kylin couldnât merge from HBase. If youâre sure those segments wonât be merged, you can move them to other paths or even delete.</p> </li> <li> - <p>Please pay attention to the âresourcesâ sub-folder under âhdfs-working-dirâ, which persists some big metadata files like dictionaries and lookup tablesâ snapshots. They shouldnât be moved.</p> + <p>Please pay attention to the âresourcesâ or âjdbc-resourcesâ sub-folder under â/kylin/kylin_metadata/â, which persists big metadata files like dictionaries and lookup tablesâ snapshots. They shouldnât be manually moved.</p> </li> </ul> +<h4 id="how-to-escape-the-key-word-in-fuzzy-match-like-queries">How to escape the key word in fuzzy match (like) queries?</h4> +<p>â%â, â<em>â are key words in the âlikeâ clause; â%â matches any character, and â</em>â matches a single character; When you wants to match the key word like â<em>â, need to escape them with another character ahead; Below is a sample with â/â to escape, the query is to match the âxiao</em>â:<br /> +âselect username from gg_user where username like â%xiao/_%â escape â/â; â</p> + </article> </div> </div> Modified: kylin/site/docs/install/configuration.html URL: http://svn.apache.org/viewvc/kylin/site/docs/install/configuration.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/docs/install/configuration.html (original) +++ kylin/site/docs/install/configuration.html Thu Feb 28 01:48:46 2019 @@ -6417,6 +6417,7 @@ var _hmt = _hmt || []; <li><a href="#zookeeper-acl">Enable ZooKeeper ACL</a></li> </ul> </li> + <li><a href="#distributed-cache">Distributed query cache with Memcached</a></li> </ul> <h3 id="kylin-config">Configuration Files and Overriding</h3> @@ -7041,6 +7042,59 @@ Kylin can use three types of compression <li><code class="highlighter-rouge">kylin.env.zookeeper.zk-acl</code>: Use a single ID as the ACL identifier. The default value is <em>world:anyone:rwcda</em>, <em>anyone</em> for anyone</li> </ul> +<h3 id="distributed-cache">Distributed query cache with Memcached</h3> + +<p>From v2.6.0, Kylin can use Memcached as the cache. To enable this feature, you need to do the following steps:</p> + +<ol> + <li> + <p>Install Memcached on 1 or multiple nodes;</p> + </li> + <li> + <p>Modify the applicationContext.xml under $KYLIN_HOME/tomcat/webapps/kylin/WEB-INF/classes directory, comment the following code:</p> + </li> +</ol> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff"><bean id="ehcache" + class="org.springframework.cache.ehcache.EhCacheManagerFactoryBean" + p:configLocation="classpath:ehcache-test.xml" p:shared="true"/> + +<bean id="cacheManager" class="org.springframework.cache.ehcache.EhCacheCacheManager" + p:cacheManager-ref="ehcache"/></code></pre></div> + +<p>Uncomment the following code:</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff"><bean id="ehcache" class="org.springframework.cache.ehcache.EhCacheManagerFactoryBean" + p:configLocation="classpath:ehcache-test.xml" p:shared="true"/> + +<bean id="remoteCacheManager" class="org.apache.kylin.cache.cachemanager.MemcachedCacheManager" /> +<bean id="localCacheManager" class="org.apache.kylin.cache.cachemanager.InstrumentedEhCacheCacheManager" + p:cacheManager-ref="ehcache"/> +<bean id="cacheManager" class="org.apache.kylin.cache.cachemanager.RemoteLocalFailOverCacheManager" /> + +<bean id="memcachedCacheConfig" class="org.apache.kylin.cache.memcached.MemcachedCacheConfig"> + <property name="timeout" value="500" /> + <property name="hosts" value="${kylin.cache.memcached.hosts}" /> +</bean></code></pre></div> + +<p>The value of <code class="highlighter-rouge">${kylin.cache.memcached.hosts}</code> in applicationContext.xml is from the value of <code class="highlighter-rouge">kylin.cache.memcached.hosts</code> in conf/kylin.properties.</p> + +<p>3.Add the following parameters to <code class="highlighter-rouge">conf/kylin.properties</code>:</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.cache-enabled=true +kylin.query.lazy-query-enabled=true +kylin.query.cache-signature-enabled=true +kylin.query.segment-cache-enabled=true +kylin.cache.memcached.hosts=memcached1:11211,memcached2:11211,memcached3:11211</code></pre></div> + +<ul> + <li><code class="highlighter-rouge">kylin.query.cache-enabled</code> controls the on-off of query cache, its default value is <code class="highlighter-rouge">true</code>.</li> + <li><code class="highlighter-rouge">kylin.query.lazy-query-enabled</code> : whether to lazily answer the queries that be sent repeatedly in a short time (hold it until the previous query be returned, and then reuse the result); The default value is <code class="highlighter-rouge">false</code>.</li> + <li><code class="highlighter-rouge">kylin.query.cache-signature-enabled</code> : whether to use the signature of a query to determine the cacheâs validity. The signature is calculated by the cube/hybrid list of the project, their last build time and other information (at the moment when cache is persisted); Itâs default value is <code class="highlighter-rouge">false</code>.</li> + <li><code class="highlighter-rouge">kylin.query.segment-cache-enabled</code> : whether to cache the segment level returned data (from HBase storage) into Memcached. This feature is mainly for the cube that built very frequently (e.g, streaming cube, whose last build time always changed, the whole query cache is very likely be cleaned). This only works when Memcached configured. Itâs default value is <code class="highlighter-rouge">false</code>.</li> + <li><code class="highlighter-rouge">kylin.cache.memcached.hosts</code>: a list of memcached node and port, connected with comma.</li> +</ul> + </article> </div> </div> Modified: kylin/site/docs/install/index.html URL: http://svn.apache.org/viewvc/kylin/site/docs/install/index.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/docs/install/index.html (original) +++ kylin/site/docs/install/index.html Thu Feb 28 01:48:46 2019 @@ -6378,8 +6378,8 @@ Kylin can be launched on any node in a H <li>Download a binary package for your Hadoop version from the <a href="https://kylin.apache.org/download/">Apache Kylin Download Site</a>. For example, Kylin 2.5.0 for HBase 1.x can be downloaded from the following command line:</li> </ol> -<div class="highlighter-rouge"><pre class="highlight"><code>Cd /usr/local/ -Wget http://mirror.bit.edu.cn/apache/kylin/apache-kylin-2.5.0/apache-kylin-2.5.0-bin-hbase1x.tar.gz +<div class="highlighter-rouge"><pre class="highlight"><code><span class="nb">cd</span> /usr/local/ +wget http://mirror.bit.edu.cn/apache/kylin/apache-kylin-2.5.0/apache-kylin-2.5.0-bin-hbase1x.tar.gz </code></pre> </div> @@ -6387,12 +6387,24 @@ Wget http://mirror.bit.edu.cn/apache/kyl <li>Unzip the tarball and configure the environment variable <code class="highlighter-rouge">$KYLIN_HOME</code> to the Kylin folder.</li> </ol> -<div class="highlighter-rouge"><pre class="highlight"><code>Tar -zxvf apache-kylin-2.5.0-bin-hbase1x.tar.gz -Cd apache-kylin-2.5.0-bin-hbase1x -Export <span class="nv">KYLIN_HOME</span><span class="o">=</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span> +<div class="highlighter-rouge"><pre class="highlight"><code>tar -zxvf apache-kylin-2.5.0-bin-hbase1x.tar.gz +<span class="nb">cd </span>apache-kylin-2.5.0-bin-hbase1x +<span class="nb">export </span><span class="nv">KYLIN_HOME</span><span class="o">=</span><span class="sb">`</span><span class="nb">pwd</span><span class="sb">`</span> </code></pre> </div> +<h3 id="kylin-tarball-structure">Kylin tarball structure</h3> +<ul> + <li><code class="highlighter-rouge">bin</code>: shell scripts to start/stop Kylin service, backup/restore metadata, as well as some utility scripts.</li> + <li><code class="highlighter-rouge">conf</code>: XML configuration files. The function of these xml files can be found in <a href="/docs/install/configuration.html">configuration page</a></li> + <li><code class="highlighter-rouge">lib</code>: Kylin jar files for external use, like the Hadoop job jar, JDBC driver, HBase coprocessor jar, etc.</li> + <li><code class="highlighter-rouge">meta_backups</code>: default backup folder when run âbin/metastore.sh backupâ;</li> + <li><code class="highlighter-rouge">sample_cube</code>: files to create the sample cube and its tables.</li> + <li><code class="highlighter-rouge">spark</code>: the default spark binary that built with Kylin.</li> + <li><code class="highlighter-rouge">tomcat</code> the tomcat web server that run Kylin application.</li> + <li><code class="highlighter-rouge">tool</code>: the jar file for running utility CLI.</li> +</ul> + <h3 id="checking-the-operating-environment">Checking the operating environment</h3> <p>Kylin runs on a Hadoop cluster and has certain requirements for the version, access rights, and CLASSPATH of each component. To avoid various environmental problems, you can run the script, <code class="highlighter-rouge">$KYLIN_HOME/bin/check-env.sh</code> to have a test on your environment, if there are any problems with your environment, the script will print a detailed error message. If there is no error message, it means that your environment is suitable for Kylin to run.</p> @@ -6431,6 +6443,16 @@ Kylin with pid 25964 has been stopped. <p>You can run <code class="highlighter-rouge">ps -ef | grep kylin</code> to see if the Kylin process has stopped.</p> +<h3 id="hdfs-folder-structure">HDFS folder structure</h3> +<p>Kylin will generate files on HDFS. The root folder is â/kylin/â, but will have the second level folder for each Kylin cluster, named with the metadata table name, by default it is âkylin_metadataâ (can be customized in <code class="highlighter-rouge">conf/kylin.properties</code>).</p> + +<p>Usually, there are at least these four kind of directories under <code class="highlighter-rouge">/kylin/kylin_metadata</code>: <code class="highlighter-rouge">cardinality</code>, <code class="highlighter-rouge">coprocessor</code>, <code class="highlighter-rouge">kylin-job_id</code>, <code class="highlighter-rouge">resources</code>. <br /> +1. <code class="highlighter-rouge">cardinality</code>: the output folder of the cardinality calculation job when Kylin loads a Hive table. It can be cleaned when there is no job running;<br /> +2. <code class="highlighter-rouge">coprocessor</code>: the folder that Kylin puts HBase coprocessor jar file. Please do not delete it. <br /> +3. <code class="highlighter-rouge">kylin-job_id</code>: the cubing jobâs output folder. Please keep them; if need a cleanup, follow the <a href="/docs/howto/howto_cleanup_storage.html">storage cleanup guide</a>. <br /> +4. <code class="highlighter-rouge">resources</code>: the metadata entries that too big to persisted in HBase (e.g, a dictionary or table snapshot); Please do not delete it; if need a cleanup, follow the <a href="/docs/howto/howto_backup_metadata.html">cleanup resources from metadata</a> <br /> +5. <code class="highlighter-rouge">jdbc-resources</code>: similar as <code class="highlighter-rouge">resources</code>, only appeared when using MySQL as the metadata storageã</p> + </article> </div> </div> Modified: kylin/site/docs/tutorial/create_cube.html URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/create_cube.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/docs/tutorial/create_cube.html (original) +++ kylin/site/docs/tutorial/create_cube.html Thu Feb 28 01:48:46 2019 @@ -6532,7 +6532,8 @@ b) precise implementation with bitmap (s Approximate TopN measure pre-calculates the top records in each dimension combination, it will provide higher performance in query time than no pre-calculation; Need specify two parameters here: the first is the column will be used as metrics for Top records (aggregated with SUM and then sorted in descending order); the second is the literal ID, represents the entity like seller_id;</li> </ul> - <p>Properly select the return type, depends on how many top records to inspect: top 10, top 100, top 500, top 1000, top 5000 or top 10000.</p> + <p>Properly select the return type, depends on how many top records to inspect: top 10, top 100, top 500, top 1000, top 5000 or top 10000. <br /> +<strong>Note:</strong> If you want to use <code class="highlighter-rouge">TOP_N</code>, you should also add a <code class="highlighter-rouge">SUM</code> measure for the âORDER | SUM by Columnâ. For example, if your creates a measure of Top100 seller_id by the sum of price, it is also should create a measure of SUM(price).</p> <p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8 measure-topn.png" alt="" /></p> </li> Modified: kylin/site/docs/tutorial/kylin_sample.html URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/kylin_sample.html?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/docs/tutorial/kylin_sample.html (original) +++ kylin/site/docs/tutorial/kylin_sample.html Thu Feb 28 01:48:46 2019 @@ -6345,36 +6345,44 @@ var _hmt = _hmt || []; <article class="post-content" > - <p>Kylin provides a script for you to create a sample Cube; the script will also create five sample hive tables:</p> + <p>Kylin provides a script for you to create a sample Cube; the script will also create five sample Hive tables:</p> <ol> - <li>Run ${KYLIN_HOME}/bin/sample.sh ; Restart kylin server to flush the caches;</li> - <li>Logon Kylin web with default user ADMIN/KYLIN, select project âlearn_kylinâ in the project dropdown list (left upper corner);</li> - <li>Select the sample cube âkylin_sales_cubeâ, click âActionsâ -> âBuildâ, pick up a date later than 2014-01-01 (to cover all 10000 sample records);</li> - <li>Check the build progress in âMonitorâ tab, until 100%;</li> - <li>Execute SQLs in the âInsightâ tab, for example:<br /> - select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt</li> - <li>You can verify the query result and compare the response time with hive;</li> + <li>Run <code class="highlighter-rouge">${KYLIN_HOME}/bin/sample.sh</code>; Restart Kylin server to flush the caches;</li> + <li>Logon Kylin web with default user and password ADMIN/KYLIN, select project <code class="highlighter-rouge">learn_kylin</code> in the project dropdown list (left upper corner);</li> + <li>Select the sample Cube <code class="highlighter-rouge">kylin_sales_cube</code>, click âActionsâ -> âBuildâ, pick up a date later than 2014-01-01 (to cover all 10000 sample records);</li> + <li>Check the build progress in the âMonitorâ tab, until 100%;</li> + <li>Execute SQLs in the âInsightâ tab, for example:</li> </ol> +<div class="highlighter-rouge"><pre class="highlight"><code>select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt +</code></pre> +</div> + +<p>6.You can verify the query result and compare the response time with Hive;</p> + <h2 id="quick-start-with-streaming-sample-cube">Quick Start with Streaming Sample Cube</h2> -<p>Kylin provides a script for streaming sample cube also. This script will create Kafka topic and send the random messages constantly to the generated topic.</p> +<p>Kylin provides a script for streaming sample Cube also. This script will create a Kafka topic and send random messages constantly to the generated topic.</p> <ol> <li>Export KAFKA_HOME first, and start Kylin.</li> - <li>Run ${KYLIN_HOME}/bin/sample.sh, it will generate Table DEFAULT.KYLIN_STREAMING_TABLE, Model kylin_streaming_model, Cube kylin_streaming_cube in learn_kylin project.</li> - <li>Run ${KYLIN_HOME}/bin/sample-streaming.sh, it will create Kafka Topic kylin_streaming_topic into the localhost:9092 broker. It also send the random 100 messages into kylin_streaming_topic per second.</li> - <li>Follow the the standard cube build process, and trigger the Cube kylin_streaming_cube build.</li> - <li>Check the build process in âMonitorâ tab, until at least one job is 100%.</li> - <li>Execute SQLs in the âInsightâ tab, for example:<br /> - select count(*), HOUR_START from kylin_streaming_table group by HOUR_START</li> - <li>Verify the query result.</li> + <li>Run <code class="highlighter-rouge">${KYLIN_HOME}/bin/sample.sh</code>, it will generate Table <code class="highlighter-rouge">DEFAULT.KYLIN_STREAMING_TABLE</code>, Model <code class="highlighter-rouge">kylin_streaming_model</code>, Cube <code class="highlighter-rouge">kylin_streaming_cube</code> in <code class="highlighter-rouge">learn_kylin project</code>.</li> + <li>Run <code class="highlighter-rouge">${KYLIN_HOME}/bin/sample-streaming.sh</code>, it will create Kafka <code class="highlighter-rouge">Topic kylin_streaming_topic</code> into the localhost:9092 broker. It also sends the random 100 messages into <code class="highlighter-rouge">Kylin_streaming_topic</code> per second.</li> + <li>Follow the standard Cube build process, and trigger the Cube <code class="highlighter-rouge">kylin_streaming_cube</code> build.</li> + <li>Check the build process in the âMonitorâ tab, until at least one job is 100%.</li> + <li>Execute SQLs in the âInsightâ tab, for example:</li> </ol> +<div class="highlighter-rouge"><pre class="highlight"><code>select count(*), HOUR_START from kylin_streaming_table group by HOUR_START +</code></pre> +</div> + +<p>7.Verify the query result.</p> + <h2 id="whats-next">Whatâs next</h2> -<p>You can create another cube with the sample tables, by following the tutorials.</p> +<p>You can create another Cube with the sample tables, by following the tutorials.</p> </article> </div> Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1854493&r1=1854492&r2=1854493&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Thu Feb 28 01:48:46 2019 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Thu, 14 Feb 2019 05:59:21 -0800</pubDate> - <lastBuildDate>Thu, 14 Feb 2019 05:59:21 -0800</lastBuildDate> + <pubDate>Wed, 27 Feb 2019 17:39:34 -0800</pubDate> + <lastBuildDate>Wed, 27 Feb 2019 17:39:34 -0800</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item> Added: kylin/site/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8 measure-topn.PNG URL: http://svn.apache.org/viewvc/kylin/site/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8%20measure-topn.PNG?rev=1854493&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/8 measure-topn.PNG ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream