Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1870664&r1=1870663&r2=1870664&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Sun Dec 1 09:13:50 2019 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Sun, 17 Nov 2019 05:59:02 -0800</pubDate> - <lastBuildDate>Sun, 17 Nov 2019 05:59:02 -0800</lastBuildDate> + <pubDate>Sun, 01 Dec 2019 01:05:07 -0800</pubDate> + <lastBuildDate>Sun, 01 Dec 2019 01:05:07 -0800</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item> @@ -1270,58 +1270,72 @@ Security: (depend on your security setti </item> <item> - <title>Apache Kylin v3.0.0-alpha Release Announcement</title> - <description><p>The Apache Kylin community is pleased to announce the release of Apache Kylin v3.0.0-alpha.</p> - -<p>Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Big Data supporting extremely large datasets.</p> + <title>ä½ ç¦»å¯è§åé ·ç«å¤§å±åªå·®ä¸å¥ Kylin + Davinci</title> + <description><p>Kylin æä¾ä¸ BI å·¥å ·çæ´åè½åï¼å¦ Tableauï¼PowerBI/Excelï¼MSTRï¼QlikSenseï¼Hue å SuperSetãä½å°±å¯è§åå·¥å ·èè¨ï¼Davinci è¯å¥½çäº¤äºæ§å个æ§åçå¯è§å大å±å±ç°ææï¼ä½¿å ¶ä¸ Kylin çç»åè½è®©å¤§é¨åç¨æ·ææ´å¥½çå¯è§ååæä½éªã</p> -<p>This is the first release of the new generation v3.x, the main feature introduced is the Real-time OLAP. All of the changes can be found in the <a href="/docs/release_notes.html">release notes</a>. Here we just highlight the main features.</p> - -<h1 id="important-features">Important features</h1> +<p>Davinci æ¯å½å 弿ºçå¤§æ°æ®å¯è§åå¹³å°ï¼æ¯ä¸æ¬¾åºäº webï¼æä¾ä¸ç«å¼æ°æ®å¯è§åè§£å³æ¹æ¡çå¹³å°ï¼Java ç³»ãç¨æ·åªéå¨å¯è§å UI ä¸ç®åé ç½®å³å¯æå¡å¤ç§æ°æ®å¯è§ååºç¨ï¼å¹¶æ¯æé«çº§äº¤äº/è¡ä¸åæ/æ¨¡å¼æ¢ç´¢/社交æºè½çå¯è§ååè½ã详æ 请访é®å ¶å®æ¹ç½ç«ï¼https://edp963.github.io/davinci/ï¼ã</p> -<h3 id="kylin-3654---real-time-olap">KYLIN-3654 - Real-time OLAP</h3> -<p>With the newly introduced Kylin real-time receiver and coordinator components, Kylin can implement a millisecond-level data preparation delay for streaming data from sources like Apache Kafka. This means since v3.0 on, Kylin can support sub-second level OLAP over historical batch data, near real-time streaming as well as real-time streaming. The user can use one OLAP platform to serve different scenarios. This solution has been deployed and verified in early adopters like eBay since 2018. For how to enable it, please refer to <a href="/docs30/tutorial/realtime_olap.html">this tutorial</a>.</p> +<h3 id="section">ä¸è½½ä¸å®è£ </h3> +<p>å®ä¿¡å¨ 2018 å¹´ 4 æåå¸äº Davinci ç第ä¸ä¸ªæ£å¼çæ¬ V0.1.0ï¼ç®åä¸ºæ¢ Davinci çæ£å¼åå¸çæ¬æ¯ v0.2.1ï¼å ¶æ¬¡å°±æ¯ v0.3 ç³»åçæµè¯çãDavinci èª 0.2.1 çæ¬ä¹åå¼å§æ¯æå¯¹ Kylin çè¿æ¥ãéè¿å¯¹æ¯å¯ä»¥åç°ï¼0.2 çæ¬åªæ¯ç®åå°å®ç°äºæ°æ®å¯è§åæ¥è¡¨ï¼å ¶åè½ä¸å ¨ï¼ç¨æ·äº¤äºæ§å·®ãä½éåç 0.3 çæ¬å¨ä¸æå°å®åå¹³å°åè½ï¼å¯ä»¥è¯´ä½¿ç¨è¿ç¨ä¸ä½éªæè¯å¥½ï¼åè½æ¯è¾é½å ¨ãå¹¶ä¸å®æ¹å¨ä¸æå°è¿è¡çæ¬çæ´æ°ä¸ï¼æä» ¥å¯¹äºå次æ¥è§¦ Davinci åæ³æ¥æèªå®ä¹ä»ªè¡¨çå大屿æçäººç¾¤ï¼æ´å»ºè®®ä½¿ç¨ææ°ç v0.3 ç³»åã</p> -<h3 id="kylin-3795---submit-spark-jobs-via-apache-livy">KYLIN-3795 - Submit Spark jobs via Apache Livy</h3> -<p>This feature allows the administrator to configure Kylin to integrate with Apache Livy (incubating) for Spark job submissions. The Spark job is submitted to the Livy Server through Livyâs REST API, instead of starting the Spark Driver process in local, which facilitates the management and monitoring of the Spark resources, and also releases the pressure of the nodes where the Kylin job server is running.</p> +<p>é¨ç½²ä¹åï¼å®è£ ç¯å¢è¦å å« JDKï¼MySQLï¼Mail Serverï¼PhantomJsãç¶åï¼å°å®ç½ç»å®ç github ç½ç«ä¸ä¸è½½ææ°åå¸ç软件å ï¼è§£åå°èªå®ä¹çå®è£ ç®å½ä¸ï¼å¹¶é ç½® davinci çç¯å¢åéãåæ¶ï¼ä¿®æ¹ bin ç®å½ä¸ initdb.sh 䏿°æ®åºä¿¡æ¯ä¸ºè¦åå§åçæ°æ®åºï¼è¿è¡èæ¬åå§åæ°æ®åºï¼sh bin/initdb.sh</p> -<h3 id="kylin-3820---a-curator-based-job-scheduler">KYLIN-3820 - A curator-based job scheduler</h3> -<p>A new job scheduler is added to automatically discover the Kylin nodes and do an automatic leader selection among them (only the leader will submit jobs). With this feature, you can easily deploy and scale out Kylin nodes without manually update the node address in <code class="highlighter-rouge">kylin.properties</code> and restart Kylin to take effective.</p> +<p>ä¹åï¼è¿å ¥å°configæä»¶å¤¹ä¸ï¼å° application.yml.example éå½å为 application.yml åå¼å§é ç½®ãå¦ï¼è®¿é®å°åå端å£å·ï¼é»è®¤ç«¯å£å·ä¸º 8080ï¼å¯èªå®ä¹ï¼ï¼æ°æ®æºçé ç½®ã详ç»çé ç½®é¨ç½²è¯·åèå®ç½è¯´æï¼https://edp963.github.io/davinci/deployment.htmlï¼ï¼å®æé¨ç½²åãå¨ bin ç®å½ä¸æ§è¡ sh start-server.sh å½ä»¤å¯å¨ Davinci æå¡ã</p> -<h1 id="other-enhancements">Other enhancements</h1> +<p>æåï¼æå¼æµè§å¨ï¼è®¿é®å°åï¼http://{é ç½®çå°å}:{é ç½®ç端å£å·}ï¼å³å¯è¿å ¥ Davinciï¼æ°ç¨æ·è¿è¡æ³¨åå³å¯ä½¿ç¨è¯¥æå¡ã<br /> +<img src="/images/blog/davinci/login.png" alt="" /></p> +<center>ç»éçé¢</center> -<h3 id="kylin-3716---fastthreadlocal-replaces-threadlocal">KYLIN-3716 - FastThreadLocal replaces ThreadLocal</h3> -<p>Using FastThreadLocal instead of ThreadLocal can improve Kylinâs overall performance to some extent.</p> - -<h3 id="kylin-3867---enable-jdbc-to-use-key-store--trust-store-for-https-connection">KYLIN-3867 - Enable JDBC to use key store &amp; trust store for https connection</h3> -<p>By using HTTPS, the authentication information used by JDBC is protected, making Kylin more secure.</p> - -<h3 id="kylin-3905---enable-shrunken-dictionary-default">KYLIN-3905 - Enable shrunken dictionary default</h3> -<p>By default, the shrunken dictionary is enabled, and the precise counting scene for high cardinal dimensions can significantly reduce the build time.</p> - -<h3 id="kylin-3839---storage-clean-up-after-the-refreshing-and-deleting-a-segment">KYLIN-3839 - Storage clean up after the refreshing and deleting a segment</h3> -<p>Clear unnecessary data files in a timely manner</p> - -<p><strong>Download</strong></p> - -<p>To download Apache Kylin v3.0.0-alpha source code or binary package, visit the <a href="http://kylin.apache.org/download">download</a> page.</p> - -<p><strong>Upgrade</strong></p> +<h3 id="kylin">è¿æ¥ Kylin</h3> +<p>Davinci ç宿¹ç½ç«ä»ç»å ¶æ¯æ JDBC æ°æ®æºè¿æ¥ï¼è¿å°±ä¸º kylin çè¿æ¥æä¾äºå¯è½ãDavinci é»è®¤å¯æ¯æçæ°æ®æºä¸å æ¬ kylinï¼ä½æ¯æä¾äºèªå®ä¹æ°æ®æºé ç½®æä»¶ãé¦å ï¼è¿å ¥ lib ç®å½ä¸æ·»å kylin-jdbc å ï¼å ¶æ¬¡ï¼è¿å ¥configç®å½ä¸ï¼æ´æ¹datasource_driver.yml.exampleæä»¶å为datasource_driver.yml ä½¿å ¶çæï¼å¹¶å¨æä»¶éé ç½®Kylin ç¸å ³ä¿¡æ¯ï¼å¦ä¸ï¼<br /> +<code class="highlighter-rouge"> +kylin: + name: kylin + desc: kylin + driver: org.apache.kylin.jdbc.Driver + keyword_prefix: \" + keyword_suffix: \" + alias_prefix: \" + alias_suffix: \" +</code><br /> +é坿å¡ï¼ä½¿é ç½®çæã</p> -<p>Follow the <a href="/docs/howto/howto_upgrade.html">upgrade guide</a>.</p> +<p>æåï¼å¯åä¸ä¸ªç®åçæ°æ®è¿æ¥æµè¯æ¥éªè¯æ¯å¦è¿æ¥æåãå¨ Source é¨åæ·»å æ°æ®æº kylin å¹¶å¡«åç¸å ³çç¨æ·åï¼å¯ç ï¼url å°åçä¿¡æ¯æ¥è¿è¡è¿æ¥æµè¯ï¼å¦ä¸å¾æç¤ºï¼<br /> +<img src="/images/blog/davinci/connect.png" alt="" /></p> +<center>æ°æ®æºè¿æ¥</center> +<p>è¿æ¥æååï¼æ¥çå¨ View å±è¾å ¥æ¥è¯¢ SQL è¯å¥ï¼ç¹å»å³ä¸è§çæ§è¡æé®å³å¯ãå¦ä¸å¾ï¼<br /> +<img src="/images/blog/davinci/query.png" alt="" /></p> + +<h3 id="section-1">å¶ä½æ°æ®ä»ªè¡¨çå大å±å±ç¤º</h3> +<p>Davinci ä¸ºç¨æ·æä¾äºä¸¤ç§èªå®ä¹çæ¥è¡¨å½¢å¼ï¼ä¸ç§æ¯å¸¸è§çå¯ä»¥èªç±å¸å±çæ¥è¡¨ï¼dashbordï¼ï¼é¤æ¤ä¹å¤ï¼è¿æä¾äºç¨æ·å¯èªå®å¶ç大å±å±ç°å½¢å¼ï¼displayï¼ã</p> + +<p>æä»¬å¯ä»¥å©ç¨ Widget å±ä¸°å¯çå¾è¡¨æ¥å±ç° View å±çæ°æ®ï¼è¿èæ ¹æ®éæ±å¶ä½ä¸åå±ç°å½¢å¼çæ¥è¡¨ãé£ä¹å¨ Widget å±ï¼æä»¬å¯ä»¥éè¿ææ½çæ¹å¼ï¼ä¸ºä¸åç»´åº¦çæ°æ®éæ©éåçå¾åè¿è¡å±ç¤ºã仪表çï¼Dashbordï¼çå±ç°å¦ä¸å¾ï¼<br /> +<img src="/images/blog/davinci/dashboard.png" alt="" /></p> +<center>æ°æ®ä»ªè¡¨ç</center> +<p>å¦æç¨æ·éè¦æ´å é ·ç«ç大å±å±ç°å½¢å¼ï¼æä»¬å¯ä»¥ä½¿ç¨ Display æ¥æå¨å®å¶æ¥è¡¨çå±ç°å½¢å¼ï¼å¦ä¸å¾ï¼<br /> +<img src="/images/blog/davinci/setting.png" alt="" /></p> +<center>Display åè½åº</center> +<p>å ¶ä¸ï¼<br /> +ç½æ ¼åºåï¼å¸ç½®ç»å¸åºåï¼ææå±ç°åºå<br /> +èè²åºåï¼æ·»å Widget å±å¶ä½çå¾è¡¨ï¼æ·»å è¿ç¨ä¸æä»¬å¯ä»¥èªå®ä¹å®æ¶å·æ°æ°æ®ï¼<br /> +红è²åºåï¼æ·»å è¾ å©å¾å½¢ï¼å¦ï¼ææ¬ç¼è¾æ¡ï¼ç©å½¢ï¼<br /> +绿è²åºåï¼ç»å¸ä¸ä¸åå ç´ çå¾å±è®¾ç½®ï¼<br /> +é»è²åºåï¼å¤§å±çèæ¯è®¾ç½®åºåï¼å æ¬å±å¹ç尺寸ï¼ç¼©æ¾è§åï¼èæ¯é¢è²ï¼æ·»å èæ¯å¾çï¼æªåå°ç®ã</p> -<p><strong>Feedback</strong></p> +<p>éè¿è¿äºåè½ï¼æä»¬å¯ä»¥è½»è½»æ¾æ¾å°å®å¶åºç¬¦ååºæ¯éæ±ç卿大å±å±ç¤ºææãå¦ä¸ç¤ºä¾ï¼<br /> +<img src="/images/blog/davinci/monitor.png" alt="" /></p> -<p>If you face issue or question, please send mail to Apache Kylin dev or user mailing list: d...@kylin.apache.org , u...@kylin.apache.org; Before sending, please make sure you have subscribed the mailing list by dropping an email to dev-subscr...@kylin.apache.org or user-subscr...@kylin.apache.org.</p> +<h3 id="section-2">æ»ç»</h3> +<p>Kylin æ¬èº«ä¹æä¾ç®åçå¾è¡¨å±ç¤ºï¼ä¾å¦ï¼é¥¼å¾ï¼æ±ç¶å¾çãä½å¹¶ä¸è½æ»¡è¶³å¤§å¤æ°ç¨æ·çéæ±ï¼éè¿ Kylin+Davinci çç»åï¼æä»¬å¯ä»¥å° Kylin å¿«éæ¥è¯¢ç¹ç¹ä¸ Davinci 夿 ·åå个æ§åçå±ç¤ºææå åçæ´åèµ·æ¥ï¼ä»è满足æ´å¤ç¨æ·çéæ±ï¼åå¥½å¤§æ°æ®åææåä¸ç«çæå¡å·¥ä½ã</p> -<p><em>Great thanks to everyone who contributed!</em></p> +<p>é£ä¹æ¬æ¬¡éæ© Davinci æ¥åæ°æ®å¯è§åå±ç°ï¼ä¸æ¯ç±äºå ¶èªèº«ä¸°å¯çåè½åä¸ç«å¼çå¯è§ååæå±ç°ãåè ï¼å ¶å¼æºçæ§è´¨åå¼åçè¯è¨ï¼ä¸ºå¤§å¤æ°å¼åè æä¾äºæ´å¤çå¯è½ï¼å¦æä½ 忬¢ï¼é£ä¹ä½ å°±å¯ä»¥å¨å ¶åºç¡ä¸è¿è¡äºæ¬¡å¼åï¼æ¥æ»¡è¶³èªå·±çåºæ¯ã</p> </description> - <pubDate>Fri, 19 Apr 2019 13:00:00 -0700</pubDate> - <link>http://kylin.apache.org/blog/2019/04/19/release-v3.0.0-alpha/</link> - <guid isPermaLink="true">http://kylin.apache.org/blog/2019/04/19/release-v3.0.0-alpha/</guid> + <pubDate>Thu, 23 May 2019 08:00:00 -0700</pubDate> + <link>http://kylin.apache.org/cn_blog/2019/05/23/Davinci-Kylin-Insight/</link> + <guid isPermaLink="true">http://kylin.apache.org/cn_blog/2019/05/23/Davinci-Kylin-Insight/</guid> - <category>blog</category> + <category>cn_blog</category> </item> @@ -1382,6 +1396,62 @@ Security: (depend on your security setti </item> <item> + <title>Apache Kylin v3.0.0-alpha Release Announcement</title> + <description><p>The Apache Kylin community is pleased to announce the release of Apache Kylin v3.0.0-alpha.</p> + +<p>Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Big Data supporting extremely large datasets.</p> + +<p>This is the first release of the new generation v3.x, the main feature introduced is the Real-time OLAP. All of the changes can be found in the <a href="/docs/release_notes.html">release notes</a>. Here we just highlight the main features.</p> + +<h1 id="important-features">Important features</h1> + +<h3 id="kylin-3654---real-time-olap">KYLIN-3654 - Real-time OLAP</h3> +<p>With the newly introduced Kylin real-time receiver and coordinator components, Kylin can implement a millisecond-level data preparation delay for streaming data from sources like Apache Kafka. This means since v3.0 on, Kylin can support sub-second level OLAP over historical batch data, near real-time streaming as well as real-time streaming. The user can use one OLAP platform to serve different scenarios. This solution has been deployed and verified in early adopters like eBay since 2018. For how to enable it, please refer to <a href="/docs30/tutorial/realtime_olap.html">this tutorial</a>.</p> + +<h3 id="kylin-3795---submit-spark-jobs-via-apache-livy">KYLIN-3795 - Submit Spark jobs via Apache Livy</h3> +<p>This feature allows the administrator to configure Kylin to integrate with Apache Livy (incubating) for Spark job submissions. The Spark job is submitted to the Livy Server through Livyâs REST API, instead of starting the Spark Driver process in local, which facilitates the management and monitoring of the Spark resources, and also releases the pressure of the nodes where the Kylin job server is running.</p> + +<h3 id="kylin-3820---a-curator-based-job-scheduler">KYLIN-3820 - A curator-based job scheduler</h3> +<p>A new job scheduler is added to automatically discover the Kylin nodes and do an automatic leader selection among them (only the leader will submit jobs). With this feature, you can easily deploy and scale out Kylin nodes without manually update the node address in <code class="highlighter-rouge">kylin.properties</code> and restart Kylin to take effective.</p> + +<h1 id="other-enhancements">Other enhancements</h1> + +<h3 id="kylin-3716---fastthreadlocal-replaces-threadlocal">KYLIN-3716 - FastThreadLocal replaces ThreadLocal</h3> +<p>Using FastThreadLocal instead of ThreadLocal can improve Kylinâs overall performance to some extent.</p> + +<h3 id="kylin-3867---enable-jdbc-to-use-key-store--trust-store-for-https-connection">KYLIN-3867 - Enable JDBC to use key store &amp; trust store for https connection</h3> +<p>By using HTTPS, the authentication information used by JDBC is protected, making Kylin more secure.</p> + +<h3 id="kylin-3905---enable-shrunken-dictionary-default">KYLIN-3905 - Enable shrunken dictionary default</h3> +<p>By default, the shrunken dictionary is enabled, and the precise counting scene for high cardinal dimensions can significantly reduce the build time.</p> + +<h3 id="kylin-3839---storage-clean-up-after-the-refreshing-and-deleting-a-segment">KYLIN-3839 - Storage clean up after the refreshing and deleting a segment</h3> +<p>Clear unnecessary data files in a timely manner</p> + +<p><strong>Download</strong></p> + +<p>To download Apache Kylin v3.0.0-alpha source code or binary package, visit the <a href="http://kylin.apache.org/download">download</a> page.</p> + +<p><strong>Upgrade</strong></p> + +<p>Follow the <a href="/docs/howto/howto_upgrade.html">upgrade guide</a>.</p> + +<p><strong>Feedback</strong></p> + +<p>If you face issue or question, please send mail to Apache Kylin dev or user mailing list: d...@kylin.apache.org , u...@kylin.apache.org; Before sending, please make sure you have subscribed the mailing list by dropping an email to dev-subscr...@kylin.apache.org or user-subscr...@kylin.apache.org.</p> + +<p><em>Great thanks to everyone who contributed!</em></p> +</description> + <pubDate>Fri, 19 Apr 2019 13:00:00 -0700</pubDate> + <link>http://kylin.apache.org/blog/2019/04/19/release-v3.0.0-alpha/</link> + <guid isPermaLink="true">http://kylin.apache.org/blog/2019/04/19/release-v3.0.0-alpha/</guid> + + + <category>blog</category> + + </item> + + <item> <title>Real-time Streaming Design in Apache Kylin</title> <description><h2 id="why-build-real-time-streaming-in-kylin">Why Build Real-time Streaming in Kylin</h2> <p>The real-time streaming feature is contributed by eBay big data team in Kylin 3.0, the purpose we build real-time streaming is:</p> @@ -1530,84 +1600,6 @@ The checkpoint info is the smallest part <category>blog</category> - - </item> - - <item> - <title>Apache Kylin v2.6.0 Release Announcement</title> - <description><p>The Apache Kylin community is pleased to announce the release of Apache Kylin v2.6.0.</p> - -<p>Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Big Data supporting extremely large datasets.</p> - -<p>This is a major release after 2.5.0, including many enhancements. All of the changes can be found in the <a href="https://kylin.apache.org/docs/release_notes.html">release notes</a>. Here just highlight the major ones:</p> - -<h3 id="sdk-for-jdbc-sources">SDK for JDBC sources</h3> -<p>Apache Kylin has already supported several data sources like Amazon Redshift, SQL Server through JDBC. <br /> -To help developers handle SQL dialect differences and easily implement a new data source through JDBC, Kylin provides a new data source SDK with APIs for:<br /> -* Synchronize metadata and data from JDBC source<br /> -* Build cube from JDBC source<br /> -* Query pushdown to JDBC source engine when cube is unmatched</p> - -<p>Check KYLIN-3552 for more.</p> - -<h3 id="memcached-as-distributed-cache">Memcached as distributed cache</h3> -<p>In the past, query caches are not efficiently used in Kylin due to two aspects: aggressive cache expiration strategy and local cache. <br /> -Because of the aggressive cache expiration strategy, useful caches are often cleaned up unnecessarily. <br /> -Because query caches are stored in local servers, they cannot be shared between servers. <br /> -And because of the size limitation of local cache, not all useful query results can be cached.</p> - -<p>To deal with these shortcomings, we change the query cache expiration strategy by signature checking and introduce the memcached as Kylinâs distributed cache so that Kylin servers are able to share cache between servers. <br /> -And itâs easy to add memcached servers to scale out distributed cache. With enough memcached servers, we can cached things as much as possible. <br /> -Then we also introduce segment level query cache which can not only speed up query but also reduce the rpcs to HBase. <br /> -The related tasks are KYLIN-2895, KYLIN-2894, KYLIN-2896, KYLIN-2897, KYLIN-2898, KYLIN-2899.</p> - -<h3 id="forkjoinpool-for-fast-cubing">ForkJoinPool for fast cubing</h3> -<p>In the past, fast cubing uses split threads, task threads and main thread to do the cube building, there is complex join and error handling logic.</p> - -<p>The new implement leverages the ForkJoinPool from JDK, the event split logic is handled in<br /> -main thread. Cuboid task and sub-tasks are handled in fork join pool, cube results are collected<br /> -async and can be write to output earlier. Check KYLIN-2932 for more.</p> - -<h3 id="improve-hllcounter-performance">Improve HLLCounter performance</h3> -<p>In the past, the way to create HLLCounter and to compute harmonic mean are not efficient.</p> - -<p>The new implement improve the HLLCounter creation by copy register from another HLLCounter instead of merge. To compute harmonic mean in the HLLCSnapshot, it does the enhancement by <br /> -* using table to cache all 1/2^r without computing on the fly<br /> -* remove floating addition by using integer addition in the bigger loop<br /> -* remove branch, e.g. neednât checking whether registers[i] is zero or not, although this is minor improvement.</p> - -<p>Check KYLIN-3656 for more.</p> - -<h3 id="improve-cuboid-recommendation-algorithm">Improve Cuboid Recommendation Algorithm</h3> -<p>In the past, to add cuboids which are not prebuilt, the cube planner turns to mandatory cuboids which are selected if its rollup row count is above some threshold. <br /> -There are two shortcomings:<br /> -* The way to estimate the rollup row count is not good<br /> -* Itâs hard to determine the threshold of rollup row count for recommending mandatory cuboids</p> - -<p>The new implement improves the way to estimate the row count of un-prebuilt cuboids by rollup ratio rather than exact rollup row count. <br /> -With better estimated row counts for un-prebuilt cuboids, the cost-based cube planner algorithm will decide which cuboid to be built or not and the threshold for previous mandatory cuboids is not needed. <br /> -By this improvement, we donât need the threshold for mandatory cuboids recommendation, and mandatory cuboids can only be manually set and will not be recommended. Check KYLIN-3540 for more.</p> - -<p><strong>Download</strong></p> - -<p>To download Apache Kylin v2.6.0 source code or binary package, visit the <a href="http://kylin.apache.org/download">download</a> page.</p> - -<p><strong>Upgrade</strong></p> - -<p>Follow the <a href="/docs/howto/howto_upgrade.html">upgrade guide</a>.</p> - -<p><strong>Feedback</strong></p> - -<p>If you face issue or question, please send mail to Apache Kylin dev or user mailing list: d...@kylin.apache.org , u...@kylin.apache.org; Before sending, please make sure you have subscribed the mailing list by dropping an email to dev-subscr...@kylin.apache.org or user-subscr...@kylin.apache.org.</p> - -<p><em>Great thanks to everyone who contributed!</em></p> -</description> - <pubDate>Fri, 18 Jan 2019 12:00:00 -0800</pubDate> - <link>http://kylin.apache.org/blog/2019/01/18/release-v2.6.0/</link> - <guid isPermaLink="true">http://kylin.apache.org/blog/2019/01/18/release-v2.6.0/</guid> - - - <category>blog</category> </item>
Added: kylin/site/images/blog/davinci/connect.png URL: http://svn.apache.org/viewvc/kylin/site/images/blog/davinci/connect.png?rev=1870664&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/blog/davinci/connect.png ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream Added: kylin/site/images/blog/davinci/dashboard.png URL: http://svn.apache.org/viewvc/kylin/site/images/blog/davinci/dashboard.png?rev=1870664&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/blog/davinci/dashboard.png ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream Added: kylin/site/images/blog/davinci/login.png URL: http://svn.apache.org/viewvc/kylin/site/images/blog/davinci/login.png?rev=1870664&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/blog/davinci/login.png ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream Added: kylin/site/images/blog/davinci/monitor.png URL: http://svn.apache.org/viewvc/kylin/site/images/blog/davinci/monitor.png?rev=1870664&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/blog/davinci/monitor.png ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream Added: kylin/site/images/blog/davinci/query.png URL: http://svn.apache.org/viewvc/kylin/site/images/blog/davinci/query.png?rev=1870664&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/blog/davinci/query.png ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream Added: kylin/site/images/blog/davinci/setting.png URL: http://svn.apache.org/viewvc/kylin/site/images/blog/davinci/setting.png?rev=1870664&view=auto ============================================================================== Binary file - no diff available. Propchange: kylin/site/images/blog/davinci/setting.png ------------------------------------------------------------------------------ svn:mime-type = application/octet-stream