Author: lidong Date: Wed Jan 19 08:32:36 2022 New Revision: 1897192 URL: http://svn.apache.org/viewvc?rev=1897192&view=rev Log: Add new blog: The future of Kylin
Added: kylin/site/blog/2022/ kylin/site/blog/2022/01/ kylin/site/blog/2022/01/12/ kylin/site/blog/2022/01/12/The-Future-Of-Kylin/ kylin/site/blog/2022/01/12/The-Future-Of-Kylin/index.html kylin/site/cn_blog/2022/ kylin/site/cn_blog/2022/01/ kylin/site/cn_blog/2022/01/12/ kylin/site/cn_blog/2022/01/12/The-Future-Of-Kylin/ kylin/site/cn_blog/2022/01/12/The-Future-Of-Kylin/index.html kylin/site/images/blog/the_future_of_kylin.png (with props) Modified: kylin/site/blog/index.html kylin/site/cn/blog/index.html kylin/site/download/index.html kylin/site/feed.xml Added: kylin/site/blog/2022/01/12/The-Future-Of-Kylin/index.html URL: http://svn.apache.org/viewvc/kylin/site/blog/2022/01/12/The-Future-Of-Kylin/index.html?rev=1897192&view=auto ============================================================================== --- kylin/site/blog/2022/01/12/The-Future-Of-Kylin/index.html (added) +++ kylin/site/blog/2022/01/12/The-Future-Of-Kylin/index.html Wed Jan 19 08:32:36 2022 @@ -0,0 +1,333 @@ +<!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> +<!doctype html> +<html> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <title>Apache Kylin | The future of Apache Kylinï¼More powerful and easy-to-use OLAP</title> + <meta name="description" content="01 Apache Kylin Today"> + <meta name="author" content="Apache Kylin"> + <link rel="shortcut icon" href="fav.png" type="image/png"> + + + +<link rel="stylesheet" href="/assets/css/animate.css"> +<!-- Bootstrap --> +<link rel="stylesheet" href="/assets/css/bootstrap.min.css"> + +<!-- Fonts --> +<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> --> + +<!-- Icons --> +<link rel="stylesheet" href="/assets/css/font-awesome.min.css"> + + <!-- Custom styles --> + <link rel="stylesheet" href="/assets/css/styles.css"> + <link rel="stylesheet" href="/assets/css/docs.css"> + <link rel="stylesheet" href="/assets/css/pygments.css"> + + <link rel="canonical" href="http://kylin.apache.org/blog/2022/01/12/The-Future-Of-Kylin/"> + <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" /> + +<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]--> +<!-- Global site tag (gtag.js) - Google Analytics --> +<script async src="https://www.googletagmanager.com/gtag/js?id=UA-120788561-1"></script> +<script> + window.dataLayer = window.dataLayer || []; + function gtag(){dataLayer.push(arguments);} + gtag('js', new Date()); + + gtag('config', 'UA-120788561-1'); +</script> +<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script> +<script type="text/javascript" src="/assets/js/nside.js"></script> </script> +<script type="text/javascript" src="/assets/js/nnav.js"></script> </script> +<script> +var _hmt = _hmt || []; +(function() { + var hm = document.createElement("script"); + hm.src = "https://hm.baidu.com/hm.js?bdc5e03add430c0b72cc0eb91eabfa99"; + var s = document.getElementsByTagName("script")[0]; + s.parentNode.insertBefore(hm, s); +})(); +</script> + +</head> + + <body> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<header id="header" > + + <!-- Main Menu --> + <nav class="navbar navbar-default" role="navigation" id="nav-wrapper"> + <div class="container-fluid" id="nav"> + <!-- + <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg"> + --> + <!-- Brand and toggle get grouped for better mobile display --> + <div class="navbar-header"> + <img class="navbar-logo" width="46" src="/assets/images/kylin_logo.png" ></img> + <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <ul class="nav icon-navbar"> + <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li> + <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li> + <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li> + </ul> + </div> + + <!-- Collect the nav links, forms, and other content for toggling --> + <div class="navbar-collapse collapse" id="bs-example-navbar-collapse-1"> + + <ul class="nav navbar-nav"> + + <li><a href="/">Home</a></li> + <li> + <a href="/docs" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Docs<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/docs/">Latest Release(Kylin 4.0.1)</a></li> + <li><a href="/docs31/">Kylin 3.1.3</a></li> + <li><a href="/docs24/">Kylin 2.4.0</a></li> + <li><a href="/archive/">Archive</a></li> + </ul> + </li> + <li><a href="/download">Download</a></li> + <li><a href="/community" >Community</a></li> + <li> + <a href="/development" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Development<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/development40/">Kylin 4.x</a></li> + <li><a href="/development/">Kylin 3.x And Older Versions</a></li> + </ul> + </li> + <li><a href="/blog">Blog</a></li> + <li><a href="/cn" >䏿ç</a></li> + </ul> + </div><!-- /.navbar-collapse --> + </div><!-- /.container-fluid --> + </nav> + + <div id="head" class="parallax normal-header" > + <div class="text-center header-apache"> + <a href="http://apache.org/foundation/contributing.html" title="Support Apache" style="margin-left: 150px;"> + <div> + <img src="https://www.apache.org/images/SupportApache-small.png" > + </div> + </a> + </div> + </div> + + </header> + + <div class="page-content main"> + <header style=" padding:2em 0 0 "> + <div class="container" > + <div style=" padding:0 4em"> + <div class="blog-icon"> + <img width="30" src="/assets/images/icon_blog_w.png"> + </div> + <h4 class="index-title" style=" float:left;"><span>Apache Kylin⢠Technical Blog</span></h4> + </div> + </div> + </div> + + <div class="container blog"> + <div> + <article class="post-content" > + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<div class="post" style=" padding:2em 4em 4em 4em"> + + <header class="post-header"> + <h1 class="post-title">The future of Apache Kylinï¼More powerful and easy-to-use OLAP</h1> + <p class="post-meta" >Jan 12, 2022 ⢠Yang Li</p> + </header> + + <article class="post-content" > + <h2 id="apache-kylin-today">01 Apache Kylin Today</h2> + +<p>Currently, the latest release of Apache Kylin is 4.0.1. Apache Kylin 4.0 is a major version update after Kylin 3.x (HBase Storage). Kylin 4.0 uses Parquet to replace HBase as storage engine, so as to improve file scanning performance. At the same time, Kylin 4.0 reimplements the spark based build engine and query engine, making it possible to separate computing and storage, and better adapt to the technology trend of cloud native.</p> + +<p>Kylin 4.0 comprehensively updated the build and query engine, realized the deployment mode without Hadoop dependency, decrease the complexity of deployment. In addition, combined with the feedback of Kylin users and the trend of OLAP technology, Kylin community found that there are still some weaknesses and deficiencies in todayâs Apache Kylin, such as the ability of business semantic layer needs to be strengthened and the modification of model/cube is not flexible. With these, we thinking a few things to do::</p> + +<ul> + <li>Multi-dimensional query ability friendly to non-technical personnel. Multi-dimensional model is the key to distinguish Kylin from general OLAP engine. The feature is that the model concept based on dimension and measurement is more friendly to non-technical personnel and closer to the goal of âeveryone is a data analystâ. The multi-dimensional query capability that non-technical personnel can use should be the new focus of Kylin technology.</li> + <li>Native Engine. The query engine of Kylin still has much room for improvement in vector acceleration and cpu instruction level optimization. The Spark community Kylin relies on also has a strong demand for native engine. It is optimistic that native engine can improve the performance of Kylin by at least three times, which is worthy of investment.</li> + <li>More cloud native capabilities. Kylin 4.0 has only completed the initial cloud deployment and realized the features of rapid deployment and dynamic resource scaling on the cloud, but there are still many cloud native capabilities to be developed.</li> +</ul> + +<p>More explanations are following.</p> + +<h2 id="kylin-as-a-multi-dimensional-database">02 KYLIN AS A MULTI-DIMENSIONAL DATABASE</h2> +<p>The core of Kylin is a multi-dimensional database, which is a special OLAP engine. Although Kylin has always had the ability of relational database since its birth, and it is often compared with other relational OLAP engines, what really makes Kylin different is multi-dimensional model and multi-dimensional database ability. Considering the essence of Kylin and its wide range of business uses in the future (not only technical uses), we will clearly position Kylin as a multi-dimensional database. We also hope that through multi-dimensional model and precomputation technology, Apache Kylin can make non-technical people understand and afford big data, and finally realize data democratization.</p> + +<h3 id="the-semantic-layer">THE SEMANTIC LAYER</h3> +<p>The key difference between multi-dimensional database and relational database is business expression ability. Although SQL has strong expression ability and is the basic skill of data analysts, SQL and relational database are still too difficult for non-technical personnel if we aim at âeveryone is a data analystâ. From the perspective of non-technical personnel, the data lake and data warehouse are like a dark room. They know that there is a lot of data, but they canât see clearly, understand and use this data because they donât understand database theory and SQL.<br /> +How to make the Data Lake (and data warehouse) clear to non-technical personnel? This requires introducing a more friendly data model for non-technical personnel ââ multi-dimensional data model. While the relational model describes the technical form of data, the multi-dimensional model describes the business form of data. In multi-dimensional database, measurement corresponds to business indicators that everyone understands, and dimension is the perspective of comparing and observing these business indicators. Compare KPI with last month and compare performance between parallel business units, which are concepts understood by every non-technical personnel. By mapping the relational model to the multi-dimensional model, the essence is to enhance the business semantics on the technical data, form a business semantic layer, and help non-technical personnel understand, explore and use the data.<br /> +In order to enhance Kylinâs ability as the semantic layer of multi-dimensional database, supporting multi-dimensional query language is the key content of Kylin roadmap, such as MDX and DAX. MDX can transform the data model in Kylin into a business friendly language, endow data with business value, and facilitate Kylinâs multi-dimensional analysis with BI tools such as Excel and Tableau.</p> + +<h3 id="precomputation-and-model-flexibility">PRECOMPUTATION AND MODEL FLEXIBILITY</h3> +<p>It is kylinâs unchanging mission to continue to reduce the cost of a single query through precomputation technology so that ordinary people can afford big data. If the multi-dimensional model solves the problem that non-technical personnel can understand data, then precomputation can solve the problem that ordinary people can afford data. Both are necessary conditions for data democratization. Through one calculation and multiple use, the data cost can be shared by multiple users to achieve the scale effect that the more users, the cheaper. Precalculation is Kylinâs traditional strength, but it lacks some flexibility in the change of precalculation model. In order to strengthen the ability to change models flexibly of Kylin and bring more optimization room, Kylin community expects to propose a new metadata format in Kylin in the future to make precalculation more flexible, be able to cope with that table format or business requirements may change at any time.</p> + +<h3 id="summary">SUMMARY</h3> +<p>To sum up, we will make it clear that Kylinâs technical position is a multi-dimensional database. Through multi-dimensional model and precomputation technology, ordinary people can understand and afford big data, and finally realize the vision of data democratization. Meanwhile, for todayâs users who use Kylin as the SQL acceleration layer, Kylin will continue to maintain a complete SQL interface to ensure that the precomputation technology can be used by both relational model and multi-dimensional model.<br /> +In the figure below, we can clearly see the direction of Kylinâs attention in the future. The newly added and modified parts are roughly marked in blue and orange.</p> + +<p><img src="/images/blog/the_future_of_kylin.png" alt="" /></p> + +<h2 id="the-future-plan">03 THE FUTURE PLAN</h2> + +<p>Based on Kylinâs positioning as a multi-dimensional database, combined with the existing capabilities of Kylin that need to be strengthened, and in order to support the long-awaited features of users such as schema change, we plan to introduce a new metadata format of DataModel into Kylin : no longer expose Cube to users, but simplify the metadata dependency to âModel -> Tableâ.<br /> +As metadata is the basis and contract for the subsequent collaborative development of Kylin, the design and development of the new metadata format will be the focus of Kylin communityâs work at present and in the next few months. The metadata design and discussion proposal will be released later. You are welcome to participate in the discussion. Not surprisingly, the new metadata format will meet you this year.<br /> +In addition to metadata format upgrading, the build and query engine which support metadata upgrade, semantic layer capability (MDX), better integration with BI tools and native engine are also the key work that Kylin community has been actively promoting. More like-minded users and developers are welcome to participate in development and promote Kylin community development jointly.</p> + +<p>** Further Reading **<br /> +- https://en.wikipedia.org/wiki/Data_model<br /> +- https://en.wikipedia.org/wiki/Semantic_layer<br /> +- https://en.wikipedia.org/wiki/Multidimensional_analysis<br /> +- https://en.wikipedia.org/wiki/MultiDimensional_eXpressions<br /> +- https://en.wikipedia.org/wiki/XML_for_Analysis<br /> +- https://en.wikipedia.org/wiki/SIMD<br /> +- https://en.wikipedia.org/wiki/Cloud_native_computing<br /> +- https://blogs.gartner.com/carlie-idoine/2018/05/13/citizen-data-scientists-and-why-they-matter/</p> + + + </article> + +</div> + + + + + + </article> + </div> + </div> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<footer id="underfooter"> + <div> + <div class="row"> + <div class="col-md-12 widget"> + <div class="widget-body"> + <div class="footer-img"> + <a href="http://www.apache.org"> + <img id="asf-logo" height="78px" alt="Apache Software Foundation" src="/assets/images/apache_footer.png"> + </a> + </div> + <p style="padding-top: 11px;"> + The contents of this website are © 2015 Apache Software Foundation under the terms of the + <a href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. + </p> + <p style="margin-bottom: 11px;"> + Apache Kylin and its logo are trademarks of the Apache Software Foundation. + </div> + + </div> + </div> + </div> + <!-- /row of widgets --> + + </div> + <div></div> + +</footer> + + <script src="/assets/js/jquery-1.9.1.min.js"></script> + <script src="/assets/js/bootstrap.min.js"></script> + <script src="/assets/js/main.js"></script> + </body> +</html> + + + + Modified: kylin/site/blog/index.html URL: http://svn.apache.org/viewvc/kylin/site/blog/index.html?rev=1897192&r1=1897191&r2=1897192&view=diff ============================================================================== --- kylin/site/blog/index.html (original) +++ kylin/site/blog/index.html Wed Jan 19 08:32:36 2022 @@ -197,6 +197,16 @@ var _hmt = _hmt || []; <div class="col-md-6 col-lg-6 col-xs-12"> + <a class="blog-card" href="/blog/2022/01/12/The-Future-Of-Kylin/"> + <div class="blog-pic"> + <img width="20" src="../assets/images/icon_blog_w.png" /> + </div> + <p class="blog-title">The future of Apache Kylinï¼More powerful and easy-to-use OLAP</p> + <p align="left" class="post-meta">posted: Jan 12, 2022</p> + </a> + </div> + + <div class="col-md-6 col-lg-6 col-xs-12"> <a class="blog-card" href="/blog/2021/10/21/Local-Cache-and-Soft-Affinity-Scheduling/"> <div class="blog-pic"> <img width="20" src="../assets/images/icon_blog_w.png" /> Modified: kylin/site/cn/blog/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/blog/index.html?rev=1897192&r1=1897191&r2=1897192&view=diff ============================================================================== --- kylin/site/cn/blog/index.html (original) +++ kylin/site/cn/blog/index.html Wed Jan 19 08:32:36 2022 @@ -199,6 +199,16 @@ var _hmt = _hmt || []; <div class="col-md-6 col-lg-6 col-xs-12"> + <a class="blog-card" href="/cn_blog/2022/01/12/The-Future-Of-Kylin/"> + <div class="blog-pic"> + <img width="20" src="/assets/images/icon_blog_w.png" /> + </div> + <p class="blog-title">ä¸ä¸ä»£ Kylinï¼æ´å¼ºå¤§åæç¨ç OLAP</p> + <p align="left" class="post-meta">posted: Jan 12, 2022</p> + </a> + </div> + + <div class="col-md-6 col-lg-6 col-xs-12"> <a class="blog-card" href="/cn_blog/2021/10/21/Local-Cache-and-Soft-Affinity-Scheduling/"> <div class="blog-pic"> <img width="20" src="/assets/images/icon_blog_w.png" /> Added: kylin/site/cn_blog/2022/01/12/The-Future-Of-Kylin/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn_blog/2022/01/12/The-Future-Of-Kylin/index.html?rev=1897192&view=auto ============================================================================== --- kylin/site/cn_blog/2022/01/12/The-Future-Of-Kylin/index.html (added) +++ kylin/site/cn_blog/2022/01/12/The-Future-Of-Kylin/index.html Wed Jan 19 08:32:36 2022 @@ -0,0 +1,327 @@ +<!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> +<!doctype html> +<html> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <title>Apache Kylin | ä¸ä¸ä»£ Kylinï¼æ´å¼ºå¤§åæç¨ç OLAP</title> + <meta name="description" content="01 Apache Kylin çä»å¤©ç®åï¼Apache Kylin çææ°åå¸çæ¬æ¯ 4.0.1ã Apache Kylin 4.0 æ¯ Kylin 3.xï¼HBase Storageï¼çæ¬åç䏿¬¡éå¤§çæ¬æ´æ°ï¼Kylin 4 ä½¿ç¨ Parquet è¿ç§çæ£çåå¼å卿¥ä»£æ¿ HBase åå¨ï¼ä»èæåæä»¶æ«ææ§..."> + <meta name="author" content="Apache Kylin"> + <link rel="shortcut icon" href="fav.png" type="image/png"> + + + +<link rel="stylesheet" href="/assets/css/animate.css"> +<!-- Bootstrap --> +<link rel="stylesheet" href="/assets/css/bootstrap.min.css"> + +<!-- Fonts --> +<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> --> + +<!-- Icons --> +<link rel="stylesheet" href="/assets/css/font-awesome.min.css"> + + <!-- Custom styles --> + <link rel="stylesheet" href="/assets/css/styles.css"> + <link rel="stylesheet" href="/assets/css/docs.css"> + <link rel="stylesheet" href="/assets/css/pygments.css"> + + <link rel="canonical" href="http://kylin.apache.org/cn_blog/2022/01/12/The-Future-Of-Kylin/"> + <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" /> + +<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]--> +<!-- Global site tag (gtag.js) - Google Analytics --> +<script async src="https://www.googletagmanager.com/gtag/js?id=UA-120788561-1"></script> +<script> + window.dataLayer = window.dataLayer || []; + function gtag(){dataLayer.push(arguments);} + gtag('js', new Date()); + + gtag('config', 'UA-120788561-1'); +</script> +<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script> +<script type="text/javascript" src="/assets/js/nside.js"></script> </script> +<script type="text/javascript" src="/assets/js/nnav.js"></script> </script> +<script> +var _hmt = _hmt || []; +(function() { + var hm = document.createElement("script"); + hm.src = "https://hm.baidu.com/hm.js?bdc5e03add430c0b72cc0eb91eabfa99"; + var s = document.getElementsByTagName("script")[0]; + s.parentNode.insertBefore(hm, s); +})(); +</script> + +</head> + + <body> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<header id="header" > + + <!-- Main Menu --> + <nav class="navbar navbar-default" role="navigation" id="nav-wrapper"> + <div class="container-fluid" id="nav"> + <!-- + <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg"> + --> + <!-- Brand and toggle get grouped for better mobile display --> + <div class="navbar-header"> + <img class="navbar-logo" width="46" src="/assets/images/kylin_logo.png" ></img> + <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <ul class="nav icon-navbar"> + <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li> + <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li> + <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li> + </ul> + </div> + + <!-- Collect the nav links, forms, and other content for toggling --> + <div class="navbar-collapse collapse" id="bs-example-navbar-collapse-1"> + + <ul class="nav navbar-nav"> + + <li><a href="/">Home</a></li> + <li> + <a href="/docs" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Docs<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/docs/">Latest Release(Kylin 4.0.1)</a></li> + <li><a href="/docs31/">Kylin 3.1.3</a></li> + <li><a href="/docs24/">Kylin 2.4.0</a></li> + <li><a href="/archive/">Archive</a></li> + </ul> + </li> + <li><a href="/download">Download</a></li> + <li><a href="/community" >Community</a></li> + <li> + <a href="/development" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">Development<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/development40/">Kylin 4.x</a></li> + <li><a href="/development/">Kylin 3.x And Older Versions</a></li> + </ul> + </li> + <li><a href="/blog">Blog</a></li> + <li><a href="/cn" >䏿ç</a></li> + </ul> + </div><!-- /.navbar-collapse --> + </div><!-- /.container-fluid --> + </nav> + + <div id="head" class="parallax normal-header" > + <div class="text-center header-apache"> + <a href="http://apache.org/foundation/contributing.html" title="Support Apache" style="margin-left: 150px;"> + <div> + <img src="https://www.apache.org/images/SupportApache-small.png" > + </div> + </a> + </div> + </div> + + </header> + + <div class="page-content main"> + <header style=" padding:2em 0 0 "> + <div class="container" > + <div style=" padding:0 4em"> + <div class="blog-icon"> + <img width="30" src="/assets/images/icon_blog_w.png"> + </div> + <h4 class="index-title" style=" float:left;"><span>Apache Kylin⢠Technical Blog</span></h4> + </div> + </div> + </div> + + <div class="container blog"> + <div> + <article class="post-content" > + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<div class="post" style=" padding:2em 4em 4em 4em"> + + <header class="post-header"> + <h1 class="post-title">ä¸ä¸ä»£ Kylinï¼æ´å¼ºå¤§åæç¨ç OLAP</h1> + <p class="post-meta" >Jan 12, 2022 ⢠Yang Li</p> + </header> + + <article class="post-content" > + <h2 id="apache-kylin-">01 Apache Kylin çä»å¤©</h2> +<p>ç®åï¼Apache Kylin çææ°åå¸çæ¬æ¯ 4.0.1ã Apache Kylin 4.0 æ¯ Kylin 3.xï¼HBase Storageï¼çæ¬åç䏿¬¡éå¤§çæ¬æ´æ°ï¼Kylin 4 ä½¿ç¨ Parquet è¿ç§çæ£çåå¼å卿¥ä»£æ¿ HBase åå¨ï¼ä»èæåæä»¶æ«ææ§è½ï¼åæ¶ï¼Kylin 4 éæ°å®ç°äºåºäº Spark çæå»ºå¼æåæ¥è¯¢å¼æï¼ä½¿å¾è®¡ç®ååå¨çå离å为å¯è½ï¼æ´å éåºäºåççææ¯è¶å¿ã<br /> +Kylin 4.0 对æå»ºåæ¥è¯¢å¼æåäºå ¨é¢æ´æ°ï¼å®ç°äºå» Hadoop é¨ç½²ï¼è§£å³äºåæ¥ä¸äºçé®é¢ã餿¤ä¹å¤ï¼ç»å社åºç¨æ·çåé¦ä»¥å OLAP ææ¯åå±çè¶å¿ï¼Kylin 社åºåç°å½åç Kylin ä»ç¶åå¨ä¸äºå¼±å¿ä¸ä¸è¶³ï¼æ¯å¦ä¸å¡è¯ä¹å±è½åæå¾ å 强ãé¢è®¡ç®æ¨¡ååæ´ä¸å¤çµæ´»çï¼åºäºè¿äºä¸è¶³å¯ä»¥å°åç»éè¦è¿è¡ç工使»ç»ä¸ºä»¥ä¸å 个æ¹é¢ï¼</p> + +<ul> + <li>坹鿿¯äººåå好çå¤ç»´æ¥è¯¢è½åãå¤ç»´æ¨¡åæ¯ Kylin åºå«äºä¸è¬ OLAP 弿çå ³é®ãç¹ç¹å¨äºï¼ä»¥ç»´åº¦ã度é为åºç¡çæ¨¡åæ¦å¿µå¯¹éææ¯äººåæ´åå¥½ï¼æ´æ¥è¿ âäººäººé½æ¯æ°æ®åæå¸â çç®æ ãéææ¯äººåè½ç¨çå¤ç»´æ¥è¯¢è½åï¼åºè¯¥æ¯ Kylin ææ¯åç»çæ°éå¿ã</li> + <li>Native EngineãKylin 弿å¨åéå éãæä»¤çº§ä¼åæ¹é¢å°æå¾å¤§çæå空é´ãKylin ä¾èµç Spark 社åºä¹æå¾å¼ºç Native Engine éæ±ï¼ä¹è§ä¼°è®¡ï¼Native Engine å¯ä»¥è³å°æåç®åç Kylin 3 å以䏿§è½ï¼å¼å¾æå ¥ã</li> + <li>æ´å¤äºåçè½åãKylin 4.0 åªå®æäºåæ¥ä¸äºï¼å®ç°äºäºä¸çå¿«éé¨ç½²ãå¨æèµæºä¼¸ç¼©çåè½ï¼ä½ä»æå¾å¤äºåççè½åè¿æå¾ å¼åã</li> +</ul> + +<h2 id="apache-kylin---">02 Apache Kylin çå®ä½ ââ å¤ç»´æ°æ®åº</h2> +<p>Kylin çæ ¸å¿æ¯ä¸ä¸ªå¤ç»´æ°æ®åºï¼æ¯ä¸ç§ç¹æ®ç OLAP 弿ãè½ç¶ä»è¯ç以æ¥ï¼Kylin ä¸ç´é½æå ³ç³»æ°æ®åºçè½åï¼ä¹å¸¸å¸¸ä¸å ¶ä»å ³ç³»å OLAP 弿å对æ¯ï¼ä½çæ£è®© Kylin ä¸ä¼ä¸åçæ¯å®çå¤ç»´æ¨¡ååå¤ç»´æ°æ®åºè½åãèèå° Kylin çæ¬è´¨åæªæ¥å¹¿æ³çä¸å¡ç¨éï¼ä¸ä» æ¯ææ¯ç¨éï¼ï¼æä»¬å°æç¡®å®ä½ Kylin 为ä¸ä¸ªå¤ç»´æ°æ®åºãæä»¬ä¹ææéè¿å¤ç»´æ¨¡ååé¢è®¡ç®ææ¯ï¼Apache Kylin è½è®©æ®é人ç徿åç¨å¾èµ·å¤§æ° æ®ï¼æç»å®ç°æ°æ®æ°ä¸»åã</p> + +<h3 id="section">è¯ä¹å±</h3> +<p>å¤ç»´æ°æ®åºä¸å ³ç³»åæ°æ®åºç å ³é®åºå«å¨äºä¸å¡è¡¨è¾¾è½åã尽管 SQL 表达è½åå¾å¼ºï¼æ¯æ°æ®åæå¸çåºæ¬æè½ï¼ä½å¦æä»¥ âäººäººé½æ¯åæå¸â ä¸ºç®æ ï¼SQL åå ³ç³»æ°æ®åºå¯¹éææ¯äººåè¿æ¯å¤ªé¾äºãä»éææ¯äººåçè§è§ï¼æ°æ®æ¹åæ°æ®ä»åºå°±å¥½ä¼¼ä¸ä¸ªé»æçæ¿é´ï¼ç¥éå ¶ä¸æå¾å¤æ°æ®ï¼å´å ä¸ºä¸ææ°æ®åºç论å SQLï¼æ æ³çæ¸ ãçè§£ãå使ç¨è¿äºæ°æ®ã<br /> +å¦ä½è®©æ°æ®æ¹ï¼åæ°æ®ä»åºï¼å¯¹éææ¯äººåä¹ âæ¸ æ¾è§åºâï¼è¿å°±éè¦å¼å ¥ä¸ä¸ªå¯¹éææ¯äººåæ´å åå¥½çæ°æ®æ¨¡å â å¤ç»´æ°æ®æ¨¡åãå¦æè¯´å ³ç³»æ¨¡åæè¿°äºæ°æ®çææ¯å½¢æï¼é£ä¹å¤ç»´æ¨¡ååæè¿°äºæ°æ®çä¸å¡å½¢æãå¨å¤ç»´æ°æ®åºä¸ï¼åº¦é对åºäºæ¯ä¸ªäººé½æçä¸å¡ææ ï¼ç»´åº¦åæ¯æ¯è¾ãè§å¯è¿äºä¸å¡ææ çè§åº¦ãè¦ä¸ä¸ä¸ªææ¯è¾ KPIï¼è¦å¨å¹³è¡äºä¸é¨ä¹é´æ¯è¾ç»©æï¼è¿äºæ¯æ¯ä¸ªé ææ¯äººåé½çè§£çæ¦å¿µãéè¿å°å ³ç³»æ¨¡åæ å°å°å¤ç»´æ¨¡åï¼æ¬è´¨æ¯å¨ææ¯æ°æ®ä¹ä¸å¢å¼ºäºä¸å¡è¯ä¹ï¼å½¢æä¸å¡è¯ä¹å±ï¼å¸®å©éææ¯äººåä¹è½çæãæ¢ç´¢ãä½¿ç¨æ°æ®ã<br /> +为äºå¢å¼º Kylin ä½ä¸ºå¤ç»´æ°æ®åºçè¯ä¹å±è½åï¼æ¯æå¤ç»´æ¥è¯¢è¯è¨æ¯ Kylin Roadmap ä¸çéç¹å å®¹ï¼æ¯å¦ MDX å DAXãéè¿ MDX å¯ä»¥å° Kylin ä¸çæ°æ®æ¨¡å转æ¢ä¸ºä¸å¡å好çè¯è¨ï¼èµäºæ°æ®ä¸å¡ä»·å¼ï¼æ¹ä¾¿å¯¹æ¥ ExcelãTableau ç BI å·¥å ·è¿è¡å¤ç»´åæã</p> + +<h3 id="section-1">é¢è®¡ç®åçµæ´»ç模å</h3> +<p>ç»§ç»éè¿é¢è®¡ç®ææ¯éä½åæ¥è¯¢ææ¬ï¼è®©æ®é人ç¨å¾èµ·å¤§æ°æ®ï¼ä¹æ¯ Kylin ä¸åç使å½ãå¦æè¯´å¤ç»´æ¨¡åè§£å³äºéææ¯äººåçå¾ææ°æ®çé®é¢ï¼é£ä¹é¢è®¡ç®åè½è§£å³æ®é人ç¨å¾èµ·æ°æ®çé®é¢ï¼ä¸¤è 齿¯æ°æ®æ°ä¸»åçå¿ å¤æ¡ä»¶ãéè¿ä¸æ¬¡è®¡ç®å¤æ¬¡ä½¿ç¨ï¼æ°æ®ææ¬å¯ä»¥è¢«å¤ä¸ªç¨æ·åæï¼è¾¾å°ç¨æ·è¶å¤è¶ä¾¿å®çè§æ¨¡æåºãé¢è®¡ç®æ¯ Kylin çä¼ ç»å¼ºé¡¹ï¼ä½æ¯å¨é¢è®¡ç®æ¨¡åçåæ´æ¹é¢ç¼ºä¹ä¸å®ç çµæ´»æ§ï¼ä¸ºäºå 强 Kylin çæ¨¡åççµæ´»åæ´è½åï¼å¹¶å¸¦æ¥æ´å¤å¯ä¼åç空é´ï¼Kylin 社åºé¢è®¡å¨æªæ¥ç Kylin 䏿åºå ¨æ°çå æ°æ®ç»æï¼ä½¿é¢è®¡ç®æ´çµæ´»ï¼è½å¤åºå¯¹éæ¶å¯è½åçååçè¡¨ç»ææè ä¸å¡éæ±ã</p> + +<h3 id="section-2">æ»ç»</h3> +<p>综ä¸ï¼æä»¬å°æç¡® Kylin çææ¯å®ä½æ¯ä¸ä¸ªå¤ç»´æ°æ®åºï¼éè¿å¤ç»´æ¨¡ååé¢è®¡ç®ææ¯ï¼è®©æ®é人ç徿åç¨å¾èµ·å¤§æ°æ®ï¼æç»å®ç°æ°æ®æ°ä¸»åçç¾å¥½æ¿æ¯ãåæ¶ï¼å¯¹äºä»å¤©å° Kylin ç¨ä½ SQL å éå±çç¨æ·ï¼Kylin å°ç»§ç»ä¿æå®å¤ç SQL æ¥å£ï¼ä¿è¯é¢è®¡ç®ææ¯å¯ä»¥åæ¶è¢«å ³ç³»æ¨¡ååå¤ç»´æ¨¡å使ç¨ã<br /> +å¨ä¸å¾ä¸ï¼æä»¬è½æ¸ æ°å°çå°æªæ¥ Kylin å ³æ³¨çæ¹åï¼æ°å¢åä¿®æ¹çé¨å大è´ä½¿ç¨èè²åæ©è²æ ç¤ºåºæ¥ã</p> + +<p><img src="/images/blog/the_future_of_kylin.png" alt="" /></p> + +<h2 id="apache-kylin--1">03 Apache Kylin å级计å</h2> +<p>åºäº Kylin ä½ä¸ºä¸ä¸ªå¤ç»´æ°æ®åºçå®ä½ï¼ç»åå½å Kylin åå¨çæå¾ å 强çè½åï¼åæ¶ä¸ºäºæ¯æ Schema Change çç¨æ·æå¾ å·²ä¹ çåè½ï¼æä»¬è®¡å卿ªæ¥ç Kylin ä¸å¼å ¥æ°ç DataModel çå æ°æ®ç»æï¼ä¸ååç¨æ·æ´é² Cube çå æ°æ®ï¼å°å æ°æ®ä¾èµå ³ç³»ç®å为 Model -> Table ã<br /> +ç±äºå æ°æ®æ¯ç¤¾åºåç»åä½å¼åçåºç¡åå¥çº¦ï¼å ¨æ°å æ°æ®ç»æç设计å¼åå°ä¼æ¯å½å以åä»åå 个æå Kylin 社åºå·¥ä½çéç¹ï¼å æ°æ®è®¾è®¡ä»¥åè®¨è®ºææ¡£ä¼å¨ä¸ä¸ªæå åå¸ï¼æ¬¢è¿å¤§å®¶è¸è·åä¸è®¨è®ºï¼ä¸åºæå¤å°è¯ 2022 å¹´æ°çå æ°æ®ç»æå°±ä¼ä¸å¤§å®¶è§é¢ï¼æ¬è¯·æå¾ ã<br /> +é¤äºå æ°æ®ç»æå级以å¤ï¼åå æ°æ®å级é å¥çæå»ºåæ¥è¯¢å¼æãè¯ä¹å±è½åï¼MDXï¼ãä¸ BI å·¥å ·æ´å¥½éæãNative Engine ç乿¯ Kylin 社åºä¸ç´å¨ç§¯ææ¨è¿çéç¹å·¥ä½ï¼æ¬¢è¿æ´å¤å¿åéåçå°ä¼ä¼´åä¸è¿æ¥ï¼å ±å社åºã</p> + +<p>** Further Reading **<br /> +- https://en.wikipedia.org/wiki/Data_model<br /> +- https://en.wikipedia.org/wiki/Semantic_layer<br /> +- https://en.wikipedia.org/wiki/Multidimensional_analysis<br /> +- https://en.wikipedia.org/wiki/MultiDimensional_eXpressions<br /> +- https://en.wikipedia.org/wiki/XML_for_Analysis<br /> +- https://en.wikipedia.org/wiki/SIMD<br /> +- https://en.wikipedia.org/wiki/Cloud_native_computing<br /> +- https://blogs.gartner.com/carlie-idoine/2018/05/13/citizen-data-scientists-and-why-they-matter/</p> + + </article> + +</div> + + + + + + </article> + </div> + </div> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<footer id="underfooter"> + <div> + <div class="row"> + <div class="col-md-12 widget"> + <div class="widget-body"> + <div class="footer-img"> + <a href="http://www.apache.org"> + <img id="asf-logo" height="78px" alt="Apache Software Foundation" src="/assets/images/apache_footer.png"> + </a> + </div> + <p style="padding-top: 11px;"> + The contents of this website are © 2015 Apache Software Foundation under the terms of the + <a href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. + </p> + <p style="margin-bottom: 11px;"> + Apache Kylin and its logo are trademarks of the Apache Software Foundation. + </div> + + </div> + </div> + </div> + <!-- /row of widgets --> + + </div> + <div></div> + +</footer> + + <script src="/assets/js/jquery-1.9.1.min.js"></script> + <script src="/assets/js/bootstrap.min.js"></script> + <script src="/assets/js/main.js"></script> + </body> +</html> + + + + Modified: kylin/site/download/index.html URL: http://svn.apache.org/viewvc/kylin/site/download/index.html?rev=1897192&r1=1897191&r2=1897192&view=diff ============================================================================== --- kylin/site/download/index.html (original) +++ kylin/site/download/index.html Wed Jan 19 08:32:36 2022 @@ -196,7 +196,7 @@ var _hmt = _hmt || []; <h4 id="v401">v4.0.1</h4> <ul> <li>This is a bug-fix release after Kylin 4.0.0, with 8 new features/improvements and 6 bug fixes. Check the release notes.</li> - <li><a href="/docs/release_notes.html">Release notes</a>, <a href="https://cwiki.apache.org/confluence/display/KYLIN/Installation+Guide">installation guide</a> and <a href="https://cwiki.apache.org/confluence/display/KYLIN/How+to+upgrade">upgrade guide</a></li> + <li><a href="/docs/release_notes.html">Release notes</a>, <a href="https://cwiki.apache.org/confluence/display/KYLIN/Installation+Guide">installation guide</a> and <a href="/docs/howto/howto_upgrade.html">upgrade guide</a></li> <li>Source download: <a href="https://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-4.0.1/apache-kylin-4.0.1-source-release.zip">apache-kylin-4.0.1-source-release.zip</a> [<a href="https://www.apache.org/dist/kylin/apache-kylin-4.0.1/apache-kylin-4.0.1-source-release.zip.asc">asc</a>] [<a href="https://www.apache.org/dist/kylin/apache-kylin-4.0.1/apache-kylin-4.0.1-source-release.zip.sha256">sha256</a>]</li> <li>Binary for the download (check this to see which binary you should choose <a href="https://cwiki.apache.org/confluence/display/KYLIN/Support+Hadoop+Version+Matrix+of+Kylin+4">Hadoop Matrix supported</a>) : <ul>