Author: lidong Date: Mon Jan 29 14:05:18 2018 New Revision: 1822508 URL: http://svn.apache.org/viewvc?rev=1822508&view=rev Log: KYLIN-3207 fix typo
Added: kylin/site/blog/2018/ kylin/site/blog/2018/01/ kylin/site/blog/2018/01/01/ kylin/site/blog/2018/01/01/kylin-and-superset/ kylin/site/blog/2018/01/01/kylin-and-superset/index.html kylin/site/cn/docs23/ kylin/site/cn/docs23/howto/ kylin/site/cn/docs23/howto/howto_backup_metadata.html kylin/site/cn/docs23/howto/howto_build_cube_with_restapi.html kylin/site/cn/docs23/howto/howto_cleanup_storage.html kylin/site/cn/docs23/howto/howto_jdbc.html kylin/site/cn/docs23/howto/howto_optimize_build.html kylin/site/cn/docs23/index.html kylin/site/cn/docs23/install/ kylin/site/cn/docs23/install/index.html kylin/site/cn/docs23/install/manual_install_guide.html kylin/site/cn/docs23/tutorial/ kylin/site/cn/docs23/tutorial/Qlik.html kylin/site/cn/docs23/tutorial/acl.html kylin/site/cn/docs23/tutorial/create_cube.html kylin/site/cn/docs23/tutorial/cube_build_job.html kylin/site/cn/docs23/tutorial/kylin_client_tool.html kylin/site/cn/docs23/tutorial/odbc.html kylin/site/cn/docs23/tutorial/powerbi.html kylin/site/cn/docs23/tutorial/query_pushdown.html kylin/site/cn/docs23/tutorial/tableau.html kylin/site/cn/docs23/tutorial/tableau_91.html kylin/site/cn/docs23/tutorial/web.html kylin/site/docs23/ kylin/site/docs23/gettingstarted/ kylin/site/docs23/gettingstarted/best_practices.html kylin/site/docs23/gettingstarted/concepts.html kylin/site/docs23/gettingstarted/events.html kylin/site/docs23/gettingstarted/faq.html kylin/site/docs23/gettingstarted/terminology.html kylin/site/docs23/howto/ kylin/site/docs23/howto/howto_backup_metadata.html kylin/site/docs23/howto/howto_build_cube_with_restapi.html kylin/site/docs23/howto/howto_cleanup_storage.html kylin/site/docs23/howto/howto_enable_zookeeper_acl.html kylin/site/docs23/howto/howto_install_ranger_kylin_plugin.html kylin/site/docs23/howto/howto_jdbc.html kylin/site/docs23/howto/howto_ldap_and_sso.html kylin/site/docs23/howto/howto_optimize_build.html kylin/site/docs23/howto/howto_optimize_cubes.html kylin/site/docs23/howto/howto_setup_systemcube.html kylin/site/docs23/howto/howto_update_coprocessor.html kylin/site/docs23/howto/howto_upgrade.html kylin/site/docs23/howto/howto_use_beeline.html kylin/site/docs23/howto/howto_use_cube_planner.html kylin/site/docs23/howto/howto_use_dashboard.html kylin/site/docs23/howto/howto_use_distributed_scheduler.html kylin/site/docs23/howto/howto_use_restapi.html kylin/site/docs23/howto/howto_use_restapi_in_js.html kylin/site/docs23/index.html kylin/site/docs23/install/ kylin/site/docs23/install/advance_settings.html kylin/site/docs23/install/hadoop_env.html kylin/site/docs23/install/index.html kylin/site/docs23/install/kylin_aws_emr.html kylin/site/docs23/install/kylin_cluster.html kylin/site/docs23/install/kylin_docker.html kylin/site/docs23/release_notes.html kylin/site/docs23/tutorial/ kylin/site/docs23/tutorial/Qlik.html kylin/site/docs23/tutorial/acl.html kylin/site/docs23/tutorial/create_cube.html kylin/site/docs23/tutorial/cube_build_job.html kylin/site/docs23/tutorial/cube_build_performance.html kylin/site/docs23/tutorial/cube_spark.html kylin/site/docs23/tutorial/cube_streaming.html kylin/site/docs23/tutorial/flink.html kylin/site/docs23/tutorial/hue.html kylin/site/docs23/tutorial/kylin_sample.html kylin/site/docs23/tutorial/microstrategy.html kylin/site/docs23/tutorial/odbc.html kylin/site/docs23/tutorial/powerbi.html kylin/site/docs23/tutorial/project_level_acl.html kylin/site/docs23/tutorial/query_pushdown.html kylin/site/docs23/tutorial/squirrel.html kylin/site/docs23/tutorial/tableau.html kylin/site/docs23/tutorial/tableau_91.html kylin/site/docs23/tutorial/web.html kylin/site/images/Kylin-and-Superset/ kylin/site/images/Kylin-and-Superset/gif/ kylin/site/images/Kylin-and-Superset/gif/11. SQL_lab.gif (with props) kylin/site/images/Kylin-and-Superset/gif/13-1. sort.gif (with props) kylin/site/images/Kylin-and-Superset/gif/13-2. sort_on_viz.gif (with props) kylin/site/images/Kylin-and-Superset/gif/14. time_filter.gif (with props) kylin/site/images/Kylin-and-Superset/gif/15. dimension_filter.gif (with props) kylin/site/images/Kylin-and-Superset/gif/16. search_box.gif (with props) kylin/site/images/Kylin-and-Superset/gif/17. having.gif (with props) kylin/site/images/Kylin-and-Superset/gif/18. filter_box.gif (with props) kylin/site/images/Kylin-and-Superset/gif/19. top10.gif (with props) kylin/site/images/Kylin-and-Superset/gif/20. page_length.gif (with props) kylin/site/images/Kylin-and-Superset/gif/4. build_cube.gif (with props) kylin/site/images/Kylin-and-Superset/png/ kylin/site/images/Kylin-and-Superset/png/1. kylin_diagram.png (with props) kylin/site/images/Kylin-and-Superset/png/10. superset_6.png (with props) kylin/site/images/Kylin-and-Superset/png/11. SQL_Lab.png (with props) kylin/site/images/Kylin-and-Superset/png/12. SQL_Lab_2.png (with props) kylin/site/images/Kylin-and-Superset/png/13. sort.png (with props) kylin/site/images/Kylin-and-Superset/png/14. time_filter.png (with props) kylin/site/images/Kylin-and-Superset/png/15. dimension_filter.png (with props) kylin/site/images/Kylin-and-Superset/png/16. search_box.png (with props) kylin/site/images/Kylin-and-Superset/png/17. having.png (with props) kylin/site/images/Kylin-and-Superset/png/18. filter_box.png (with props) kylin/site/images/Kylin-and-Superset/png/19. top10.png (with props) kylin/site/images/Kylin-and-Superset/png/2. superset_logo.png (with props) kylin/site/images/Kylin-and-Superset/png/20. page_length.png (with props) kylin/site/images/Kylin-and-Superset/png/21. viz.png (with props) kylin/site/images/Kylin-and-Superset/png/22. viz_2.png (with props) kylin/site/images/Kylin-and-Superset/png/23. map.png (with props) kylin/site/images/Kylin-and-Superset/png/24. bubble.png (with props) kylin/site/images/Kylin-and-Superset/png/25. chinese.png (with props) kylin/site/images/Kylin-and-Superset/png/3. Superset_screen_shot.png (with props) kylin/site/images/Kylin-and-Superset/png/4. build_cube.png (with props) kylin/site/images/Kylin-and-Superset/png/5. superset_1.png (with props) kylin/site/images/Kylin-and-Superset/png/6. superset_2.png (with props) kylin/site/images/Kylin-and-Superset/png/7. superset_3.png (with props) kylin/site/images/Kylin-and-Superset/png/8. superset_4.png (with props) kylin/site/images/Kylin-and-Superset/png/9. superset_5.png (with props) Modified: kylin/site/blog/index.html kylin/site/cn/docs21/install/index.html kylin/site/development/index.html kylin/site/docs21/gettingstarted/best_practices.html kylin/site/docs21/gettingstarted/concepts.html kylin/site/docs21/gettingstarted/events.html kylin/site/docs21/gettingstarted/faq.html kylin/site/docs21/gettingstarted/terminology.html kylin/site/docs21/howto/howto_backup_metadata.html kylin/site/docs21/howto/howto_build_cube_with_restapi.html kylin/site/docs21/howto/howto_cleanup_storage.html kylin/site/docs21/howto/howto_enable_zookeeper_acl.html kylin/site/docs21/howto/howto_install_ranger_kylin_plugin.html kylin/site/docs21/howto/howto_jdbc.html kylin/site/docs21/howto/howto_ldap_and_sso.html kylin/site/docs21/howto/howto_optimize_build.html kylin/site/docs21/howto/howto_optimize_cubes.html kylin/site/docs21/howto/howto_setup_systemcube.html kylin/site/docs21/howto/howto_update_coprocessor.html kylin/site/docs21/howto/howto_upgrade.html kylin/site/docs21/howto/howto_use_beeline.html kylin/site/docs21/howto/howto_use_cube_planner.html kylin/site/docs21/howto/howto_use_dashboard.html kylin/site/docs21/howto/howto_use_distributed_scheduler.html kylin/site/docs21/howto/howto_use_restapi.html kylin/site/docs21/howto/howto_use_restapi_in_js.html kylin/site/docs21/index.html kylin/site/docs21/install/advance_settings.html kylin/site/docs21/install/hadoop_env.html kylin/site/docs21/install/index.html kylin/site/docs21/install/kylin_aws_emr.html kylin/site/docs21/install/kylin_cluster.html kylin/site/docs21/install/kylin_docker.html kylin/site/docs21/release_notes.html kylin/site/docs21/tutorial/Qlik.html kylin/site/docs21/tutorial/acl.html kylin/site/docs21/tutorial/create_cube.html kylin/site/docs21/tutorial/cube_build_job.html kylin/site/docs21/tutorial/cube_build_performance.html kylin/site/docs21/tutorial/cube_spark.html kylin/site/docs21/tutorial/cube_streaming.html kylin/site/docs21/tutorial/flink.html kylin/site/docs21/tutorial/hue.html kylin/site/docs21/tutorial/kylin_sample.html kylin/site/docs21/tutorial/microstrategy.html kylin/site/docs21/tutorial/odbc.html kylin/site/docs21/tutorial/powerbi.html kylin/site/docs21/tutorial/project_level_acl.html kylin/site/docs21/tutorial/query_pushdown.html kylin/site/docs21/tutorial/squirrel.html kylin/site/docs21/tutorial/tableau.html kylin/site/docs21/tutorial/tableau_91.html kylin/site/docs21/tutorial/web.html kylin/site/feed.xml Added: kylin/site/blog/2018/01/01/kylin-and-superset/index.html URL: http://svn.apache.org/viewvc/kylin/site/blog/2018/01/01/kylin-and-superset/index.html?rev=1822508&view=auto ============================================================================== --- kylin/site/blog/2018/01/01/kylin-and-superset/index.html (added) +++ kylin/site/blog/2018/01/01/kylin-and-superset/index.html Mon Jan 29 14:05:18 2018 @@ -0,0 +1,522 @@ +<!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> +<!doctype html> +<html> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <title>Apache Kylin | Get Your Interactive Analytics Superpower, with Apache Kylin and Apache Superset</title> + <meta name="description" content="Challenge of Big Data"> + <meta name="author" content="Apache Kylin"> + <link rel="shortcut icon" href="fav.png" type="image/png"> + + + +<link rel="stylesheet" href="/assets/css/animate.css"> +<!-- Bootstrap --> +<link rel="stylesheet" href="/assets/css/bootstrap.min.css"> + +<!-- Fonts --> +<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> --> + +<!-- Icons --> +<link rel="stylesheet" href="/assets/css/font-awesome.min.css"> + + <!-- Custom styles --> + <link rel="stylesheet" href="/assets/css/styles.css"> + <link rel="stylesheet" href="/assets/css/docs.css"> + <link rel="stylesheet" href="/assets/css/pygments.css"> + + <link rel="canonical" href="http://kylin.apache.org/blog/2018/01/01/kylin-and-superset/"> + <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" /> + +<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]--> +<script> + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + //oringal tracker for kylin.io + ga('create', 'UA-55534813-1', 'auto'); + //new tracker for kylin.apache.org + ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'}); + + ga('send', 'pageview'); + ga('toplevel.send', 'pageview'); + + +</script> +<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script> +<script type="text/javascript" src="/assets/js/nside.js"></script> </script> +<script type="text/javascript" src="/assets/js/nnav.js"></script> </script> +</head> + + <body> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<header id="header" > + + <div id="head" class="parallax" parallax-speed="3" > + <div id="logo" class="text-center"> <img class="img-circle" id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title" >Apache Kylinâ¢</span> <span class="tagline">Extreme OLAP Engine for Big Data</span> + </div> + <div class="text-center" style=" + position: relative; + top: 66px; + width: 1080px; + margin: 0 auto; + z-index: 11; + margin-top: -253px; + text-align: right;" + > + <a href="http://apache.org/foundation/contributing.html" title="Support Apache" style="margin-left: 150px;"> + <img src="https://www.apache.org/images/SupportApache-small.png" style="height: 150px; width: 150px;"> + </a> + </div> + </div> + + + <!-- Main Menu --> + <nav class="navbar navbar-default" role="navigation" id="nav-wrapper"> + <div class="container-fluid" id="nav"> + <!-- + <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg"> + --> + <!-- Brand and toggle get grouped for better mobile display --> + <div class="navbar-header"> + <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + + </div> + + <!-- Collect the nav links, forms, and other content for toggling --> + <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1"> + <ul class="nav navbar-nav"> + <li><a href="/">Home</a></li> + <li><a href="/docs21" >Docs</a></li> + <li><a href="/download">Download</li> + <li><a href="/community" >Community</a></li> + <li><a href="/development" >Development</a></li> + <li><a href="/blog">Blog</li> + <li><a href="/cn" >䏿ç</a></li> + <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li> + <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li> + <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li> + </ul> + </div><!-- /.navbar-collapse --> + </div><!-- /.container-fluid --> +</nav> + </header> + + <div class="page-content"> + <header style=" padding:2em 0 0 0"> + <div class="container" > + <h4 class="section-title"><span>Apache Kylin⢠Technical Blog</span></h4> + </div> + </div> + + <div class="container"> + <div> + <article class="post-content" > + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<div class="post" style=" padding:2em 4em 4em 4em"> + + <header class="post-header"> + <h1 class="post-title">Get Your Interactive Analytics Superpower, with Apache Kylin and Apache Superset</h1> + <p class="post-meta" >Jan 1, 2018 ⢠YongjieZhao, Joanna He</p> + </header> + + <article class="post-content" > + <h2 id="challenge-of-big-data">Challenge of Big Data</h2> + +<p>In the big data era, all enterprisesâ face the growing demand and challenge of processing large volumes of dataâworkloads that traditional legacy systems can no longer satisfy. With the emergence of Artificial Intelligence (AI) and Internet-of-Things (IoT) technology, it has become mission-critical for businesses to accelerate their pace of discovering valuable insights from their massive and ever-growing datasets. Thus, large companies are constantly searching for a solution, often turning to open source technologies. We will introduce two open source technologies that, when combined together, can meet these pressing big data demands for large enterprises.</p> + +<h2 id="apache-kylin-a-leading-opensource-olap-on-hadoop">Apache Kylin: a Leading OpenSource OLAP-on-Hadoop</h2> +<p>Modern organizations have had a long history of applying Online Analytical Processing (OLAP) technology to analyze data and uncover business insights. These insights help businesses make informed decisions and improve their service and product. With the emergence of the Hadoop ecosystem, OLAP has also embraced new technologies in the big data era.</p> + +<p>Apache Kylin is one such technology that directly addresses the challenge of conducting analytical workloads on massive datasets. It is already widely adopted by enterprises around the world. With powerful pre-calculation technology, Apache Kylin enables sub-second query latency over petabyte-scale datasets. The innovative and intricate design of Apache Kylin allows it to seamlessly consume data from any Hadoop-based data source, as well as other relational database management system (RDBMS). Analysts can use Apache Kylin using standard SQL through ODBC, JDBC, and Restful API, which enables the platform to integrate with any third-party applications.<br /> +<img src="/images/Kylin-and-Superset/png/1. kylin_diagram.png" alt="" /><br /> +Figure 1: Apache Kylin Architecture</p> + +<p>In a fast-paced and rapidly-changing business environment, business users and analysts are expected to uncover insights with speed of thoughts. They can meet this expectation with Apache Kylin, and no longer subjected to the predicament of waiting for hours for one single query to return results. Such a powerful data processing engine empowers the data scientists, engineers, and business analysts of any enterprise to find insights to help reach critical business decisions. However, business decisions cannot be made without rich data visualization. To address this last-mile challenge of big data analytics, Apache Superset comes into the picture.</p> + +<h2 id="apache-superset-modern-enterprise-ready-business-intelligence-platform">Apache Superset: Modern, Enterprise-ready Business Intelligence Platform</h2> + +<p>Apache Superset is a data exploration and visualization platform designed to be visual, intuitive, and interactive. A user can access data in the following two ways:</p> + +<ol> + <li> + <p>Access data from the following commonly used data sources one table at a time: Kylin, Presto, Hive, Impala, SparkSQL, MySQL, Postgres, Oracle, Redshift, SQL Server, Druid.</p> + </li> + <li> + <p>Use a rich SQL Interactive Development Environment (IDE) called SQL Lab that is designed for power users with the ability to write SQL queries to analyze multiple tables.</p> + </li> +</ol> + +<p>Users can immediately analyze and visualize their query results using Apache Superset âs rich visualization and reporting features.</p> + +<p><img src="/images/Kylin-and-Superset/png/2. superset_logo.png" alt="" /><br /> +Figure 2</p> + +<p><img src="/images/Kylin-and-Superset/png/3. Superset_screen_shot.png" alt="" /><br /> +Figure 3: Apache Superset Visualization Interface</p> + +<h2 id="integrating-apache-kylin-and-apache-superset-to-boost-your-productivity">Integrating Apache Kylin and Apache Superset to Boost Your Productivity</h2> + +<p>Both Apache Kylin and Apache Superset are built to provide fast and interactive analytics for their users. The combination of these two open source projects can bring that goal to reality on petabyte-scale datasets, thanks to pre-calculated Kylin Cube.</p> + +<p>The Kyligence Data Science team has recently open sourced kylinpy, a project that makes this combination possible. Kylinpy is a Python-based Apache Kylin client library. Any application that uses SQLAlchemy can now query Apache Kylin with this library installed, specifically Apache Superset. Below is a brief tutorial that shows how to integrate Apache Kylin and Apache Superset.</p> + +<h2 id="prerequisite">Prerequisite</h2> +<ol> + <li>Install Apache Kylin<br /> +Please refer to this installation tutorial.</li> + <li>Apache Kylin provides a script for you to create a sample Cube. After you successfully installed Apache Kylin, you can run the below script under Apache Kylin installation directory to generate sample project and Cube. <br /> + ./${KYLIN_HOME}/bin/sample.sh</li> + <li> + <p>When the script finishes running, log onto Apache Kylin web with default user ADMIN/KYLIN; in the system page click âReload Metadata,â then you will see a sample project called âLearn Kylin.â</p> + </li> + <li>Select the sample cube âkylin_sales_cubeâ, click âActionsâ -> âBuildâ, pick a date later than 2014-01-01 (to cover all 10000 sample records);</li> +</ol> + +<p><img src="/images/Kylin-and-Superset/png/4. build_cube.png" alt="" /><br /> +Figure 4: Build Cube in Apache Kylin</p> + +<ol> + <li>Check the build progress in âMonitorâ tab until it reaches 100%;</li> + <li>Execute SQL in the âInsightâ tab, for example:</li> +</ol> + +<div class="highlighter-rouge"><pre class="highlight"><code> select part_dtï¼ + sum(price) as total_selledï¼ + count(distinct seller_id) as sellers + from kylin_sales + group by part_dt + order by part_dt +-- #This query will hit on the newly built Cube âKylin_sales_cubeâ. +</code></pre> +</div> + +<ol> + <li>Next, we will install Apache Superset and initialize it.<br /> + You may refer to Apache Superset official website instruction to install and initialize.</li> + <li>Install kylinpy</li> +</ol> + +<div class="highlighter-rouge"><pre class="highlight"><code> $ pip install kylinpy +</code></pre> +</div> + +<ol> + <li>Verify your installation, if everything goes well, Apache Superset daemon should be up and running.</li> +</ol> + +<div class="highlighter-rouge"><pre class="highlight"><code>$ superset runserver -d +Starting server with command: +gunicorn -w 2 --timeout 60 -b 0.0.0.0:8088 --limit-request-line 0 --limit-request-field_size 0 superset:app + +[2018-01-03 15:54:03 +0800] [73673] [INFO] Starting gunicorn 19.7.1 +[2018-01-03 15:54:03 +0800] [73673] [INFO] Listening at: http://0.0.0.0:8088 (73673) +[2018-01-03 15:54:03 +0800] [73673] [INFO] Using worker: sync +[2018-01-03 15:54:03 +0800] [73676] [INFO] Booting worker with pid: 73676 +[2018-01-03 15:54:03 +0800] [73679] [INFO] Booting worker with pid: 73679 +</code></pre> +</div> + +<h2 id="connect-apache-kylin-from-apachesuperset">Connect Apache Kylin from ApacheSuperset</h2> + +<p>Now everything you need is installed and ready to go. Letâs try to create an Apache Kylin data source in Apache Superset.<br /> +1. Open up http://localhost:8088 in your web browser with the credential you set during Apache Superset installation.<br /> + <img src="/images/Kylin-and-Superset/png/5. superset_1.png" alt="" /><br /> + Figure 5: Apache Superset Login Page</p> + +<ol> + <li>Go to Source -> Datasource to configure a new data source. + <ul> + <li>SQLAlchemy URI pattern is : kylin://<username>:<password>@<hostname>:<port>/<project name=""></project></port></hostname></password></username></li> + <li>Check âExpose in SQL Labâ if you want to expose this data source in SQL Lab.</li> + <li>Click âTest Connectionâ to see if the URI is working properly.</li> + </ul> + </li> +</ol> + +<p><img src="/images/Kylin-and-Superset/png/6. superset_2.png" alt="" /><br /> + Figure 6: Create an Apache Kylin data source</p> + +<p><img src="/images/Kylin-and-Superset/png/7. superset_3.png" alt="" /><br /> + Figure 7: Test Connection to Apache Kylin</p> + +<p>If the connection to Apache Kylin is successful, you will see all the tables from Learn_kylin project show up at the bottom of the connection page.</p> + +<p><img src="/images/Kylin-and-Superset/png/8. superset_4.png" alt="" /><br /> +Figure 8: Tables will show up if connection is successful</p> + +<h3 id="query-kylin-table">Query Kylin Table</h3> +<ol> + <li>Go to Source -> Tables to add a new table, type in a table name from âLearn_kylinâ project, for example, âKylin_salesâ.</li> +</ol> + +<p><img src="/images/Kylin-and-Superset/png/9. superset_5.png" alt="" /><br /> +Figure 9 Add Kylin Table in Apache Superset</p> + +<ol> + <li>Click on the table you created. Now you are ready to analyze your data from Apache Kylin.</li> +</ol> + +<p><img src="/images/Kylin-and-Superset/png/10. superset_6.png" alt="" /><br /> +Figure 10 Query single table from Apache Kylin</p> + +<h3 id="query-multiple-tables-from-kylin-using-sql-lab">Query Multiple Tables from Kylin Using SQL Lab.</h3> +<p>Kylin Cube is usually based on a data model joined by multiples tables. Thus, it is quite common to query multiple tables at the same time using Apache Kylin. In Apache Superset, you can use SQL Lab to join your data across tables by composing SQL queries. We will use a query that can hit on the sample cube âkylin_sales_cubeâ as an example. <br /> +When you run your query in SQL Lab, the result will come from the data source, in this case, Apache Kylin.</p> + +<p><img src="/images/Kylin-and-Superset/png/11. SQL_Lab.png" alt="" /><br /> +Figure 11 Query multiple tables from Apache Kylin using SQL Lab</p> + +<p>When the query returns results, you may immediately visualize them by clicking on the âVisualizeâ button.<br /> +<img src="/images/Kylin-and-Superset/png/12. SQL_Lab_2.png" alt="" /><br /> +Figure 12 Define your query and visualize it immediately</p> + +<p>You may copy the entire SQL below to experience how you can query Kylin Cube in SQL Lab. <br /> +<code class="highlighter-rouge"> +select +YEAR_BEG_DT, +MONTH_BEG_DTï¼ +WEEK_BEG_DTï¼ +META_CATEG_NAMEï¼ +CATEG_LVL2_NAME, +CATEG_LVL3_NAME, +OPS_REGION, +NAME as BUYER_COUNTRY_NAME, +sum(PRICE) as GMV, +sum(ACCOUNT_BUYER_LEVEL) ACCOUNT_BUYER_LEVEL, +count(*) as CNT +from KYLIN_SALES +join KYLIN_CAL_DT on CAL_DT=PART_DT +join KYLIN_CATEGORY_GROUPINGS on SITE_ID=LSTG_SITE_ID and KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID=KYLIN_SALES.LEAF_CATEG_ID +join KYLIN_ACCOUNT on ACCOUNT_ID=BUYER_ID +join KYLIN_COUNTRY on ACCOUNT_COUNTRY=COUNTRY +group by YEAR_BEG_DT, MONTH_BEG_DTï¼WEEK_BEG_DTï¼META_CATEG_NAMEï¼CATEG_LVL2_NAME, CATEG_LVL3_NAME, OPS_REGION, NAME +</code><br /> +## Experience All Features in Apache Superset with Apache Kylin</p> + +<p>Most of the common reporting features are available in Apache Superset. Now letâs see how we can use those features to analyze data from Apache Kylin.</p> + +<h3 id="sorting">Sorting</h3> +<p>You may sort by a measure regardless of how it is visualized.</p> + +<p>You may specify a âSort Byâ measure or sort the measure on the visualization after the query returns.</p> + +<p><img src="/images/Kylin-and-Superset/png/13. sort.png" alt="" /><br /> +Figure 13 Sort by</p> + +<h3 id="filtering">Filtering</h3> +<p>There are multiple ways you may filter data from Apache Kylin.<br /> +1. Date Filter<br /> + You may filter date and time dimension with the calendar filter. <br /> + <img src="/images/Kylin-and-Superset/png/14. time_filter.png" alt="" /><br /> + Figure 14 Filtering time</p> + +<ol> + <li> + <p>Dimension Filter<br /> + For other dimensions, you may filter it with SQL conditions like âin, not in, equal to, not equal to, greater than and equal to, smaller than and equal to, greater than, smaller than, likeâ.<br /> + <img src="/images/Kylin-and-Superset/png/15. dimension_filter.png" alt="" /><br /> + Figure 15 Filtering dimension</p> + </li> + <li> + <p>Search Box<br /> + In some visualizations, it is also possible to further narrow down your result set after the query is returned from the data source using the âSearch Boxâ. <br /> + <img src="/images/Kylin-and-Superset/png/16. search_box.png" alt="" /><br /> + Figure 16 Search Box</p> + </li> + <li> + <p>Filtering the measure<br /> + Apache Superset allows you to write a âhaving clauseâ to filtering the measure. <br /> + <img src="/images/Kylin-and-Superset/png/17. having.png" alt="" /><br /> + Figure 17 Filtering measure</p> + </li> + <li> + <p>Filter Box<br /> + The filter box visualization allows you to create a drop-down style filter that can filter all slices on a dashboard dynamically <br /> + As the screenshot below shows, if you filter the CATE_LVL2_NAME dimension from the filter box, all the visualizations on this dashboard will be filtered based on your selection. <br /> + <img src="/images/Kylin-and-Superset/png/18. filter_box.png" alt="" /><br /> + Figure 18 The filter box visualization</p> + </li> +</ol> + +<h3 id="top-n">Top-N</h3> +<p>To provide higher performance in query time for Top N query, Apache Kylin provides approximate Top N measure to pre-calculate the top records. In Apache Superset, you may use both âSort Byâ and âRow Limitâ feature to make sure your query can utilize the Top N pre-calculation from Kylin Cube. <br /> + <img src="/images/Kylin-and-Superset/png/19. top10.png" alt="" /><br /> + Figure 19 use both âSort Byâ and âRow Limitâ to get Top 10</p> + +<h3 id="page-length">Page Length</h3> +<p>Apache Kylin users usually need to deal with high cardinality dimension. When displaying a high cardinality dimension, the visualization will display too many distinct values, taking a long time to render. In that case, it is nice that Apache Superset provides the page length feature to limit the number of rows per page. This way the up-front rendering effort can be reduced. <br /> + <img src="/images/Kylin-and-Superset/png/20. page_length.png" alt="" /><br /> + Figure 20 Limit page length</p> + +<h3 id="visualizations">Visualizations</h3> +<p>Apache Superset provides a rich and extensive set of visualizations. >From basic charts like a pie chart, bar chart, line chart to advanced visualizations, like a sunburst, heatmap, world map, Sankey diagram. <br /> + <img src="/images/Kylin-and-Superset/png/21. viz.png" alt="" /><br /> + Figure 21</p> + +<p><img src="/images/Kylin-and-Superset/png/22. viz_2.png" alt="" /><br /> + Figure 22</p> + +<p><img src="/images/Kylin-and-Superset/png/23. map.png" alt="" /><br /> + Figure 23 World map visualization</p> + +<p><img src="/images/Kylin-and-Superset/png/24. bubble.png" alt="" /><br /> + Figure 24 bubble chart</p> + +<h3 id="other-functionalities">Other functionalities</h3> +<p>Apache Superset also supports exporting to CSV, sharing, and viewing SQL query.</p> + +<h2 id="summary">Summary</h2> +<p>With the right technical synergy of open source projects, you can achieve amazing results, more than the sum of its parts. The pre-calculation technology of Apache Kylin accelerates visualization performance. The rich functionality of Apache Superset enables all Kylin Cube features to be fully utilized. When you marry the two, you get the superpower of accelerated interactive analytics.</p> + +<h2 id="references">References</h2> + +<ol> + <li><a href="http://kylin.apache.org">Apache Kylin</a></li> + <li><a href="https://github.com/Kyligence/kylinpy">kylinpy on Github</a></li> + <li><a href="https://medium.com/airbnb-engineering/caravel-airbnb-s-data-exploration-platform-15a72aa610e5">Superset:Airbnbâs data exploration platform</a></li> + <li><a href="https://github.com/apache/incubator-superset">Apache Superset on Github</a></li> +</ol> + + + </article> + +</div> + + + + + + </article> + </div> + </div> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<footer id="underfooter"> + <div class="container"> + <div class="row"> + <div class="col-md-12 widget"> + <div class="widget-body" style="text-align:center"> + <a href="http://www.apache.org"> + <img id="asf-logo" alt="Apache Software Foundation" src="/assets/images/feather-small.gif"> + </a> + + <div> + The contents of this website are © 2015 Apache Software Foundation under the terms of the <a + href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. Apache Kylin and + its logo are trademarks of the Apache Software Foundation. + </div> + + </div> + </div> + </div> + <!-- /row of widgets --> + + </div> + <div></div> + +</footer> + + <script src="/assets/js/jquery-1.9.1.min.js"></script> + <script src="/assets/js/bootstrap.min.js"></script> + <script src="/assets/js/main.js"></script> + </body> +</html> + + + + Modified: kylin/site/blog/index.html URL: http://svn.apache.org/viewvc/kylin/site/blog/index.html?rev=1822508&r1=1822507&r2=1822508&view=diff ============================================================================== --- kylin/site/blog/index.html (original) +++ kylin/site/blog/index.html Mon Jan 29 14:05:18 2018 @@ -187,6 +187,12 @@ <li> <h2 align="left" style="margin:0px"> + <a class="post-link" href="/blog/2018/01/01/kylin-and-superset/">Get Your Interactive Analytics Superpower, with Apache Kylin and Apache Superset</a></h2><div align="left" class="post-meta">posted: Jan 1, 2018</div> + + </li> + + <li> + <h2 align="left" style="margin:0px"> <a class="post-link" href="/blog/2017/07/21/Improving-Spark-Cubing/">Improving Spark Cubing in Kylin 2.0</a></h2><div align="left" class="post-meta">posted: Jul 21, 2017</div> </li> @@ -199,13 +205,13 @@ <li> <h2 align="left" style="margin:0px"> - <a class="post-link" href="/blog/2017/02/25/v2.0.0-beta-ready/">Apache Kylin v2.0.0 Beta Announcement</a></h2><div align="left" class="post-meta">posted: Feb 25, 2017</div> + <a class="post-link" href="/cn/blog/2017/02/25/v2.0.0-beta-ready/">Apache Kylin v2.0.0 beta åå¸</a></h2><div align="left" class="post-meta">posted: Feb 25, 2017</div> </li> <li> <h2 align="left" style="margin:0px"> - <a class="post-link" href="/cn/blog/2017/02/25/v2.0.0-beta-ready/">Apache Kylin v2.0.0 beta åå¸</a></h2><div align="left" class="post-meta">posted: Feb 25, 2017</div> + <a class="post-link" href="/blog/2017/02/25/v2.0.0-beta-ready/">Apache Kylin v2.0.0 Beta Announcement</a></h2><div align="left" class="post-meta">posted: Feb 25, 2017</div> </li> @@ -289,13 +295,13 @@ <li> <h2 align="left" style="margin:0px"> - <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 Release Announcement</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div> + <a class="post-link" href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div> </li> <li> <h2 align="left" style="margin:0px"> - <a class="post-link" href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div> + <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 Release Announcement</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div> </li> @@ -319,13 +325,13 @@ <li> <h2 align="left" style="margin:0px"> - <a class="post-link" href="/cn/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div> + <a class="post-link" href="/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div> </li> <li> <h2 align="left" style="margin:0px"> - <a class="post-link" href="/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div> + <a class="post-link" href="/cn/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 æ£å¼åå¸</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div> </li> Modified: kylin/site/cn/docs21/install/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs21/install/index.html?rev=1822508&r1=1822507&r2=1822508&view=diff ============================================================================== --- kylin/site/cn/docs21/install/index.html (original) +++ kylin/site/cn/docs21/install/index.html Mon Jan 29 14:05:18 2018 @@ -2272,50 +2272,6 @@ - <li><a href="/docs21/howto/howto_jdbc.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin JDBC Driver</a></li> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - @@ -3920,186 +3876,6 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - <li><a href="/docs21/howto/howto_setup_systemcube.html" class="list-group-item-lay pjaxlink" id="navlist">Set Up System Cube</a></li> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - <li><a href="/docs21/howto/howto_use_cube_planner.html" class="list-group-item-lay pjaxlink" id="navlist">Use Cube Planner</a></li> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - <li><a href="/docs21/howto/howto_use_dashboard.html" class="list-group-item-lay pjaxlink" id="navlist">Use Dashboard</a></li> - - - Added: kylin/site/cn/docs23/howto/howto_backup_metadata.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs23/howto/howto_backup_metadata.html?rev=1822508&view=auto ============================================================================== --- kylin/site/cn/docs23/howto/howto_backup_metadata.html (added) +++ kylin/site/cn/docs23/howto/howto_backup_metadata.html Mon Jan 29 14:05:18 2018 @@ -0,0 +1,1786 @@ +<!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<!doctype html> +<html> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <title>Apache Kylin | å¤ä»½å æ°æ®</title> + <meta name="description" content="Apache Kylin Home"> + <meta name="author" content="Apache Kylin"> + <link rel="shortcut icon" href="fav.png" type="image/png"> + + + +<link rel="stylesheet" href="/assets/css/animate.css"> +<!-- Bootstrap --> +<link rel="stylesheet" href="/assets/css/bootstrap.min.css"> + +<!-- Fonts --> +<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> --> + +<!-- Icons --> +<link rel="stylesheet" href="/assets/css/font-awesome.min.css"> + + <!-- Custom styles --> + <link rel="stylesheet" href="/assets/css/styles.css"> + <link rel="stylesheet" href="/assets/css/docs.css"> + + <link rel="canonical" href="http://kylin.apache.org/cn/docs23/howto/howto_backup_metadata.html"> + <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" /> + +<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]--> +<script> + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + + //oringal tracker for kylin.io + ga('create', 'UA-55534813-1', 'auto'); + //new tracker for kylin.apache.org + ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'}); + + ga('send', 'pageview'); + ga('toplevel.send', 'pageview'); + + +</script> +<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script> +<script type="text/javascript" src="/assets/js/nside.js"></script> </script> +<script type="text/javascript" src="/assets/js/nnav.js"></script> </script> +</head> + + <body> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<header id="header" > + <div id="head" class="parallax" parallax-speed="3" > + <div id="logo" class="text-center"> <img class="img-circle" id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title" >Apache Kylinâ¢</span> <span class="tagline">Extreme OLAP Engine for Big Data</span> + </div> + <div class="text-center" style=" + position: relative; + top: 66px; + width: 1080px; + margin: 0 auto; + z-index: 11; + margin-top: -253px; + text-align: right;" + > + <a href="http://apache.org/foundation/contributing.html" title="Support Apache" style="margin-left: 150px;"> + <img src="https://www.apache.org/images/SupportApache-small.png" style="height: 150px; width: 150px;"> + </a> + </div> + </div> + + <!-- Main Menu --> + <nav class="navbar navbar-default" role="navigation" id="nav-wrapper"> + <div class="container-fluid" id="nav"> + <!-- Brand and toggle get grouped for better mobile display --> + <div class="navbar-header"> + <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + + </div> + + <!-- Collect the nav links, forms, and other content for toggling --> + <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1"> + <ul class="nav navbar-nav"> + <li><a href="/cn">é¦é¡µ</a></li> + <li><a href="/cn/docs21" >ææ¡£</a></li> + <li><a href="/cn/download">ä¸è½½</li> + <li><a href="/community" >社åº</a></li> + <li><a href="/development" >å¼å</a></li> + <li><a href="/blog">å客</li> + <li><a href="/" >English</a></li> + <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li> + <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li> + <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li> + </ul> + + + </div><!-- /.navbar-collapse --> + </div><!-- /.container-fluid --> +</nav> + </header> + + + <div class="container"> + <div class="row"> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<div class="col-md-3 col-lg-3 col-xs-4 aside1 visible-md visible-lg" id="nside1" style=" padding-top: 2em"> + <ul class="nav nav-pills nav-stacked"> + + <li><a href="#titleå¼å§" data-toggle="collapse" id="navtitle">å¼å§</a></li> + <div class="collapse in"> + <div class="list-group" id="list1"> + <ul style="list-style-type:disc"> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/index.html" class="list-group-item-lay pjaxlink" id="navlist">æ¦è¿°</a></li> + + + + + + + + + <ul> + </div> +</div> + + <li><a href="#titleå®è£ " data-toggle="collapse" id="navtitle">å®è£ </a></li> + <div class="collapse in"> + <div class="list-group" id="list1"> + <ul style="list-style-type:disc"> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/install/manual_install_guide.html" class="list-group-item-lay pjaxlink" id="navlist">æå¨å®è£ æå</a></li> + + + + + + + + + <ul> + </div> +</div> + + <li><a href="#titleæç¨" data-toggle="collapse" id="navtitle">æç¨</a></li> + <div class="collapse in"> + <div class="list-group" id="list1"> + <ul style="list-style-type:disc"> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/create_cube.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Cube å建æç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/cube_build_job.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Cube 建ç«åJobçæ§æç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/acl.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Cube æéæäºæç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/web.html" class="list-group-item-lay pjaxlink" id="navlist">Kylinç½é¡µçæç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/tableau.html" class="list-group-item-lay pjaxlink" id="navlist">Tableauæç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/tableau_91.html" class="list-group-item-lay pjaxlink" id="navlist">Tableau 9 æç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/powerbi.html" class="list-group-item-lay pjaxlink" id="navlist">微软ExcelåPower BIæç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/odbc.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin ODBC 驱å¨ç¨åºæç¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/tutorial/Qlik.html" class="list-group-item-lay pjaxlink" id="navlist">ä¸Qlik Senseéæ</a></li> + + + + + + + + + <ul> + </div> +</div> + + <li><a href="#title帮å©" data-toggle="collapse" id="navtitle">帮å©</a></li> + <div class="collapse in"> + <div class="list-group" id="list1"> + <ul style="list-style-type:disc"> + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/howto/howto_backup_metadata.html" class="list-group-item-lay pjaxlink" id="navlist">å¤ä»½å æ°æ®</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/howto/howto_build_cube_with_restapi.html" class="list-group-item-lay pjaxlink" id="navlist">ç¨APIæå»ºcube</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/howto/howto_cleanup_storage.html" class="list-group-item-lay pjaxlink" id="navlist">æ¸ çåå¨</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/howto/howto_jdbc.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin JDBC Driver</a></li> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + <li><a href="/cn/docs23/howto/howto_optimize_build.html" class="list-group-item-lay pjaxlink" id="navlist">ä¼åcubeæå»º</a></li> + + + + + + + + + <ul> + </div> +</div> + + + </ul> +</div> + <div class="col-md-9 col-lg-9 col-xs-14 aside2"> + <div id="container"> + <div id="pjax"> + <h1 class="post-title">å¤ä»½å æ°æ®</h1> + <article class="post-content" > + <p>Kylinå°å®å ¨é¨çå æ°æ®ï¼å æ¬cubeæè¿°åå®ä¾ã项ç®ãåæç´¢å¼æè¿°åå®ä¾ãä»»å¡ã表ååå ¸ï¼ç»ç»æå±çº§æä»¶ç³»ç»çå½¢å¼ãç¶èï¼Kylin使ç¨hbaseæ¥åå¨å æ°æ®ï¼è䏿¯ä¸ä¸ªæ®éçæä»¶ç³»ç»ãå¦æä½ æ¥çè¿Kylinçé ç½®æä»¶ï¼kylin.propertiesï¼ï¼ä½ ä¼åç°è¿æ ·ä¸è¡ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">## The metadata store in hbase +kylin.metadata.url=kylin_metadata@hbase</code></pre></div> + +<p>è¿è¡¨æå æ°æ®ä¼è¢«ä¿åå¨ä¸ä¸ªå«ä½âkylin_metadataâçhtableéãä½ å¯ä»¥å¨hbase shelléscan该htbaleæ¥è·åå®ã</p> + +<h2 id="metadata-store">使ç¨äºè¿å¶å æ¥å¤ä»½Metadata Store</h2> + +<p>ææ¶ä½ éè¦å°KylinçMetadata Storeä»hbaseå¤ä»½å°ç£çæä»¶ç³»ç»ãå¨è¿ç§æ åµä¸ï¼åè®¾ä½ å¨é¨ç½²Kylinçhadoopå½ä»¤è¡ï¼ææ²çï¼éï¼ä½ å¯ä»¥å°KYLIN_HOMEå¹¶è¿è¡ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh backup</code></pre></div> + +<p>æ¥å°ä½ çå æ°æ®å¯¼åºå°æ¬å°ç®å½ï¼è¿ä¸ªç®å½å¨KYLIN_HOME/metadata_backpsä¸ï¼å®çå½åè§å使ç¨äºå½åæ¶é´ä½ä¸ºåæ°ï¼KYLIN_HOME/meta_backups/meta_year_month_day_hour_minute_second ã</p> + +<h2 id="metatdara-store">使ç¨äºè¿å¶å æ¥æ¢å¤Metatdara Store</h2> + +<p>ä¸ä¸ä½ åç°ä½ çå æ°æ®è¢«æå¾ä¸å¢ç³ï¼æ³è¦æ¢å¤å åçå¤ä»½ï¼</p> + +<p>é¦å ï¼éç½®Metatdara Storeï¼è¿ä¸ªä¼æ¸ çKylinå¨hbaseçMetadata Storeçææä¿¡æ¯ï¼è¯·ç¡®ä¿å å¤ä»½ï¼ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh reset</code></pre></div> + +<p>ç¶åä¸ä¼ å¤ä»½çå æ°æ®å°KylinçMetadata Storeï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh restore $KYLIN_HOME/meta_backups/meta_xxxx_xx_xx_xx_xx_xx</code></pre></div> + +<h2 id="section">å¨å¼åç¯å¢å¤ä»½/æ¢å¤å æ°æ®ï¼0.7.3çæ¬ä»¥ä¸å¯ç¨ï¼</h2> + +<p>å¨å¼åè°è¯Kylinæ¶ï¼å ¸åçç¯å¢æ¯ä¸å°è£ æIDEçå¼åæºä¸åä¸ä¸ªåå°çæ²çï¼éå¸¸ä½ ä¼å代ç å¹¶å¨å¼åæºä¸è¿è¡æµè¯æ¡ä¾ï¼ä½æ¯æ¬¡é½éè¦å°äºè¿å¶å æ¾å°æ²çéä»¥æ£æ¥å æ°æ®æ¯å¾éº»ç¦çãè¿æ¶æä¸ä¸ªå为SandboxMetastoreCLIå·¥å ·ç±»å¯ä»¥å¸®å©ä½ å¨å¼åæºæ¬å°ä¸è½½/ä¸ä¼ å æ°æ®ã</p> + +<h2 id="metadata-store073">ä»Metadata Storeæ¸ çæ ç¨çèµæºï¼0.7.3çæ¬ä»¥ä¸å¯ç¨ï¼</h2> +<p>éçè¿è¡æ¶é´å¢é¿ï¼ç±»ä¼¼åå ¸ãè¡¨å¿«ç §çèµæºå徿²¡æç¨ï¼cube segmentè¢«ä¸¢å¼æè åå¹¶äºï¼ï¼ä½æ¯å®ä»¬ä¾æ§å ç¨ç©ºé´ï¼ä½ å¯ä»¥è¿è¡å½ä»¤æ¥æ¾å°å¹¶æ¸ é¤å®ä»¬ï¼</p> + +<p>é¦å ï¼è¿è¡ä¸ä¸ªæ£æ¥ï¼è¿æ¯å®å ¨çå 为å®ä¸ä¼æ¹åä»»ä½ä¸è¥¿ï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean</code></pre></div> + +<p>å°è¦è¢«å é¤çèµæºä¼è¢«ååºæ¥ï¼</p> + +<p>æ¥ä¸æ¥ï¼å¢å ââdelete trueâåæ°æ¥æ¸ çè¿äºèµæºï¼å¨è¿ä¹åï¼ä½ åºè¯¥ç¡®ä¿å·²ç»å¤ä»½metadata storeï¼</p> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div> + + + </article> + </div> + </div> + </div> + </div> + </div> + <!-- +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, software +* distributed under the License is distributed on an "AS IS" BASIS, +* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +* See the License for the specific language governing permissions and +* limitations under the License. +--> + +<footer id="underfooter"> + <div class="container"> + <div class="row"> + <div class="col-md-12 widget"> + <div class="widget-body" style="text-align:center"> + <a href="http://www.apache.org"> + <img id="asf-logo" alt="Apache Software Foundation" src="/assets/images/feather-small.gif"> + </a> + + <div> + The contents of this website are © 2015 Apache Software Foundation under the terms of the <a + href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. Apache Kylin and + its logo are trademarks of the Apache Software Foundation. + </div> + + </div> + </div> + </div> + <!-- /row of widgets --> + + </div> + <div></div> + +</footer> + + <script src="/assets/js/jquery-1.9.1.min.js"></script> + <script src="/assets/js/bootstrap.min.js"></script> + <script src="/assets/js/main.js"></script> + </body> +</html>