Author: lidong Date: Tue Jan 22 14:09:20 2019 New Revision: 1851820 URL: http://svn.apache.org/viewvc?rev=1851820&view=rev Log: Modify the Community page for showing clearly and change the error url
Modified: kylin/site/cn/community/index.html kylin/site/cn/community/poweredby.html kylin/site/cn/docs/install/advance_settings.html kylin/site/community/index.html kylin/site/community/poweredby.html kylin/site/docs/install/advance_settings.html kylin/site/feed.xml Modified: kylin/site/cn/community/index.html URL: http://svn.apache.org/viewvc/kylin/site/cn/community/index.html?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/cn/community/index.html (original) +++ kylin/site/cn/community/index.html Tue Jan 22 14:09:20 2019 @@ -191,65 +191,36 @@ var _hmt = _hmt || []; ä¾å¦ï¼å¦ææ¨è¦è®¢é u...@kylin.apache.orgï¼é£ä¹å åä¸ä¸ªç©ºé®ä»¶å° user-subscr...@kylin.apache.orgï¼ç¨åæ¨ä¼æ¶å°ä¸å°ç¡®è®¤é®ä»¶ï¼å¯¹å®è¿è¡åå¤å³å¯å®æè®¢é ãå¨è®¢é æååï¼è¯·åå鿍çé®é¢å° u...@kylin.apache.orgï¼é£ä¹ææè®¢é 该é®ä»¶ç»çå ¶å®ç¨æ·å°ä¼æ¶å°æ¨çé®ä»¶ï¼å¹¶ååºå享ã</p> - <p> - <span>ç¨æ·(user)é®ä»¶å表</span> - <span> - <a href="mailto:user-subscr...@kylin.apache.org">订é </a> - </span> - <span> - <a href="mailto:user-unsubscr...@kylin.apache.org">é订</a> - </span> - <span> - <a href="mailto:u...@kylin.apache.org">åéæ°é®ä»¶</a> - </span> - <span> - <a href="https://lists.apache.org/list.html?u...@kylin.apache.org">åå²åæ¡£</a> - </span> - </p> - - <p> - <span>å¼åè (dev)é®ä»¶å表</span> - <span> - <a href="mailto:dev-subscr...@kylin.apache.org">订é </a> - </span> - <span> - <a href="mailto:dev-unsubscr...@kylin.apache.org">é订</a> - </span> - <span> - <a href="mailto:d...@kylin.apache.org">åéæ°é®ä»¶</a> - </span> - <span> - <a href="https://lists.apache.org/list.html?d...@kylin.apache.org">åå²åæ¡£</a> - </span> - </p> - - <p> - <span>Issues é®ä»¶å表</span> - <span> - <a href="mailto:issues-subscr...@kylin.apache.org">订é </a> - </span> - <span> - <a href="mailto:issues-unsubscr...@kylin.apache.org">é订</a> - </span> - <span>N/A</span> - <span> - <a href="https://lists.apache.org/list.html?iss...@kylin.apache.org">åå²åæ¡£</a> - </span> - </p> - - <p> - <span>Commits é®ä»¶å表</span> - <span> - <a href="mailto:commits-subscr...@kylin.apache.org">订é </a> - </span> - <span> - <a href="mailto:commits-unsubscr...@kylin.apache.org">é订</a> - </span> - <span>N/A</span> - <span> - <a href="https://lists.apache.org/list.html?commits@kylin.apache.org">åå²åæ¡£</a> - </span> - </p> + <table> + <tr height="50px"> + <td width="155px" align="left">ç¨æ·(user)é®ä»¶å表</td> + <td width="50px"><a href="mailto:user-subscr...@kylin.apache.org">订é </a></td> + <td width="50px"><a href="mailto:user-unsubscr...@kylin.apache.org">é订</a></td> + <td width="90px"><a href="mailto:u...@kylin.apache.org">åéæ°é®ä»¶</a></td> + <td width="95px"><a href="https://lists.apache.org/list.html?u...@kylin.apache.org">åå²åæ¡£</a></td> + </tr> + <tr height="50px"> + <td width="155px" align="left">å¼åè (dev)é®ä»¶å表</td> + <td width="50px"><a href="mailto:dev-subscr...@kylin.apache.org">订é </a></td> + <td width="50px"><a href="mailto:dev-unsubscr...@kylin.apache.org">é订</a></td> + <td width="90px"><a href="mailto:d...@kylin.apache.org">åéæ°é®ä»¶</a></td> + <td width="95px"><a href="https://lists.apache.org/list.html?d...@kylin.apache.org">åå²åæ¡£</a></td> + </tr> + <tr height="50px"> + <td width="155px" align="left">Issues é®ä»¶å表</td> + <td width="50px"><a href="mailto:issues-subscr...@kylin.apache.org">订é </a></td> + <td width="50px"><a href="mailto:issues-unsubscr...@kylin.apache.org">é订</a></td> + <td width="90px">N/A</td> + <td width="95px"><a href="https://lists.apache.org/list.html?iss...@kylin.apache.org">åå²åæ¡£</a></td> + </tr> + <tr height="50px"> + <td width="155px" align="left">Commits é®ä»¶å表</td> + <td width="50px"><a href="mailto:commits-subscr...@kylin.apache.org">订é </a></td> + <td width="50px"><a href="mailto:commits-unsubscr...@kylin.apache.org">é订</a></td> + <td width="90px">N/A</td> + <td width="95px"><a href="https://lists.apache.org/list.html?commits@kylin.apache.org">åå²åæ¡£</a></td> + </tr> + </table> </div> <div class="col-sm-6 col-md-6"> Modified: kylin/site/cn/community/poweredby.html URL: http://svn.apache.org/viewvc/kylin/site/cn/community/poweredby.html?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/cn/community/poweredby.html (original) +++ kylin/site/cn/community/poweredby.html Tue Jan 22 14:09:20 2019 @@ -177,6 +177,26 @@ var _hmt = _hmt || []; <p><strong>å ¬å¸ & ç»ç»</strong></p> <ul> + <li><a href="https://www.telecoming.com/">Telecoming</a>, 2019-01-21 + <ul> + <li>Telecoming éç¨äº Apache Kylinï¼å ä¸ºå®æ¯ä¸ä¸ªé常æç¨çå䏿ºè½å·¥å ·ãKylin 缩çäºæ¥è¯¢æ¶é´ï¼æ¹è¿äºæ¥è¡¨çæï¼æéè¦çæ¯å®æå©äºä¸å¡å³çã</li> + </ul> + </li> + <li><a href="https://www.cisco.com/">Cisco Systems, Inc. æç§</a>, 2019-01-17 + <ul> + <li>æç§æ¯ ITãç½ç»åç½ç»å®å ¨è§£å³æ¹æ¡é¢åçå ¨çé¢å¯¼è ãæç§å° Apache Kylin åºç¨äºæ¥è¡¨ç³»ç»ï¼ä»¥å¨é«å¹¶ååºæ¯ä¸è·åè¯å¥½çæ¥è¯¢æ§è½ãæ³è¦äºè§£æ´å¤è¯·é 读<a href="http://kylin.apache.org/blog/2019/01/17/cisco-throughput-5x/">æ¤å客</a>ã</li> + </ul> + </li> + <li><a href="https://www.mi.com/global">Xiaomi å°ç±³</a>, 2018-12-3 + <ul> + <li>å°ç±³æ¯ä¸å½ä¸»è¦çæºè½ææºååãApache Kylin å¨å ¶æ ¸å¿å¤§æ°æ®é¡¹ç® UnionSQL 䏿®æ¼çå ³é®è§è²ï¼å¹¶å·²å¼å§å¨å ¬å¸å é¨è¿è¡å¤§è§æ¨¡æ¨å¹¿ãæ³è¦äºè§£æ´å¤è¯·é 读<a href="https://www.infoq.cn/article/bNLypvSJVpSHv-dLogsu">æ¤å客</a>ã</li> + </ul> + </li> + <li><a href="http://www.ctrip.com">Ctrip æºç¨</a>, 2018-11-20 + <ul> + <li>ä½ä¸ºä¸å½æå¤§çå¨çº¿æ 游æå¡åï¼æºç¨æä¾åç±»æ æ¸¸å¥é¤ä»¥åä¸ç«å¼é åºåæºç¥¨é¢è®¢æå¡ãæºç¨å¨å ¶å¤§æ°æ®å¹³å°ä¸é´å±ä¸ä½¿ç¨ Kylin è¿è¡äº¤äºå¼æ¥è¯¢ï¼ç¨äº Ad-hoc ä»¥åæ¥è¡¨ç³»ç»ã</li> + </ul> + </li> <li><a href="https://www.hobsons.com/">Hobsons, Inc.</a>, 2018-08-11 <ul> <li>Hobsons è§£å³æ¹æ¡ä½¿æè²å·¥ä½è è½å¤æ¹å大å¦åèä¸è§åï¼æçåå ¥å¦ç®¡çï¼å¦çæåå建议ãHobsons ä½¿ç¨ Apache Kylin 为æè²è æä¾æå ³å¦æ ¡è¡¨ç°åå¦çæåææ çå®è´µè§è§£ã</li> Modified: kylin/site/cn/docs/install/advance_settings.html URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/install/advance_settings.html?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/cn/docs/install/advance_settings.html (original) +++ kylin/site/cn/docs/install/advance_settings.html Tue Jan 22 14:09:20 2019 @@ -323,6 +323,41 @@ java -classpath kylin-server-base-\<v <p><em>注æï¼è¯¥åè½è¿å¨æµè¯ä¸ï¼å»ºè®®æ¨è°¨æ 使ç¨</em></p> +<h2 id="sparksql--hive-">ä½¿ç¨ SparkSql å建 Hive ä¸é´è¡¨</h2> + +<p><strong>注æï¼å½ç¬¬äºæ¬¡è¿æ¥ thriftserver è¿è¡æå»ºæ¶å°ä¼åºç°é®é¢ï¼è¯¦ç»ä¿¡æ¯è¯·æ¥ç <a href="https://issues.apache.org/jira/browse/SPARK-21067">https://issues.apache.org/jira/browse/SPARK-21067</a></strong></p> + +<p>Kylin è½å¤ä½¿ç¨ SparkSql å建 Hive ä¸é´è¡¨ï¼ä½¿å ¶çæä¹åï¼</p> + +<ul> + <li>ç¡®ä¿ä»¥ä¸åæ°åå¨äº hive-site.xmlï¼</li> +</ul> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff"><property> + <name>hive.security.authorization.sqlstd.confwhitelist</name> + <value>mapred.*|hive.*|mapreduce.*|spark.*</value> +</property> + +<property> + <name>hive.security.authorization.sqlstd.confwhitelist.append</name> + <value>mapred.*|hive.*|mapreduce.*|spark.*</value> +</property></code></pre></div> + +<ul> + <li>å° <code class="highlighter-rouge">hive.execution.engine</code> æ¹ä¸º mrï¼å¯éï¼ï¼å¦ææ¨æ³è¦ä½¿ç¨ tezï¼è¯·ç¡®ä¿ tez ç¸å ³ä¾èµå·²å¯¼å ¥</li> + <li>å° hive-site.xml æ·è´å° $SPARK_HOME/conf</li> + <li>ç¡®ä¿è®¾ç½®äº HADOOP_CONF_DIR ç¯å¢åé</li> + <li>ä½¿ç¨ <code class="highlighter-rouge">sbin/start-thriftserver.sh --master spark://sparkmasterip:sparkmasterport</code> å½ä»¤å¯å¨ thriftserverï¼é常端å£ä¸º 7077</li> + <li>ç¼è¾ <code class="highlighter-rouge">conf/kylin.properties</code>ï¼è®¾ç½®å¦ä¸åæ°ï¼</li> +</ul> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.source.hive.enable-sparksql-for-table-ops=true +kylin.source.hive.sparksql-beeline-shell=/path/to/spark-client/bin/beeline +kylin.source.hive.sparksql-beeline-params=-n root -u 'jdbc:hive2://thriftserverip:thriftserverport'</code></pre></div> + +<p>éå¯ Kylin ä»¤å ¶çæãéè¿å° <code class="highlighter-rouge">kylin.source.hive.enable-sparksql-for-table-ops</code> 设置为 <code class="highlighter-rouge">false</code> æ¥ä»¤å ¶å¤±æ</p> + + </article> </div> </div> Modified: kylin/site/community/index.html URL: http://svn.apache.org/viewvc/kylin/site/community/index.html?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/community/index.html (original) +++ kylin/site/community/index.html Tue Jan 22 14:09:20 2019 @@ -6045,66 +6045,37 @@ var _hmt = _hmt || []; <p>These are the mailing lists that have been established for this project. For each list, there is a subscribe, unsubscribe, and an archive link.</p> + <table> + <tr height="50px"> + <td width="165px" align="left">User Mailing List</td> + <td width="73px"><a href="mailto:user-subscr...@kylin.apache.org">Subscribe</a></td> + <td width="88px"><a href="mailto:user-unsubscr...@kylin.apache.org">Unsubscribe</a></td> + <td width="40px"><a href="mailto:u...@kylin.apache.org">Post</a></td> + <td width="165px"><a href="https://lists.apache.org/list.html?u...@kylin.apache.org">mail-archives.apache.org</a></td> + </tr> + <tr height="50px"> + <td width="165px" align="left">Developers Mailing List</td> + <td width="73px"><a href="mailto:dev-subscr...@kylin.apache.org">Subscribe</a></td> + <td width="88px"><a href="mailto:dev-unsubscr...@kylin.apache.org">Unsubscribe</a></td> + <td width="40px"><a href="mailto:d...@kylin.apache.org">Post</a></td> + <td width="165px"><a href="https://lists.apache.org/list.html?d...@kylin.apache.org">mail-archives.apache.org</a></td> + </tr> + <tr height="50px"> + <td width="165px" align="left">Issues Mailing List</td> + <td width="73px"><a href="mailto:issues-subscr...@kylin.apache.org">Subscribe</a></td> + <td width="88px"><a href="mailto:issues-unsubscr...@kylin.apache.org">Unsubscribe</a></td> + <td width="40px">N/A</td> + <td width="165px"><a href="https://lists.apache.org/list.html?iss...@kylin.apache.org">mail-archives.apache.org</a></td> + </tr> + <tr height="50px"> + <td width="165px" align="left">Commits Mailing List</td> + <td width="73px"><a href="mailto:commits-subscr...@kylin.apache.org">Subscribe</a></td> + <td width="88px"><a href="mailto:commits-unsubscr...@kylin.apache.org">Unsubscribe</a></td> + <td width="40px">N/A</td> + <td width="165px"><a href="https://lists.apache.org/list.html?commits@kylin.apache.org">mail-archives.apache.org</a></td> + </tr> + </table> - <p> - <span>User Mailing List</span> - <span> - <a href="mailto:user-subscr...@kylin.apache.org">Subscribe</a> - </span> - <span> - <a href="mailto:user-unsubscr...@kylin.apache.org">Unsubscribe</a> - </span> - <span> - <a href="mailto:u...@kylin.apache.org">Post</a> - </span> - <span> - <a href="https://lists.apache.org/list.html?u...@kylin.apache.org">mail-archives.apache.org</a> - </span> - </p> - - <p> - <span>Developers Mailing List</span> - <span> - <a href="mailto:dev-subscr...@kylin.apache.org">Subscribe</a> - </span> - <span> - <a href="mailto:dev-unsubscr...@kylin.apache.org">Unsubscribe</a> - </span> - <span> - <a href="mailto:d...@kylin.apache.org">Post</a> - </span> - <span> - <a href="https://lists.apache.org/list.html?d...@kylin.apache.org">mail-archives.apache.org</a> - </span> - </p> - - <p> - <span>Issues Mailing List</span> - <span> - <a href="mailto:issues-subscr...@kylin.apache.org">Subscribe</a> - </span> - <span> - <a href="mailto:issues-unsubscr...@kylin.apache.org">Unsubscribe</a> - </span> - <span>N/A</span> - <span> - <a href="https://lists.apache.org/list.html?iss...@kylin.apache.org">mail-archives.apache.org</a> - </span> - </p> - - <p> - <span>Commits Mailing List</span> - <span> - <a href="mailto:commits-subscr...@kylin.apache.org">Subscribe</a> - </span> - <span> - <a href="mailto:commits-unsubscr...@kylin.apache.org">Unsubscribe</a> - </span> - <span>N/A</span> - <span> - <a href="https://lists.apache.org/list.html?iss...@kylin.apache.org">mail-archives.apache.org</a> - </span> - </p> </div> <div class="col-sm-6 col-md-6"> Modified: kylin/site/community/poweredby.html URL: http://svn.apache.org/viewvc/kylin/site/community/poweredby.html?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/community/poweredby.html (original) +++ kylin/site/community/poweredby.html Tue Jan 22 14:09:20 2019 @@ -6036,6 +6036,26 @@ Send a quick description of your organiz <p><strong>Companies & Organizations</strong></p> <ul> + <li><a href="https://www.telecoming.com/">Telecoming</a>, 2019-01-21 + <ul> + <li>Telecoming has adopted Apache Kylin, since itâs an extremely useful business intelligence tool. It has encouraged lower consultation time, it has improved report generation and above all it contributes to improving business decisions.</li> + </ul> + </li> + <li><a href="https://www.cisco.com/">Cisco Systems, Inc.</a>, 2019-01-17 + <ul> + <li>Cisco is the worldwide leader in IT, networking, and cybersecurity solutions. Apache Kylin is adopted in its reporting system and delivers a good query performance in high concurrency scenarios. Read more at <a href="http://kylin.apache.org/blog/2019/01/17/cisco-throughput-5x/">this blog</a>.</li> + </ul> + </li> + <li><a href="https://www.mi.com/global">Xiaomi</a>, 2018-12-3 + <ul> + <li>Xiaomi is a major smartphone player in China. Apache Kylin plays a pivotal role in its core big data project, UnionSQL, and has begun to be widely promoted within the company. Read more at <a href="https://www.infoq.cn/article/bNLypvSJVpSHv-dLogsu">this blog</a>.</li> + </ul> + </li> + <li><a href="http://www.ctrip.com">Ctrip</a>, 2018-11-20 + <ul> + <li>Ctrip is the No.1 online travel agency in China and offers huge variety of travel package as well as one-stop hotel and flight booking service. Ctrip uses Kylin in the middle tier of its big data platform to carry out interactive queries for ad-hoc and reporting systems.</li> + </ul> + </li> <li><a href="https://www.hobsons.com/">Hobsons, Inc.</a>, 2018-08-11 <ul> <li>Hobsons solutions enable educators to improve college and career planning, admissions and enrollment management, student success and advising. Apache Kylin is used at Hobsons to gain valuable insight for educators on school performance and student success metrics.</li> Modified: kylin/site/docs/install/advance_settings.html URL: http://svn.apache.org/viewvc/kylin/site/docs/install/advance_settings.html?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/docs/install/advance_settings.html (original) +++ kylin/site/docs/install/advance_settings.html Tue Jan 22 14:09:20 2019 @@ -6188,6 +6188,41 @@ java -classpath kylin-server-base-\<v <p><strong>Note: The feature is in beta now.</strong></p> +<h2 id="use-sparksql-to-create-intermediate-flat-hive-table">Use SparkSql to create intermediate flat Hive table</h2> + +<p><strong>Note: There will be an issue when connecting thriftserver again, detail info, please check <a href="https://issues.apache.org/jira/browse/SPARK-21067">https://issues.apache.org/jira/browse/SPARK-21067</a></strong></p> + +<p>Kylin can use SparkSql to create intermediate flat Hive table; Before enable this:</p> + +<ul> + <li>Make sure the following parameters exist in hive-site.xml:</li> +</ul> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff"><property> + <name>hive.security.authorization.sqlstd.confwhitelist</name> + <value>mapred.*|hive.*|mapreduce.*|spark.*</value> +</property> + +<property> + <name>hive.security.authorization.sqlstd.confwhitelist.append</name> + <value>mapred.*|hive.*|mapreduce.*|spark.*</value> +</property></code></pre></div> + +<ul> + <li>Change <code class="highlighter-rouge">hive.execution.engine</code> to mr (Optional), if you want to use tez, please make sure the dependency of tez has been added</li> + <li>Copy the hive-site.xml to $SPARK_HOME/conf</li> + <li>Make sure the environmental variable HADOOP_CONF_DIR has been set</li> + <li>Use <code class="highlighter-rouge">sbin/start-thriftserver.sh --master spark://sparkmasterip:sparkmasterport</code> to start the thriftserver, usually port is 7077</li> + <li>Edit <code class="highlighter-rouge">conf/kylin.properties</code>, set the following parameters:</li> +</ul> + +<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.source.hive.enable-sparksql-for-table-ops=true +kylin.source.hive.sparksql-beeline-shell=/path/to/spark-client/bin/beeline +kylin.source.hive.sparksql-beeline-params=-n root -u 'jdbc:hive2://thriftserverip:thriftserverport'</code></pre></div> + +<p>Restart Kylin server to take effective. To disable, set <code class="highlighter-rouge">kylin.source.hive.enable-sparksql-for-table-ops</code> back to <code class="highlighter-rouge">false</code>.</p> + + </article> </div> </div> Modified: kylin/site/feed.xml URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1851820&r1=1851819&r2=1851820&view=diff ============================================================================== --- kylin/site/feed.xml (original) +++ kylin/site/feed.xml Tue Jan 22 14:09:20 2019 @@ -19,8 +19,8 @@ <description>Apache Kylin Home</description> <link>http://kylin.apache.org/</link> <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/> - <pubDate>Sun, 20 Jan 2019 20:11:59 -0800</pubDate> - <lastBuildDate>Sun, 20 Jan 2019 20:11:59 -0800</lastBuildDate> + <pubDate>Tue, 22 Jan 2019 05:59:17 -0800</pubDate> + <lastBuildDate>Tue, 22 Jan 2019 05:59:17 -0800</lastBuildDate> <generator>Jekyll v2.5.3</generator> <item>