[GitHub] [incubator-doris] imay commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
imay commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704#discussion_r317915271 ## File path: be/src/olap/iterators.h ## @@ -28,27 +28,63 @@ class RowBloc

[GitHub] [incubator-doris] imay commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
imay commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704#discussion_r317913758 ## File path: be/src/olap/rowset/segment_v2/segment_iterator.cpp ## @@ -47

[GitHub] [incubator-doris] imay merged pull request #1686: Add a loaded rows in SHOW LOAD result

2019-08-26 Thread GitBox
imay merged pull request #1686: Add a loaded rows in SHOW LOAD result URL: https://github.com/apache/incubator-doris/pull/1686 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1705: Limit V2 segment file row count (#1647)

2019-08-26 Thread GitBox
chaoyli commented on a change in pull request #1705: Limit V2 segment file row count (#1647) URL: https://github.com/apache/incubator-doris/pull/1705#discussion_r317904432 ## File path: be/src/olap/rowset/beta_rowset_writer.cpp ## @@ -84,6 +84,9 @@ OLAPStatus BetaRowsetWri

[GitHub] [incubator-doris] zhaidongbo opened a new issue #1707: Support new hint format /* */

2019-08-26 Thread GitBox
zhaidongbo opened a new issue #1707: Support new hint format /* */ URL: https://github.com/apache/incubator-doris/issues/1707 Doris now only support the hint format [ ]. When connecting Doris by Druid (connect pool), Druid report error about []. Mysql and Hive only support the hint fo

[GitHub] [incubator-doris] gaodayue commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
gaodayue commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704#discussion_r317894281 ## File path: be/src/olap/rowset/segment_v2/segment_iterator.h ## @@ -

[GitHub] [incubator-doris] gaodayue commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
gaodayue commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704#discussion_r317893771 ## File path: be/src/util/doris_metrics.h ## @@ -107,9 +107,14 @@ clas

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
kangpinghuang commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704#discussion_r317891752 ## File path: be/src/olap/rowset/segment_v2/segment_iterator.h ##

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
kangpinghuang commented on a change in pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704#discussion_r317892116 ## File path: be/src/util/doris_metrics.h ## @@ -107,9 +107,14 @@

[GitHub] [incubator-doris] imay merged pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow

2019-08-26 Thread GitBox
imay merged pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow URL: https://github.com/apache/incubator-doris/pull/1699 This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [incubator-doris] morningman opened a new issue #1706: BE cash when inserting data

2019-08-26 Thread GitBox
morningman opened a new issue #1706: BE cash when inserting data URL: https://github.com/apache/incubator-doris/issues/1706 **To Reproduce** ``` CREATE TABLE `largeint_s` ( `k1` tinyint(4) NOT NULL COMMENT "", `k2` smallint(6) NOT NULL COMMENT "", `k3` bigint(20) NOT NUL

[GitHub] [incubator-doris] liutang123 edited a comment on issue #1705: Limit V2 segment file row count (#1647)

2019-08-26 Thread GitBox
liutang123 edited a comment on issue #1705: Limit V2 segment file row count (#1647) URL: https://github.com/apache/incubator-doris/pull/1705#issuecomment-525113963 cc @gaodayue This is an automated message from the Apache Gi

[GitHub] [incubator-doris] liutang123 opened a new pull request #1705: Limit V2 segment file row count (#1647)

2019-08-26 Thread GitBox
liutang123 opened a new pull request #1705: Limit V2 segment file row count (#1647) URL: https://github.com/apache/incubator-doris/pull/1705 Because many bitmap implementations usually only support 32 bits integer, so use INT_MAX to limit the row count of a segment file. ---

[GitHub] [incubator-doris] liutang123 commented on issue #1705: Limit V2 segment file row count (#1647)

2019-08-26 Thread GitBox
liutang123 commented on issue #1705: Limit V2 segment file row count (#1647) URL: https://github.com/apache/incubator-doris/pull/1705#issuecomment-525113963 @gaodayue This is an automated message from the Apache Git Service.

[GitHub] [incubator-doris] gaodayue commented on issue #1678: Add rowset id generator to FE and BE

2019-08-26 Thread GitBox
gaodayue commented on issue #1678: Add rowset id generator to FE and BE URL: https://github.com/apache/incubator-doris/pull/1678#issuecomment-525110566 Can anyone explain what's the purpose of this PR and give a brief description of what's changed? -

[GitHub] [incubator-doris] gaodayue opened a new pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions

2019-08-26 Thread GitBox
gaodayue opened a new pull request #1704: support multiple key ranges in RowwiseIterator and StorageReadOptions URL: https://github.com/apache/incubator-doris/pull/1704 Main changes - support multiple key ranges in RowwiseIterator and StorageReadOptions - remove unused fields and

[GitHub] [incubator-doris] morningman commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
morningman commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317857231 ## File path: be/src/olap/data_dir.cpp ## @@ -1057,4 +1058,35 @@ void DataDir::

[GitHub] [incubator-doris] morningman commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
morningman commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317857248 ## File path: be/src/olap/data_dir.cpp ## @@ -1057,4 +1058,35 @@ void DataDir::

[GitHub] [incubator-doris] imay commented on a change in pull request #1644: Refactor DateLiteral class in FE

2019-08-26 Thread GitBox
imay commented on a change in pull request #1644: Refactor DateLiteral class in FE URL: https://github.com/apache/incubator-doris/pull/1644#discussion_r317677438 ## File path: fe/src/main/java/org/apache/doris/rewrite/FEFunctions.java ## @@ -92,415 +89,67 @@ public static

[GitHub] [incubator-doris] imay commented on a change in pull request #1644: Refactor DateLiteral class in FE

2019-08-26 Thread GitBox
imay commented on a change in pull request #1644: Refactor DateLiteral class in FE URL: https://github.com/apache/incubator-doris/pull/1644#discussion_r317675693 ## File path: fe/src/main/java/org/apache/doris/analysis/DateLiteral.java ## @@ -29,16 +31,58 @@ import org.

[GitHub] [incubator-doris] imay commented on a change in pull request #1644: Refactor DateLiteral class in FE

2019-08-26 Thread GitBox
imay commented on a change in pull request #1644: Refactor DateLiteral class in FE URL: https://github.com/apache/incubator-doris/pull/1644#discussion_r317673067 ## File path: fe/src/main/java/org/apache/doris/rewrite/FEFunctions.java ## @@ -56,8 +49,13 @@ */ @F

[GitHub] [incubator-doris] imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow

2019-08-26 Thread GitBox
imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow URL: https://github.com/apache/incubator-doris/pull/1699#discussion_r317626754 ## File path: be/src/util/arrow/row_block.cpp ## @@ -0,0 +1,323 @@ +// Licensed to the

[GitHub] [incubator-doris] imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow

2019-08-26 Thread GitBox
imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow URL: https://github.com/apache/incubator-doris/pull/1699#discussion_r317626834 ## File path: be/src/util/arrow/row_batch.h ## @@ -0,0 +1,70 @@ +// Licensed to the Apa

[GitHub] [incubator-doris] imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow

2019-08-26 Thread GitBox
imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow URL: https://github.com/apache/incubator-doris/pull/1699#discussion_r317626704 ## File path: be/src/util/arrow/row_block.h ## @@ -0,0 +1,65 @@ +// Licensed to the Apa

[GitHub] [incubator-doris] imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow

2019-08-26 Thread GitBox
imay commented on a change in pull request #1699: Support converting RowBatch and RowBlockV2 to/from Arrow URL: https://github.com/apache/incubator-doris/pull/1699#discussion_r317626437 ## File path: be/src/util/arrow/utils.h ## @@ -0,0 +1,49 @@ +// Licensed to the Apache

Re: issues about the website

2019-08-26 Thread Dave Fisher
Hi - Also on the website there should be the Incubation Disclaimer. See http://incubator.apache.org/guides/branding.html#disclaimers That would be a good start. There are other links needed to refer back to the Apache Software Foundation that we can add after an English language version is cre

[GitHub] [incubator-doris] imay merged pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
imay merged pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694 This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [incubator-doris] imay commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
imay commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#discussion_r317607982 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -81,24 +81,21 @@ class BinaryPl

[GitHub] [incubator-doris] gaodayue commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
gaodayue commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#discussion_r317603892 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -81,24 +81,21 @@ class Bina

[GitHub] [incubator-doris] gaodayue commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
gaodayue commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#discussion_r317603892 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -81,24 +81,21 @@ class Bina

[GitHub] [incubator-doris] gaodayue commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
gaodayue commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#discussion_r317603802 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -81,24 +81,21 @@ class Bina

[GitHub] [incubator-doris] wangbo commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
wangbo commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#discussion_r317599205 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -81,24 +81,21 @@ class Binary

[GitHub] [incubator-doris] morningman opened a new pull request #1686: Add a loaded rows in SHOW LOAD result

2019-08-26 Thread GitBox
morningman opened a new pull request #1686: Add a loaded rows in SHOW LOAD result URL: https://github.com/apache/incubator-doris/pull/1686 Add a new column 'JobDetails' to show more info of a load job. Loaded rows will be updated periodically by query report. So that user can see tha

[GitHub] [incubator-doris] morningman closed pull request #1686: Add a loaded rows in SHOW LOAD result

2019-08-26 Thread GitBox
morningman closed pull request #1686: Add a loaded rows in SHOW LOAD result URL: https://github.com/apache/incubator-doris/pull/1686 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [incubator-doris] imay opened a new issue #1703: Support Arrow format

2019-08-26 Thread GitBox
imay opened a new issue #1703: Support Arrow format URL: https://github.com/apache/incubator-doris/issues/1703 Now there are some undergoing work in Doris, such connecting with other system like Apache Spark. So there are many work that define data exchange interface. I think we can levera

[GitHub] [incubator-doris] imay commented on a change in pull request #1471: Planner support push down predicates past agg, win and sort

2019-08-26 Thread GitBox
imay commented on a change in pull request #1471: Planner support push down predicates past agg, win and sort URL: https://github.com/apache/incubator-doris/pull/1471#discussion_r317559883 ## File path: fe/src/main/java/org/apache/doris/planner/SingleNodePlanner.java ## @@

[GitHub] [incubator-doris] imay commented on a change in pull request #1471: Planner support push down predicates past agg, win and sort

2019-08-26 Thread GitBox
imay commented on a change in pull request #1471: Planner support push down predicates past agg, win and sort URL: https://github.com/apache/incubator-doris/pull/1471#discussion_r317559717 ## File path: fe/src/main/java/org/apache/doris/planner/SingleNodePlanner.java ## @@

[GitHub] [incubator-doris] morningman commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
morningman commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317579278 ## File path: be/src/olap/data_dir.cpp ## @@ -59,14 +59,14 @@ DataDir::DataDir(

[GitHub] [incubator-doris] imay commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
imay commented on a change in pull request #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#discussion_r317575436 ## File path: be/src/olap/rowset/segment_v2/binary_plain_page.h ## @@ -81,24 +81,21 @@ class BinaryPl

[GitHub] [incubator-doris] morningman commented on a change in pull request #1687: add limit to show tablet(#1547)

2019-08-26 Thread GitBox
morningman commented on a change in pull request #1687: add limit to show tablet(#1547) URL: https://github.com/apache/incubator-doris/pull/1687#discussion_r317563810 ## File path: fe/src/main/java/org/apache/doris/analysis/ShowTabletStmt.java ## @@ -79,10 +131,106 @@ publ

[GitHub] [incubator-doris] morningman commented on a change in pull request #1687: add limit to show tablet(#1547)

2019-08-26 Thread GitBox
morningman commented on a change in pull request #1687: add limit to show tablet(#1547) URL: https://github.com/apache/incubator-doris/pull/1687#discussion_r317559537 ## File path: docs/documentation/cn/sql-reference/sql-statements/Data Manipulation/SHOW TABLET.md ## @@ -

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317559888 ## File path: be/src/olap/data_dir.cpp ## @@ -1057,4 +1058,35 @@ void DataDir::_re

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317561189 ## File path: be/src/olap/data_dir.cpp ## @@ -59,14 +59,14 @@ DataDir::DataDir(con

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317560951 ## File path: be/src/olap/compaction.cpp ## @@ -186,4 +186,17 @@ OLAPStatus Compac

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
chaoyli commented on a change in pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702#discussion_r317562527 ## File path: be/src/olap/schema_change.cpp ## @@ -1889,10 +1889,16 @@ OLAPStatus

[GitHub] [incubator-doris] gaodayue commented on issue #1694: optimize V2 BinaryPlainPage format (#1648)

2019-08-26 Thread GitBox
gaodayue commented on issue #1694: optimize V2 BinaryPlainPage format (#1648) URL: https://github.com/apache/incubator-doris/pull/1694#issuecomment-524820964 @morningman , please take a look This is an automated message from t

[GitHub] [incubator-doris] kangpinghuang commented on a change in pull request #1687: add limit to show tablet(#1547)

2019-08-26 Thread GitBox
kangpinghuang commented on a change in pull request #1687: add limit to show tablet(#1547) URL: https://github.com/apache/incubator-doris/pull/1687#discussion_r317556403 ## File path: fe/src/main/java/org/apache/doris/analysis/ShowTabletStmt.java ## @@ -68,6 +73,14 @@ publ

[GitHub] [incubator-doris] morningman opened a new pull request #1702: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
morningman opened a new pull request #1702: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/pull/1702 Set high watermark and flood stage of disk used capacity. And forbid some operations if disk usage is too high. ISSUE: #1

[GitHub] [incubator-doris] morningman opened a new issue #1701: Limit the disk usage to avoid running out of disk capacity

2019-08-26 Thread GitBox
morningman opened a new issue #1701: Limit the disk usage to avoid running out of disk capacity URL: https://github.com/apache/incubator-doris/issues/1701 Currently, Doris does not limit any disk usage, this may cause BE crash after running out of disk space. So we need to monitor the d

[GitHub] [incubator-doris] chenhao7253886 opened a new pull request #1700: Partition pruning support Expr

2019-08-26 Thread GitBox
chenhao7253886 opened a new pull request #1700: Partition pruning support Expr URL: https://github.com/apache/incubator-doris/pull/1700 This is an automated message from the Apache Git Service. To respond to the message, plea

Re: issues about the website

2019-08-26 Thread Willem Jiang
For the web content, we could use the translation service first then made some adjustments by hand. It won't take you lot of time. Please keep it in mind, we need to provide english version content first. Willem Jiang Twitter: willemjiang Weibo: 姜宁willem On Mon, Aug 26, 2019 at 4:13 PM Zhao Chun

Re: issues about the website

2019-08-26 Thread Zhao Chun
Hi Willem, I have some questions. We can translate menu and website repo to English. And mention Doris has been donated to Apache. However we have no English version web content. And this could take us a lot of time to translate. What should we do? Zhao Chun 于2019年8月26日周一 下午4:02写道: > Thanks Wi

Re: issues about the website

2019-08-26 Thread Zhao Chun
Thanks Willem, we will fix these problems Willem Jiang 于2019年8月26日周一 下午3:46写道: > Hi, > > Current we got some feedback from IPMC about the website issues of > doris. We need to provide English version of website first. > > 1. Website only includes the English readme. Still using Chinese menu, > h

issues about the website

2019-08-26 Thread Willem Jiang
Hi, Current we got some feedback from IPMC about the website issues of doris. We need to provide English version of website first. 1. Website only includes the English readme. Still using Chinese menu, http://doris.apache.org/. After I clicked which menu item or Next at the bottom of the page, it