[GitHub] [incubator-doris] imay commented on pull request #4226: [Calcite optimzer] support opertor of scan, filter, project of One QueryBlock #4223

2020-07-30 Thread GitBox
imay commented on pull request #4226: URL: https://github.com/apache/incubator-doris/pull/4226#issuecomment-666959279 Hi @wutiangan I think support calcite in Doris is a long-time and very hard work, it will last for a long time. Can you give more detail design about it before you co

[GitHub] [incubator-doris] imay commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-30 Thread GitBox
imay commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-666958042 > It can be done in some other new data model in future. Changing the current data model to "Copy-on-Write" is a very costly thing. Having you any idea about it? We can

[GitHub] [incubator-doris] kangkaisen merged pull request #4190: [Feature]Add fetch/update/clear proto of fe&be for cache

2020-07-30 Thread GitBox
kangkaisen merged pull request #4190: URL: https://github.com/apache/incubator-doris/pull/4190 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [Feature]Add fetch/update/clear proto of fe&be for cache (#4190)

2020-07-30 Thread kangkaisen
This is an automated email from the ASF dual-hosted git repository. kangkaisen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 1ebd156 [Feature]Add fetch/update/

[GitHub] [incubator-doris] yangzhg commented on issue #4218: Wrong result of querying with cast expression in where clause

2020-07-30 Thread GitBox
yangzhg commented on issue #4218: URL: https://github.com/apache/incubator-doris/issues/4218#issuecomment-666911408 0, "0", false, "false" can cast to false 1 , "1", true, "true" can cast to true other cast to null Thi

[incubator-doris] branch support_batch_delete_in_fe created (now 8043668)

2020-07-30 Thread yangzhg
This is an automated email from the ASF dual-hosted git repository. yangzhg pushed a change to branch support_batch_delete_in_fe in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. at 8043668 xx No new revisions were added by this update.

[GitHub] [incubator-doris] wutiangan opened a new pull request #4226: [Calcite optimzer] support opertor of scan, filter, project of One QueryBlock #4223

2020-07-30 Thread GitBox
wutiangan opened a new pull request #4226: URL: https://github.com/apache/incubator-doris/pull/4226 ## Proposed changes the predicate of filter operator only support BinaryPredicate and CompoundPredicate. for example: set enable_calcite = true; select i from t where j > 1

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #4217: [Bug][Load][Json] #4124 Load json format with stream load failed

2020-07-30 Thread GitBox
wuyunfeng commented on a change in pull request #4217: URL: https://github.com/apache/incubator-doris/pull/4217#discussion_r463389954 ## File path: be/src/common/config.h ## @@ -303,11 +303,14 @@ namespace config { CONF_Int64(load_data_reserve_hours, "4"); // log erro

[GitHub] [incubator-doris] morningman commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-30 Thread GitBox
morningman commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-666893332 > Why not change it to 'Merge on Write'? It can be done in some other new data model in future. Changing the current data model to "Copy-on-Write" is a very costly

[GitHub] [incubator-doris] imay commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-30 Thread GitBox
imay commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-666881045 > 1. Currently Doris is implemented based on the `Merge on Read` method. This implementation method is the same as the current implementation strategy. Why not change it

[GitHub] [incubator-doris] morningman commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-30 Thread GitBox
morningman commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-666876657 > I have some question about this proposal. > > 1. Doris is a OLAP system which should be read optimized, however this batch delete proposal is write optimized.

[GitHub] [incubator-doris] imay commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-30 Thread GitBox
imay commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-666872723 I have some question about this proposal. 1. Doris is a OLAP system which should be read optimized, however this batch delete proposal is write optimized. 2. When user wa

[GitHub] [incubator-doris] imay commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-30 Thread GitBox
imay commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-666867303 I think we should discuss about this feature befor developing it. This is an automated message from the Apache

[GitHub] [incubator-doris] imay commented on a change in pull request #4225: Config netty param in HttpServer

2020-07-30 Thread GitBox
imay commented on a change in pull request #4225: URL: https://github.com/apache/incubator-doris/pull/4225#discussion_r463359465 ## File path: fe/fe-core/src/main/java/org/apache/doris/http/HttpServer.java ## @@ -17,6 +17,17 @@ package org.apache.doris.http; +import io.net

[GitHub] [incubator-doris] yangzhg closed issue #4176: Reduce the conflict of grammar file

2020-07-30 Thread GitBox
yangzhg closed issue #4176: URL: https://github.com/apache/incubator-doris/issues/4176 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-doris] yangzhg closed issue #4130: [BUG] from_base64

2020-07-30 Thread GitBox
yangzhg closed issue #4130: URL: https://github.com/apache/incubator-doris/issues/4130 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-doris] morningman commented on a change in pull request #4225: Config netty param in HttpServer

2020-07-30 Thread GitBox
morningman commented on a change in pull request #4225: URL: https://github.com/apache/incubator-doris/pull/4225#discussion_r463111506 ## File path: fe/fe-core/src/main/java/org/apache/doris/http/HttpServer.java ## @@ -17,6 +17,17 @@ package org.apache.doris.http; +import

[GitHub] [incubator-doris] kangkaisen commented on pull request #4225: Config netty param in HttpServer

2020-07-30 Thread GitBox
kangkaisen commented on pull request #4225: URL: https://github.com/apache/incubator-doris/pull/4225#issuecomment-666381298 @liutang123 Hi. please add these new configs to doc. This is an automated message from the Apache Git

[GitHub] [incubator-doris] kangkaisen commented on pull request #4221: Add approx count distinct function

2020-07-30 Thread GitBox
kangkaisen commented on pull request #4221: URL: https://github.com/apache/incubator-doris/pull/4221#issuecomment-666379143 @HangyuanLiu Hi, you should also add a doc for this function. This is an automated message from the A

[GitHub] [incubator-doris] liutang123 opened a new pull request #4225: Config netty param in HttpServer

2020-07-30 Thread GitBox
liutang123 opened a new pull request #4225: URL: https://github.com/apache/incubator-doris/pull/4225 for #4224 Add three http param to control the netty behavior. This is an automated message from the Apache Git Servic

[GitHub] [incubator-doris] liutang123 opened a new issue #4224: Config netty param in HttpServer

2020-07-30 Thread GitBox
liutang123 opened a new issue #4224: URL: https://github.com/apache/incubator-doris/issues/4224 Now, if the length of URL is longer than 4096 bytes, netty will refuse. The case can be reproduced by constructing a very long URL(longer than 4096bytes) ``` curl -sS -m 1800 --location-

[GitHub] [incubator-doris] wutiangan opened a new issue #4223: [proposal] Introduce Calcite as the one of the optimizers of Doris

2020-07-30 Thread GitBox
wutiangan opened a new issue #4223: URL: https://github.com/apache/incubator-doris/issues/4223 ## Hierarchy of query planner layer The hierarchy of Good Query Planner Layer is as follows: - Analysis phase: identify the namespace and check the meta data; build the queryblock,

[GitHub] [incubator-doris] HappenLee opened a new pull request #4222: [Spill To Disk][4/6] Partition Aggregation Node Support Spill to disk in big query

2020-07-30 Thread GitBox
HappenLee opened a new pull request #4222: URL: https://github.com/apache/incubator-doris/pull/4222 ## Proposed changes 1. Remove MemTracker in ReservationTracker, the men limit in bufferpool will be replace by MemTracker in BufferedBlockMgr2 2. Replace BufferedTupleStream3 by Buf

[GitHub] [incubator-doris] HangyuanLiu opened a new pull request #4221: Add approx count distinct function

2020-07-30 Thread GitBox
HangyuanLiu opened a new pull request #4221: URL: https://github.com/apache/incubator-doris/pull/4221 FIX #4220 This PR not modify logical, only add a alias to ndv This is an automated message from the Apache Git Service.

[GitHub] [incubator-doris] imay commented on issue #4220: [FEATURE] Support approx_count_distinct function

2020-07-30 Thread GitBox
imay commented on issue #4220: URL: https://github.com/apache/incubator-doris/issues/4220#issuecomment-666308988 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [incubator-doris] HangyuanLiu opened a new issue #4220: [FEATURE] Support approx_count_distinct function

2020-07-30 Thread GitBox
HangyuanLiu opened a new issue #4220: URL: https://github.com/apache/incubator-doris/issues/4220 We currently have a function called "NDV", but the name of this function is not easy to understand, and we cannot literally understand what the function does. So we should add a common alia

[GitHub] [incubator-doris] sduzh opened a new pull request #4219: [BUG] Fix wrong result of querying with cast expr in where clause

2020-07-30 Thread GitBox
sduzh opened a new pull request #4219: URL: https://github.com/apache/incubator-doris/pull/4219 ## Proposed changes Fix #4218 ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_ - [x] Bugfix (non-br

[GitHub] [incubator-doris] morningman commented on pull request #4216: [Bug][ColocateJoin] Fix the bug 'Make a wrong choice of colocate join'

2020-07-30 Thread GitBox
morningman commented on pull request #4216: URL: https://github.com/apache/incubator-doris/pull/4216#issuecomment-666273129 Label! Label! Label! This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [incubator-doris] sduzh opened a new issue #4218: Wrong result of querying with cast expression in where clause

2020-07-30 Thread GitBox
sduzh opened a new issue #4218: URL: https://github.com/apache/incubator-doris/issues/4218 **Describe the bug** Wrong result of query with cast **To Reproduce** ``` CREATE TABLE `t3` ( `c0` varchar(1) ) ENGINE=OLAP DUPLICATE KEY(`c0`) COMMENT "OLAP" DISTRIBUT

[GitHub] [incubator-doris] morningman opened a new pull request #4217: [Bug][Load][Json] #4124 Load json format with stream load failed

2020-07-30 Thread GitBox
morningman opened a new pull request #4217: URL: https://github.com/apache/incubator-doris/pull/4217 ## Proposed changes Stream load should read all the data completely before parsing the json. And also add a new BE config `streaming_load_max_batch_read_mb` to limit the data siz

[GitHub] [incubator-doris] HappenLee opened a new issue #4215: [BUG] Make a wrong choice of colocate join

2020-07-30 Thread GitBox
HappenLee opened a new issue #4215: URL: https://github.com/apache/incubator-doris/issues/4215 **Describe the bug** There are two colocate table:colocate1 and colocate2 ``` create table colocate1 (k1 int, k2 int, k3 int) distributed by hash(k1, k2) buckets 1

[GitHub] [incubator-doris] HappenLee opened a new pull request #4216: [Bug][ColocateJoin] Fix the bug 'Make a wrong choice of colocate join'

2020-07-30 Thread GitBox
HappenLee opened a new pull request #4216: URL: https://github.com/apache/incubator-doris/pull/4216 The detail description #4215 ## Proposed changes Fix bug #4215 ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the b

[incubator-doris-website] branch asf-site updated: add version option for branch-0.13

2020-07-30 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-doris-website.git The following commit(s) were added to refs/heads/asf-site by this push: new d234d49 add version option

[GitHub] [incubator-doris] kangkaisen merged pull request #4159: [Feature][Cache]Add interface, cache coordinator, metric, variable and config for query cache

2020-07-30 Thread GitBox
kangkaisen merged pull request #4159: URL: https://github.com/apache/incubator-doris/pull/4159 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman merged pull request #4152: [Spill To Disk][2/6] Add some runningtime function and change some function will be called in the future

2020-07-30 Thread GitBox
morningman merged pull request #4152: URL: https://github.com/apache/incubator-doris/pull/4152 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] sduzh closed issue #3863: Issue template should be updated

2020-07-30 Thread GitBox
sduzh closed issue #3863: URL: https://github.com/apache/incubator-doris/issues/3863 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-doris] caiconghui closed issue #4204: [Bug] Wrong fe meta version check for DropDbInfo and doc content for drop meta check is needed

2020-07-30 Thread GitBox
caiconghui closed issue #4204: URL: https://github.com/apache/incubator-doris/issues/4204 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] caiconghui closed issue #3956: An uniform solution to check db used data quota when data load job begin a new txn

2020-07-30 Thread GitBox
caiconghui closed issue #3956: URL: https://github.com/apache/incubator-doris/issues/3956 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] morningman merged pull request #4148: [Bug][TabletRepair] Fix bug that too many replicas generated when decommission BE

2020-07-30 Thread GitBox
morningman merged pull request #4148: URL: https://github.com/apache/incubator-doris/pull/4148 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] lovecatchuan commented on issue #4153: Be error "Check failure stack trace"

2020-07-30 Thread GitBox
lovecatchuan commented on issue #4153: URL: https://github.com/apache/incubator-doris/issues/4153#issuecomment-666079469 > You should set `open files` limit exceed 65535 Correct answer,I found the reason for the error in the log,thanks --

[GitHub] [incubator-doris] morningman closed issue #4147: [Bug] Lots of version incomplete replica created when decommission BE

2020-07-30 Thread GitBox
morningman closed issue #4147: URL: https://github.com/apache/incubator-doris/issues/4147 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] kangkaisen commented on pull request #4214: [BUG]Fix remove expired stale rowset path order error

2020-07-30 Thread GitBox
kangkaisen commented on pull request #4214: URL: https://github.com/apache/incubator-doris/pull/4214#issuecomment-666173595 @ZhangYu0123 Hi, Could we write a UT to cover this bug? This is an automated message from the Apache

[GitHub] [incubator-doris] imay closed issue #4181: Linked schema change not work

2020-07-30 Thread GitBox
imay closed issue #4181: URL: https://github.com/apache/incubator-doris/issues/4181 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-doris] ZhangYu0123 opened a new issue #4213: [BUG][remove stale rowset] Remove stale rowset path order error.

2020-07-30 Thread GitBox
ZhangYu0123 opened a new issue #4213: URL: https://github.com/apache/incubator-doris/issues/4213 **Describe the bug** Delete stale rowset path order error. This bug leads to stale rowsets version inconsistents **To Reproduce** Steps to reproduce the behavior: 1. load data 2

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #4212: Compaction rules optimization

2020-07-30 Thread GitBox
kangkaisen commented on a change in pull request #4212: URL: https://github.com/apache/incubator-doris/pull/4212#discussion_r462750027 ## File path: be/src/common/config.h ## @@ -265,6 +265,27 @@ namespace config { CONF_mInt64(base_compaction_interval_seconds_since_last_op

[GitHub] [incubator-doris] morningman merged pull request #4205: [Bug] Fix fe meta version problem, make drop meta check code easy to read and add doc content for drop meta check

2020-07-30 Thread GitBox
morningman merged pull request #4205: URL: https://github.com/apache/incubator-doris/pull/4205 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman closed pull request #4125: [Bug][Load][Json] #4124 Load json format with stream load failed

2020-07-30 Thread GitBox
morningman closed pull request #4125: URL: https://github.com/apache/incubator-doris/pull/4125 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] caiconghui closed issue #3988: [Proposal]Before drop db, table, partition should check whether there exits related committed txns ready to publish

2020-07-30 Thread GitBox
caiconghui closed issue #3988: URL: https://github.com/apache/incubator-doris/issues/3988 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] caiconghui closed issue #3696: [Proposal] Change some default config in be to make doris more friendly to new user and make brpc_num_threads configurable to get better perfo

2020-07-30 Thread GitBox
caiconghui closed issue #3696: URL: https://github.com/apache/incubator-doris/issues/3696 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] caiconghui closed issue #4054: Optimize the logic of processing unfinishedTask when transaction is publishTimeout

2020-07-30 Thread GitBox
caiconghui closed issue #4054: URL: https://github.com/apache/incubator-doris/issues/4054 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #4190: [Feature]Add fetch/update/clear proto of fe&be for cache

2020-07-30 Thread GitBox
kangkaisen commented on a change in pull request #4190: URL: https://github.com/apache/incubator-doris/pull/4190#discussion_r462713558 ## File path: gensrc/proto/internal_service.proto ## @@ -147,6 +147,59 @@ message PFetchDataResult { optional PQueryStatistics query_stati

[GitHub] [incubator-doris] ZhangYu0123 opened a new pull request #4214: Fix stale rowset path order error

2020-07-30 Thread GitBox
ZhangYu0123 opened a new pull request #4214: URL: https://github.com/apache/incubator-doris/pull/4214 ## Proposed changes Delete stale rowset path order error. This bug leads to stale rowsets version inconsistents. #4213 ## Types of changes What types of changes does

[GitHub] [incubator-doris] morningman merged pull request #4136: Fixbug: json load

2020-07-30 Thread GitBox
morningman merged pull request #4136: URL: https://github.com/apache/incubator-doris/pull/4136 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] kangkaisen merged pull request #4151: [Spill To Disk][1/6] The adjustment of the basic BufferedBlockMgr includes the following change

2020-07-30 Thread GitBox
kangkaisen merged pull request #4151: URL: https://github.com/apache/incubator-doris/pull/4151 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] imay commented on pull request #4211: Fix multi predicate in correlation subquery analyze fail

2020-07-30 Thread GitBox
imay commented on pull request #4211: URL: https://github.com/apache/incubator-doris/pull/4211#issuecomment-666036663 @HangyuanLiu Fail to pass Unit test. please check This is an automated message from the Apache Git Serv

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #4198: Add bitmap longitudinal cutting udaf

2020-07-30 Thread GitBox
EmmyMiao87 commented on a change in pull request #4198: URL: https://github.com/apache/incubator-doris/pull/4198#discussion_r462711408 ## File path: docs/zh-CN/extending-doris/udf/contrib/udaf-orthogonal-bitmap-manual.md ## @@ -0,0 +1,209 @@ +--- +{ +"title": "BITMAP正交计算UD

[GitHub] [incubator-doris] lovecatchuan closed issue #4153: Be error "Check failure stack trace"

2020-07-30 Thread GitBox
lovecatchuan closed issue #4153: URL: https://github.com/apache/incubator-doris/issues/4153 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-doris] ZhangYu0123 opened a new pull request #4212: Compaction rules optimization

2020-07-30 Thread GitBox
ZhangYu0123 opened a new pull request #4212: URL: https://github.com/apache/incubator-doris/pull/4212 ## Proposed changes Compaction rules optimization, the detail problem description and design to see #4164. This pr commits 2 functions: (1) add the cumulative policy configable

[GitHub] [incubator-doris] WingsGo commented on pull request #4127: [Bug][DynamicPartition]Fix bug that Modify a dynamic partition property in a non-dynamic partition table will throw a Exception

2020-07-30 Thread GitBox
WingsGo commented on pull request #4127: URL: https://github.com/apache/incubator-doris/pull/4127#issuecomment-666051195 Hi, @morningman , I think the PR should included in 0.13-branch, can you review it? thx~~ This is an au

[GitHub] [incubator-doris] morningman merged pull request #4182: #4181 Let linked-schema change work for BETA tablet

2020-07-30 Thread GitBox
morningman merged pull request #4182: URL: https://github.com/apache/incubator-doris/pull/4182 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov