[GitHub] [incubator-doris] HappenLee opened a new pull request #4052: [Bug] Fix core of double delete, when RowBatch call transfer_resource_ownership

2020-07-07 Thread GitBox
HappenLee opened a new pull request #4052: URL: https://github.com/apache/incubator-doris/pull/4052 Resource release should be done by dest RowBatch. When we call method transfer_resource_ownership. if we don't clear the corresponding resources, which will cause the core problem of double

[GitHub] [incubator-doris] caiconghui commented on a change in pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
caiconghui commented on a change in pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049#discussion_r451318966 ## File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java ## @@ -458,10 +459,10 @@ public DynamicPartitionScheduler getDynamicParti

[GitHub] [incubator-doris] yangzhg edited a comment on issue #4051: [Proposal] Doris supports batch delete

2020-07-07 Thread GitBox
yangzhg edited a comment on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-655317768 # Doris 支持批量删除设计文档 ## 背景 ​目前Doris 支持broker load, routine load, stream load 等多种导入方式,对于数据的删除目前只能通过delete 语句进行删除,使用delete 语句的方式删除时,每执行一次delete

[GitHub] [incubator-doris] yangzhg commented on issue #4051: [Proposal] Doris supports batch delete

2020-07-07 Thread GitBox
yangzhg commented on issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051#issuecomment-655317768 # Doris 支持批量删除设计文档 ## 背景 ​目前Doris 支持broker load, routine load, stream load 等多种导入方式,对于数据的删除目前只能通过delete 语句进行删除,使用delete 语句的方式删除时,每执行一次delete 都会生成一个新

[GitHub] [incubator-doris] yangzhg opened a new issue #4051: [Proposal] Doris supports batch delete

2020-07-07 Thread GitBox
yangzhg opened a new issue #4051: URL: https://github.com/apache/incubator-doris/issues/4051 # Doris supports batch delete ## BACKGROUND At present, Doris supports multiple import methods such as broker load, routine load, stream load, etc. For the deletion of data, it can on

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
WingsGo commented on a change in pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049#discussion_r451308462 ## File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java ## @@ -458,10 +459,10 @@ public DynamicPartitionScheduler getDynamicPartitio

[GitHub] [incubator-doris] WingsGo commented on a change in pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
WingsGo commented on a change in pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049#discussion_r451308462 ## File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java ## @@ -458,10 +459,10 @@ public DynamicPartitionScheduler getDynamicPartitio

[GitHub] [incubator-doris] caiconghui commented on pull request #4022: Add thrift_client_retry_interval_ms config in be for thrift client to avoid avalanche disaster in fe thrift server

2020-07-07 Thread GitBox
caiconghui commented on pull request #4022: URL: https://github.com/apache/incubator-doris/pull/4022#issuecomment-655308540 > UT failed on ThreadPoolManagerTest.java. > Can you pass it in your local env? @morningman I test in with "mvn test -Dtest=ThreadPoolManagerTest", and it pa

[GitHub] [incubator-doris] caiconghui edited a comment on pull request #4022: Add thrift_client_retry_interval_ms config in be for thrift client to avoid avalanche disaster in fe thrift server

2020-07-07 Thread GitBox
caiconghui edited a comment on pull request #4022: URL: https://github.com/apache/incubator-doris/pull/4022#issuecomment-655308540 > UT failed on ThreadPoolManagerTest.java. > Can you pass it in your local env? @morningman I test it with "mvn test -Dtest=ThreadPoolManagerTest", an

[GitHub] [incubator-doris] chaoyli commented on issue #3930: [Proposal] Doris support version column for REPLACE aggregate type

2020-07-07 Thread GitBox
chaoyli commented on issue #3930: URL: https://github.com/apache/incubator-doris/issues/3930#issuecomment-655289846 I think it's better to handle the problem in load. If you want to preserve the ordering, you can speculate the behavior in the load command. CreateTable should not catc

[GitHub] [incubator-doris] vagetablechicken closed issue #4027: DeltaWriter's FlushStatistic needs a metric

2020-07-07 Thread GitBox
vagetablechicken closed issue #4027: URL: https://github.com/apache/incubator-doris/issues/4027 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [incubator-doris] vagetablechicken commented on issue #4027: DeltaWriter's FlushStatistic needs a metric

2020-07-07 Thread GitBox
vagetablechicken commented on issue #4027: URL: https://github.com/apache/incubator-doris/issues/4027#issuecomment-655275835 MemTable flush count & time already have BE level stats, sorry, I didn't see it before create this issue. But no tablet level. It's better to add tablet monitoring

[GitHub] [incubator-doris] xy720 commented on a change in pull request #3981: [Feature] Batch update partition's property in one command

2020-07-07 Thread GitBox
xy720 commented on a change in pull request #3981: URL: https://github.com/apache/incubator-doris/pull/3981#discussion_r451273362 ## File path: fe/src/main/java/org/apache/doris/analysis/ModifyPartitionClause.java ## @@ -48,27 +61,80 @@ public ModifyPartitionClause(String parti

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #4014: Add framework of mv selector

2020-07-07 Thread GitBox
wutiangan commented on a change in pull request #4014: URL: https://github.com/apache/incubator-doris/pull/4014#discussion_r451257912 ## File path: fe/src/main/java/org/apache/doris/analysis/CreateMaterializedViewStmt.java ## @@ -50,7 +53,21 @@ * [PROPERTIES ("key" = "value"

[incubator-doris] branch master updated (6d4fd25 -> 413d6d2)

2020-07-07 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 6d4fd25 [shell] Fix BE unit test directory not match bug (#4028) add 413d6d2 [Bug] Fix core when

[GitHub] [incubator-doris] chaoyli merged pull request #4042: [Bug] Fix core when modifing char to varchar and loading boolean with replace aggregation

2020-07-07 Thread GitBox
chaoyli merged pull request #4042: URL: https://github.com/apache/incubator-doris/pull/4042 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-doris] chaoyli closed issue #4044: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli closed issue #4044: URL: https://github.com/apache/incubator-doris/issues/4044 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-doris] chaoyli closed issue #4043: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli closed issue #4043: URL: https://github.com/apache/incubator-doris/issues/4043 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-doris] caiconghui commented on a change in pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
caiconghui commented on a change in pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049#discussion_r451250664 ## File path: fe/src/main/java/org/apache/doris/common/publish/FixedTimePublisher.java ## @@ -28,7 +28,7 @@ public class FixedTimePublisher {

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #4014: Add framework of mv selector

2020-07-07 Thread GitBox
wutiangan commented on a change in pull request #4014: URL: https://github.com/apache/incubator-doris/pull/4014#discussion_r451249418 ## File path: fe/src/main/java/org/apache/doris/analysis/MVColumnOneChildPattern.java ## @@ -0,0 +1,56 @@ +// Licensed to the Apache Software F

[GitHub] [incubator-doris] acelyc111 commented on pull request #4050: [webserver] Make BE webserver more pretty

2020-07-07 Thread GitBox
acelyc111 commented on pull request #4050: URL: https://github.com/apache/incubator-doris/pull/4050#issuecomment-655238887 Now BE's website looks like: ![image](https://user-images.githubusercontent.com/10775040/86866495-a8d7d080-c103-11ea-94be-3d3318d8ca47.png) ---

[GitHub] [incubator-doris] morningman commented on pull request #4022: Add thrift_client_retry_interval_ms config in be for thrift client to avoid avalanche disaster in fe thrift server

2020-07-07 Thread GitBox
morningman commented on pull request #4022: URL: https://github.com/apache/incubator-doris/pull/4022#issuecomment-655237182 UT failed on ThreadPoolManagerTest.java. Can you pass it in your local env? This is an automated m

[GitHub] [incubator-doris] morningman commented on a change in pull request #4014: Add framework of mv selector

2020-07-07 Thread GitBox
morningman commented on a change in pull request #4014: URL: https://github.com/apache/incubator-doris/pull/4014#discussion_r450258546 ## File path: fe/src/main/java/org/apache/doris/rewrite/mvrewrite/SlotRefEqualRule.java ## @@ -0,0 +1,39 @@ +// Licensed to the Apache Softwar

[GitHub] [incubator-doris] morningman commented on a change in pull request #4014: Add framework of mv selector

2020-07-07 Thread GitBox
morningman commented on a change in pull request #4014: URL: https://github.com/apache/incubator-doris/pull/4014#discussion_r451239890 ## File path: fe/src/main/java/org/apache/doris/analysis/QueryStmt.java ## @@ -113,6 +113,40 @@ // represent the "INTO OUTFILE" clause

[GitHub] [incubator-doris] morningman merged pull request #4028: [shell] Fix BE unit test directory not match bug

2020-07-07 Thread GitBox
morningman merged pull request #4028: URL: https://github.com/apache/incubator-doris/pull/4028 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman commented on pull request #4028: [shell] Fix BE unit test directory not match bug

2020-07-07 Thread GitBox
morningman commented on pull request #4028: URL: https://github.com/apache/incubator-doris/pull/4028#issuecomment-655235433 I merged this PR so that following UT can run normally. This is an automated message from the Apache

[incubator-doris] branch master updated (7715a84 -> 6d4fd25)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 7715a84 [Config] Enable some features by default (#4031) add 6d4fd25 [shell] Fix BE unit test dir

[incubator-doris] branch master updated: [Config] Enable some features by default (#4031)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 7715a84 [Config] Enable some featu

[GitHub] [incubator-doris] morningman merged pull request #4031: [Config] Enable some features by default

2020-07-07 Thread GitBox
morningman merged pull request #4031: URL: https://github.com/apache/incubator-doris/pull/4031 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman commented on a change in pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
morningman commented on a change in pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049#discussion_r451232425 ## File path: fe/src/main/java/org/apache/doris/common/publish/FixedTimePublisher.java ## @@ -28,7 +28,7 @@ public class FixedTimePublisher {

[GitHub] [incubator-doris] morningman commented on a change in pull request #4050: [webserver] Make BE webserver more pretty

2020-07-07 Thread GitBox
morningman commented on a change in pull request #4050: URL: https://github.com/apache/incubator-doris/pull/4050#discussion_r451230720 ## File path: webroot/be/index.html ## @@ -0,0 +1,24 @@ + + + +Doris Webserver Review comment: How about: `Doris Backend` ?

[GitHub] [incubator-doris] acelyc111 opened a new pull request #4050: [webserver] Make BE webserver more pretty

2020-07-07 Thread GitBox
acelyc111 opened a new pull request #4050: URL: https://github.com/apache/incubator-doris/pull/4050 Add some CSS and js files, and use boost-table framework to make BE's website more pretty This is an automated message from

[GitHub] [incubator-doris] caiconghui commented on pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
caiconghui commented on pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049#issuecomment-654973560 for #4046 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [incubator-doris] caiconghui opened a new pull request #4049: [Thread Resource Leak] Fix thread resource leak after checkpoint catalog destroyed

2020-07-07 Thread GitBox
caiconghui opened a new pull request #4049: URL: https://github.com/apache/incubator-doris/pull/4049 This PR is mainly to fix thread resource leak, and then add some notice to use newDaemonScheduledThreadPool api in ThreadPoolManager . -

[GitHub] [incubator-doris] acelyc111 closed pull request #3909: [webserver] Make BE webserver more pretty

2020-07-07 Thread GitBox
acelyc111 closed pull request #3909: URL: https://github.com/apache/incubator-doris/pull/3909 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-doris] caiconghui edited a comment on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler threads in our production environment

2020-07-07 Thread GitBox
caiconghui edited a comment on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654852287 Here, we start the thread in MasterTaskExecutor https://github.com/apache/incubator-doris/blob/1fc82cd6e48ef5fed4d29b7e5cb4df63c3130027/fe/src/main/java/org/

[GitHub] [incubator-doris] Youngwb commented on issue #3930: [Proposal] Doris support version column for REPLACE aggregate type

2020-07-07 Thread GitBox
Youngwb commented on issue #3930: URL: https://github.com/apache/incubator-doris/issues/3930#issuecomment-654940291 > If user create `sequence_visible` column in table, does it still has a hidden sequence column? > In my point, it should has. yes, it has.

[GitHub] [incubator-doris] morningman commented on a change in pull request #3981: [Feature] Batch update partition's property in one command

2020-07-07 Thread GitBox
morningman commented on a change in pull request #3981: URL: https://github.com/apache/incubator-doris/pull/3981#discussion_r450944928 ## File path: fe/src/main/java/org/apache/doris/analysis/ModifyPartitionClause.java ## @@ -17,28 +17,41 @@ package org.apache.doris.analysis

[incubator-doris] branch master updated (ab8851f -> b7051d0)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from ab8851f [webserver] Make BE webserver handle static files (#4021) add b7051d0 [Config]Make it eas

[GitHub] [incubator-doris] morningman merged pull request #3957: Make it easier for users to find configuration items needed

2020-07-07 Thread GitBox
morningman merged pull request #3957: URL: https://github.com/apache/incubator-doris/pull/3957 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [webserver] Make BE webserver handle static files (#4021)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new ab8851f [webserver] Make BE webser

[GitHub] [incubator-doris] morningman merged pull request #4021: [webserver] Make BE webserver handle static files

2020-07-07 Thread GitBox
morningman merged pull request #4021: URL: https://github.com/apache/incubator-doris/pull/4021 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman merged pull request #4020: [Load][Json] Refactor json load logic to make it more reasonable

2020-07-07 Thread GitBox
morningman merged pull request #4020: URL: https://github.com/apache/incubator-doris/pull/4020 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman merged pull request #4026: Fix mini load NPE

2020-07-07 Thread GitBox
morningman merged pull request #4026: URL: https://github.com/apache/incubator-doris/pull/4026 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [Bug]Fix mini load NPE (#4026)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 1aa148d [Bug]Fix mini load NPE (#4

[incubator-doris] branch master updated (5c42514 -> c3d9fee)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 5c42514 [Bug][SQL]Fix except node child not order correctly (#4003) add c3d9fee [Load][Json] Refa

[GitHub] [incubator-doris] morningman merged pull request #4003: Fix except node child not order correctly

2020-07-07 Thread GitBox
morningman merged pull request #4003: URL: https://github.com/apache/incubator-doris/pull/4003 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [Bug][SQL]Fix except node child not order correctly (#4003)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 5c42514 [Bug][SQL]Fix except node

[GitHub] [incubator-doris] morningman closed issue #3995: UNION and EXCEPT result is wrong

2020-07-07 Thread GitBox
morningman closed issue #3995: URL: https://github.com/apache/incubator-doris/issues/3995 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[incubator-doris] branch master updated: [Doris On ES] Add UT test for all search phase (#4035)

2020-07-07 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 1cc9e16 [Doris On ES] Add UT test

[GitHub] [incubator-doris] morningman merged pull request #4035: [Doris On ES] [UT] Add UT test for all search phase

2020-07-07 Thread GitBox
morningman merged pull request #4035: URL: https://github.com/apache/incubator-doris/pull/4035 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman commented on a change in pull request #4039: Add delayed deletion of rowsets function, fix -230 error.

2020-07-07 Thread GitBox
morningman commented on a change in pull request #4039: URL: https://github.com/apache/incubator-doris/pull/4039#discussion_r450879095 ## File path: be/src/olap/rowset_graph.h ## @@ -23,16 +23,32 @@ #include "olap/rowset/rowset_meta.h" namespace doris { - +/// RowsetGraph c

[GitHub] [incubator-doris] morningman commented on issue #3930: [Proposal] Doris support version column for REPLACE aggregate type

2020-07-07 Thread GitBox
morningman commented on issue #3930: URL: https://github.com/apache/incubator-doris/issues/3930#issuecomment-654919279 If user create `sequence_visible` column in table, does it still has a hidden sequence column? In my point, it should has. ---

[GitHub] [incubator-doris] wutiangan opened a new pull request #4048: [BUG] fix big inline_view table join small mysql table choose shuffle join bug

2020-07-07 Thread GitBox
wutiangan opened a new pull request #4048: URL: https://github.com/apache/incubator-doris/pull/4048 fix #4047 #3886 has certain relevance to this case。 the sql : bigtable t1 join mysqltable t2 join mysqltable t3 on t1.k1 = t3.k1 1、after reorder: t1, t2, t3 2、cho

[GitHub] [incubator-doris] wutiangan opened a new issue #4047: inlineView join small mysql table use shufflejoin, wait too lang to return

2020-07-07 Thread GitBox
wutiangan opened a new issue #4047: URL: https://github.com/apache/incubator-doris/issues/4047 **Describe the bug** a big olap table join two small mysql table, I want to the join method use broadcast join, but the doris choose shuffer join,. **To Reproduce** select * from

[GitHub] [incubator-doris] caiconghui edited a comment on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui edited a comment on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654852287 Here, we start the thread in MasterTaskExecutor https://github.com/apache/incubator-doris/blob/1fc82cd6e48ef5fed4d29b7e5cb4df63c3130027/fe/src/main/java/org/

[GitHub] [incubator-doris] caiconghui edited a comment on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui edited a comment on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654852287 Here, we start the thread in MasterTaskExecutor public MasterTaskExecutor(int threadNum) { executor = ThreadPoolManager.newScheduledThreadPool(

[GitHub] [incubator-doris] Youngwb commented on issue #3930: [Proposal] Doris support version column for REPLACE aggregate type

2020-07-07 Thread GitBox
Youngwb commented on issue #3930: URL: https://github.com/apache/incubator-doris/issues/3930#issuecomment-654853902 According to @morningman @yangzhg 's suggest, I made some corrections ## name use `sequence` column instead of `version` column for user understand easy. ## Crea

[GitHub] [incubator-doris] caiconghui edited a comment on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui edited a comment on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654852287 https://github.com/apache/incubator-doris/blob/master/fe/src/main/java/org/apache/doris/task/MasterTaskExecutor.java#L39~#L43

[GitHub] [incubator-doris] caiconghui edited a comment on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui edited a comment on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654852287 https://github.com/apache/incubator-doris/blob/master/fe/src/main/java/org/apache/doris/task/MasterTaskExecutor.java#L39 -

[GitHub] [incubator-doris] caiconghui commented on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui commented on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654852287 https://github.com/apache/incubator-doris/blob/master/fe/src/main/java/org/apache/doris/task/MasterTaskExecutor.java#L39-#L43 ---

[GitHub] [incubator-doris] caiconghui commented on issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui commented on issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046#issuecomment-654849459 I get the thread snapshot of fe process, and find there are many schduler thread. grep "ScheduledThreadPoolExecutor.java:899" temp | wc -l 3826 --

[GitHub] [incubator-doris] caiconghui opened a new issue #4046: [ThreadPool Resource Leak]There are more and more scheduler thread in our production environment

2020-07-07 Thread GitBox
caiconghui opened a new issue #4046: URL: https://github.com/apache/incubator-doris/issues/4046 ![image](https://user-images.githubusercontent.com/55968745/86786379-82c81700-c096-11ea-826e-b1a0e0d0ffd6.png) This is an au

[GitHub] [incubator-doris] wangbo commented on issue #4027: DeltaWriter's FlushStatistic needs a metric

2020-07-07 Thread GitBox
wangbo commented on issue #4027: URL: https://github.com/apache/incubator-doris/issues/4027#issuecomment-654838945 Thanks for the answer This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [incubator-doris] wangbo opened a new pull request #4045: Fix mem_pool npe

2020-07-07 Thread GitBox
wangbo opened a new pull request #4045: URL: https://github.com/apache/incubator-doris/pull/4045 (#4030) Fix mem_pool npe in column reader This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [incubator-doris] chaoyli commented on issue #4044: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli commented on issue #4044: URL: https://github.com/apache/incubator-doris/issues/4044#issuecomment-654824077 ![image](https://user-images.githubusercontent.com/44767902/86781836-f9faac80-c090-11ea-98ae-e79086e6c2a6.png) -

[GitHub] [incubator-doris] chaoyli commented on issue #4044: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli commented on issue #4044: URL: https://github.com/apache/incubator-doris/issues/4044#issuecomment-654823774 ``` 2020-06-23 1 2020-06-25 1 2020-06-24 0 ``` This is an automated message from the Apach

[GitHub] [incubator-doris] chaoyli opened a new issue #4044: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli opened a new issue #4044: URL: https://github.com/apache/incubator-doris/issues/4044 ``` CREATE TABLE aggregate_table_with_null ( k1 date NULL COMMENT "", k2 datetime NULL COMMENT "", k3 char(20) NULL COMMENT "", k4 varchar(20) NULL COMMENT "", k5 boolean NULL COMME

[GitHub] [incubator-doris] chaoyli commented on issue #4043: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli commented on issue #4043: URL: https://github.com/apache/incubator-doris/issues/4043#issuecomment-654821207 ![image](https://user-images.githubusercontent.com/44767902/86781316-4c879900-c090-11ea-9ba8-367e848506d2.png) -

[GitHub] [incubator-doris] chaoyli commented on issue #4043: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli commented on issue #4043: URL: https://github.com/apache/incubator-doris/issues/4043#issuecomment-654820839 ``` 2020-06-23 2020-06-23 00:00:00 beijing haidian 1 -128 -32768 -2147483648 -9223372036854775808-18446744073709551616 -3.1 -3.14 -3.141

[GitHub] [incubator-doris] chaoyli opened a new issue #4043: Core upon modifing char to varchar

2020-07-07 Thread GitBox
chaoyli opened a new issue #4043: URL: https://github.com/apache/incubator-doris/issues/4043 ``` CREATE TABLE duplicate_table_with_null (k1 date,k2 datetime,k3 char(20),k4 varchar(20),k5 boolean,k6 tinyint,k7 smallint,k8 int,k9 bigint,k10 largeint,k11 float,k12 double,k13 decim

[GitHub] [incubator-doris] chaoyli opened a new pull request #4042: [Bug] Fix core when modifing char to varchar and loading boolean with replace aggregation

2020-07-07 Thread GitBox
chaoyli opened a new pull request #4042: URL: https://github.com/apache/incubator-doris/pull/4042 1. Doris support modify char to varchar. There is a bug when use two-level pointer when converting the date. 2. Boolean can be used as metric value with REPLACE and REPLACE_IF_NOT_NULL aggr

[incubator-doris] branch master updated: [Bug] Return actual json for ConnectionAction (#4016)

2020-07-07 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new c9a7c37 [Bug] Return actual json f

[GitHub] [incubator-doris] chaoyli merged pull request #4016: [Bug] Return actual json for ConnectionAction

2020-07-07 Thread GitBox
chaoyli merged pull request #4016: URL: https://github.com/apache/incubator-doris/pull/4016 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-doris] yangzhg opened a new pull request #4041: Fix predicate pushdown amy incorrect when groupby with grouping sets

2020-07-07 Thread GitBox
yangzhg opened a new pull request #4041: URL: https://github.com/apache/incubator-doris/pull/4041 Fixes #4040 Fix predicate pushdown amy incorrect when groupby with grouping sets This is an automated message from the Apac

[GitHub] [incubator-doris] yangzhg opened a new issue #4040: Predicate pushdown amy incorrect when groupby with grouping sets

2020-07-07 Thread GitBox
yangzhg opened a new issue #4040: URL: https://github.com/apache/incubator-doris/issues/4040 with sql like ``` SELECT IF(col2 IS NULL, 'ALL', col2) AS col2, IF(col3 IS NULL, 'ALL', col3) AS col3, pv FROM ( SELECT col1, col2,

[GitHub] [incubator-doris] xy720 commented on a change in pull request #4039: Add delayed deletion of rowsets function, fix -230 error.

2020-07-07 Thread GitBox
xy720 commented on a change in pull request #4039: URL: https://github.com/apache/incubator-doris/pull/4039#discussion_r450727522 ## File path: be/src/olap/rowset_graph.h ## @@ -47,6 +50,86 @@ class RowsetGraph { std::unordered_map _vertex_index_map; }; -} // namespace

[GitHub] [incubator-doris] vagetablechicken commented on issue #4027: DeltaWriter's FlushStatistic needs a metric

2020-07-07 Thread GitBox
vagetablechicken commented on issue #4027: URL: https://github.com/apache/incubator-doris/issues/4027#issuecomment-654714129 > I see. > I am curious about detail of `some reason the flush time or count in one BE is always longer/higher than others`. > Under what circumstances will th

[GitHub] [incubator-doris] wuyunfeng commented on a change in pull request #4039: Add delayed deletion of rowsets function, fix -230 error.

2020-07-07 Thread GitBox
wuyunfeng commented on a change in pull request #4039: URL: https://github.com/apache/incubator-doris/pull/4039#discussion_r450711406 ## File path: be/src/olap/rowset_graph.cpp ## @@ -17,14 +17,247 @@ #include "olap/rowset_graph.h" -#include #include +#include #incl

[GitHub] [incubator-doris] ZhangYu0123 opened a new pull request #4039: Add delayed deletion of rowsets function, fix -230 error.

2020-07-07 Thread GitBox
ZhangYu0123 opened a new pull request #4039: URL: https://github.com/apache/incubator-doris/pull/4039 Related issue #4017, main changes as follows: (1) Add expired_snapshot_rs_version_map,_expired_snapshot_rs_metas,(2) Add VersionedRowsetTracker record compacted path version, (3) Record

[GitHub] [incubator-doris] morningman commented on a change in pull request #4028: [shell] Fix BE unit test directory not match bug

2020-07-07 Thread GitBox
morningman commented on a change in pull request #4028: URL: https://github.com/apache/incubator-doris/pull/4028#discussion_r450694715 ## File path: run-ut.sh ## @@ -105,7 +105,7 @@ echo "Running PaloBe Unittest" echo "**" cd ${DORIS_HOME

[GitHub] [incubator-doris] morningman commented on pull request #4038: [Ut] Fix BE UT dir error

2020-07-07 Thread GitBox
morningman commented on pull request #4038: URL: https://github.com/apache/incubator-doris/pull/4038#issuecomment-654686400 Duplicated with #4028 ,closed This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-doris] morningman closed pull request #4038: [Ut] Fix BE UT dir error

2020-07-07 Thread GitBox
morningman closed pull request #4038: URL: https://github.com/apache/incubator-doris/pull/4038 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman opened a new pull request #4038: [Ut] Fix BE UT dir error

2020-07-07 Thread GitBox
morningman opened a new pull request #4038: URL: https://github.com/apache/incubator-doris/pull/4038 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [incubator-doris] mnloveyx opened a new issue #4037: doris can't get Decimals precision use com.mysql.jdbc.JDBC42 but mysql can get it

2020-07-07 Thread GitBox
mnloveyx opened a new issue #4037: URL: https://github.com/apache/incubator-doris/issues/4037 PreparedStatement preparedStatement = null; try { preparedStatement = connection.prepareStatement( databaseMeta.stripCR( sql ), ResultSet.TYPE_FORWARD_ONLY,

[GitHub] [incubator-doris] acelyc111 opened a new pull request #4036: [metrics] Use atomic instead of SpinLock for interger metric

2020-07-07 Thread GitBox
acelyc111 opened a new pull request #4036: URL: https://github.com/apache/incubator-doris/pull/4036 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-doris] WingsGo commented on pull request #4009: [Bug]Fix some schema change not work right

2020-07-07 Thread GitBox
WingsGo commented on pull request #4009: URL: https://github.com/apache/incubator-doris/pull/4009#issuecomment-654643098 > > > It's better add more discrete message in commit info like you issue. > > > > > > Ok, done, and I tested the schema change supported in doc, but I found t

[GitHub] [incubator-doris] WingsGo commented on pull request #3912: [Code Refactor]Remove some redundant code

2020-07-07 Thread GitBox
WingsGo commented on pull request #3912: URL: https://github.com/apache/incubator-doris/pull/3912#issuecomment-654642718 > Hi @WingsGo , could you please rebase the code to solve the conflict? And I will review it later. Sorry for reply later, done.