[GitHub] [incubator-doris] wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r394137565 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.java #

[GitHub] [incubator-doris] wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r394137293 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.java #

[GitHub] [incubator-doris] wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r394137099 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.java #

[GitHub] [incubator-doris] wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r394137099 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.java #

[GitHub] [incubator-doris] wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
wangbo commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r394136655 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.java #

[GitHub] [incubator-doris] gengjun-git commented on issue #3085: use datagrip connect fe error

2020-03-17 Thread GitBox
gengjun-git commented on issue #3085: use datagrip connect fe error URL: https://github.com/apache/incubator-doris/issues/3085#issuecomment-600412042 @stalary This error occurs when datagrip attempts to sync schemas from Doris. Connection can be established however. You can close the sync

[GitHub] [incubator-doris] yangzhg commented on a change in pull request #3135: support subquery in case when statement

2020-03-17 Thread GitBox
yangzhg commented on a change in pull request #3135: support subquery in case when statement URL: https://github.com/apache/incubator-doris/pull/3135#discussion_r394086481 ## File path: fe/src/main/java/org/apache/doris/analysis/SelectStmt.java ## @@ -1244,6 +1213,46 @@ pu

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions

2020-03-17 Thread GitBox
kangkaisen commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions URL: https://github.com/apache/incubator-doris/pull/3120#discussion_r394076919 ## File path: fe/src/main/java/org/apache/doris/analysis/AdminRepairTableStmt.java #

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions

2020-03-17 Thread GitBox
kangkaisen commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions URL: https://github.com/apache/incubator-doris/pull/3120#discussion_r394075856 ## File path: fe/src/main/java/org/apache/doris/planner/OlapTableSink.java ## @

[GitHub] [incubator-doris] morningman closed issue #3112: [Bug] mapping columns are not exist in the table schema

2020-03-17 Thread GitBox
morningman closed issue #3112: [Bug] mapping columns are not exist in the table schema URL: https://github.com/apache/incubator-doris/issues/3112 This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [incubator-doris] morningman closed pull request #3130: [Alter]Clear expire alterJobV2

2020-03-17 Thread GitBox
morningman closed pull request #3130: [Alter]Clear expire alterJobV2 URL: https://github.com/apache/incubator-doris/pull/3130 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [incubator-doris] WingsGo opened a new pull request #3130: [Alter]Clear expire alterJobV2

2020-03-17 Thread GitBox
WingsGo opened a new pull request #3130: [Alter]Clear expire alterJobV2 URL: https://github.com/apache/incubator-doris/pull/3130 Too much AlterJobsV2 may consume too much memory, which may cause FullGC. Clear some data for finished or cancelled alterJobs and remove them when expire. --

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393748190 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.jav

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393741326 ## File path: fe/src/main/java/org/apache/doris/analysis/LoadStmt.java ##

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393751867 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.jav

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393739178 ## File path: fe/src/main/java/org/apache/doris/analysis/DataProcessorDesc.java ##

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393746860 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkEtlJobHandler.jav

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393754887 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/SparkLoadPendingTask.j

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393746345 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/LoadManager.java #

[GitHub] [incubator-doris] morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3055: [Spark load] FE creates spark load job and submits spark etl job URL: https://github.com/apache/incubator-doris/pull/3055#discussion_r393757291 ## File path: fe/src/main/java/org/apache/doris/load/loadv2/etl/EtlJobConfig.java

[GitHub] [incubator-doris] morningman edited a comment on issue #3063: (#3061) [Spark Load] Doris Support Using Hive Table to Build Global Dict

2020-03-17 Thread GitBox
morningman edited a comment on issue #3063: (#3061) [Spark Load] Doris Support Using Hive Table to Build Global Dict URL: https://github.com/apache/incubator-doris/pull/3063#issuecomment-599387357 Draw a flow, just for review. ``` +--

[GitHub] [incubator-doris] morningman commented on a change in pull request #3135: support subquery in case when statement

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3135: support subquery in case when statement URL: https://github.com/apache/incubator-doris/pull/3135#discussion_r393726480 ## File path: fe/src/main/java/org/apache/doris/analysis/SelectStmt.java ## @@ -102,6 +103,8 @@

[GitHub] [incubator-doris] morningman commented on a change in pull request #3135: support subquery in case when statement

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3135: support subquery in case when statement URL: https://github.com/apache/incubator-doris/pull/3135#discussion_r393727675 ## File path: fe/src/main/java/org/apache/doris/analysis/SelectStmt.java ## @@ -1244,6 +1213,46 @@

[GitHub] [incubator-doris] morningman commented on a change in pull request #3135: support subquery in case when statement

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3135: support subquery in case when statement URL: https://github.com/apache/incubator-doris/pull/3135#discussion_r393729725 ## File path: fe/src/main/java/org/apache/doris/analysis/SelectStmt.java ## @@ -1244,6 +1213,46 @@

[GitHub] [incubator-doris] morningman commented on a change in pull request #3135: support subquery in case when statement

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3135: support subquery in case when statement URL: https://github.com/apache/incubator-doris/pull/3135#discussion_r393733325 ## File path: fe/src/main/java/org/apache/doris/analysis/SelectStmt.java ## @@ -1244,6 +1213,46 @@

[GitHub] [incubator-doris] morningman commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions URL: https://github.com/apache/incubator-doris/pull/3120#discussion_r393723200 ## File path: fe/src/main/java/org/apache/doris/analysis/AdminRepairTableStmt.java #

[GitHub] [incubator-doris] morningman commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3120: [Temp Partition] Support loading data into temp partitions URL: https://github.com/apache/incubator-doris/pull/3120#discussion_r393721894 ## File path: fe/src/main/java/org/apache/doris/planner/OlapTableSink.java ## @

[GitHub] [incubator-doris] morningman commented on a change in pull request #3130: [Alter]Clear expire alterJobV2

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3130: [Alter]Clear expire alterJobV2 URL: https://github.com/apache/incubator-doris/pull/3130#discussion_r393714324 ## File path: fe/src/main/java/org/apache/doris/alter/AlterHandler.java ## @@ -119,6 +121,30 @@ public Alte

[GitHub] [incubator-doris] morningman commented on a change in pull request #3130: [Alter]Clear expire alterJobV2

2020-03-17 Thread GitBox
morningman commented on a change in pull request #3130: [Alter]Clear expire alterJobV2 URL: https://github.com/apache/incubator-doris/pull/3130#discussion_r393714159 ## File path: fe/src/main/java/org/apache/doris/alter/AlterHandler.java ## @@ -119,6 +121,30 @@ public Alte

[GitHub] [incubator-doris] morningman commented on issue #3125: Delete, update and simplify some FE code

2020-03-17 Thread GitBox
morningman commented on issue #3125: Delete, update and simplify some FE code URL: https://github.com/apache/incubator-doris/pull/3125#issuecomment-600094315 ![image](https://user-images.githubusercontent.com/2899462/76864707-8264-689c-11ea-9895-ba0fcedbd50c.png) Build failed, has un

[GitHub] [incubator-doris] yangzhg opened a new pull request #3135: support subquery in case when statement

2020-03-17 Thread GitBox
yangzhg opened a new pull request #3135: support subquery in case when statement URL: https://github.com/apache/incubator-doris/pull/3135 implement subquery support for sub query in case when statement like ``` SELECT CASE WHEN ( SELECT COUNT(*) / 2

[incubator-doris] branch master updated (d01b58b -> 08e4035)

2020-03-17 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from d01b58b Support 64 bit timestamp in from_unixtime (#3069) add 08e4035 1 (#3134) No new revisions

[GitHub] [incubator-doris] chaoyli merged pull request #3134: [RemoveLog] remove some unnecessary log in BE

2020-03-17 Thread GitBox
chaoyli merged pull request #3134: [RemoveLog] remove some unnecessary log in BE URL: https://github.com/apache/incubator-doris/pull/3134 This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [incubator-doris] morningman opened a new pull request #3134: [RemoveLog] remove some unnecessary log in BE

2020-03-17 Thread GitBox
morningman opened a new pull request #3134: [RemoveLog] remove some unnecessary log in BE URL: https://github.com/apache/incubator-doris/pull/3134 There are too many open and close rowset logs Change them to VLOG level. Th

[GitHub] [incubator-doris] imay merged pull request #3069: Support 64 bit timestamp in from_unixtime

2020-03-17 Thread GitBox
imay merged pull request #3069: Support 64 bit timestamp in from_unixtime URL: https://github.com/apache/incubator-doris/pull/3069 This is an automated message from the Apache Git Service. To respond to the message, please lo

[incubator-doris] branch master updated (33319d6 -> d01b58b)

2020-03-17 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 33319d6 [Thrift] Fix a bug when ThriftClientImpl close() error (#3128) add d01b58b Support 64 bit time

[GitHub] [incubator-doris] gengjun-git opened a new issue #3133: Support collate in where clause

2020-03-17 Thread GitBox
gengjun-git opened a new issue #3133: Support collate in where clause URL: https://github.com/apache/incubator-doris/issues/3133 support syntax like: select * from user where **name collate utf8_general_ci = 'xiaoming'** Thi

[GitHub] [incubator-doris] acelyc111 closed issue #3126: BE crash in Thrift frame when send RPC to a busy FE

2020-03-17 Thread GitBox
acelyc111 closed issue #3126: BE crash in Thrift frame when send RPC to a busy FE URL: https://github.com/apache/incubator-doris/issues/3126 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [incubator-doris] WingsGo commented on issue #3132: [Alter]AlterJobs in big table will use to much memory, which may cause FullGC

2020-03-17 Thread GitBox
WingsGo commented on issue #3132: [Alter]AlterJobs in big table will use to much memory, which may cause FullGC URL: https://github.com/apache/incubator-doris/issues/3132#issuecomment-599936824 ![Snip20200317_46](https://user-images.githubusercontent.com/22497357/76835830-c2aa8a80-686a-11

[GitHub] [incubator-doris] WingsGo commented on issue #3130: [Alter]Clear expire alterJobV2

2020-03-17 Thread GitBox
WingsGo commented on issue #3130: [Alter]Clear expire alterJobV2 URL: https://github.com/apache/incubator-doris/pull/3130#issuecomment-599933136 For #3132 This is an automated message from the Apache Git Service. To respond t

[GitHub] [incubator-doris] ighack opened a new issue #3131: Unknown host repository.cloudera.com: Name or service not known

2020-03-17 Thread GitBox
ighack opened a new issue #3131: Unknown host repository.cloudera.com: Name or service not known URL: https://github.com/apache/incubator-doris/issues/3131 [INFO] [INFO] BUILD FAILURE [INFO] --

[GitHub] [incubator-doris] WingsGo opened a new issue #3132: [Alter]AlterJobs in big table will use to much memory, which may cause FullGC

2020-03-17 Thread GitBox
WingsGo opened a new issue #3132: [Alter]AlterJobs in big table will use to much memory, which may cause FullGC URL: https://github.com/apache/incubator-doris/issues/3132 The old alterJob has clear logic to avoid consume too much memory, but I found that alterJobV2 don't, In our scenario,

[GitHub] [incubator-doris] WingsGo opened a new pull request #3130: [Alter]Clear expire alterJobV2

2020-03-17 Thread GitBox
WingsGo opened a new pull request #3130: [Alter]Clear expire alterJobV2 URL: https://github.com/apache/incubator-doris/pull/3130 Too much AlterJobsV2 may consume too much memory, which may cause FullGC. Clear some data for finished or cancelled alterJobs and remove them when expire. --

[incubator-doris] branch master updated (0959abc -> 33319d6)

2020-03-17 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 0959abc [ExceptNode] Implement except node (#3056) add 33319d6 [Thrift] Fix a bug when ThriftClientImp

[GitHub] [incubator-doris] imay merged pull request #3128: [Thrift] Fix a bug when ThriftClientImpl close() error

2020-03-17 Thread GitBox
imay merged pull request #3128: [Thrift] Fix a bug when ThriftClientImpl close() error URL: https://github.com/apache/incubator-doris/pull/3128 This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [incubator-doris] ighack closed issue #3129: BUILD FAILURE

2020-03-17 Thread GitBox
ighack closed issue #3129: BUILD FAILURE URL: https://github.com/apache/incubator-doris/issues/3129 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [incubator-doris] ighack commented on issue #3129: BUILD FAILURE

2020-03-17 Thread GitBox
ighack commented on issue #3129: BUILD FAILURE URL: https://github.com/apache/incubator-doris/issues/3129#issuecomment-599919214 vi fe/pom.xml change http://repo.spring.io/plugins-release/ to https://repo.spring.io/plugins-release/. http -> https

[GitHub] [incubator-doris] ighack edited a comment on issue #3129: BUILD FAILURE

2020-03-17 Thread GitBox
ighack edited a comment on issue #3129: BUILD FAILURE URL: https://github.com/apache/incubator-doris/issues/3129#issuecomment-599912913 wget http://repo.spring.io/plugins-release/net/sourceforge/czt/dev/cup-maven-plugin/1.6-cdh/cup-maven-plugin-1.6-cdh.pom--2020-03-17 07:11:10-- http://

[GitHub] [incubator-doris] ighack commented on issue #3129: BUILD FAILURE

2020-03-17 Thread GitBox
ighack commented on issue #3129: BUILD FAILURE URL: https://github.com/apache/incubator-doris/issues/3129#issuecomment-599912913 wget http://repo.spring.io/plugins-release/net/sourceforge/czt/dev/cup-maven-plugin/1.6-cdh/cup-maven-plugin-1.6-cd h.pom--2020-03-17 07:11:10-- http://repo

[GitHub] [incubator-doris] ighack opened a new issue #3129: BUILD FAILURE

2020-03-17 Thread GitBox
ighack opened a new issue #3129: BUILD FAILURE URL: https://github.com/apache/incubator-doris/issues/3129 Build Frontend [INFO] Scanning for projects... [INFO] [INFO] < org.apache:doris-fe >- [INFO] Building doris-fe 3.4.0 [INF