[GitHub] [incubator-doris] xy720 opened a new pull request #4528: [Spark Load] [Bug] Load job's state will stay in ETL state all the time after FE restart

2020-09-02 Thread GitBox
xy720 opened a new pull request #4528: URL: https://github.com/apache/incubator-doris/pull/4528 ## Proposed changes fix #4519 How to reproduce: **Restart when the state is ETL** 1. Submit a spark load job 2. Wait until the job state become `ETL` 3. Restart FE 4.

[GitHub] [incubator-doris] ZhangYu0123 opened a new issue #4527: [BUG] Fix segment group add zone map bug when schema change.

2020-09-02 Thread GitBox
ZhangYu0123 opened a new issue #4527: URL: https://github.com/apache/incubator-doris/issues/4527 **Describe the bug** Fix segment group add zone map bug when schema change. (1) WrapperField null point check (2) in DUP_KEYS, let _zone_maps index consistent with _schema column index

[GitHub] [incubator-doris] ZhangYu0123 opened a new pull request #4526: [BUG] Fix segment group add zone map bug when schema change.

2020-09-02 Thread GitBox
ZhangYu0123 opened a new pull request #4526: URL: https://github.com/apache/incubator-doris/pull/4526 ## Proposed changes Fix segment group add zone map bug when schema change. (1) WrapperField null point check (2) in DUP_KEYS, let _zone_maps index consistent with _schema colu

[GitHub] [incubator-doris] ccoffline commented on pull request #4521: add version message to fe heartbeat and system page

2020-09-02 Thread GitBox
ccoffline commented on pull request #4521: URL: https://github.com/apache/incubator-doris/pull/4521#issuecomment-686218300 > @ccoffline Hi, Thanks for your contribution. > > > This commit adds git commit message of fe to the system page, just like be. > > If we only want to sh

[GitHub] [incubator-doris] acelyc111 commented on issue #4522: [Bug] BE crash when restarting

2020-09-02 Thread GitBox
acelyc111 commented on issue #4522: URL: https://github.com/apache/incubator-doris/issues/4522#issuecomment-685774330 IntCounter which use CoreLocalValue as underlayer storage seems not faster than IntAtomicCounter both in single thread and multi-threads, according to unit test's output o

[GitHub] [incubator-doris] kangkaisen commented on pull request #4521: add version message to fe heartbeat and system page

2020-09-02 Thread GitBox
kangkaisen commented on pull request #4521: URL: https://github.com/apache/incubator-doris/pull/4521#issuecomment-685745775 @ccoffline Hi, Thanks for your contribution. > This commit adds git commit message of fe to the system page, just like be. If we only want to show a git

[GitHub] [incubator-doris] wangbo opened a new issue #4525: [Spark Load][Feature]Support complete data types

2020-09-02 Thread GitBox
wangbo opened a new issue #4525: URL: https://github.com/apache/incubator-doris/issues/4525 1 support decimal andl largeint 2 add validate logic for char/varchar/decimal 3 check data load from hive with strict mode 4 support decimal/date/datetime aggregator ---

[GitHub] [incubator-doris] wangbo opened a new pull request #4524: support complete types

2020-09-02 Thread GitBox
wangbo opened a new pull request #4524: URL: https://github.com/apache/incubator-doris/pull/4524 ## Proposed changes For[Spark Load] 1 support decimal andl largeint 2 add validate logic for char/varchar/decimal 3 check data load from hive with strict mode 4 support decimal

[GitHub] [incubator-doris] morningman opened a new pull request #4523: [Bug] Fix bug of core local value

2020-09-02 Thread GitBox
morningman opened a new pull request #4523: URL: https://github.com/apache/incubator-doris/pull/4523 ## Proposed changes When creating core local value from CoreDataAllocator, A lock is needed to protect the modification of _blocks. ## Types of changes - [x] Bugfix (n

[GitHub] [incubator-doris] morningman opened a new issue #4522: [Bug] BE crash when restarting

2020-09-02 Thread GitBox
morningman opened a new issue #4522: URL: https://github.com/apache/incubator-doris/issues/4522 **Describe the bug** ``` *** Aborted at 1599045887 (unix time) try "date -d @1599045887" if you are using GNU date *** PC: @ 0x25ed67b tcmalloc::ThreadCache::ReleaseToCentra

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #4502: [SQL] Support where, limit, order clause in show resourcestmt.

2020-09-02 Thread GitBox
HappenLee commented on a change in pull request #4502: URL: https://github.com/apache/incubator-doris/pull/4502#discussion_r482016787 ## File path: fe/fe-core/src/main/java/org/apache/doris/catalog/ResourceMgr.java ## @@ -17,9 +17,11 @@ package org.apache.doris.catalog; +i

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #4502: [SQL] Support where, limit, order clause in show resourcestmt.

2020-09-02 Thread GitBox
HappenLee commented on a change in pull request #4502: URL: https://github.com/apache/incubator-doris/pull/4502#discussion_r482016076 ## File path: fe/fe-core/src/main/java/org/apache/doris/catalog/ResourceMgr.java ## @@ -109,8 +112,41 @@ public int getResourceNum() {

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #4502: [SQL] Support where, limit, order clause in show resourcestmt.

2020-09-02 Thread GitBox
HappenLee commented on a change in pull request #4502: URL: https://github.com/apache/incubator-doris/pull/4502#discussion_r482015511 ## File path: fe/fe-core/src/main/java/org/apache/doris/catalog/ResourceMgr.java ## @@ -109,8 +112,41 @@ public int getResourceNum() {

[GitHub] [incubator-doris] kangkaisen merged pull request #4330: [Feature][Cache] Sql cache and partition cache #2581

2020-09-02 Thread GitBox
kangkaisen merged pull request #4330: URL: https://github.com/apache/incubator-doris/pull/4330 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (e6367e9 -> c019547)

2020-09-02 Thread kangkaisen
This is an automated email from the ASF dual-hosted git repository. kangkaisen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from e6367e9 [Bug] Support disable colocate join where join clause has join hint (#4497) add c019547

[GitHub] [incubator-doris] ccoffline opened a new pull request #4521: add version message to fe heartbeat and system page

2020-09-02 Thread GitBox
ccoffline opened a new pull request #4521: URL: https://github.com/apache/incubator-doris/pull/4521 ## Proposed changes This commit add git commit message of fe on the system page, just like be. To achieve this, fe heartbeat message has now been carrying git commit message.

[GitHub] [incubator-doris] xy720 opened a new issue #4520: [Spark Load][Bug] The number of columns in broker load and spark load is different

2020-09-02 Thread GitBox
xy720 opened a new issue #4520: URL: https://github.com/apache/incubator-doris/issues/4520 **Describe the bug** There is a 17 column source data: ``` 2007397|3|2374|40342|1899|19950627|1-URGENT|0|38|4872892|8942348|8|4483060|76940|6|19950905|SHIP| 2007398|1|24337|186404|904

[GitHub] [incubator-doris] xy720 opened a new issue #4519: [Spark Load][Bug] Load job's state is incorrect after FE restart

2020-09-02 Thread GitBox
xy720 opened a new issue #4519: URL: https://github.com/apache/incubator-doris/issues/4519 **Describe the bug** Load job's state will become incorrect after FE restart. **To Reproduce** Steps to reproduce the behavior: **[restart when the state is PENDDING]** 1. Submit a s

[GitHub] [incubator-doris] xy720 opened a new issue #4518: [Spark Load][Bug] Cancelling a spark load in the pending phase will not succeed

2020-09-02 Thread GitBox
xy720 opened a new issue #4518: URL: https://github.com/apache/incubator-doris/issues/4518 **Describe the bug** Cancelling a spark load in the pending phase will not succeed. **To Reproduce** Steps to reproduce the behavior: 1. Submit a spark load job 2. The job state is `

[GitHub] [incubator-doris] kangkaisen commented on a change in pull request #4495: [Bug] function str_to_date()'s behavior on BE and FE is inconsistent

2020-09-02 Thread GitBox
kangkaisen commented on a change in pull request #4495: URL: https://github.com/apache/incubator-doris/pull/4495#discussion_r481868930 ## File path: fe/fe-core/src/main/java/org/apache/doris/analysis/DateLiteral.java ## @@ -632,4 +669,435 @@ public long getSecond() { publi

[GitHub] [incubator-doris] caoyang10 opened a new pull request #4514: [Feature] support hour time unit with dynamic parition

2020-09-02 Thread GitBox
caoyang10 opened a new pull request #4514: URL: https://github.com/apache/incubator-doris/pull/4514 Many tables are so large that need seperate partitions with "HOUR" time unit. But now dynamic partition doesn't support "HOUR" time unit and it was marked as "TODO". So I support the feature

[GitHub] [incubator-doris] acelyc111 commented on a change in pull request #4440: [refactor] Optimize threads usage mode in BE

2020-09-02 Thread GitBox
acelyc111 commented on a change in pull request #4440: URL: https://github.com/apache/incubator-doris/pull/4440#discussion_r481799249 ## File path: be/src/olap/olap_server.cpp ## @@ -330,108 +303,92 @@ void* StorageEngine::_cumulative_compaction_thread_callback(void* arg, Data

[GitHub] [incubator-doris] yangzhg opened a new issue #4516: 【Refactor】palo

2020-09-02 Thread GitBox
yangzhg opened a new issue #4516: URL: https://github.com/apache/incubator-doris/issues/4516 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-doris] yangzhg opened a new pull request #4517: optimize third party build script

2020-09-02 Thread GitBox
yangzhg opened a new pull request #4517: URL: https://github.com/apache/incubator-doris/pull/4517 ## Proposed changes here are a lot of lib64 and lib processing logic in the build script of thridparty, but this is still not enough in different linux distributions and needs to be uni

[GitHub] [incubator-doris] xy720 opened a new pull request #4515: [Feature] Support cancel load jobs in batch

2020-09-02 Thread GitBox
xy720 opened a new pull request #4515: URL: https://github.com/apache/incubator-doris/pull/4515 ## Proposed changes #3992 ## Types of changes What types of changes does your code introduce to Doris? _Put an `x` in the boxes that apply_ - [x] New feature (non-b