[GitHub] [incubator-doris] morningman closed issue #3831: [BUG] load data with bool value will convert to all true value;

2020-07-01 Thread GitBox
morningman closed issue #3831: URL: https://github.com/apache/incubator-doris/issues/3831 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] morningman merged pull request #3898: Support import true or false as boolean value

2020-07-01 Thread GitBox
morningman merged pull request #3898: URL: https://github.com/apache/incubator-doris/pull/3898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [Load] Support load true or false as boolean value (#3898)

2020-07-01 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 5ade21b [Load] Support load true o

[incubator-doris] branch master updated: [Performance] Improve performance of unique table read (#3974)

2020-07-01 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new d3d8358 [Performance] Improve perf

[incubator-doris] branch master updated (d3d8358 -> 707d03c)

2020-07-01 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from d3d8358 [Performance] Improve performance of unique table read (#3974) add 707d03c [SQL] Remove

[GitHub] [incubator-doris] morningman merged pull request #3806: Remove order by for subquery in set opertion clause

2020-07-01 Thread GitBox
morningman merged pull request #3806: URL: https://github.com/apache/incubator-doris/pull/3806 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman merged pull request #3974: Improve performance of unique table read

2020-07-01 Thread GitBox
morningman merged pull request #3974: URL: https://github.com/apache/incubator-doris/pull/3974 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman commented on pull request #4004: [Issue-fix-3963]Update doc for how to build fe on windows

2020-07-01 Thread GitBox
morningman commented on pull request #4004: URL: https://github.com/apache/incubator-doris/pull/4004#issuecomment-652799896 Hi @francisoliverlee I already fixed this in #3952 ~ Thanks for your PR~ This is an automated mess

[incubator-doris] branch master updated: [Doc] Add doc for setting dev env of FE in Eclipse (#3952)

2020-07-01 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 6a7583b [Doc] Add doc for setting

[GitHub] [incubator-doris] morningman merged pull request #3952: [Doc] Add doc for setting dev env of FE in Eclipse

2020-07-01 Thread GitBox
morningman merged pull request #3952: URL: https://github.com/apache/incubator-doris/pull/3952 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] yangzhg opened a new pull request #4003: Fix except node child not order correctly

2020-07-01 Thread GitBox
yangzhg opened a new pull request #4003: URL: https://github.com/apache/incubator-doris/pull/4003 Fixes #3995 ## Why does it happen When SetOperations encounters that the previous node needs Aggregate, the timing of add AggregationNode is wrong. You should add AggregationNode first

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #4002: [Bug] Cancel the query if OlapScanner prepare failed

2020-07-01 Thread GitBox
wutiangan commented on a change in pull request #4002: URL: https://github.com/apache/incubator-doris/pull/4002#discussion_r448755605 ## File path: be/src/exec/olap_scan_node.cpp ## @@ -681,7 +681,11 @@ Status OlapScanNode::start_scan_thread(RuntimeState* state) {

[GitHub] [incubator-doris] morningman opened a new pull request #4002: [Bug] Cancel the query is OlapScanner prepare failed

2020-07-01 Thread GitBox
morningman opened a new pull request #4002: URL: https://github.com/apache/incubator-doris/pull/4002 Fix #4001 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [incubator-doris] morningman opened a new issue #4001: [Bug] BE crash in OlapScanner

2020-07-01 Thread GitBox
morningman opened a new issue #4001: URL: https://github.com/apache/incubator-doris/issues/4001 **Describe the bug** ``` #0 data_dir (this=0x0) at /doris/core/be/src/olap/base_tablet.h:82 #1 scan_disk (this=0x260ba240) at /doris/core/be/src/exec/olap_scanner.h:86 #2 doris::Ola

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #3991: Fix the problem of mem exec, when analytic eval node need to spill to disk with a low mem limit

2020-07-01 Thread GitBox
HappenLee commented on a change in pull request #3991: URL: https://github.com/apache/incubator-doris/pull/3991#discussion_r448740284 ## File path: be/src/exec/analytic_eval_node.cpp ## @@ -710,7 +709,13 @@ Status AnalyticEvalNode::process_child_batch(RuntimeState* state) {

[GitHub] [incubator-doris] vagetablechicken opened a new pull request #3999: Fix some code & comments

2020-07-01 Thread GitBox
vagetablechicken opened a new pull request #3999: URL: https://github.com/apache/incubator-doris/pull/3999 TPlanExecParams::volume_id is never used, so delete the `print_volume_ids()` function. Fix log, and log if PlanFragmentExecutor::open() returns error. Fix some comments ---

[incubator-doris] branch master updated (2362500 -> 9785e10)

2020-07-01 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 2362500 [Doris On ES] Support create table with wildcard or aliase index (#3968) add 9785e10 [Bu

[GitHub] [incubator-doris] chaoyli merged pull request #3943: [Bug] Fix bug that delete stmt with filter condition delete all data from table on segment v2

2020-07-01 Thread GitBox
chaoyli merged pull request #3943: URL: https://github.com/apache/incubator-doris/pull/3943 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-doris] chaoyli closed issue #3942: [Bug] Delete stmt with filter condition delete all data from table on segment v2

2020-07-01 Thread GitBox
chaoyli closed issue #3942: URL: https://github.com/apache/incubator-doris/issues/3942 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-doris] wangbo commented on issue #3998: [Spark Load] Some Todo For Spark Before It can be used in Prod Env

2020-07-01 Thread GitBox
wangbo commented on issue #3998: URL: https://github.com/apache/incubator-doris/issues/3998#issuecomment-652752320 > > * Support Job resume > > What is "job resume"? For example,If load job fails because of be downs,then we can resume the load job to load data to be when be r

[GitHub] [incubator-doris] francisoliverlee commented on issue #3963: [DOC-ERROR, Images can't be seen, cause of 404 in the urls]

2020-07-01 Thread GitBox
francisoliverlee commented on issue #3963: URL: https://github.com/apache/incubator-doris/issues/3963#issuecomment-652738999 @yangzhg ok, i will give it a try This is an automated message from the Apache Git Service. To resp

[GitHub] [incubator-doris] yangzhg commented on pull request #3993: Keep order of read from segment consist with the write order

2020-07-01 Thread GitBox
yangzhg commented on pull request #3993: URL: https://github.com/apache/incubator-doris/pull/3993#issuecomment-652730744 @chaoyli this problem is really exists for a long time. the issue #3930 describe the load cannot keep order and this pr fix read cannot keep order

[GitHub] [incubator-doris] phenixmzy commented on issue #3853: Kafka-Topic长时间没有新消息到达,Routine Load任务会被卡住,没有重新被调度

2020-07-01 Thread GitBox
phenixmzy commented on issue #3853: URL: https://github.com/apache/incubator-doris/issues/3853#issuecomment-652729975 thanks @EmmyMiao87 总结一下,这个问题主要是没有配置好,正确的操作应该是 FROM KAFKA ( "kafka_broker_list" = "$kafka_host:9092", "kafka_topic" = "kafka-topic-name", "kafka_partiti

[GitHub] [incubator-doris] morningman commented on issue #3998: [Spark Load] Some Todo For Spark Before It can be used in Prod Env

2020-07-01 Thread GitBox
morningman commented on issue #3998: URL: https://github.com/apache/incubator-doris/issues/3998#issuecomment-652451652 > * Support Job resume What is "job resume"? This is an automated message from the Apache Git Serv

[GitHub] [incubator-doris] morningman commented on a change in pull request #3981: [Feature] Batch update partition's property in one command

2020-07-01 Thread GitBox
morningman commented on a change in pull request #3981: URL: https://github.com/apache/incubator-doris/pull/3981#discussion_r448391781 ## File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java ## @@ -3334,6 +3334,45 @@ public void replayRecoverPartition(RecoverInfo i

[GitHub] [incubator-doris] morningman merged pull request #3968: [Doris On ES][Feature] Support create table with wildcard or aliase index

2020-07-01 Thread GitBox
morningman merged pull request #3968: URL: https://github.com/apache/incubator-doris/pull/3968 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman commented on a change in pull request #3981: [Feature] Batch update partition's property in one command

2020-07-01 Thread GitBox
morningman commented on a change in pull request #3981: URL: https://github.com/apache/incubator-doris/pull/3981#discussion_r447611747 ## File path: docs/zh-CN/sql-reference/sql-statements/Data Definition/ALTER TABLE.md ## @@ -64,7 +64,7 @@ under the License.

[incubator-doris] branch master updated: [Doris On ES] Support create table with wildcard or aliase index (#3968)

2020-07-01 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 2362500 [Doris On ES] Support crea

[GitHub] [incubator-doris] chaoyli commented on pull request #3993: Keep order of read from segment consist with the write order

2020-07-01 Thread GitBox
chaoyli commented on pull request #3993: URL: https://github.com/apache/incubator-doris/pull/3993#issuecomment-652414934 Do you can reproduce the problem using UNIQUE KEY? Because I have a little double why this bug exists for so long time. --

[GitHub] [incubator-doris] wangbo opened a new issue #3998: [Spark Load] Some Todo For Spark Before It can be used in Prod Env

2020-07-01 Thread GitBox
wangbo opened a new issue #3998: URL: https://github.com/apache/incubator-doris/issues/3998 **Goal** * Major goal is ```stable and can be used in some user cases``` and then ```use Spark Load in Prod Env``` as quick as possible. * More comprehensive optimization can be slowly improve

[GitHub] [incubator-doris] WingsGo opened a new pull request #3997: Use ThreadPoolManager to manage some native thread

2020-07-01 Thread GitBox
WingsGo opened a new pull request #3997: URL: https://github.com/apache/incubator-doris/pull/3997 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [incubator-doris] blackfox1983 commented on a change in pull request #3994: SQL result cache and partition cache

2020-07-01 Thread GitBox
blackfox1983 commented on a change in pull request #3994: URL: https://github.com/apache/incubator-doris/pull/3994#discussion_r448285149 ## File path: be/src/runtime/cache/result_cache.h ## @@ -0,0 +1,117 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3994: SQL result cache and partition cache

2020-07-01 Thread GitBox
wutiangan commented on a change in pull request #3994: URL: https://github.com/apache/incubator-doris/pull/3994#discussion_r448295650 ## File path: docs/zh-CN/administrator-guide/partition_cache.md ## @@ -0,0 +1,205 @@ +# 分区缓存 + +## 需求场景 +大部分数据分析场景是写少读多,数据写入一次,多次频繁读取,比如一张报表涉及的维

[GitHub] [incubator-doris] morningman commented on a change in pull request #3996: Add log for loading image

2020-07-01 Thread GitBox
morningman commented on a change in pull request #3996: URL: https://github.com/apache/incubator-doris/pull/3996#discussion_r448294489 ## File path: fe/src/main/java/org/apache/doris/catalog/Catalog.java ## @@ -1833,8 +1841,10 @@ public long loadTransactionState(DataInputStream

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3993: Keep order of read from segment consist with the write order

2020-07-01 Thread GitBox
wutiangan commented on a change in pull request #3993: URL: https://github.com/apache/incubator-doris/pull/3993#discussion_r448288786 ## File path: be/src/olap/generic_iterators.cpp ## @@ -227,8 +229,13 @@ class MergeIterator : public RowwiseIterator { bool operator()(

[GitHub] [incubator-doris] blackfox1983 commented on a change in pull request #3994: SQL result cache and partition cache

2020-07-01 Thread GitBox
blackfox1983 commented on a change in pull request #3994: URL: https://github.com/apache/incubator-doris/pull/3994#discussion_r448279546 ## File path: be/src/common/config.h ## @@ -536,6 +536,15 @@ namespace config { // Whether to continue to start be when load tablet from

[GitHub] [incubator-doris] xy720 opened a new pull request #3996: Add log for loading image

2020-07-01 Thread GitBox
xy720 opened a new pull request #3996: URL: https://github.com/apache/incubator-doris/pull/3996 When fe load image failed, more logs should be printed to help users analyze errors. This is an automated message from the Apach

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3991: Fix the problem of mem exec, when analytic eval node need to spill to disk with a low mem limit

2020-07-01 Thread GitBox
wutiangan commented on a change in pull request #3991: URL: https://github.com/apache/incubator-doris/pull/3991#discussion_r448240802 ## File path: be/src/exec/analytic_eval_node.cpp ## @@ -710,7 +709,13 @@ Status AnalyticEvalNode::process_child_batch(RuntimeState* state) {

[GitHub] [incubator-doris] wutiangan commented on a change in pull request #3991: Fix the problem of mem exec, when analytic eval node need to spill to disk with a low mem limit

2020-07-01 Thread GitBox
wutiangan commented on a change in pull request #3991: URL: https://github.com/apache/incubator-doris/pull/3991#discussion_r448239716 ## File path: be/src/runtime/spill_sorter.cc ## @@ -1109,6 +1110,7 @@ Status SpillSorter::add_batch(RowBatch* batch) { // The curre

[GitHub] [incubator-doris] morningman commented on issue #3930: [Proposal] Doris support version column for REPLACE aggregate type

2020-07-01 Thread GitBox
morningman commented on issue #3930: URL: https://github.com/apache/incubator-doris/issues/3930#issuecomment-652301359 > I suggest that the columns used for keeping order should not exist in the create table statement, but as a hidden column. When creating a unique table, add a property s

[GitHub] [incubator-doris] yangzhg commented on issue #3963: [DOC-ERROR, Images can't be seen, cause of 404 in the urls]

2020-07-01 Thread GitBox
yangzhg commented on issue #3963: URL: https://github.com/apache/incubator-doris/issues/3963#issuecomment-652295604 @francisoliverlee You are welcome to contribute. In step 4, if you import the root directory of doris into idea instead of fe directory, you don't need to copy the files und

[GitHub] [incubator-doris] yangzhg commented on issue #3930: [Proposal] Doris support version column for REPLACE aggregate type

2020-07-01 Thread GitBox
yangzhg commented on issue #3930: URL: https://github.com/apache/incubator-doris/issues/3930#issuecomment-652268901 I suggest that the columns used for keeping order should not exist in the create table statement, but as a hidden column. When creating a unique table, add a property such a

[GitHub] [incubator-doris] kangkaisen opened a new issue #3995: UNION and EXCEPT result is wrong

2020-07-01 Thread GitBox
kangkaisen opened a new issue #3995: URL: https://github.com/apache/incubator-doris/issues/3995 ``` SELECT 449 UNION SELECT 670 EXCEPT SELECT 449; ``` Current doris result is empty. correct result should be 670. -

[GitHub] [incubator-doris] marising opened a new pull request #3994: SQL result cache and partition cache

2020-07-01 Thread GitBox
marising opened a new pull request #3994: URL: https://github.com/apache/incubator-doris/pull/3994 #2581 ## Solutions This cache give priority to ensuring data consistency. On this basis, it refines the cache granularity and improves the hit rate. Therefore, it has the follow

[GitHub] [incubator-doris] yangzhg opened a new pull request #3993: Keep order of read from segment consist with the write order

2020-07-01 Thread GitBox
yangzhg opened a new pull request #3993: URL: https://github.com/apache/incubator-doris/pull/3993 Fixes #3989 Add segemt id to the comparator This is an automated message from the Apache Git Service. To respond to the mes

[GitHub] [incubator-doris] xy720 edited a comment on issue #3433: [Spark load] Doris support Spark load

2020-07-01 Thread GitBox
xy720 edited a comment on issue #3433: URL: https://github.com/apache/incubator-doris/issues/3433#issuecomment-636846173 **Be handle push task** #3742 [Spark load][Be 1/1] Be handle push task **Optimize** #3878 [Spark load][broker load]Optimize reading parquet format file ---