[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #3760: Support external users to contribute udf

2020-06-03 Thread GitBox
EmmyMiao87 commented on a change in pull request #3760: URL: https://github.com/apache/incubator-doris/pull/3760#discussion_r435017276 ## File path: custom_udf/build_custom_udf.sh ## @@ -0,0 +1,156 @@ +#!/usr/bin/env bash +# Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [incubator-doris] chaoyli commented on pull request #3766: [Bug] Clear Txn when load been cancelled

2020-06-03 Thread GitBox
chaoyli commented on pull request #3766: URL: https://github.com/apache/incubator-doris/pull/3766#issuecomment-638621491 > Please create an issue to describe the bug you met I have already linked issues. This is an aut

[incubator-doris] branch master updated (27046c5 -> 01c1de1)

2020-06-03 Thread kangkaisen
This is an automated email from the ASF dual-hosted git repository. kangkaisen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 27046c5 [Enhancement] Improve the performance of query with IN predicate (#3694) add 01c1de1 [L

[GitHub] [incubator-doris] kangkaisen merged pull request #3703: [Load] Add more metric to trace the time cost in stream load and make brpc_num_threads configurable

2020-06-03 Thread GitBox
kangkaisen merged pull request #3703: URL: https://github.com/apache/incubator-doris/pull/3703 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] yangzhg opened a new pull request #3770: Add some log to make it easier to find out bug

2020-06-03 Thread GitBox
yangzhg opened a new pull request #3770: URL: https://github.com/apache/incubator-doris/pull/3770 Added some logs to record to which be a query was sent. Increasing the efficiency of tracing the problem This is an automate

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #3766: [Bug] Clear Txn when load been cancelled

2020-06-03 Thread GitBox
chaoyli commented on a change in pull request #3766: URL: https://github.com/apache/incubator-doris/pull/3766#discussion_r434985106 ## File path: fe/src/main/java/org/apache/doris/service/FrontendServiceImpl.java ## @@ -808,7 +808,8 @@ private void loadTxnRollbackImpl(TLoadTxnR

[GitHub] [incubator-doris] hxianshun closed issue #2271: Does routine load will make oom?

2020-06-03 Thread GitBox
hxianshun closed issue #2271: URL: https://github.com/apache/incubator-doris/issues/2271 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-doris] morningman merged pull request #3694: [Enhancement] Improve the performance of query with IN predicate

2020-06-03 Thread GitBox
morningman merged pull request #3694: URL: https://github.com/apache/incubator-doris/pull/3694 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (fc33ee3 -> 27046c5)

2020-06-03 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from fc33ee3 [Plugin] Add timeout of connection when downloading the plugins from URL (#3755) add 2704

[GitHub] [incubator-doris] morningman closed issue #3693: [Enhancement] Improve the performance of query with IN predicate

2020-06-03 Thread GitBox
morningman closed issue #3693: URL: https://github.com/apache/incubator-doris/issues/3693 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] hxianshun commented on issue #3740: [Suggestion] Hope to Add Instructions for BE Configurations

2020-06-03 Thread GitBox
hxianshun commented on issue #3740: URL: https://github.com/apache/incubator-doris/issues/3740#issuecomment-638583116 > For BE configs, how about to add a new description parameter for config defination like gflag style, for example: > > ``` > CONF_Int32(be_port, "9060", "por

[GitHub] [incubator-doris] morningman merged pull request #3755: [Plugin] Add timeout of connection when downloading the plugins from URL

2020-06-03 Thread GitBox
morningman merged pull request #3755: URL: https://github.com/apache/incubator-doris/pull/3755 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (791f8fe -> fc33ee3)

2020-06-03 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 791f8fe [Bug][Outfile] Fix bug that column separater is missing in output file. (#3765) add fc33e

[GitHub] [incubator-doris] morningman closed issue #3754: [Plugin] install plugin block when downloading from URL

2020-06-03 Thread GitBox
morningman closed issue #3754: URL: https://github.com/apache/incubator-doris/issues/3754 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] imay commented on a change in pull request #3738: [Bug]fix the crash of checksum task #3735

2020-06-03 Thread GitBox
imay commented on a change in pull request #3738: URL: https://github.com/apache/incubator-doris/pull/3738#discussion_r434973104 ## File path: be/src/olap/row.h ## @@ -186,7 +186,12 @@ void agg_finalize_row(const std::vector& ids, RowType* row, MemPool* m template uint32_t

[GitHub] [incubator-doris] acelyc111 edited a comment on issue #3740: [Suggestion] Hope to Add Instructions for BE Configurations

2020-06-03 Thread GitBox
acelyc111 edited a comment on issue #3740: URL: https://github.com/apache/incubator-doris/issues/3740#issuecomment-638578537 For BE configs, how about to add a new description parameter for config defination like gflag style, for example: ``` CONF_Int32(be_port, "9060", "port on

[GitHub] [incubator-doris] acelyc111 commented on issue #3740: [Suggestion] Hope to Add Instructions for BE Configurations

2020-06-03 Thread GitBox
acelyc111 commented on issue #3740: URL: https://github.com/apache/incubator-doris/issues/3740#issuecomment-638578537 For BE configs, how about to add a new description parameter for config defination like gflag style, for example: ``` CONF_Int32(be_port, "9060", "port on which I

[GitHub] [incubator-doris] morningman commented on a change in pull request #3766: [Bug] Clear Txn when load been cancelled

2020-06-03 Thread GitBox
morningman commented on a change in pull request #3766: URL: https://github.com/apache/incubator-doris/pull/3766#discussion_r434963203 ## File path: fe/src/main/java/org/apache/doris/service/FrontendServiceImpl.java ## @@ -808,7 +808,8 @@ private void loadTxnRollbackImpl(TLoadT

[GitHub] [incubator-doris] caiconghui commented on pull request #3703: [Load] Add more metric to trace the time cost in stream load and make brpc_num_threads configurable

2020-06-03 Thread GitBox
caiconghui commented on pull request #3703: URL: https://github.com/apache/incubator-doris/pull/3703#issuecomment-638570362 > hi @caiconghui Please resolve the conflict @morningman Done This is an automated message fro

[GitHub] [incubator-doris] morningman merged pull request #3765: [Bug][Outfile] Fix bug that column separator is missing in output file.

2020-06-03 Thread GitBox
morningman merged pull request #3765: URL: https://github.com/apache/incubator-doris/pull/3765 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated (a8c95e7 -> 791f8fe)

2020-06-03 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from a8c95e7 [Bug] Fix binaryPredicte's equals function ignore op (#3753) add 791f8fe [Bug][Outfile] F

[GitHub] [incubator-doris] morningman closed issue #3764: [Bug][Outfile] column separator is missing

2020-06-03 Thread GitBox
morningman closed issue #3764: URL: https://github.com/apache/incubator-doris/issues/3764 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] morningman commented on pull request #3768: Disable Bitmap or Hll type in keys or in values with incorrect agg-type

2020-06-03 Thread GitBox
morningman commented on pull request #3768: URL: https://github.com/apache/incubator-doris/pull/3768#issuecomment-638564961 > [issue](https://github.com/apache/incubator-doris/issues/3769) Link issue like this: `#3769` If you want to close the issue automatically after PR being mer

[GitHub] [incubator-doris] morningman commented on a change in pull request #3760: Support external users to contribute udf

2020-06-03 Thread GitBox
morningman commented on a change in pull request #3760: URL: https://github.com/apache/incubator-doris/pull/3760#discussion_r434948184 ## File path: custom_udf/build_custom_udf.sh ## @@ -0,0 +1,156 @@ +#!/usr/bin/env bash +# Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [incubator-doris] morningman commented on pull request #3703: [Load] Add more metric to trace the time cost in stream load and make brpc_num_threads configurable

2020-06-03 Thread GitBox
morningman commented on pull request #3703: URL: https://github.com/apache/incubator-doris/pull/3703#issuecomment-638548557 hi @caiconghui Please resolve the conflict This is an automated message from the Apache Git Service.

[GitHub] [incubator-doris] morningman merged pull request #3753: [FIX] fix binaryPredicte's equals function ignore op

2020-06-03 Thread GitBox
morningman merged pull request #3753: URL: https://github.com/apache/incubator-doris/pull/3753 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] morningman closed issue #3756: BinaryPredict's equals function compares ignore the op

2020-06-03 Thread GitBox
morningman closed issue #3756: URL: https://github.com/apache/incubator-doris/issues/3756 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[incubator-doris] branch master updated: [Bug] Fix binaryPredicte's equals function ignore op (#3753)

2020-06-03 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new a8c95e7 [Bug] Fix binaryPredicte's

[GitHub] [incubator-doris] spaces-X commented on a change in pull request #3741: Ignore broken disks when BE starts up

2020-06-03 Thread GitBox
spaces-X commented on a change in pull request #3741: URL: https://github.com/apache/incubator-doris/pull/3741#discussion_r434699516 ## File path: be/src/olap/utils.cpp ## @@ -973,6 +979,104 @@ OLAPStatus copy_file(const string& src, const string& dest) { return res

[GitHub] [incubator-doris] spaces-X commented on pull request #3741: Ignore broken disks when BE starts up

2020-06-03 Thread GitBox
spaces-X commented on pull request #3741: URL: https://github.com/apache/incubator-doris/pull/3741#issuecomment-638253988 > auto_deallocator sorry, i forgot to remove that line This is an automated message from the Apa

[GitHub] [incubator-doris] spaces-X commented on pull request #3768: Disable Bitmap or Hll type in keys or in values with incorrect agg-type

2020-06-03 Thread GitBox
spaces-X commented on pull request #3768: URL: https://github.com/apache/incubator-doris/pull/3768#issuecomment-638236361 [issue](https://github.com/apache/incubator-doris/issues/3769) This is an automated message from the Ap

[GitHub] [incubator-doris] spaces-X opened a new issue #3769: bitmap and hll type check

2020-06-03 Thread GitBox
spaces-X opened a new issue #3769: URL: https://github.com/apache/incubator-doris/issues/3769 **Describe the bug** Bitmap and Hll type can not be used with incorrect aggregate functions, which will cause to BEs crush. Add some logical checks in FE's ColumnDef#analyze to avoid creating

[GitHub] [incubator-doris] spaces-X opened a new pull request #3768: Disable Bitmap or Hll type in keys or in values with incorrect agg-type

2020-06-03 Thread GitBox
spaces-X opened a new pull request #3768: URL: https://github.com/apache/incubator-doris/pull/3768 Bitmap and Hll type can not be used with incorrect aggregate functions, which will cause to BE crush. Add some logical checks in FE's ColumnDef#analyze to avoid creating tables or changing

[GitHub] [incubator-doris] morningman merged pull request #3604: (#3464) fix Query failed when fact table has no data in join case

2020-06-03 Thread GitBox
morningman merged pull request #3604: URL: https://github.com/apache/incubator-doris/pull/3604 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [Bug]Fix Query failed when fact table has no data in join case (#3604)

2020-06-03 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 7f6271c [Bug]Fix Query failed when

[GitHub] [incubator-doris] morningman closed issue #3719: tcmalloc 使用错误

2020-06-03 Thread GitBox
morningman closed issue #3719: URL: https://github.com/apache/incubator-doris/issues/3719 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] morningman merged pull request #3732: [Config] Add new BE config for tcmalloc

2020-06-03 Thread GitBox
morningman merged pull request #3732: URL: https://github.com/apache/incubator-doris/pull/3732 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[incubator-doris] branch master updated: [Config] Add new BE config for tcmalloc (#3732)

2020-06-03 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 2ad1b20 [Config] Add new BE config

[GitHub] [incubator-doris] morningman commented on pull request #3741: Ignore broken disks when BE starts up

2020-06-03 Thread GitBox
morningman commented on pull request #3741: URL: https://github.com/apache/incubator-doris/pull/3741#issuecomment-638215306 Compilation failed. Did you miss `util/auto_deallocator.h`? This is an automated message from the Apa

[GitHub] [incubator-doris] chaoyli commented on issue #3767: Txn is not cleared when load been cancelled.

2020-06-03 Thread GitBox
chaoyli commented on issue #3767: URL: https://github.com/apache/incubator-doris/issues/3767#issuecomment-638198964 The data will be encounter error when loading. But the Txn is still exists until timeout.

[GitHub] [incubator-doris] chaoyli opened a new issue #3767: Txn is not cleared when load been cancelled.

2020-06-03 Thread GitBox
chaoyli opened a new issue #3767: URL: https://github.com/apache/incubator-doris/issues/3767 ``` CREATE TABLE `table1` ( `siteid` tinyint(4) NULL DEFAULT "10" COMMENT "", `citycode` smallint(6) NULL COMMENT "", `username` varchar(32) NULL DEFAULT "" COMMENT "", `pv` bi

[GitHub] [incubator-doris] chaoyli opened a new pull request #3766: [Bug] Clear Txn when load been cancelled

2020-06-03 Thread GitBox
chaoyli opened a new pull request #3766: URL: https://github.com/apache/incubator-doris/pull/3766 If you a load task encoutering error, it will be cancelled. At this time, FE will clear the Txn according to the DbName. In FE, DbName should be added by cluter name. If missing cluster

[GitHub] [incubator-doris] chaoyli closed pull request #3744: [Feature] Add QueryDetail to store query statistics.

2020-06-03 Thread GitBox
chaoyli closed pull request #3744: URL: https://github.com/apache/incubator-doris/pull/3744 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-doris] morningman opened a new pull request #3765: [Bug][Outfile] Fix bug that column separator is missing in output file.

2020-06-03 Thread GitBox
morningman opened a new pull request #3765: URL: https://github.com/apache/incubator-doris/pull/3765 When output result of a query using `OUTFILE` statement, is some of output column is null, then then following column separator is missing. Fix: #3764

[GitHub] [incubator-doris] morningman opened a new issue #3764: [Bug][Outfile] column separator is missing

2020-06-03 Thread GitBox
morningman opened a new issue #3764: URL: https://github.com/apache/incubator-doris/issues/3764 **Describe the bug** When output result of a query using `OUTFILE` statement, if some of output column is null, then then following column separator is missing. ---

[GitHub] [incubator-doris] EmmyMiao87 opened a new issue #3763: Support decoupling UDF and BE

2020-06-03 Thread GitBox
EmmyMiao87 opened a new issue #3763: URL: https://github.com/apache/incubator-doris/issues/3763 Support decoupling udf and be Some of the UDFs used by users at their own business level are universal and can be used as third-party extension functions for other users with the same busines

[incubator-doris] branch master updated (ed886a4 -> 73c3de4)

2020-06-03 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from ed886a4 [HttpServer] capture convert exception (#3736) add 73c3de4 [refactor] Simple refactor on class

[GitHub] [incubator-doris] imay merged pull request #3691: [refactor] Simple refactor on class Reader

2020-06-03 Thread GitBox
imay merged pull request #3691: URL: https://github.com/apache/incubator-doris/pull/3691 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [incubator-doris] imay merged pull request #3736: [HttpServer] capture convert exception

2020-06-03 Thread GitBox
imay merged pull request #3736: URL: https://github.com/apache/incubator-doris/pull/3736 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[incubator-doris] branch master updated: [HttpServer] capture convert exception (#3736)

2020-06-03 Thread zhaoc
This is an automated email from the ASF dual-hosted git repository. zhaoc pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new ed886a4 [HttpServer] capture convert ex

[GitHub] [incubator-doris] decster opened a new pull request #3762: [Memory Engine] MemTablet creation and compatibility handling in BE

2020-06-03 Thread GitBox
decster opened a new pull request #3762: URL: https://github.com/apache/incubator-doris/pull/3762 After adding meta, BE now can create MemTablet, and put it into TabletManager, but MemTablet is not compatible with Tablet, a lot of code may break. This CL contains the following changes:

[GitHub] [incubator-doris] acelyc111 opened a new pull request #3761: [StorageEngine] Make StorageEngine::open return more detailed info

2020-06-03 Thread GitBox
acelyc111 opened a new pull request #3761: URL: https://github.com/apache/incubator-doris/pull/3761 StorageEngine::open just return a very vague status info when failed, we have to check logs to find out the root reason, and it's not convenient to check logs if we run unit tests in CI

[incubator-doris] branch master updated: Fix large string val allocation failure (#3724)

2020-06-03 Thread lingmiao
This is an automated email from the ASF dual-hosted git repository. lingmiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new e16873a Fix large string val allocat

[GitHub] [incubator-doris] morningman commented on pull request #3760: Support independently add and build custom udf in Doris

2020-06-03 Thread GitBox
morningman commented on pull request #3760: URL: https://github.com/apache/incubator-doris/pull/3760#issuecomment-638067635 Create a proposal first This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [incubator-doris] EmmyMiao87 merged pull request #3724: Fix large string val allocation failure

2020-06-03 Thread GitBox
EmmyMiao87 merged pull request #3724: URL: https://github.com/apache/incubator-doris/pull/3724 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] EmmyMiao87 closed issue #3600: large bitmap serialization failed because of overflow of size

2020-06-03 Thread GitBox
EmmyMiao87 closed issue #3600: URL: https://github.com/apache/incubator-doris/issues/3600 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [incubator-doris] EmmyMiao87 closed pull request #3760: Support independently add and build custom udf in Doris

2020-06-03 Thread GitBox
EmmyMiao87 closed pull request #3760: URL: https://github.com/apache/incubator-doris/pull/3760 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [incubator-doris] EmmyMiao87 opened a new pull request #3760: Support independently add and build custom udf in Doris

2020-06-03 Thread GitBox
EmmyMiao87 opened a new pull request #3760: URL: https://github.com/apache/incubator-doris/pull/3760 *Source code: The new directory nanmed `custom_udf` is used to add and build custom udf. The directory structure is as follows: Doris -- be -- custom_udf -- fe If use

[GitHub] [incubator-doris] EmmyMiao87 commented on pull request #3760: Support independently add and build custom udf in Doris

2020-06-03 Thread GitBox
EmmyMiao87 commented on pull request #3760: URL: https://github.com/apache/incubator-doris/pull/3760#issuecomment-638063564 Changing doc file This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #3741: Ignore broken disks when BE starts up

2020-06-03 Thread GitBox
chaoyli commented on a change in pull request #3741: URL: https://github.com/apache/incubator-doris/pull/3741#discussion_r434387237 ## File path: be/src/olap/utils.cpp ## @@ -973,6 +979,104 @@ OLAPStatus copy_file(const string& src, const string& dest) { return res;

[GitHub] [incubator-doris] chaoyli commented on a change in pull request #3741: Ignore broken disks when BE starts up

2020-06-03 Thread GitBox
chaoyli commented on a change in pull request #3741: URL: https://github.com/apache/incubator-doris/pull/3741#discussion_r434385961 ## File path: be/src/olap/utils.cpp ## @@ -973,6 +979,104 @@ OLAPStatus copy_file(const string& src, const string& dest) { return res;

[GitHub] [incubator-doris] vagetablechicken edited a comment on issue #3469: [Memory Engine] Write Pipeline: internal data processing and storage

2020-06-03 Thread GitBox
vagetablechicken edited a comment on issue #3469: URL: https://github.com/apache/incubator-doris/issues/3469#issuecomment-631289944 ### WAL file format - need to rename WAL file will save multiple partial rows. One write TX's WAL may be split by size => generates multiple {txn_id}_{segm

[GitHub] [incubator-doris] chaoyli merged pull request #3734: [Memory Engine] Add MemTabletScan

2020-06-03 Thread GitBox
chaoyli merged pull request #3734: URL: https://github.com/apache/incubator-doris/pull/3734 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[incubator-doris] branch master updated (ad7270b -> 70aa9d6)

2020-06-03 Thread lichaoyong
This is an automated email from the ASF dual-hosted git repository. lichaoyong pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from ad7270b [Spark load][Fe 1/5] Add spark etl job config (#3712) add 70aa9d6 [Memory Engine] Add Mem

[GitHub] [incubator-doris] vagetablechicken edited a comment on issue #3469: [Memory Engine] Write Pipeline: internal data processing and storage

2020-06-03 Thread GitBox
vagetablechicken edited a comment on issue #3469: URL: https://github.com/apache/incubator-doris/issues/3469#issuecomment-631289944 ### WAL file format - need to rename WAL file will save multiple partial rows. One write TX's WAL may be split by size => generates multiple {txn_id}_{segm

[GitHub] [incubator-doris] vagetablechicken edited a comment on issue #3469: [Memory Engine] Write Pipeline: internal data processing and storage

2020-06-03 Thread GitBox
vagetablechicken edited a comment on issue #3469: URL: https://github.com/apache/incubator-doris/issues/3469#issuecomment-631289944 ### WAL file format - need to rename WAL file will save multiple partial rows. One write TX's WAL may be split by size => generates multiple {txn_id}_{segm

[GitHub] [incubator-doris] vagetablechicken commented on issue #3624: [Proposal] The execution model of compaction needs to improve

2020-06-03 Thread GitBox
vagetablechicken commented on issue #3624: URL: https://github.com/apache/incubator-doris/issues/3624#issuecomment-638000200 The problems can be divided into two separate parts 1. Generation strategy: Highest permit task first, but we need to consider about dirs. So 1. Skip the

[GitHub] [incubator-doris] vagetablechicken edited a comment on issue #3624: [Proposal] The execution model of compaction needs to improve

2020-06-03 Thread GitBox
vagetablechicken edited a comment on issue #3624: URL: https://github.com/apache/incubator-doris/issues/3624#issuecomment-638000200 @morningman The problems can be divided into two separate parts 1. Generation strategy: Highest permit task first, but we need to consider about dir