[GitHub] [incubator-doris] BiteTheDDDDt opened a new issue #8526: [Feature][Vectorized] vectorized table functions support

2022-03-17 Thread GitBox
BiteThet opened a new issue #8526: URL: https://github.com/apache/incubator-doris/issues/8526 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description

[GitHub] [incubator-doris] HappenLee commented on pull request #8509: [Feature][Vectorized] support table function explode_numbers()

2022-03-17 Thread GitBox
HappenLee commented on pull request #8509: URL: https://github.com/apache/incubator-doris/pull/8509#issuecomment-1072077931 Add a doc for the function `explode_numbers` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-doris] dp0304 commented on issue #8523: 0.15.0 rc4 shutdown

2022-03-17 Thread GitBox
dp0304 commented on issue #8523: URL: https://github.com/apache/incubator-doris/issues/8523#issuecomment-1072075798 并没有操作。查看后台日志对应时刻是大量刷屏。 8台BE集群每天都down两三个节点。 https://user-images.githubusercontent.com/1586562/158950162-cca95a13-39c1-4bd1-a516-52e27ed2b9bb.png";> -- This is an aut

[GitHub] [incubator-doris] xiaokang commented on issue #8523: 0.15.0 rc4 shutdown

2022-03-17 Thread GitBox
xiaokang commented on issue #8523: URL: https://github.com/apache/incubator-doris/issues/8523#issuecomment-1072068655 you can follow the instructions in https://github.com/apache/incubator-doris/discussions/8411 . -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [incubator-doris] xiaokang commented on issue #8523: 0.15.0 rc4 shutdown

2022-03-17 Thread GitBox
xiaokang commented on issue #8523: URL: https://github.com/apache/incubator-doris/issues/8523#issuecomment-1072067816 @dp0304 Can you provide the steps to reproduce the problem? such as cluster configuration, SQL query, table schema and sample data. -- This is an automated message from

[GitHub] [incubator-doris] zhangstar333 opened a new pull request #8525: [Vectorized][Feature] support query into outfile in vec mode

2022-03-17 Thread GitBox
zhangstar333 opened a new pull request #8525: URL: https://github.com/apache/incubator-doris/pull/8525 # Proposed changes Issue Number: close #8524 ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original

[GitHub] [incubator-doris] zhangstar333 opened a new issue #8524: [Vectorized][Feature] support query into outfile in vec mode

2022-03-17 Thread GitBox
zhangstar333 opened a new issue #8524: URL: https://github.com/apache/incubator-doris/issues/8524 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description

[incubator-doris] branch branch-0.11 updated: Update best-practice.md (#8519)

2022-03-17 Thread jiafengzheng
This is an automated email from the ASF dual-hosted git repository. jiafengzheng pushed a commit to branch branch-0.11 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/branch-0.11 by this push: new b3f833d Update best-pr

[GitHub] [incubator-doris] hf200012 merged pull request #8519: [Doc]Update best-practice.md

2022-03-17 Thread GitBox
hf200012 merged pull request #8519: URL: https://github.com/apache/incubator-doris/pull/8519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commi

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8408: [Benchmark] Add TPC-H benchmark tools

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8408: URL: https://github.com/apache/incubator-doris/pull/8408#issuecomment-1072044539 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8520: [doc] Fix some typo about spark load and broker load

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8520: URL: https://github.com/apache/incubator-doris/pull/8520#issuecomment-1072036927 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] wangbo commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
wangbo commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829698590 ## File path: be/src/olap/types.cpp ## @@ -44,27 +44,24 @@ class ScalarTypeInfoResolver { DECLARE_SINGLETON(ScalarTypeInfoResolver); public

[GitHub] [incubator-doris] dp0304 opened a new issue #8523: 0.15.0 rc4 shutdown

2022-03-17 Thread GitBox
dp0304 opened a new issue #8523: URL: https://github.com/apache/incubator-doris/issues/8523 https://user-images.githubusercontent.com/1586562/158939409-842f37ea-35d2-4ef4-825b-433e075f45cb.png";> *** Aborted at 1647509176 (unix time) try "date -d @1647509176" if you are using GNU dat

[GitHub] [incubator-doris] caiconghui commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
caiconghui commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829693209 ## File path: be/src/olap/types.cpp ## @@ -44,27 +44,24 @@ class ScalarTypeInfoResolver { DECLARE_SINGLETON(ScalarTypeInfoResolver); pu

[GitHub] [incubator-doris] zbtzbtzbt commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
zbtzbtzbt commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829692858 ## File path: be/src/olap/olap_common.h ## @@ -143,7 +142,8 @@ enum FieldType { OLAP_FIELD_TYPE_HLL = 23, OLAP_FIELD_TYPE_BOOL = 24,

[GitHub] [incubator-doris] zbtzbtzbt commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
zbtzbtzbt commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829692632 ## File path: be/src/olap/types.cpp ## @@ -44,27 +44,24 @@ class ScalarTypeInfoResolver { DECLARE_SINGLETON(ScalarTypeInfoResolver); pub

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #8475: [feature][array-type] support element_at and element_subscript([]) functions

2022-03-17 Thread GitBox
HappenLee commented on a change in pull request #8475: URL: https://github.com/apache/incubator-doris/pull/8475#discussion_r829683148 ## File path: be/src/vec/functions/array/function_array_element.h ## @@ -0,0 +1,224 @@ +// Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [incubator-doris] caiconghui commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
caiconghui commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829690739 ## File path: be/src/olap/types.cpp ## @@ -44,27 +44,24 @@ class ScalarTypeInfoResolver { DECLARE_SINGLETON(ScalarTypeInfoResolver); pu

[GitHub] [incubator-doris] zbtzbtzbt commented on pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
zbtzbtzbt commented on pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#issuecomment-1072024272 > every cell insert always need to call get_type_info once, it doesn't sound reasonable. Should we improve it by cache TypeInfo? yes, There is still a lot of ro

[GitHub] [incubator-doris] zenoyang commented on a change in pull request #8318: [improvement](storage) Low cardinality string optimization in storage layer

2022-03-17 Thread GitBox
zenoyang commented on a change in pull request #8318: URL: https://github.com/apache/incubator-doris/pull/8318#discussion_r829686097 ## File path: be/src/vec/columns/column_dictionary.h ## @@ -0,0 +1,386 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or m

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8318: [improvement](storage) Low cardinality string optimization in storage layer

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8318: URL: https://github.com/apache/incubator-doris/pull/8318#issuecomment-1072017365 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [incubator-doris] zenoyang commented on a change in pull request #8318: [improvement](storage) Low cardinality string optimization in storage layer

2022-03-17 Thread GitBox
zenoyang commented on a change in pull request #8318: URL: https://github.com/apache/incubator-doris/pull/8318#discussion_r829684644 ## File path: be/src/vec/columns/column_dictionary.h ## @@ -0,0 +1,386 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or m

[GitHub] [incubator-doris] zenoyang commented on a change in pull request #8318: [improvement](storage) Low cardinality string optimization in storage layer

2022-03-17 Thread GitBox
zenoyang commented on a change in pull request #8318: URL: https://github.com/apache/incubator-doris/pull/8318#discussion_r829684404 ## File path: be/src/vec/columns/column_dictionary.h ## @@ -0,0 +1,386 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or m

[GitHub] [incubator-doris] cambyzju commented on pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
cambyzju commented on pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#issuecomment-1072015221 every cell insert always need to call get_type_info once, it doesn't sound reasonable. Should we improve it by cache TypeInfo? -- This is an automated message fro

[GitHub] [incubator-doris] spaces-X commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
spaces-X commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829676895 ## File path: be/src/olap/olap_common.h ## @@ -143,7 +142,8 @@ enum FieldType { OLAP_FIELD_TYPE_HLL = 23, OLAP_FIELD_TYPE_BOOL = 24,

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #8318: [improvement](storage) Low cardinality string optimization in storage layer

2022-03-17 Thread GitBox
HappenLee commented on a change in pull request #8318: URL: https://github.com/apache/incubator-doris/pull/8318#discussion_r829676106 ## File path: be/src/vec/columns/column_dictionary.h ## @@ -0,0 +1,386 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

[GitHub] [incubator-doris] zbtzbtzbt commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
zbtzbtzbt commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829675327 ## File path: be/src/olap/types.cpp ## @@ -85,7 +82,11 @@ ScalarTypeInfoResolver::ScalarTypeInfoResolver() { add_mapping(); } -ScalarTyp

[GitHub] [incubator-doris] zbtzbtzbt opened a new issue #8522: [Enhancement] speed up stream load 50%

2022-03-17 Thread GitBox
zbtzbtzbt opened a new issue #8522: URL: https://github.com/apache/incubator-doris/issues/8522 - pr: https://github.com/apache/incubator-doris/pull/8500 - **speed up data load for no-vec-engine 35%~100% , avg enhance 50%** 🚀🚀🚀 https://user-images.githubusercontent.com/356889

[incubator-doris] 01/02: [fix](load) fix bug that BE may crash when calling `mark_as_failed` (#8501)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch dev-1.0.0 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git commit 422d4d2afdf8bccb431e9f7565ed4e9071886f9a Author: Mingyu Chen AuthorDate: Fri Mar 18 09:38:16 2022 +0800

[incubator-doris] branch dev-1.0.0 updated (4a96dc8 -> 536c03b)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch dev-1.0.0 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 4a96dc8 [fix](vectorized) fix core dump on get_json_string and add some ut (#8496) new 422d4d2

[incubator-doris] 02/02: [fix] fix String type comapaction or agg may crash when string is null (#8515)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch dev-1.0.0 in repository https://gitbox.apache.org/repos/asf/incubator-doris.git commit 536c03bdf750fc27147fc342a58d6c4affae1bff Author: Zhengguo Yang AuthorDate: Fri Mar 18 11:27:28 2022 +080

[GitHub] [incubator-doris] gj-zhang opened a new issue #8521: [Bug] NPE while restart FE. at Catalog.replayCreateTable

2022-03-17 Thread GitBox
gj-zhang opened a new issue #8521: URL: https://github.com/apache/incubator-doris/issues/8521 ### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Version 0.15.

[incubator-doris] branch master updated (4da1718 -> 58a4c70)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 4da1718 [fix] memory leak in ResourceTls (#8517) add 58a4c70 [fix] fix String type comapaction or

[GitHub] [incubator-doris] morningman merged pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
morningman merged pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman commented on pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
morningman commented on pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515#issuecomment-1071992430 merge for quick test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515#issuecomment-1071992069 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [incubator-doris] mrhhsg commented on a change in pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
mrhhsg commented on a change in pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515#discussion_r829668740 ## File path: be/src/olap/field.h ## @@ -247,7 +247,7 @@ class Field { // used by init scan key stored in string format // value_string s

[GitHub] [incubator-doris] morningman opened a new pull request #8520: [doc] Fix some typo about spark load and broker load

2022-03-17 Thread GitBox
morningman opened a new pull request #8520: URL: https://github.com/apache/incubator-doris/pull/8520 # Proposed changes Issue Number: close #xxx ## Problem Summary: 1. add hive-bitmap-udf link 2. modify preceding-filter ## Checklist(Required) 1. Does it

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#issuecomment-1071981087 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] adonis0147 commented on a change in pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
adonis0147 commented on a change in pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#discussion_r829652863 ## File path: be/src/vec/core/block.cpp ## @@ -701,63 +702,118 @@ doris::Tuple* Block::deep_copy_tuple(const doris::TupleDescriptor& desc, Mem

[GitHub] [incubator-doris] adonis0147 commented on a change in pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
adonis0147 commented on a change in pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#discussion_r829649391 ## File path: be/src/vec/exprs/vliteral.cpp ## @@ -24,107 +24,104 @@ #include "vec/data_types/data_type_nullable.h" #include "vec/runtime/vda

[GitHub] [incubator-doris] adonis0147 commented on a change in pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
adonis0147 commented on a change in pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#discussion_r829649391 ## File path: be/src/vec/exprs/vliteral.cpp ## @@ -24,107 +24,104 @@ #include "vec/data_types/data_type_nullable.h" #include "vec/runtime/vda

[GitHub] [incubator-doris] adonis0147 commented on a change in pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
adonis0147 commented on a change in pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#discussion_r829649391 ## File path: be/src/vec/exprs/vliteral.cpp ## @@ -24,107 +24,104 @@ #include "vec/data_types/data_type_nullable.h" #include "vec/runtime/vda

[GitHub] [incubator-doris] ChPi commented on issue #8514: [Bug]

2022-03-17 Thread GitBox
ChPi commented on issue #8514: URL: https://github.com/apache/incubator-doris/issues/8514#issuecomment-1071960845 maybe a bug like #7564 , has been fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-doris] adonis0147 commented on a change in pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
adonis0147 commented on a change in pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#discussion_r829648307 ## File path: be/src/vec/exprs/vliteral.cpp ## @@ -24,107 +24,104 @@ #include "vec/data_types/data_type_nullable.h" #include "vec/runtime/vda

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#issuecomment-1071958365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] luzhijing commented on pull request #8519: [Doc]Update best-practice.md

2022-03-17 Thread GitBox
luzhijing commented on pull request #8519: URL: https://github.com/apache/incubator-doris/pull/8519#issuecomment-1071956223 You can also update the English document -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [incubator-doris] luzhijing commented on pull request #8519: [Doc]Update best-practice.md

2022-03-17 Thread GitBox
luzhijing commented on pull request #8519: URL: https://github.com/apache/incubator-doris/pull/8519#issuecomment-1071955044 LGTM This PR update some wrong numbers in Apache Doris 0.11 Version document -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [incubator-doris] Gabriel39 commented on a change in pull request #8516: [feature-wip][UDF][DIP-1] support java UDF with fixed-length input and output

2022-03-17 Thread GitBox
Gabriel39 commented on a change in pull request #8516: URL: https://github.com/apache/incubator-doris/pull/8516#discussion_r829644075 ## File path: be/src/util/jni-util.cpp ## @@ -0,0 +1,244 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contribut

[GitHub] [incubator-doris] morningman commented on a change in pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
morningman commented on a change in pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515#discussion_r829639280 ## File path: be/src/olap/field.h ## @@ -247,7 +247,7 @@ class Field { // used by init scan key stored in string format // value_stri

[incubator-doris] branch master updated: [fix] memory leak in ResourceTls (#8517)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 4da1718 [fix] memory leak in Resou

[GitHub] [incubator-doris] morningman merged pull request #8517: [fix]memory leak in ResourceTls

2022-03-17 Thread GitBox
morningman merged pull request #8517: URL: https://github.com/apache/incubator-doris/pull/8517 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [doc] add flink 1.14 support (#8511)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 8765759 [doc] add flink 1.14 suppo

[GitHub] [incubator-doris] morningman merged pull request #8511: [Doc]flink 1.14 support

2022-03-17 Thread GitBox
morningman merged pull request #8511: URL: https://github.com/apache/incubator-doris/pull/8511 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (035ca52 -> 9499186)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 035ca52 [fix] Fix may coredump when check if all rowset is beta-rowset of a tablet (#8503) add 94

[GitHub] [incubator-doris] morningman closed issue #8506: [Bug] FE cannot get the right size of tablet

2022-03-17 Thread GitBox
morningman closed issue #8506: URL: https://github.com/apache/incubator-doris/issues/8506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[GitHub] [incubator-doris] morningman merged pull request #8507: [Fix] Fix bug that __set_ missing for thrift optional fields in be

2022-03-17 Thread GitBox
morningman merged pull request #8507: URL: https://github.com/apache/incubator-doris/pull/8507 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [fix] Fix may coredump when check if all rowset is beta-rowset of a tablet (#8503)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 035ca52 [fix] Fix may coredump whe

[GitHub] [incubator-doris] morningman merged pull request #8503: [fix] Fix may coredump when check if all rowset is beta-rowset of a tablet

2022-03-17 Thread GitBox
morningman merged pull request #8503: URL: https://github.com/apache/incubator-doris/pull/8503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated: [fix](load) fix bug that BE may crash when calling `mark_as_failed` (#8501)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new b07b840 [fix](load) fix bug that B

[GitHub] [incubator-doris] morningman closed issue #8502: [Bug] BE crash in "mark_as_failed"

2022-03-17 Thread GitBox
morningman closed issue #8502: URL: https://github.com/apache/incubator-doris/issues/8502 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[GitHub] [incubator-doris] morningman merged pull request #8501: [fix](load) fix bug that BE may crash when calling `mark_as_failed`

2022-03-17 Thread GitBox
morningman merged pull request #8501: URL: https://github.com/apache/incubator-doris/pull/8501 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] mrhhsg commented on a change in pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
mrhhsg commented on a change in pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515#discussion_r829633754 ## File path: be/src/olap/field.h ## @@ -247,7 +247,7 @@ class Field { // used by init scan key stored in string format // value_string s

[incubator-doris] branch master updated: [fix](sample)(cpp) fix the condition of breaking for loop in function (#8497)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new ac9acc8 [fix](sample)(cpp) fix the

[GitHub] [incubator-doris] morningman merged pull request #8497: [fix](connect)(cpp) fix the condition of breaking for loop in functio…

2022-03-17 Thread GitBox
morningman merged pull request #8497: URL: https://github.com/apache/incubator-doris/pull/8497 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] mrhhsg commented on a change in pull request #8515: [fix] fix String type comapaction or agg may crash when string is null

2022-03-17 Thread GitBox
mrhhsg commented on a change in pull request #8515: URL: https://github.com/apache/incubator-doris/pull/8515#discussion_r829633218 ## File path: be/src/olap/field.h ## @@ -185,7 +185,7 @@ class Field { if (is_null) { return; } -if (type()

[incubator-doris] branch master updated: [refactor] CalcPageLenForRow return void rather than always Status::Ok (#8490)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git The following commit(s) were added to refs/heads/master by this push: new 25cdd0b [refactor] CalcPageLenForR

[GitHub] [incubator-doris] morningman merged pull request #8490: CalcPageLenForRow return void rather than always Status::Ok

2022-03-17 Thread GitBox
morningman merged pull request #8490: URL: https://github.com/apache/incubator-doris/pull/8490 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[incubator-doris] branch master updated (70fbb3b -> 8470455)

2022-03-17 Thread morningman
This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-doris.git. from 70fbb3b [test] support run regression test with out load data (#8499) add 8470455 [fix](tablet-re

[GitHub] [incubator-doris] morningman merged pull request #8481: [Bug](ReportHandler) Fix bug that tabletReport function of ReportHandler in fe may throw NullPointerException due to transaction check

2022-03-17 Thread GitBox
morningman merged pull request #8481: URL: https://github.com/apache/incubator-doris/pull/8481 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] morningman closed issue #8480: [Bug] tabletReport function of ReportHandler in fe throws NullPointerException

2022-03-17 Thread GitBox
morningman closed issue #8480: URL: https://github.com/apache/incubator-doris/issues/8480 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[GitHub] [incubator-doris] yangjun616 opened a new pull request #8519: [Doc]Update best-practice.md

2022-03-17 Thread GitBox
yangjun616 opened a new pull request #8519: URL: https://github.com/apache/incubator-doris/pull/8519 typo # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the o

[GitHub] [incubator-doris] yangjun616 closed pull request #8518: Patch 3

2022-03-17 Thread GitBox
yangjun616 closed pull request #8518: URL: https://github.com/apache/incubator-doris/pull/8518 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: com

[GitHub] [incubator-doris] yangjun616 opened a new pull request #8518: Patch 3

2022-03-17 Thread GitBox
yangjun616 opened a new pull request #8518: URL: https://github.com/apache/incubator-doris/pull/8518 # Proposed changes Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required) 1. Does it affect the original beha

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #8494: [feature-wip][array-type][vec] Support insertion for vectorized engine.

2022-03-17 Thread GitBox
HappenLee commented on a change in pull request #8494: URL: https://github.com/apache/incubator-doris/pull/8494#discussion_r829290877 ## File path: be/src/vec/exprs/vliteral.cpp ## @@ -24,107 +24,104 @@ #include "vec/data_types/data_type_nullable.h" #include "vec/runtime/vdat

[GitHub] [incubator-doris] HappenLee commented on a change in pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
HappenLee commented on a change in pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#discussion_r829284447 ## File path: be/src/olap/types.cpp ## @@ -85,7 +82,11 @@ ScalarTypeInfoResolver::ScalarTypeInfoResolver() { add_mapping(); } -ScalarTyp

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8505: [Bug][Vectorized] fix regexp_replace get wrong result on clang

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8505: URL: https://github.com/apache/incubator-doris/pull/8505#issuecomment-1071078451 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [incubator-doris] morningman commented on a change in pull request #8516: [feature-wip][UDF][DIP-1] support java UDF with fixed-length input and output

2022-03-17 Thread GitBox
morningman commented on a change in pull request #8516: URL: https://github.com/apache/incubator-doris/pull/8516#discussion_r829251637 ## File path: be/src/util/jni-util.cpp ## @@ -0,0 +1,244 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contribu

[GitHub] [incubator-doris] morningman commented on a change in pull request #8475: [feature][array-type] support element_at and element_subscript([]) functions

2022-03-17 Thread GitBox
morningman commented on a change in pull request #8475: URL: https://github.com/apache/incubator-doris/pull/8475#discussion_r829208150 ## File path: gensrc/script/doris_builtins_functions.py ## @@ -114,12 +114,30 @@ [['array'], 'ARRAY', ['ARRAY', '...'], '', '', '', '', ''

[GitHub] [incubator-doris] morningman commented on a change in pull request #8475: [feature][array-type] support element_at and element_subscript([]) functions

2022-03-17 Thread GitBox
morningman commented on a change in pull request #8475: URL: https://github.com/apache/incubator-doris/pull/8475#discussion_r829198100 ## File path: be/src/vec/functions/array/function_array_element.h ## @@ -0,0 +1,224 @@ +// Licensed to the Apache Software Foundation (ASF) und

[GitHub] [incubator-doris] morningman edited a comment on pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
morningman edited a comment on pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#issuecomment-1070986965 > Exciting news, I just tested it vai 100G SSB data and find **almost faster X1**! Sounds great! But I made a simple broker load job in my env, not that

[GitHub] [incubator-doris] morningman commented on pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
morningman commented on pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#issuecomment-1070986965 > Exciting news, I just tested it vai 100G SSB data and find **almost faster X1**! Sounds great! But I made a simple broker load job in my env, not that much

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829152380 ## File path: be/src/runtime/row_batch.cpp ## @@ -39,8 +40,8 @@ namespace doris { const int RowBatch::AT_CAPACITY_MEM_USAGE = 8 * 1024 * 1024;

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829152380 ## File path: be/src/runtime/row_batch.cpp ## @@ -39,8 +40,8 @@ namespace doris { const int RowBatch::AT_CAPACITY_MEM_USAGE = 8 * 1024 * 1024;

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829152380 ## File path: be/src/runtime/row_batch.cpp ## @@ -39,8 +40,8 @@ namespace doris { const int RowBatch::AT_CAPACITY_MEM_USAGE = 8 * 1024 * 1024;

[GitHub] [incubator-doris] caiconghui commented on a change in pull request #8486: [Refactor] remove tablet instances since tablet id is unique between base tablet and new schema change tablet

2022-03-17 Thread GitBox
caiconghui commented on a change in pull request #8486: URL: https://github.com/apache/incubator-doris/pull/8486#discussion_r829143069 ## File path: be/src/olap/tablet_manager.cpp ## @@ -1340,38 +1221,25 @@ OLAPStatus TabletManager::_drop_tablet_directly_unlocked(TTabletId tab

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8517: [fix]memory leak in ResourceTls

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8517: URL: https://github.com/apache/incubator-doris/pull/8517#issuecomment-1070929648 PR approved by at least one committer and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [incubator-doris] github-actions[bot] commented on pull request #8517: [fix]memory leak in ResourceTls

2022-03-17 Thread GitBox
github-actions[bot] commented on pull request #8517: URL: https://github.com/apache/incubator-doris/pull/8517#issuecomment-1070929712 PR approved by anyone and no changes requested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [incubator-doris] kpfly commented on pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
kpfly commented on pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#issuecomment-1070925243 Good Job! zbtzbtzbt ***@***.***> 于2022年3月17日周四 20:33写道: > Exciting news, I just tested it vai 100G SSB data and find *almost faster > X1*! > >- 1

[GitHub] [incubator-doris] morrySnow opened a new pull request #8517: [fix]memory leak in ResourceTls

2022-03-17 Thread GitBox
morrySnow opened a new pull request #8517: URL: https://github.com/apache/incubator-doris/pull/8517 # Proposed changes fix memory leak in ResourceTls Issue Number: close #xxx ## Problem Summary: Describe the overview of changes. ## Checklist(Required)

[GitHub] [incubator-doris] Gabriel39 opened a new pull request #8516: [feature-wip][UDF][DIP-1] support java UDF with fixed-length input and output

2022-03-17 Thread GitBox
Gabriel39 opened a new pull request #8516: URL: https://github.com/apache/incubator-doris/pull/8516 # Proposed changes Related Issues: #8389 #8441 ## Problem Summary: This feature is propsoed in [DIP-1](https://cwiki.apache.org/confluence/display/DORIS/DSIP-001%

[GitHub] [incubator-doris] dataalive commented on issue #8446: 复制现有doris环境整个目录,在新环境启动导致原环境的be服务宕机

2022-03-17 Thread GitBox
dataalive commented on issue #8446: URL: https://github.com/apache/incubator-doris/issues/8446#issuecomment-1070894849 so the issue is resolved ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [incubator-doris] zbtzbtzbt commented on pull request #8500: [Opt] speed up data load for no-vec-load

2022-03-17 Thread GitBox
zbtzbtzbt commented on pull request #8500: URL: https://github.com/apache/incubator-doris/pull/8500#issuecomment-1070865751 Exciting news, I just tested it vai 100G SSB data and find **almost faster X1**! - 100G SSB data for loading - 1 FE - 3 BE before: loading 100G ne

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829038800 ## File path: be/src/runtime/dpp_sink.cpp ## @@ -0,0 +1,926 @@ +// Licensed to the Apache Software Foundation (ASF) under one Review comment:

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829029793 ## File path: be/src/olap/snapshot_manager.h ## @@ -99,6 +102,9 @@ class SnapshotManager { // snapshot Mutex _snapshot_mutex; uint

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829034838 ## File path: be/src/olap/task/engine_alter_tablet_task.cpp ## @@ -25,7 +25,14 @@ namespace doris { using std::to_string; EngineAlterTabletTa

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829034192 ## File path: be/src/olap/tablet_manager.cpp ## @@ -73,7 +73,7 @@ static bool _cmp_tablet_by_create_time(const TabletSharedPtr& a, const TabletS

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829029793 ## File path: be/src/olap/snapshot_manager.h ## @@ -99,6 +102,9 @@ class SnapshotManager { // snapshot Mutex _snapshot_mutex; uint

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829026362 ## File path: be/src/olap/rowset/segment_v2/segment.cpp ## @@ -51,10 +51,10 @@ Segment::Segment(const FilePathDesc& path_desc, uint32_t segment_

[GitHub] [incubator-doris] xinyiZzz commented on a change in pull request #8476: [Feature] (Memory) Hook TCMalloc new/delete automatically counts to MemTracker

2022-03-17 Thread GitBox
xinyiZzz commented on a change in pull request #8476: URL: https://github.com/apache/incubator-doris/pull/8476#discussion_r829026095 ## File path: be/src/olap/memtable.cpp ## @@ -31,14 +31,13 @@ namespace doris { MemTable::MemTable(int64_t tablet_id, Schema* schema, const Ta

  1   2   >