[GitHub] [doris] zzzzzzzs commented on pull request #20044: [Function] Support date function: microsecond()

2023-06-16 Thread via GitHub


zzzs commented on PR #20044:
URL: https://github.com/apache/doris/pull/20044#issuecomment-1594203525

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] nextdreamblue commented on pull request #20824: [Feature] (json)add json_contains function

2023-06-16 Thread via GitHub


nextdreamblue commented on PR #20824:
URL: https://github.com/apache/doris/pull/20824#issuecomment-1594204057

   LGTM


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20824: [Feature] (json)add json_contains function

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20824:
URL: https://github.com/apache/doris/pull/20824#issuecomment-1594205373

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20824: [Feature] (json)add json_contains function

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20824:
URL: https://github.com/apache/doris/pull/20824#issuecomment-1594205487

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] deadlinefen commented on pull request #20870: [Test](regression) CCR syncer thrift interface regression test

2023-06-16 Thread via GitHub


deadlinefen commented on PR #20870:
URL: https://github.com/apache/doris/pull/20870#issuecomment-1594207380

   run P0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] englefly opened a new pull request, #20895: [improve](Nereids)tpch q20 rewrite sql improvement

2023-06-16 Thread via GitHub


englefly opened a new pull request, #20895:
URL: https://github.com/apache/doris/pull/20895

   ## Proposed changes
   on tpch100, from 2.2 sec to 0.44 sec
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] czzmmc opened a new issue, #20896: [Bug] Java UDAF will be blocked when querying empty table

2023-06-16 Thread via GitHub


czzmmc opened a new issue, #20896:
URL: https://github.com/apache/doris/issues/20896

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Version
   
   Version : doris-1.2.3-rc02
   
   
   ### What's Wrong?
   
   Util now, I still got this problem. When I do a query which may have empty 
data set, the query will be running forever.
   
   ### What You Expected?
   
   Response anything, but not this.
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] lide-reed merged pull request #20824: [Feature] (json)add json_contains function

2023-06-16 Thread via GitHub


lide-reed merged PR #20824:
URL: https://github.com/apache/doris/pull/20824


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated: [Feature] (json)add json_contains function (#20824)

2023-06-16 Thread lide
This is an automated email from the ASF dual-hosted git repository.

lide pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 97135a1cbb [Feature] (json)add json_contains function (#20824)
97135a1cbb is described below

commit 97135a1cbb2d3483479964515e10a0fde8fc551c
Author: yuxuan-luo <119841515+yuxuan-...@users.noreply.github.com>
AuthorDate: Fri Jun 16 15:10:12 2023 +0800

[Feature] (json)add json_contains function (#20824)
---
 be/src/vec/functions/function_json.cpp | 127 +
 .../sql-functions/json-functions/json_contains.md  |  69 +++
 .../sql-functions/json-functions/json_contains.md  |  69 +++
 gensrc/script/doris_builtins_functions.py  |   1 +
 .../json_functions/test_json_function.out  |  21 
 .../json_functions/test_json_function.groovy   |   9 ++
 6 files changed, 296 insertions(+)

diff --git a/be/src/vec/functions/function_json.cpp 
b/be/src/vec/functions/function_json.cpp
index e4f955ae0a..4d2f0f3614 100644
--- a/be/src/vec/functions/function_json.cpp
+++ b/be/src/vec/functions/function_json.cpp
@@ -18,6 +18,7 @@
 #include 
 #include 
 #include 
+#include 
 #include 
 #include 
 #include 
@@ -935,6 +936,131 @@ public:
 }
 };
 
+class FunctionJsonContains : public IFunction {
+public:
+static constexpr auto name = "json_contains";
+static FunctionPtr create() { return 
std::make_shared(); }
+
+String get_name() const override { return name; }
+
+size_t get_number_of_arguments() const override { return 3; }
+
+DataTypePtr get_return_type_impl(const DataTypes& arguments) const 
override {
+return make_nullable(std::make_shared());
+}
+
+bool use_default_implementation_for_nulls() const override { return false; 
}
+
+bool json_contains_object(const rapidjson::Value& target,
+  const rapidjson::Value& search_value) {
+if (!target.IsObject() || !search_value.IsObject()) {
+return false;
+}
+
+for (auto itr = search_value.MemberBegin(); itr != 
search_value.MemberEnd(); ++itr) {
+if (!target.HasMember(itr->name) || 
!json_contains(target[itr->name], itr->value)) {
+return false;
+}
+}
+
+return true;
+}
+
+bool json_contains_array(const rapidjson::Value& target, const 
rapidjson::Value& search_value) {
+if (!target.IsArray() || !search_value.IsArray()) {
+return false;
+}
+
+for (auto itr = search_value.Begin(); itr != search_value.End(); 
++itr) {
+bool found = false;
+for (auto target_itr = target.Begin(); target_itr != target.End(); 
++target_itr) {
+if (json_contains(*target_itr, *itr)) {
+found = true;
+break;
+}
+}
+if (!found) {
+return false;
+}
+}
+
+return true;
+}
+
+bool json_contains(const rapidjson::Value& target, const rapidjson::Value& 
search_value) {
+if (target == search_value) {
+return true;
+}
+
+if (target.IsObject() && search_value.IsObject()) {
+return json_contains_object(target, search_value);
+}
+
+if (target.IsArray() && search_value.IsArray()) {
+return json_contains_array(target, search_value);
+}
+
+return false;
+}
+
+Status execute_impl(FunctionContext* context, Block& block, const 
ColumnNumbers& arguments,
+size_t result, size_t input_rows_count) override {
+const IColumn& col_json = 
*(block.get_by_position(arguments[0]).column);
+const IColumn& col_search = 
*(block.get_by_position(arguments[1]).column);
+const IColumn& col_path = 
*(block.get_by_position(arguments[2]).column);
+
+auto null_map = ColumnUInt8::create(input_rows_count, 0);
+
+const ColumnString* col_json_string = 
check_and_get_column(col_json);
+const ColumnString* col_search_string = 
check_and_get_column(col_search);
+const ColumnString* col_path_string = 
check_and_get_column(col_path);
+
+if (!col_json_string || !col_search_string || !col_path_string) {
+return Status::RuntimeError("Illegal column should be 
ColumnString");
+}
+
+auto col_to = ColumnVector::create();
+auto& vec_to = col_to->get_data();
+size_t size = col_json.size();
+vec_to.resize(size);
+
+for (size_t i = 0; i < input_rows_count; ++i) {
+if (col_json.is_null_at(i) || col_search.is_null_at(i) || 
col_path.is_null_at(i)) {
+null_map->get_data()[i] = 1;
+vec_to[i] = 0;
+continue;
+}
+
+const auto& json_val = col_json_string->get_data_a

[GitHub] [doris] LiBinfeng-01 commented on pull request #20602: [Feature](Nereids) Add important time to profile in nereids

2023-06-16 Thread via GitHub


LiBinfeng-01 commented on PR #20602:
URL: https://github.com/apache/doris/pull/20602#issuecomment-1594217865

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] yuxuan-luo commented on pull request #20723: [improvement](mutil-catalog) PaimonColumnValue support short and Decimal

2023-06-16 Thread via GitHub


yuxuan-luo commented on PR #20723:
URL: https://github.com/apache/doris/pull/20723#issuecomment-1594218504

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] CalvinKirs opened a new pull request, #20897: [1.2-ITS](broker)Support GCS

2023-06-16 Thread via GitHub


CalvinKirs opened a new pull request, #20897:
URL: https://github.com/apache/doris/pull/20897

   ## Proposed changes
   
   How to config see 
https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/branch-2.2.x/gcs/CONFIGURATION.md
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Mryange commented on pull request #20899: [feature](Session) remove enable_function_pushdown variable

2023-06-16 Thread via GitHub


Mryange commented on PR #20899:
URL: https://github.com/apache/doris/pull/20899#issuecomment-1594237864

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Mryange opened a new pull request, #20899: [feature](Session) remove enable_function_pushdown variable

2023-06-16 Thread via GitHub


Mryange opened a new pull request, #20899:
URL: https://github.com/apache/doris/pull/20899

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] qidaye commented on pull request #20778: [Fix](invert index) fix fd over limit

2023-06-16 Thread via GitHub


qidaye commented on PR #20778:
URL: https://github.com/apache/doris/pull/20778#issuecomment-1594238783

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Mryange commented on pull request #20247: [feature](datetime) "timediff" supports calculating microseconds.

2023-06-16 Thread via GitHub


Mryange commented on PR #20247:
URL: https://github.com/apache/doris/pull/20247#issuecomment-1594240304

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Tanya-W commented on pull request #20860: [fix](match) add more checks for match expression in nereids, to fix regression case test_index_match_select and test_index_match_phrase

2023-06-16 Thread via GitHub


Tanya-W commented on PR #20860:
URL: https://github.com/apache/doris/pull/20860#issuecomment-1594241591

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20899: [feature](Session) remove enable_function_pushdown variable

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20899:
URL: https://github.com/apache/doris/pull/20899#issuecomment-1594247062

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20247: [feature](datetime) "timediff" supports calculating microseconds.

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20247:
URL: https://github.com/apache/doris/pull/20247#issuecomment-1594248742

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20894: [opt](Nereids) revert convert IN with 2 options to OR expression rule

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20894:
URL: https://github.com/apache/doris/pull/20894#issuecomment-1594249325

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20894: [opt](Nereids) revert convert IN with 2 options to OR expression rule

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20894:
URL: https://github.com/apache/doris/pull/20894#issuecomment-1594249371

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] csun5285 commented on a diff in pull request #20889: [fix](compaction) fix time series compaction policy to adjust vertical compaction max segment size

2023-06-16 Thread via GitHub


csun5285 commented on code in PR #20889:
URL: https://github.com/apache/doris/pull/20889#discussion_r1231898406


##
be/src/olap/compaction.cpp:
##
@@ -126,6 +126,10 @@ int64_t Compaction::get_avg_segment_rows() {
 // input_rowsets_size is total disk_size of input_rowset, this size is the
 // final size after codec and compress, so expect dest segment file size
 // in disk is config::vertical_compaction_max_segment_size
+if (config::compaction_policy == "time_series") {

Review Comment:
   done
   



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20860: [fix](match) add more checks for match expression in nereids, to fix regression case test_index_match_select and test_index_match

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20860:
URL: https://github.com/apache/doris/pull/20860#issuecomment-1594254265

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20860: [fix](match) add more checks for match expression in nereids, to fix regression case test_index_match_select and test_index_match

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20860:
URL: https://github.com/apache/doris/pull/20860#issuecomment-1594254328

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] sohardforaname commented on pull request #20452: [Feature](Nereids) support delete using syntax to delete data from unique key table

2023-06-16 Thread via GitHub


sohardforaname commented on PR #20452:
URL: https://github.com/apache/doris/pull/20452#issuecomment-1594254891

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20889: [fix](compaction) fix time series compaction policy to adjust vertical compaction max segment size

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20889:
URL: https://github.com/apache/doris/pull/20889#issuecomment-1594257839

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] lexluo09 opened a new issue, #20900: [Feature] Doris supports LLM(chatGPT) and enables natural language querying and tuning.

2023-06-16 Thread via GitHub


lexluo09 opened a new issue, #20900:
URL: https://github.com/apache/doris/issues/20900

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Description
   
   1、convert natural language into Doris  SQL.
   2、suggestions for Doris SQL tuning.
   3、doris web console to receive Natural Language Processing (NLP).
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20685: [Fix](planner&Nereids) fold constant invalid yyyy-mm-31 to the last day of month incorrectly

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20685:
URL: https://github.com/apache/doris/pull/20685#issuecomment-1594261469

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20685: [Fix](planner&Nereids) fold constant invalid yyyy-mm-31 to the last day of month incorrectly

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20685:
URL: https://github.com/apache/doris/pull/20685#issuecomment-1594261541

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] GoGoWen commented on pull request #20386: [minor](all) Fix some typo in docs and code

2023-06-16 Thread via GitHub


GoGoWen commented on PR #20386:
URL: https://github.com/apache/doris/pull/20386#issuecomment-1594261820

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #19467: [Enhance](regression-test)rename test_query_db for nereids.

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #19467:
URL: https://github.com/apache/doris/pull/19467#issuecomment-1594262799

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] xiaokang merged pull request #20735: [FIX](regress-test)update config for disable_nested_complex_type

2023-06-16 Thread via GitHub


xiaokang merged PR #20735:
URL: https://github.com/apache/doris/pull/20735


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated (97135a1cbb -> c3b9e99350)

2023-06-16 Thread kxiao
This is an automated email from the ASF dual-hosted git repository.

kxiao pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 97135a1cbb [Feature] (json)add json_contains function (#20824)
 add c3b9e99350 [fix](regress-test)update config for 
disable_nested_complex_type (#20735)

No new revisions were added by this update.

Summary of changes:
 fe/fe-common/src/main/java/org/apache/doris/common/Config.java | 5 -
 1 file changed, 4 insertions(+), 1 deletion(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow opened a new pull request, #20901: [opt](Nereids) add more unexpected expression check

2023-06-16 Thread via GitHub


morrySnow opened a new pull request, #20901:
URL: https://github.com/apache/doris/pull/20901

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   1. check sub-query after rewrite, should not meet any sub-query there
   2. check below expression on specific plan
 a. Aggreagate:  TableGeneratingFunction and WindowExpression
 b. Filter: AggregateFunction, GroupingScalarFunction,
   TableGeneratingFunction and WindowExpression
 c. Generate: AggregateFunction, GroupingScalarFunction and WindowExpression
 d. Having: TableGeneratingFunction and WindowExpression
 e. Join: AggregateFunction, GroupingScalarFunction,
   TableGeneratingFunction and WindowExpression
 f. Project: TableGeneratingFunction
 g. Sort: AggregateFunction, GroupingScalarFunction,
   TableGeneratingFunction and WindowExpression
 h. Window: GroupingScalarFunction and TableGeneratingFunction
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20327: [WIP](load) new build segment tool

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20327:
URL: https://github.com/apache/doris/pull/20327#issuecomment-1594274208

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow commented on pull request #20901: [opt](Nereids) add more unexpected expression check

2023-06-16 Thread via GitHub


morrySnow commented on PR #20901:
URL: https://github.com/apache/doris/pull/20901#issuecomment-1594275921

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] jackwener opened a new pull request, #20902: [fix](Nereids): MergeSetOperations can merge SetOperation ALL.

2023-06-16 Thread via GitHub


jackwener opened a new pull request, #20902:
URL: https://github.com/apache/doris/pull/20902

   ## Proposed changes
   
   Issue Number: close #xxx
   
   original MergeSetOperations is after BuildAggForUnion.
   
   So, it can't merge SetOperations Qualifier is ALL
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] xiaoyaoziyang07 commented on issue #20725: [Bug] Wrong query result

2023-06-16 Thread via GitHub


xiaoyaoziyang07 commented on issue #20725:
URL: https://github.com/apache/doris/issues/20725#issuecomment-1594281519

   and I have the same problem
   run the same sql twice return different result;the first return one row, the 
second return none row;


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] xzj7019 opened a new pull request, #20903: [improvement](nereids) Refine tpcds tools

2023-06-16 Thread via GitHub


xzj7019 opened a new pull request, #20903:
URL: https://github.com/apache/doris/pull/20903

   ## Proposed changes
   
   Refine tpcds test tools, including split 99 cases into separate files, and 
refine 100g schema with range partition format.
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #19467: [Enhance](regression-test)rename test_query_db for nereids.

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #19467:
URL: https://github.com/apache/doris/pull/19467#issuecomment-1594284687

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20903: [improvement](nereids) Refine tpcds tools

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20903:
URL: https://github.com/apache/doris/pull/20903#issuecomment-1594285357

    `sh-checker report`
   
   To get the full details, please check in the 
[job]("https://github.com/apache/doris/actions/runs/5287682041";) output.
   
   
   shellcheck errors
   
   ```
   
   'shellcheck ' returned error 1 finding the following syntactical issues:
   
   --
   
   In tools/tpcds-tools/bin/create-tpcds-tables.sh line 80:
   if [[ ${SCALE_FACTOR} -ne 1 ]] && [[ ${SCALE_FACTOR} -ne 100]]; then
   ^-- SC1009 (info): The mentioned syntax error was in this if expression.
 ^-- SC1073 (error): Couldn't parse this 
test expression. Fix to allow more checks.
 ^-- SC1020 
(error): You need a space before the ]].
 ^-- SC1072 
(error): Missing space before ]. Fix any mentioned problems and try again.
   
   
   In tools/tpcds-tools/bin/run-tpcds-queries.sh line 135:
   mysql -h${FE_HOST} -u${USER} -P${FE_QUERY_PORT}  < 
${TPCDS_QUERIES_DIR}/query${i}.sql > ${RESULT_DIR}/result${i}.out 
2>${RESULT_DIR}/result${i}.log
   ^^ SC2086 (info): Double quote to prevent globbing and 
word splitting.
^-^ SC2086 (info): Double quote to prevent 
globbing and word splitting.
  ^--^ SC2086 (info): Double 
quote to prevent globbing and word splitting.
  ^--^ 
SC2086 (info): Double quote to prevent globbing and word splitting.

^--^ SC2086 (info): Double quote to prevent globbing and word splitting.

   ^---^ SC2086 (info): Double quote to prevent globbing 
and word splitting.

   ^--^ SC2086 (info): Double quote to prevent 
globbing and word splitting.

  ^---^ SC2086 (info): 
Double quote to prevent globbing and word splitting.

  ^--^ SC2086 
(info): Double quote to prevent globbing and word splitting.
   
   Did you mean: 
   mysql -h"${FE_HOST}" -u"${USER}" -P"${FE_QUERY_PORT}"  < 
"${TPCDS_QUERIES_DIR}"/query"${i}".sql > "${RESULT_DIR}"/result"${i}".out 
2>"${RESULT_DIR}"/result"${i}".log
   
   
   In tools/tpcds-tools/bin/run-tpcds-queries.sh line 141:
   mysql -h${FE_HOST} -u${USER} -P${FE_QUERY_PORT}  < 
${TPCDS_QUERIES_DIR}/query${i}.sql > ${RESULT_DIR}/result${i}.out 
2>${RESULT_DIR}/result${i}.log
   ^^ SC2086 (info): Double quote to prevent globbing and 
word splitting.
^-^ SC2086 (info): Double quote to prevent 
globbing and word splitting.
  ^--^ SC2086 (info): Double 
quote to prevent globbing and word splitting.
  ^--^ 
SC2086 (info): Double quote to prevent globbing and word splitting.

^--^ SC2086 (info): Double quote to prevent globbing and word splitting.

   ^---^ SC2086 (info): Double quote to prevent globbing 
and word splitting.

   ^--^ SC2086 (info): Double quote to prevent 
globbing and word splitting.

  ^---^ SC2086 (info): 
Double quote to prevent globbing and word splitting.

  ^--^ SC2086 
(info): Double quote to prevent globbing and word splitting.
   
   Did you mean: 
   mysql -h"${FE_HOST}" -u"${USER}" -P"${FE_QUERY_PORT}"  < 
"${TPCDS_QUERIES_DIR}"/query"${i}".sql > "${RESULT_DIR}"/result"${i}".out 
2>"${RESULT_DIR}"/result"${i}".log
   
   
   In tools/tpcds-tools/bin/run-tpcds-queries.sh line 147:
   mysql -h${FE_HOST} -u${USER} -P${FE_QUERY_PORT}  < 
${TPCDS_QUERIES_DIR}/query${i}.sql > ${RESULT_DIR}/result${i}.out 
2>${RESULT_DIR}/result${i}.log
   ^^ SC2086 (info): Double quote to p

[GitHub] [doris] herry2038 commented on pull request #20257: [improvement](compaction) Duplicate without key table compaction optimimation

2023-06-16 Thread via GitHub


herry2038 commented on PR #20257:
URL: https://github.com/apache/doris/pull/20257#issuecomment-1594287242

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] jackwener commented on pull request #20902: [fix](Nereids): MergeSetOperations can merge SetOperation ALL.

2023-06-16 Thread via GitHub


jackwener commented on PR #20902:
URL: https://github.com/apache/doris/pull/20902#issuecomment-1594287703

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] CalvinKirs opened a new pull request, #20904: [Feature](broker)Support GCS

2023-06-16 Thread via GitHub


CalvinKirs opened a new pull request, #20904:
URL: https://github.com/apache/doris/pull/20904

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20327: [WIP](load) new build segment tool

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20327:
URL: https://github.com/apache/doris/pull/20327#issuecomment-1594289809

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow merged pull request #19467: [Enhance](regression-test)rename test_query_db for nereids.

2023-06-16 Thread via GitHub


morrySnow merged PR #19467:
URL: https://github.com/apache/doris/pull/19467


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20857: [Enhancement](tvf) Add frontends table-valued-function

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20857:
URL: https://github.com/apache/doris/pull/20857#issuecomment-1594295735

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] herry2038 commented on pull request #20257: [improvement](compaction) Duplicate without key table compaction optimimation

2023-06-16 Thread via GitHub


herry2038 commented on PR #20257:
URL: https://github.com/apache/doris/pull/20257#issuecomment-1594296423

   run p0regression


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow merged pull request #20685: [Fix](planner&Nereids) fold constant invalid yyyy-mm-31 to the last day of month incorrectly

2023-06-16 Thread via GitHub


morrySnow merged PR #20685:
URL: https://github.com/apache/doris/pull/20685


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated (5573858cb4 -> 0bd9aecfcc)

2023-06-16 Thread morrysnow
This is an automated email from the ASF dual-hosted git repository.

morrysnow pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 5573858cb4 [Enhance](regression-test) use another db  than 
test_query_db for nereids_p0 (#19467)
 add 0bd9aecfcc [Fix](planner&Nereids) fold constant invalid -mm-31 to 
the last day of month incorrectly  (#20685)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/doris/analysis/DateLiteral.java | 27 --
 .../trees/expressions/literal/DateLiteral.java | 13 ++---
 .../trees/expressions/literal/DateTimeLiteral.java | 32 ++
 .../datetime_functions/test_date_function.groovy   |  5 
 .../datetime_functions/test_date_function.groovy   |  6 +++-
 5 files changed, 58 insertions(+), 25 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Kikyou1997 opened a new pull request, #20905: [enhancement](nereids) Remove useless config option

2023-06-16 Thread via GitHub


Kikyou1997 opened a new pull request, #20905:
URL: https://github.com/apache/doris/pull/20905

   ## Proposed changes
   
   1. Remove useless config option
   2. Fix timeout cancel, before this PR an OlapAnalysisTask would continue 
running even if it's already timeout.
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Kikyou1997 commented on pull request #20905: [enhancement](nereids) Remove useless config option

2023-06-16 Thread via GitHub


Kikyou1997 commented on PR #20905:
URL: https://github.com/apache/doris/pull/20905#issuecomment-1594305916

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #19609: [feature](compaction) support delete in cumulative compaction

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #19609:
URL: https://github.com/apache/doris/pull/19609#issuecomment-1594307706

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow commented on pull request #20894: [opt](Nereids) revert convert IN with 2 options to OR expression rule

2023-06-16 Thread via GitHub


morrySnow commented on PR #20894:
URL: https://github.com/apache/doris/pull/20894#issuecomment-1594309318

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] yongjinhou commented on pull request #20857: [Enhancement](tvf) Add frontends table-valued-function

2023-06-16 Thread via GitHub


yongjinhou commented on PR #20857:
URL: https://github.com/apache/doris/pull/20857#issuecomment-1594309483

   run Need_2_Approval


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20865: [test](nereids) Add regression test for stats analyze

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20865:
URL: https://github.com/apache/doris/pull/20865#issuecomment-1594309586

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] sohardforaname commented on pull request #20452: [Feature](Nereids) support delete using syntax to delete data from unique key table

2023-06-16 Thread via GitHub


sohardforaname commented on PR #20452:
URL: https://github.com/apache/doris/pull/20452#issuecomment-1594311133

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20865: [test](nereids) Add regression test for stats analyze

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20865:
URL: https://github.com/apache/doris/pull/20865#issuecomment-1594309525

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] herry2038 commented on pull request #20257: [improvement](compaction) Duplicate without key table compaction optimimation

2023-06-16 Thread via GitHub


herry2038 commented on PR #20257:
URL: https://github.com/apache/doris/pull/20257#issuecomment-1594312081

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] eldenmoon commented on pull request #20876: [Improvement](load) single partition load optimize

2023-06-16 Thread via GitHub


eldenmoon commented on PR #20876:
URL: https://github.com/apache/doris/pull/20876#issuecomment-1594316318

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Jibing-Li opened a new pull request, #20906: [Improvement](multi catalog, statistics)Support two level external statistics cache loader.

2023-06-16 Thread via GitHub


Jibing-Li opened a new pull request, #20906:
URL: https://github.com/apache/doris/pull/20906

   
   
   The current column statistic cache loader is to load data from 
column_statistics olap table.
   This pr is to change the cache loader logic to First load from 
column_statistics olap table, if no data was loaded, then load from table 
metadata. This is mainly to support fetch statistics data for external catalog 
using HMS or Iceberg api.
   This is the first PR, next pr will implement the fetch logic for different 
external catalogs.
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20889: [fix](compaction) fix time series compaction policy to adjust vertical compaction max segment size

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20889:
URL: https://github.com/apache/doris/pull/20889#issuecomment-1594318951

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20889: [fix](compaction) fix time series compaction policy to adjust vertical compaction max segment size

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20889:
URL: https://github.com/apache/doris/pull/20889#issuecomment-1594318996

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] csun5285 commented on pull request #20889: [fix](compaction) fix time series compaction policy to adjust vertical compaction max segment size

2023-06-16 Thread via GitHub


csun5285 commented on PR #20889:
URL: https://github.com/apache/doris/pull/20889#issuecomment-1594319210

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20889: [fix](compaction) fix time series compaction policy to adjust vertical compaction max segment size

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20889:
URL: https://github.com/apache/doris/pull/20889#issuecomment-1594320577

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] herry2038 commented on pull request #20257: [improvement](compaction) Duplicate without key table compaction optimimation

2023-06-16 Thread via GitHub


herry2038 commented on PR #20257:
URL: https://github.com/apache/doris/pull/20257#issuecomment-1594329312

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow merged pull request #20865: [test](nereids) Add regression test for stats analyze

2023-06-16 Thread via GitHub


morrySnow merged PR #20865:
URL: https://github.com/apache/doris/pull/20865


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated: [fix](nereids) add regression test for stats analyze and fix some bugs (#20865)

2023-06-16 Thread morrysnow
This is an automated email from the ASF dual-hosted git repository.

morrysnow pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new e63739e729 [fix](nereids)  add regression test for stats analyze and 
fix some bugs (#20865)
e63739e729 is described below

commit e63739e7295a1c0e58165a418299ceb866824b11
Author: AKIRA <33112463+kikyou1...@users.noreply.github.com>
AuthorDate: Fri Jun 16 17:43:49 2023 +0900

[fix](nereids)  add regression test for stats analyze and fix some bugs 
(#20865)

1. Add regression test case for analyze to make sure show/drop/analyze 
stats would work as expected
2. Remove useless code, which would block the clean for expired stats
3. Fix bug of DropStats,  before this PR drop the whole table stats would 
casuse a NPE exception when parsing stmt
---
 .../org/apache/doris/analysis/AnalyzeTblStmt.java  |   9 +
 .../org/apache/doris/analysis/DropStatsStmt.java   |   4 +-
 .../doris/catalog/InternalSchemaInitializer.java   |   6 +-
 .../apache/doris/statistics/ColumnStatistic.java   |  10 +-
 .../apache/doris/statistics/StatisticsCleaner.java |  36 ---
 .../doris/statistics/util/InternalQueryResult.java |   5 +
 .../suites/statistics/analyze_stats.groovy | 323 +++--
 .../suites/statistics/manage_stats.groovy  | 271 -
 regression-test/suites/statistics/test_ddl.groovy  |  80 +
 9 files changed, 267 insertions(+), 477 deletions(-)

diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeTblStmt.java 
b/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeTblStmt.java
index 01888461ae..71d25c97f6 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeTblStmt.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/AnalyzeTblStmt.java
@@ -164,6 +164,15 @@ public class AnalyzeTblStmt extends AnalyzeStmt {
 + "collection of external tables is not supported");
 }
 }
+if (analyzeProperties.isSync()
+&& (analyzeProperties.isAutomatic() || 
analyzeProperties.getPeriodTimeInMs() != 0)) {
+throw new AnalysisException("Automatic/Period statistics 
collection "
++ "and synchronous statistics collection cannot be set at 
same time");
+}
+if (analyzeProperties.isAutomatic() && 
analyzeProperties.getPeriodTimeInMs() != 0) {
+throw new AnalysisException("Automatic collection "
++ "and period statistics collection cannot be set at same 
time");
+}
 }
 
 private void checkColumn() throws AnalysisException {
diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/analysis/DropStatsStmt.java 
b/fe/fe-core/src/main/java/org/apache/doris/analysis/DropStatsStmt.java
index df50f45bb3..1e426c586f 100644
--- a/fe/fe-core/src/main/java/org/apache/doris/analysis/DropStatsStmt.java
+++ b/fe/fe-core/src/main/java/org/apache/doris/analysis/DropStatsStmt.java
@@ -64,7 +64,9 @@ public class DropStatsStmt extends DdlStmt {
 public DropStatsStmt(TableName tableName,
 List columnNames) {
 this.tableName = tableName;
-this.columnNames = new HashSet<>(columnNames);
+if (columnNames != null) {
+this.columnNames = new HashSet<>(columnNames);
+}
 dropExpired = false;
 }
 
diff --git 
a/fe/fe-core/src/main/java/org/apache/doris/catalog/InternalSchemaInitializer.java
 
b/fe/fe-core/src/main/java/org/apache/doris/catalog/InternalSchemaInitializer.java
index 04bbbe263a..5b3a093f77 100644
--- 
a/fe/fe-core/src/main/java/org/apache/doris/catalog/InternalSchemaInitializer.java
+++ 
b/fe/fe-core/src/main/java/org/apache/doris/catalog/InternalSchemaInitializer.java
@@ -145,12 +145,12 @@ public class InternalSchemaInitializer extends Thread {
 ColumnDef partId = new ColumnDef("part_id", 
TypeDef.createVarchar(StatisticConstants.MAX_NAME_LEN));
 partId.setAllowNull(true);
 columnDefs.add(partId);
-columnDefs.add(new ColumnDef("count", 
TypeDef.create(PrimitiveType.BIGINT)));
-columnDefs.add(new ColumnDef("ndv", 
TypeDef.create(PrimitiveType.BIGINT)));
+columnDefs.add(new ColumnDef("count", 
TypeDef.create(PrimitiveType.BIGINT), true));
+columnDefs.add(new ColumnDef("ndv", 
TypeDef.create(PrimitiveType.BIGINT), true));
 columnDefs.add(new ColumnDef("null_count", 
TypeDef.create(PrimitiveType.BIGINT), true));
 columnDefs.add(new ColumnDef("min", 
TypeDef.createVarchar(ScalarType.MAX_VARCHAR_LENGTH), true));
 columnDefs.add(new ColumnDef("max", 
TypeDef.createVarchar(ScalarType.MAX_VARCHAR_LENGTH), true));
-columnDefs.add(new ColumnDef("data_size_in_bytes", 
TypeDef.create(PrimitiveType.BIGINT)));
+columnDefs.add(new ColumnDef("data_size_in_bytes", 
TypeDef.create(PrimitiveType.BIGINT), 

[GitHub] [doris] github-actions[bot] commented on pull request #20843: [feature](Nereids): DPHyp just output logicalExpression.

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20843:
URL: https://github.com/apache/doris/pull/20843#issuecomment-1594342748

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20843: [feature](Nereids): DPHyp just output logicalExpression.

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20843:
URL: https://github.com/apache/doris/pull/20843#issuecomment-1594342800

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20864: [Enhancement](http) Unify http auth config

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20864:
URL: https://github.com/apache/doris/pull/20864#issuecomment-1594344540

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20864: [Enhancement](http) Unify http auth config

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20864:
URL: https://github.com/apache/doris/pull/20864#issuecomment-1594344587

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] englefly merged pull request #20886: [fix](nereids)disable tpcds query59 plan shape check

2023-06-16 Thread via GitHub


englefly merged PR #20886:
URL: https://github.com/apache/doris/pull/20886


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated: [fix](nereids)disable tpcds query59 plan shape check #20886

2023-06-16 Thread englefly
This is an automated email from the ASF dual-hosted git repository.

englefly pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
 new 22aee21208 [fix](nereids)disable tpcds query59 plan shape check #20886
22aee21208 is described below

commit 22aee2120814b02eabbe73ddee758e4da6ad0933
Author: minghong 
AuthorDate: Fri Jun 16 16:50:40 2023 +0800

[fix](nereids)disable tpcds query59 plan shape check #20886

ds59 plan shape is not stable.
we will fix it in future
---
 .../shape/query59.groovy   | 88 +++---
 1 file changed, 44 insertions(+), 44 deletions(-)

diff --git 
a/regression-test/suites/nereids_tpcds_shape_sf100_p0/shape/query59.groovy 
b/regression-test/suites/nereids_tpcds_shape_sf100_p0/shape/query59.groovy
index f36074309c..e9eb44aa2d 100644
--- a/regression-test/suites/nereids_tpcds_shape_sf100_p0/shape/query59.groovy
+++ b/regression-test/suites/nereids_tpcds_shape_sf100_p0/shape/query59.groovy
@@ -30,52 +30,52 @@ suite("query59") {
 sql 'set enable_nereids_timeout = false'
 sql 'SET enable_pipeline_engine = true'
 
-qt_ds_shape_59 '''
-explain shape plan
+// qt_ds_shape_59 '''
+// explain shape plan
 
 
 
-with wss as 
- (select d_week_seq,
-ss_store_sk,
-sum(case when (d_day_name='Sunday') then ss_sales_price else null end) 
sun_sales,
-sum(case when (d_day_name='Monday') then ss_sales_price else null end) 
mon_sales,
-sum(case when (d_day_name='Tuesday') then ss_sales_price else  null 
end) tue_sales,
-sum(case when (d_day_name='Wednesday') then ss_sales_price else null 
end) wed_sales,
-sum(case when (d_day_name='Thursday') then ss_sales_price else null 
end) thu_sales,
-sum(case when (d_day_name='Friday') then ss_sales_price else null end) 
fri_sales,
-sum(case when (d_day_name='Saturday') then ss_sales_price else null 
end) sat_sales
- from store_sales,date_dim
- where d_date_sk = ss_sold_date_sk
- group by d_week_seq,ss_store_sk
- )
-  select  s_store_name1,s_store_id1,d_week_seq1
-   ,sun_sales1/sun_sales2,mon_sales1/mon_sales2
-   ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2
-   ,fri_sales1/fri_sales2,sat_sales1/sat_sales2
- from
- (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1
-,s_store_id s_store_id1,sun_sales sun_sales1
-,mon_sales mon_sales1,tue_sales tue_sales1
-,wed_sales wed_sales1,thu_sales thu_sales1
-,fri_sales fri_sales1,sat_sales sat_sales1
-  from wss,store,date_dim d
-  where d.d_week_seq = wss.d_week_seq and
-ss_store_sk = s_store_sk and 
-d_month_seq between 1196 and 1196 + 11) y,
- (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2
-,s_store_id s_store_id2,sun_sales sun_sales2
-,mon_sales mon_sales2,tue_sales tue_sales2
-,wed_sales wed_sales2,thu_sales thu_sales2
-,fri_sales fri_sales2,sat_sales sat_sales2
-  from wss,store,date_dim d
-  where d.d_week_seq = wss.d_week_seq and
-ss_store_sk = s_store_sk and 
-d_month_seq between 1196+ 12 and 1196 + 23) x
- where s_store_id1=s_store_id2
-   and d_week_seq1=d_week_seq2-52
- order by s_store_name1,s_store_id1,d_week_seq1
-limit 100;
+// with wss as 
+//  (select d_week_seq,
+// ss_store_sk,
+// sum(case when (d_day_name='Sunday') then ss_sales_price else null 
end) sun_sales,
+// sum(case when (d_day_name='Monday') then ss_sales_price else null 
end) mon_sales,
+// sum(case when (d_day_name='Tuesday') then ss_sales_price else  null 
end) tue_sales,
+// sum(case when (d_day_name='Wednesday') then ss_sales_price else 
null end) wed_sales,
+// sum(case when (d_day_name='Thursday') then ss_sales_price else null 
end) thu_sales,
+// sum(case when (d_day_name='Friday') then ss_sales_price else null 
end) fri_sales,
+// sum(case when (d_day_name='Saturday') then ss_sales_price else null 
end) sat_sales
+//  from store_sales,date_dim
+//  where d_date_sk = ss_sold_date_sk
+//  group by d_week_seq,ss_store_sk
+//  )
+//   select  s_store_name1,s_store_id1,d_week_seq1
+//,sun_sales1/sun_sales2,mon_sales1/mon_sales2
+//,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2
+//,fri_sales1/fri_sales2,sat_sales1/sat_sales2
+//  from
+//  (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1
+// ,s_store_id s_store_id1,sun_sales sun_sales1
+// ,mon_sales mon_sales1,tue_sales tue_sales1
+// ,wed_sales wed_sales1,thu_sales thu_sales1
+// ,fri_sales fri_sales1,sat_sales sat_sales1
+//   from wss,store,date_dim d
+//   where d.d_week_seq = wss.d_week_seq and
+// ss_store_sk = s_store_sk and 
+// d_month_seq between 1196 and 1196 + 11) y,
+//  (select s_store_name s_store_name2,wss.d

[GitHub] [doris] Yukang-Lian opened a new pull request, #20907: [Enhancement](Compaction) Caculate all committed rowsets delete bitmaps when do comapction

2023-06-16 Thread via GitHub


Yukang-Lian opened a new pull request, #20907:
URL: https://github.com/apache/doris/pull/20907

   ## Proposed changes
   
   Issue Number: close #xxx
   
   
   
   Here we will calculate all the rowsets delete bitmaps which are committed 
but not published to reduce the calculation pressure of publish phase.
   
   Step1: collect this tablet's all committed rowsets' delete bitmaps
   
   Step2: calculate all rowsets' delete bitmaps which are published during 
compaction.
   
   Step3: write back updated delete bitmap and tablet info.
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Yukang-Lian commented on pull request #20907: [Enhancement](Compaction) Caculate all committed rowsets delete bitmaps when do comapction

2023-06-16 Thread via GitHub


Yukang-Lian commented on PR #20907:
URL: https://github.com/apache/doris/pull/20907#issuecomment-1594350685

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] englefly commented on a diff in pull request #20713: [tpcds](nereids)adjust cost model for BroadCastJoin and PartitionJoin

2023-06-16 Thread via GitHub


englefly commented on code in PR #20713:
URL: https://github.com/apache/doris/pull/20713#discussion_r1231984958


##
fe/fe-core/src/main/java/org/apache/doris/nereids/cost/CostModelV1.java:
##
@@ -252,10 +271,19 @@ public Cost visitPhysicalHashJoin(
 leftRowCount + rightRowCount,
 penalty);
 }
+
+if (context.isBroadcastJoin()) {
+double broadcastJoinPenalty = 
broadCastJoinBalancePenalty(probeStats, buildStats);
+return CostV1.of(leftRowCount * broadcastJoinPenalty + 
rightRowCount + outputRowCount,

Review Comment:
   this idea can be implemented in CostModelV2. In V1, we do not have this 
dimension



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] luozenglin merged pull request #20864: [Enhancement](http) Unify http auth config

2023-06-16 Thread via GitHub


luozenglin merged PR #20864:
URL: https://github.com/apache/doris/pull/20864


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] deadlinefen commented on pull request #20870: [Test](regression) CCR syncer thrift interface regression test

2023-06-16 Thread via GitHub


deadlinefen commented on PR #20870:
URL: https://github.com/apache/doris/pull/20870#issuecomment-1594354054

   run P0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated (22aee21208 -> 2e295a1ee9)

2023-06-16 Thread luozenglin
This is an automated email from the ASF dual-hosted git repository.

luozenglin pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 22aee21208 [fix](nereids)disable tpcds query59 plan shape check #20886
 add 2e295a1ee9 [Enhancement](http)  unify http auth config (#20864)

No new revisions were added by this update.

Summary of changes:
 be/src/common/config.cpp   | 2 +-
 be/src/common/config.h | 2 +-
 be/src/http/http_handler_with_auth.cpp | 2 +-
 be/test/http/http_auth_test.cpp| 6 +++---
 4 files changed, 6 insertions(+), 6 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] liutang123 commented on pull request #19924: [improvement](pipeline) task group scan entity

2023-06-16 Thread via GitHub


liutang123 commented on PR #19924:
URL: https://github.com/apache/doris/pull/19924#issuecomment-1594371181

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20907: [Enhancement](Compaction) Caculate all committed rowsets delete bitmaps when do comapction

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20907:
URL: https://github.com/apache/doris/pull/20907#issuecomment-1594361060

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] luozenglin commented on a diff in pull request #20857: [Enhancement](tvf) Add frontends table-valued-function

2023-06-16 Thread via GitHub


luozenglin commented on code in PR #20857:
URL: https://github.com/apache/doris/pull/20857#discussion_r1231986042


##
gensrc/thrift/Types.thrift:
##
@@ -687,6 +687,7 @@ enum TSortType {
 enum TMetadataType {
   ICEBERG,
   BACKENDS,
+  FRONTENDS,

Review Comment:
   Never add enum definition in the middle of the existing thrift definition. 
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240883637



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20890: [Enhancement](function) fix compatibility issues of sum/count during upgrade process

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20890:
URL: https://github.com/apache/doris/pull/20890#issuecomment-1594370419

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] zy-kkk commented on pull request #20909: [improvement](pg jdbc)Support for automatically obtaining the precision of the postgresql timestamp type

2023-06-16 Thread via GitHub


zy-kkk commented on PR #20909:
URL: https://github.com/apache/doris/pull/20909#issuecomment-1594373487

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Mryange commented on pull request #20899: [feature](Session) remove enable_function_pushdown variable

2023-06-16 Thread via GitHub


Mryange commented on PR #20899:
URL: https://github.com/apache/doris/pull/20899#issuecomment-1594364267

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[doris] branch master updated (2e295a1ee9 -> 536bf56a35)

2023-06-16 Thread morrysnow
This is an automated email from the ASF dual-hosted git repository.

morrysnow pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


from 2e295a1ee9 [Enhancement](http)  unify http auth config (#20864)
 add 536bf56a35 [fix](planner) strip trailing zeros when cast string 
literal to decimal literal (#20743)

No new revisions were added by this update.

Summary of changes:
 .../org/apache/doris/analysis/StringLiteral.java   |  2 +-
 .../test_string_to_decimal.groovy} | 32 ++
 2 files changed, 16 insertions(+), 18 deletions(-)
 copy regression-test/suites/{nereids_syntax_p0/group_bit.groovy => 
correctness_p0/test_string_to_decimal.groovy} (63%)


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] zy-kkk opened a new issue, #20908: PostgreSQL

2023-06-16 Thread via GitHub


zy-kkk opened a new issue, #20908:
URL: https://github.com/apache/doris/issues/20908

   (no comment)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] zy-kkk opened a new pull request, #20909: [improvement](pg jdbc)Support for automatically obtaining the precision of the postgresql timestamp type

2023-06-16 Thread via GitHub


zy-kkk opened a new pull request, #20909:
URL: https://github.com/apache/doris/pull/20909

   ## Proposed changes
   
   Issue Number: close #20908 
   
   
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] zhangstar333 commented on pull request #20890: [Enhancement](function) fix compatibility issues of sum/count during upgrade process

2023-06-16 Thread via GitHub


zhangstar333 commented on PR #20890:
URL: https://github.com/apache/doris/pull/20890#issuecomment-1594364349

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] BiteTheDDDDt commented on pull request #20869: [Chore](materialized-view) add ssb_flat mv test case

2023-06-16 Thread via GitHub


BiteThet commented on PR #20869:
URL: https://github.com/apache/doris/pull/20869#issuecomment-1594361681

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20907: [Enhancement](Compaction) Caculate all committed rowsets delete bitmaps when do comapction

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20907:
URL: https://github.com/apache/doris/pull/20907#issuecomment-1594363141

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] morrySnow merged pull request #20743: [fix](planner)strip trailing zeros when cast string literal to decimal literal

2023-06-16 Thread via GitHub


morrySnow merged PR #20743:
URL: https://github.com/apache/doris/pull/20743


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20890: [Enhancement](function) fix compatibility issues of sum/count during upgrade process

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20890:
URL: https://github.com/apache/doris/pull/20890#issuecomment-1594370350

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #19924: [improvement](pipeline) task group scan entity

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #19924:
URL: https://github.com/apache/doris/pull/19924#issuecomment-1594382226

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] github-actions[bot] commented on pull request #20890: [Enhancement](function) fix compatibility issues of sum/count during upgrade process

2023-06-16 Thread via GitHub


github-actions[bot] commented on PR #20890:
URL: https://github.com/apache/doris/pull/20890#issuecomment-1594383635

   clang-tidy review says "All clean, LGTM! :+1:"


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] yongjinhou commented on pull request #20857: [Enhancement](tvf) Add frontends table-valued-function

2023-06-16 Thread via GitHub


yongjinhou commented on PR #20857:
URL: https://github.com/apache/doris/pull/20857#issuecomment-1594385865

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] yongjinhou commented on a diff in pull request #20857: [Enhancement](tvf) Add frontends table-valued-function

2023-06-16 Thread via GitHub


yongjinhou commented on code in PR #20857:
URL: https://github.com/apache/doris/pull/20857#discussion_r1232009455


##
gensrc/thrift/Types.thrift:
##
@@ -687,6 +687,7 @@ enum TSortType {
 enum TMetadataType {
   ICEBERG,
   BACKENDS,
+  FRONTENDS,

Review Comment:
   done



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] Mryange commented on pull request #20899: [feature](Session) remove enable_function_pushdown variable

2023-06-16 Thread via GitHub


Mryange commented on PR #20899:
URL: https://github.com/apache/doris/pull/20899#issuecomment-1594382426

   run p0


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



[GitHub] [doris] yongjinhou commented on pull request #20857: [Enhancement](tvf) Add frontends table-valued-function

2023-06-16 Thread via GitHub


yongjinhou commented on PR #20857:
URL: https://github.com/apache/doris/pull/20857#issuecomment-1594388203

   > u need to implement this function for Nereids(new optimizer) too
   
   I will do it latter


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


-
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org



  1   2   3   4   >