This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-1.2-unstable
in repository https://gitbox.apache.org/repos/asf/doris.git
discard c3172a559b [fix](build) fix compile fail on Segment::open (#14058)
discard 836021ac2e [Bug](Bitmap) fix sub_bitmap calculate wrong result to
return null (#13978)
discard 3da8dfb658 [feature](multi-catalog) Support data on s3-compatible oss
and support aliyun DLF (#13994)
discard 7e9890ea6d [fix](Nereids) Use simple cost to calculate benefit and
avoid unuseless calculation (#14056)
discard b4857cb608 [feature-wip](multi-catalog) fix page index filter bug
(#14015)
discard 944d572053 [thirdpart](lib) Add lock free queue of concurrentqueue
(#14045)
discard df2f528781 [feature](Nereids) support query that group by use alias
generated in aggregate output (#14030)
discard 73a004c8dc [Enhancement](Dictionary-codec) update dict once on same
segment (#13936)
discard bcde11d82d [fix](priv) fix meta replay bug when upgrading from 1.1.x
to 1.2.x (#14046)
new ab9aef389f [fix](priv) fix meta replay bug when upgrading from 1.1.x
to 1.2.x (#14046)
new f4b4e60349 [Enhancement](Dictionary-codec) update dict once on same
segment (#13936)
new 5db650f961 [feature](Nereids) support query that group by use alias
generated in aggregate output (#14030)
new 89951f3f91 [thirdpart](lib) Add lock free queue of concurrentqueue
(#14045)
new 2d8d8233b6 [feature-wip](multi-catalog) fix page index filter bug
(#14015)
new 1979312b47 [fix](Nereids) Use simple cost to calculate benefit and
avoid unuseless calculation (#14056)
new 2e0af89b7e [feature](multi-catalog) Support data on s3-compatible oss
and support aliyun DLF (#13994)
new 682dc378dd [Bug](Bitmap) fix sub_bitmap calculate wrong result to
return null (#13978)
new 8aa048c056 [fix](build) fix compile fail on Segment::open (#14058)
new dd2a122707 [regression](Nereids) add back tpch regression test cases
(#13826)
new 6d699fbcb5 [enhancement](Nereids) tpch q21 anti and semi join reorder
(#14037)
new 2367e098d2 [chore](bin) do not set heap limit for tcmalloc until doris
does not allocates large unused memory (#13761)
new bbc60f4e99 [fix](statistics) ColumnStatistics was changed unexpectedly
when show stats (#14068)
new 76b3c2b4a4 [improvement](profile) support ordinary user to get query
profile via http api (#14016)
new 0e39243080 [Nereids][Improve] infer predicate after push down
predicate (#12996)
new 087f168f2f [fix](keyranges) fix the split error of keyranges (#14049)
new f56fe5ff35 use extern template to date_time_add (#13970)
new 81d62d6c93 [feature](information_schema) add `backends`
information_schema table (#13086)
new c84ab79705 [feature](inverted index)WIP inverted index api: SQL syntax
and metadata (#13430)
new bd2daec2ef [opt](ssb) Add query hint for the SSB queries (#14089)
new f4d2c9aaab [refactor](new-scan) remove old vectorized scan node
(#14029)
new 44df5b384a [docs](odbc) fix docs for sqlserver odbc table (#14017)
new 83f243acf0 [enhancement](load) shrink reserved buffer for page builder
(#14012) (#14014)
new 6104991317 [typo](docs)update array type doc #14057
new 83663081fe [fix](JSON) Fail to parse JSONPath (libc++) (#13941)
new ddb57a4eeb [fix](ctas) text column type len = 1 when create table as
select (#13906)
new b5db5c1f0a [bug](ColumnDecimal)call set_decimalv2_type when cloning
ColumnDecimal (#14061)
new a02be24c40 [fix](Vectorized)fix json_object and json_array function
return wrong result on vectorized engine (#13775)
new f5ec89b45b [Compile](join) Boost compiling and linking (#14081)
new fdb42a4dd2 [docs](array-type) update the docs to specify how to use
array function when import data (#13995)
new 0ef2377d22 [feature](Nereids) binding slot in order by that not show
in project (#14042)
new e91dae0198 [improve](Nereids): remove redundant code, add annotation
in Memo. (#14083)
new dd2e4b0425 [fix](Nereids) aggregate disassemble generate error output
list on GLOBAL phase aggregate (#14079)
new 1eabf6975a [performance-wip] (vectorization) Opt HashJoin Performance
(#12390)
new 12ca106cae [fix](compile) fix compile error #14103
new 09650f22e5 [feature](table-valued-function) Support `desc from s3()`
and modify the syntax of tvf (#14047)
new e8a9151f13 [enhancement](Nereids) use post-order to generate runtime
filter in RuntimeFilterGenerator (#13949)
new 6f022b40a2 [refractor](array) refractor DataTypeArray from_string
(#13905)
new 3fff8f399b [Enhancement][fix](profile)() modify some profiles (#14074)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c3172a559b)
\
N -- N -- N refs/heads/branch-1.2-unstable (3fff8f399b)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 39 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/common/config.h | 4 -
be/src/exec/CMakeLists.txt | 1 +
be/src/exec/broker_scanner.cpp | 4 -
be/src/exec/es_http_scan_node.cpp | 15 +-
be/src/exec/es_http_scan_node.h | 6 -
be/src/exec/exec_node.cpp | 37 +-
be/src/exec/olap_common.h | 28 +-
be/src/exec/olap_scan_node.h | 1 -
be/src/exec/schema_scan_node.cpp | 5 +
be/src/exec/schema_scanner.cpp | 47 +-
be/src/exec/schema_scanner.h | 10 +
.../schema_scanner/schema_backends_scanner.cpp | 165 ++
.../schema_scanner/schema_backends_scanner.h} | 36 +-
be/src/exprs/expr_context.h | 5 -
be/src/exprs/json_functions.cpp | 12 +-
be/src/exprs/json_functions.h | 5 +-
be/src/olap/CMakeLists.txt | 1 +
be/src/olap/inverted_index_parser.cpp | 65 +
.../options.h => inverted_index_parser.h} | 30 +-
be/src/olap/rowset/segment_v2/binary_dict_page.cpp | 8 +-
be/src/olap/rowset/segment_v2/binary_plain_page.h | 14 +-
be/src/olap/rowset/segment_v2/options.h | 2 +
be/src/olap/tablet_meta.cpp | 35 +
be/src/olap/tablet_schema.cpp | 120 ++
be/src/olap/tablet_schema.h | 29 +
be/src/util/string_util.h | 13 +-
be/src/vec/CMakeLists.txt | 6 -
be/src/vec/columns/column_decimal.cpp | 3 +
be/src/vec/common/hash_table/join_hash_map.h | 133 ++
be/src/vec/common/hash_table/join_hash_table.h | 733 ++++++++
be/src/vec/data_types/data_type_array.cpp | 159 +-
be/src/vec/exec/join/vhash_join_node.cpp | 264 +--
be/src/vec/exec/join/vhash_join_node.h | 60 +-
be/src/vec/exec/scan/new_olap_scan_node.cpp | 9 +
be/src/vec/exec/ves_http_scan_node.cpp | 447 -----
be/src/vec/exec/ves_http_scan_node.h | 113 --
be/src/vec/exec/ves_http_scanner.cpp | 52 -
be/src/vec/exec/vjdbc_connector.cpp | 2 +-
be/src/vec/exec/vjdbc_connector.h | 2 +-
be/src/vec/exec/vjdbc_scan_node.cpp | 173 --
be/src/vec/exec/vjdbc_scan_node.h | 68 -
be/src/vec/exec/vmysql_scan_node.h | 1 +
be/src/vec/exec/vodbc_scan_node.cpp | 249 ---
be/src/vec/exec/vodbc_scan_node.h | 87 -
be/src/vec/exec/volap_scan_node.cpp | 1843 --------------------
be/src/vec/exec/volap_scan_node.h | 346 ----
be/src/vec/exec/volap_scanner.cpp | 477 -----
be/src/vec/exec/volap_scanner.h | 153 --
be/src/vec/exec/vschema_scan_node.cpp | 24 +-
be/src/vec/exprs/vliteral.cpp | 2 +
.../function_date_or_datetime_computation.h | 2 +-
be/src/vec/functions/function_json.cpp | 100 +-
be/test/CMakeLists.txt | 1 +
be/test/exec/olap_common_test.cpp | 2 +-
be/test/vec/columns/column_decimal_test.cpp | 53 +
bin/start_be.sh | 2 +-
dist/LICENSE-dist.txt | 1 +
.../fe/manager/query-profile-action.md | 101 ++
docs/en/docs/data-operate/import/load-manual.md | 17 +
.../docs/ecosystem/external-table/odbc-of-doris.md | 26 +-
.../sql-functions/table-functions/numbers.md | 11 +-
.../sql-manual/sql-reference/Data-Types/ARRAY.md | 12 +-
.../fe/manager/query-profile-action.md | 102 ++
docs/zh-CN/docs/data-operate/import/load-manual.md | 18 +
.../docs/ecosystem/external-table/odbc-of-doris.md | 27 +-
.../sql-functions/table-functions/numbers.md | 11 +-
.../sql-manual/sql-reference/Data-Types/ARRAY.md | 13 +-
fe/fe-core/src/main/cup/sql_parser.cup | 23 +-
.../java/org/apache/doris/analysis/ColumnDef.java | 7 +-
.../apache/doris/analysis/CreateIndexClause.java | 6 +-
.../org/apache/doris/analysis/CreateTableStmt.java | 5 +-
.../org/apache/doris/analysis/DescribeStmt.java | 46 +-
.../java/org/apache/doris/analysis/IndexDef.java | 52 +-
.../apache/doris/analysis/InvertedIndexUtil.java | 56 +
.../org/apache/doris/analysis/SchemaTableType.java | 3 +-
.../org/apache/doris/analysis/ShowIndexStmt.java | 1 +
.../doris/analysis/TableValuedFunctionRef.java | 4 +-
.../main/java/org/apache/doris/catalog/Index.java | 56 +-
.../java/org/apache/doris/catalog/SchemaTable.java | 51 +-
.../main/java/org/apache/doris/common/Config.java | 4 +-
.../apache/doris/common/util/ProfileManager.java | 25 +-
.../apache/doris/datasource/InternalCatalog.java | 3 +-
.../httpv2/rest/manager/QueryProfileAction.java | 63 +-
.../glue/translator/RuntimeFilterTranslator.java | 5 +-
.../org/apache/doris/nereids/jobs/JobType.java | 1 +
.../doris/nereids/jobs/batch/AnalyzeRulesJob.java | 4 +-
.../doris/nereids/jobs/batch/BatchRulesJob.java | 7 +
.../jobs/batch/NereidsRewriteJobExecutor.java | 3 +
.../nereids/jobs/rewrite/VisitorRewriteJob.java | 56 +
.../java/org/apache/doris/nereids/memo/Group.java | 69 +-
.../apache/doris/nereids/memo/GroupExpression.java | 25 +-
.../java/org/apache/doris/nereids/memo/Memo.java | 66 +-
.../nereids/processor/post/PlanPostProcessors.java | 2 +-
.../processor/post/RuntimeFilterContext.java | 62 +-
.../processor/post/RuntimeFilterGenerator.java | 130 +-
.../org/apache/doris/nereids/rules/RuleType.java | 7 +-
.../nereids/rules/analysis/BindSlotReference.java | 11 +-
.../nereids/rules/analysis/CheckAnalysis.java | 21 +-
...egateFunctions.java => FillUpMissingSlots.java} | 31 +-
.../rules/rewrite/AggregateDisassemble.java | 9 +-
.../rules/rewrite/logical/InferPredicates.java | 117 ++
.../rewrite/logical/PredicatePropagation.java | 105 ++
.../rules/rewrite/logical/PullUpPredicates.java | 165 ++
.../apache/doris/nereids/stats/JoinEstimation.java | 21 +-
.../nereids/trees/expressions/Expression.java | 4 +
.../trees/expressions/functions/agg/Avg.java | 2 +-
.../trees/expressions/functions/agg/Sum.java | 4 +-
.../nereids/trees/plans/logical/LogicalJoin.java | 6 +
.../trees/plans/physical/RuntimeFilter.java | 44 -
.../apache/doris/nereids/types/DecimalType.java | 4 +-
.../java/org/apache/doris/nereids/util/Utils.java | 8 +
.../org/apache/doris/planner/SchemaScanNode.java | 2 +
.../java/org/apache/doris/qe/ShowExecutor.java | 2 +-
.../apache/doris/service/FrontendServiceImpl.java | 126 ++
.../apache/doris/statistics/OlapTableStats.java | 46 -
.../org/apache/doris/statistics/TableStats.java | 2 +-
.../org/apache/doris/statistics/TabletStats.java | 42 -
.../tablefunction/NumbersTableValuedFunction.java | 45 +-
.../doris/tablefunction/S3TableValuedFunction.java | 39 +-
.../doris/tablefunction/TableValuedFunctionIf.java | 4 +-
fe/fe-core/src/main/jflex/sql_scanner.flex | 1 +
.../doris/analysis/CreateIndexClauseTest.java | 2 +-
.../org/apache/doris/analysis/IndexDefTest.java | 6 +-
.../org/apache/doris/catalog/OlapTableTest.java | 4 +-
.../datasets/clickbench/AnalyzeClickBenchTest.java | 16 +-
.../nereids/datasets/tpch/AnalyzeTPCHTest.java | 5 +-
.../doris/nereids/datasets/tpch/TPCHUtils.java | 32 +-
.../org/apache/doris/nereids/memo/MemoTest.java | 8 +-
...ctionsTest.java => FillUpMissingSlotsTest.java} | 2 +-
.../nereids/postprocess/RuntimeFilterTest.java | 7 +-
.../rewrite/logical/AggregateDisassembleTest.java | 63 +
.../rules/rewrite/logical/InferPredicatesTest.java | 531 ++++++
.../nereids/trees/expressions/GetDataTypeTest.java | 2 +-
.../doris/nereids/util/LogicalPlanBuilder.java | 17 +-
.../persist/TableAddOrDropColumnsInfoTest.java | 2 +-
gensrc/proto/olap_file.proto | 15 +
gensrc/script/doris_builtins_functions.py | 4 +-
gensrc/thrift/Data.thrift | 9 +-
gensrc/thrift/Descriptors.thrift | 9 +-
gensrc/thrift/FrontendService.thrift | 16 +
gensrc/thrift/PlanNodes.thrift | 8 +
regression-test/data/ddl_p0/test_ctas.out | 8 +-
.../data/index_p0/test_bitmap_index.out | 92 +-
.../test_decimal_bitmap_index_multi_page.out | 2 +-
.../data/load_p0/broker_load/simple_array.csv | 3 +-
.../data/load_p0/broker_load/test_array_load.out | 4 +
.../data/load_p0/stream_load/test_stream_load.out | 4 +-
.../json_function/test_query_json_array.out | 15 +
.../json_function/test_query_json_object.out | 20 +-
.../data/query_p0/aggregate/aggregate.out | 3 +
.../cast_function/test_cast_string_to_array.out | 9 +-
.../suites/correctness/test_backends_table.groovy | 23 +-
.../table_valued_function/test_numbers.groovy | 134 +-
regression-test/suites/ddl_p0/test_ctas.groovy | 19 +-
.../http_rest_api/post/test_query_stmt.groovy | 2 +-
.../suites/index_p0/test_index_meta.groovy | 167 ++
..._object.groovy => test_query_json_array.groovy} | 31 +-
.../json_function/test_query_json_object.groovy | 27 +-
.../suites/query_p0/aggregate/aggregate.groovy | 2 +
.../datetime_functions/test_date_function.groovy | 2 +-
.../rollup/test_materialized_view_date.groovy | 8 +-
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q1.groovy | 77 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q10.groovy | 102 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q11.groovy | 91 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q12.groovy | 93 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q13.groovy | 77 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q14.groovy | 63 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q15.groovy | 94 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q16.groovy | 97 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q17.groovy | 73 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q18.groovy | 108 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q19.groovy | 106 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q2.groovy | 129 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q20.groovy | 99 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q21.groovy | 107 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q22.groovy | 110 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q3.groovy | 83 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q4.groovy | 77 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q5.groovy | 87 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q6.groovy | 54 +
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q7.groovy | 115 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q8.groovy | 112 ++
.../suites/tpch_sf1_p1/tpch_sf1/nereids/q9.groovy | 95 +
tools/ssb-tools/ssb-queries/q4.1.sql | 4 +-
tools/ssb-tools/ssb-queries/q4.2.sql | 4 +-
tools/ssb-tools/ssb-queries/q4.3.sql | 4 +-
186 files changed, 6557 insertions(+), 5143 deletions(-)
create mode 100644 be/src/exec/schema_scanner/schema_backends_scanner.cpp
rename be/src/{vec/exec/ves_http_scanner.h =>
exec/schema_scanner/schema_backends_scanner.h} (52%)
create mode 100644 be/src/olap/inverted_index_parser.cpp
copy be/src/olap/{rowset/segment_v2/options.h => inverted_index_parser.h} (50%)
create mode 100644 be/src/vec/common/hash_table/join_hash_map.h
create mode 100644 be/src/vec/common/hash_table/join_hash_table.h
delete mode 100644 be/src/vec/exec/ves_http_scan_node.cpp
delete mode 100644 be/src/vec/exec/ves_http_scan_node.h
delete mode 100644 be/src/vec/exec/ves_http_scanner.cpp
delete mode 100644 be/src/vec/exec/vjdbc_scan_node.cpp
delete mode 100644 be/src/vec/exec/vjdbc_scan_node.h
delete mode 100644 be/src/vec/exec/vodbc_scan_node.cpp
delete mode 100644 be/src/vec/exec/vodbc_scan_node.h
delete mode 100644 be/src/vec/exec/volap_scan_node.cpp
delete mode 100644 be/src/vec/exec/volap_scan_node.h
delete mode 100644 be/src/vec/exec/volap_scanner.cpp
delete mode 100644 be/src/vec/exec/volap_scanner.h
create mode 100644 be/test/vec/columns/column_decimal_test.cpp
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/InvertedIndexUtil.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/rewrite/VisitorRewriteJob.java
rename
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/{ResolveAggregateFunctions.java
=> FillUpMissingSlots.java} (86%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/logical/InferPredicates.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/logical/PredicatePropagation.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/logical/PullUpPredicates.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/OlapTableStats.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/statistics/TabletStats.java
rename
fe/fe-core/src/test/java/org/apache/doris/nereids/parser/{ResolveAggregateFunctionsTest.java
=> FillUpMissingSlotsTest.java} (99%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/logical/InferPredicatesTest.java
create mode 100644
regression-test/data/query/sql_functions/json_function/test_query_json_array.out
copy fe/fe-core/src/main/java/org/apache/doris/nereids/jobs/JobType.java =>
regression-test/suites/correctness/test_backends_table.groovy (73%)
create mode 100644 regression-test/suites/index_p0/test_index_meta.groovy
copy
regression-test/suites/query/sql_functions/json_function/{test_query_json_object.groovy
=> test_query_json_array.groovy} (53%)
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q1.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q10.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q11.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q12.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q13.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q14.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q15.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q16.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q17.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q18.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q19.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q2.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q20.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q21.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q22.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q3.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q4.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q5.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q6.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q7.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q8.groovy
create mode 100644
regression-test/suites/tpch_sf1_p1/tpch_sf1/nereids/q9.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
