This is an automated email from the ASF dual-hosted git repository.
starocean999 pushed a change to branch dev_rec
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 6bc1045f3e0 fix some bug in fe
omit 514eb623a3b recursive cte fe part
omit 617e1fbd4a7 add TRecCTEScanNode
omit 1f1e4ab46b6 add result_expr_lists to TRecCTENode
omit b5b4f52a255 update thrift
omit e88a70b3a97 update thrift
omit ab163f9c274 add rec cte thrift struct
add 3cf779fde47 [Chore](nereids) remove TableRef (#56661)
add 596cb9fac1a [feat](cloud): add file cache consistency check (#41280)
(#54295)
add 557efa356d2 [fix](test) fix unstable regression test (#56814)
add 00580dd417c [Fix](warmup) one-time and periodic warm up job should be
triggered regardless whether the rowset has been warmed up before (#56737)
add d20036ea29b [improvement](json load) Compatible with "$" and "$."
that appear during json load (#56703)
add 158a27f8d4b [opt](test) Use better way to check `enableStoragevault`
for regression test (#56847)
add 5a7ff703a2a [fix](UT) Fix cloud string codec test when len is 0
(#56859)
add a73b6e81042 [feature](function) support
sort_json_object_keys/normalize_json_numbers_to_double function (#56576)
add ac8833ef696 [improvement](load & cache) Set disable_file_cache to true
for load data into disposable LRU queue (#56637)
add f0f12729363 [test](streaming job) add streaming job restart fe test
(#56808)
add e917c59eb4c [fix](decimal256) fix unstable overflow error when casting
decimal256 to float (#56848)
add ff97e9ab6d9 [fix](regression) fix typo error for
suites/tpch_sf0.1_p1/sql/cse.groovy (#56857)
add ff904e45dd3 [test](streaming job) add streaming job auto resume test
(#56881)
add d0af6bad651 [fix](insert) do not register group commit and insert into
value job to load manager (#56852)
add 1d7967ae5be [minor](task) Remove unnecessary status result (#56863)
add 06bb48f90d7 [opt](regression) ./run-regression-test.sh support -f
parameter to run case in specified file (#56799)
add 8785a474926 [fix](DecimalV2)keep the original precision and scale in
get_data_type_with_default_argument (#56821)
add e09c08d11c5 [Fix](Chore) Fix cumu compaction fault injection case
(#56867)
add 6fca73394f9 [fix](tde) make get_exec_env interface static (#56820)
add 4db09207ae2 [feat](s3client) Use `CustomAwsCredentialsProviderChain`
for aws sdk (#56065)
new 6f5d84efaf6 add rec cte thrift struct
new 9040bad7b91 update thrift
new e26120d2325 update thrift
new c1e13dbc902 add result_expr_lists to TRecCTENode
new 6e02ee0c2c5 add TRecCTEScanNode
new e6f133b2aec recursive cte fe part
new 6dd5e0c531f fix some bug in fe
new cc1f62548e1 fix fe plan
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6bc1045f3e0)
\
N -- N -- N refs/heads/dev_rec (cc1f62548e1)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/cloud/cloud_internal_service.cpp | 16 +-
be/src/cloud/cloud_tablet.cpp | 129 ++--
be/src/cloud/cloud_tablet.h | 34 +-
be/src/cloud/cloud_warm_up_manager.cpp | 29 +-
be/src/cloud/cloud_warm_up_manager.h | 7 -
be/src/common/config.cpp | 5 +
be/src/common/config.h | 2 +
be/src/http/action/file_cache_action.cpp | 28 +-
be/src/io/cache/block_file_cache.cpp | 81 ++-
be/src/io/cache/block_file_cache.h | 5 +
be/src/io/cache/file_cache_common.cpp | 41 +-
be/src/io/cache/file_cache_common.h | 47 +-
be/src/io/cache/file_cache_storage.h | 7 +
be/src/io/cache/fs_file_cache_storage.cpp | 69 ++-
be/src/io/cache/fs_file_cache_storage.h | 3 +
be/src/pipeline/pipeline_task.cpp | 7 +-
be/src/runtime/runtime_state.cpp | 4 +-
be/src/util/s3_util.cpp | 51 +-
be/src/util/s3_util.h | 4 +
be/src/util/thrift_rpc_helper.h | 2 +-
be/src/vec/data_types/data_type_decimal.cpp | 16 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 16 +-
be/src/vec/exec/scan/file_scanner.cpp | 1 +
.../functions/cast/cast_to_basic_number_common.h | 9 +-
be/src/vec/functions/function_jsonb_transform.cpp | 188 ++++++
be/src/vec/functions/simple_function_factory.h | 2 +
be/test/cloud/cloud_tablet_test.cpp | 513 +++++++++++++---
be/test/http/file_cache_action_test.cpp | 163 +++++
be/test/io/cache/block_file_cache_test.cpp | 147 +++++
be/test/io/s3_client_factory_test.cpp | 106 ++++
be/test/pipeline/pipeline_task_test.cpp | 33 --
be/test/vec/function/cast/cast_to_float_double.cpp | 57 +-
cloud/src/common/config.h | 3 +
cloud/src/recycler/s3_accessor.cpp | 44 +-
cloud/src/recycler/s3_accessor.h | 6 +
cloud/test/codec_test.cpp | 48 +-
.../cpp/custom_aws_credentials_provider_chain.cpp | 103 ++++
.../cpp/custom_aws_credentials_provider_chain.h | 13 +-
.../main/java/org/apache/doris/common/Config.java | 4 +
.../org/apache/doris/analysis/BaseTableRef.java | 69 ---
.../org/apache/doris/analysis/LateralViewRef.java | 102 ----
.../java/org/apache/doris/analysis/TableRef.java | 656 ---------------------
.../doris/analysis/TableValuedFunctionRef.java | 126 ----
.../doris/catalog/BuiltinScalarFunctions.java | 6 +
.../java/org/apache/doris/common/util/S3Util.java | 63 +-
.../datasource/property/storage/S3Properties.java | 48 +-
.../glue/translator/PhysicalPlanTranslator.java | 13 +-
.../properties/ChildOutputPropertyDeriver.java | 10 +-
.../org/apache/doris/nereids/rules/RuleSet.java | 2 +
.../org/apache/doris/nereids/rules/RuleType.java | 1 +
.../doris/nereids/rules/analysis/AnalyzeCTE.java | 31 +-
...ChildToPhysicalRecursiveCteRecursiveChild.java} | 18 +-
.../doris/nereids/stats/StatsCalculator.java | 14 +
.../trees/copier/LogicalPlanDeepCopier.java | 8 +
...arse.java => NormalizeJsonNumbersToDouble.java} | 20 +-
.../{JsonbParse.java => SortJsonbObjectKeys.java} | 20 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 10 +
.../apache/doris/nereids/trees/plans/PlanType.java | 2 +
.../commands/insert/AbstractInsertExecutor.java | 5 +-
.../commands/insert/InsertIntoTableCommand.java | 7 +-
.../plans/commands/insert/OlapInsertExecutor.java | 3 +-
...java => LogicalRecursiveCteRecursiveChild.java} | 58 +-
.../PhysicalRecursiveCteRecursiveChild.java | 110 ++++
.../nereids/trees/plans/visitor/PlanVisitor.java | 12 +
.../apache/doris/planner/RecursiveCteScanNode.java | 6 +-
.../org/apache/doris/qe/NereidsCoordinator.java | 36 +-
.../doris/qe/runtime/ThriftPlansBuilder.java | 2 +-
.../property/storage/S3PropertiesTest.java | 7 +
regression-test/data/json_p0/simple_json.json | 8 +
regression-test/data/json_p0/test_json_root.out | 29 +
.../test_json_normalize_json_numbers_to_double.out | 46 ++
.../jsonb_p0/test_json_sort_json_object_keys.out | 37 ++
regression-test/data/tpch_sf0.1_p1/sql/cse.out | 38 +-
.../apache/doris/regression/RegressionTest.groovy | 31 +
.../org/apache/doris/regression/suite/Suite.groovy | 32 +-
.../suites/cloud_p0/cache/test_load_cache.groovy | 350 +++++++++++
.../http/test_check_file_cache_consistency.groovy | 141 +++++
.../test_single_replica_compaction.groovy | 3 +-
.../decimalv2/test_decimalv2_rqg.groovy | 59 ++
...st_cumu_compaction_delay_fault_injection.groovy | 5 +
.../insert_overwrite_auto_detect.groovy | 16 +-
.../test_streaming_job_auto_resume.groovy | 113 ++++
.../test_streaming_job_restart_fe.groovy | 123 ++++
.../suites/json_p0/test_json_root.groovy | 159 +++++
...st_json_normalize_json_numbers_to_double.groovy | 113 ++++
.../test_json_sort_json_object_keys.groovy | 100 ++++
.../load_p0/insert/test_insert_statistic.groovy | 29 +-
.../nereids_p0/show/test_nereids_show_load.groovy | 4 +-
.../suites/tpch_sf0.1_p1/sql/cse.groovy | 2 +-
run-regression-test.sh | 70 ++-
90 files changed, 3589 insertions(+), 1427 deletions(-)
create mode 100644 be/src/vec/functions/function_jsonb_transform.cpp
create mode 100644 be/test/http/file_cache_action_test.cpp
create mode 100644 be/test/io/s3_client_factory_test.cpp
create mode 100644 common/cpp/custom_aws_credentials_provider_chain.cpp
copy be/src/http/action/pprof_actions.h =>
common/cpp/custom_aws_credentials_provider_chain.h (75%)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/BaseTableRef.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/LateralViewRef.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/TableRef.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/TableValuedFunctionRef.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/implementation/{LogicalRecursiveCteToPhysicalRecursiveCte.java
=> LogicalRecursiveCteRecursiveChildToPhysicalRecursiveCteRecursiveChild.java}
(64%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonbParse.java
=> NormalizeJsonNumbersToDouble.java} (77%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonbParse.java
=> SortJsonbObjectKeys.java} (78%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/{LogicalPreAggOnHint.java
=> LogicalRecursiveCteRecursiveChild.java} (58%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/physical/PhysicalRecursiveCteRecursiveChild.java
create mode 100644 regression-test/data/json_p0/simple_json.json
create mode 100644 regression-test/data/json_p0/test_json_root.out
create mode 100644
regression-test/data/jsonb_p0/test_json_normalize_json_numbers_to_double.out
create mode 100644
regression-test/data/jsonb_p0/test_json_sort_json_object_keys.out
create mode 100644 regression-test/suites/cloud_p0/cache/test_load_cache.groovy
create mode 100644
regression-test/suites/cloud_p2/cache/http/test_check_file_cache_consistency.groovy
create mode 100644
regression-test/suites/datatype_p0/decimalv2/test_decimalv2_rqg.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/test_streaming_job_auto_resume.groovy
create mode 100644
regression-test/suites/job_p0/streaming_job/test_streaming_job_restart_fe.groovy
create mode 100644 regression-test/suites/json_p0/test_json_root.groovy
create mode 100644
regression-test/suites/jsonb_p0/test_json_normalize_json_numbers_to_double.groovy
create mode 100644
regression-test/suites/jsonb_p0/test_json_sort_json_object_keys.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
