This is an automated email from the ASF dual-hosted git repository. airborne pushed a change to branch auto-pick-44973-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git
omit deb9255a2f9 [feat](test) add fe ut for bf index create table (#44973) add 8de08c83476 branch-3.0: [improvement](information_schema)Support show default value in information_schema. #44849 (#45079) add 45fb516d74e branch-3.0: [fix](recycler) Process self-defined domain names for s3 storage vault #45072 (#45100) add d1c20c46e21 branch-3.0: [opt](cloud) reset ms response message in case it is reused for retry #45068 (#45112) add 3f3a9f42c4b branch-3.0: [fix](runtime_profile) fix race condition in to_thrift #45047 (#45098) add e6629acf720 branch-3.0: [fix](editlog) Fix replay BatchDropInfo #45077 (#45101) add acae6ad059a branch-3.0: [fix](jdbc catalog) set `enable_jdbc_cast_predicate_push_down` default true #44548 (#44759) add 0525ed7d285 branch-3.0: [fix](routine load) fix invalid EOF tasks scheduling delay #44949 (#45087) add f4b98400783 branch-3.0: [Fix](merge-on-write) Add defensive check before partial update #44687 (#45082) add 054ae34b560 [improvement](compaction) reduce tablet skip compaction time (#44273) (#44794) add 15c3807f91f branch-3.0: [enchement](mc)mc catalog append netowrk config #44194 (#45074) add 7df5c10fc0f branch-3.0: [fix](hudi)Add hudi catalog read partition table partition prune #44669 (#45111) add 9add76b4d24 branch-3.0: [bugfix](hive)Fix split assignment leak. releated to issue (#40683). #44845 (#45143) add a364a715acd branch-3.0: [chore](job-test)Add comments to the job's test cases #44627 (#45141) add 16d5f027695 branch-3.0: [Fix](http)Enhanced Security Checks for Audit Log File Names #44612 (#44832) add d5f4d455d08 branch-3.0: [fix](case)fix manager show proc case unstable. #45040 (#45139) add 3ed7c556e19 branch-3.0: [feat](catalog)Replace HadoopUGI with HadoopKerberosAuthenticator to Support Kerberos Ticket Auto-Renewal #44916 (#45137) add fcd2ee74757 [fix](branch-3.0) Fix the data type mapping for complex types in Doris to the ORC and Parquet file formats (#45122) add bdd5e953192 branch-3.0: [Fix](job)Fix CAS competition failure leading to message publishing failure. #45018 (#45029) add abe8f22a061 branch-3.0: [enhance](mtmv)Optimize MTMV lock logic #44967 (#45014) add 7c94ac5854a [fix](auth) Prohibit deleting admin user (#44751) (#45084) add e9a60c4acf0 [fix](auth)Fix the need for low-level table permissions when querying views in certain situations (#44621) (#44841) add 860f7d057ac [feat](iceberg)Supports using `rest` type catalog to read tables in unity catalog for 3.0 (#43525) (#45161) add 46bd816f42d [opt](inverted index) Optimize the codes exception handling process #44205 #44601 (#44862) add 90ffe9068be [feat](nereids) adjust min/max for partition key #41729 branch-3.0 (#45110) add 0bd1aba0ca5 [cherry-pick](branch3.0) impl scalar functions trim_in, ltrim_in and rtrim_in (#42642) add 1d12f779790 branch-3.0: [fix](regression-test) Fix potential multi FE desc table result not refresh after schema change #44989 (#45008) add 7fe32e93969 [fix](bloomFilter)fix data type supported behavior same in FE and BE (#42416) (#45180) add 5cc648026bc [feat](test) add fe ut for bf index create table (#44973) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (deb9255a2f9) \ N -- N -- N refs/heads/auto-pick-44973-branch-3.0 (5cc648026bc) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: be/src/common/config.cpp | 4 +- be/src/common/config.h | 1 + .../exec/schema_scanner/schema_columns_scanner.cpp | 14 +- be/src/io/fs/file_system.cpp | 34 +- be/src/io/fs/file_system.h | 2 +- be/src/io/fs/local_file_system.cpp | 50 ++ be/src/io/fs/local_file_system.h | 6 +- be/src/io/fs/remote_file_system.cpp | 10 +- be/src/io/fs/remote_file_system.h | 8 +- be/src/io/fs/s3_file_system.h | 7 +- .../olap/rowset/segment_v2/inverted_index_common.h | 103 ++++ .../segment_v2/inverted_index_file_writer.cpp | 86 ++-- .../rowset/segment_v2/inverted_index_file_writer.h | 8 +- .../rowset/segment_v2/inverted_index_writer.cpp | 45 +- be/src/olap/rowset/segment_v2/segment_writer.cpp | 39 +- be/src/olap/rowset/segment_v2/segment_writer.h | 1 + .../rowset/segment_v2/vertical_segment_writer.cpp | 37 +- .../rowset/segment_v2/vertical_segment_writer.h | 1 + be/src/olap/tablet.cpp | 4 +- be/src/util/arrow/row_batch.cpp | 9 +- be/src/util/runtime_profile.cpp | 5 +- .../data_types/serde/data_type_bitmap_serde.cpp | 59 ++- .../vec/data_types/serde/data_type_bitmap_serde.h | 13 +- .../data_types/serde/data_type_date64_serde.cpp | 20 +- .../vec/data_types/serde/data_type_hll_serde.cpp | 48 +- .../vec/data_types/serde/data_type_ipv6_serde.cpp | 37 +- .../vec/data_types/serde/data_type_jsonb_serde.cpp | 28 +- .../data_types/serde/data_type_number_serde.cpp | 36 +- .../data_types/serde/data_type_object_serde.cpp | 35 ++ .../vec/data_types/serde/data_type_object_serde.h | 4 +- .../serde/data_type_quantilestate_serde.h | 56 ++- be/src/vec/data_types/serde/data_type_serde.h | 12 + be/src/vec/exec/format/parquet/schema_desc.cpp | 17 + be/src/vec/exec/format/parquet/schema_desc.h | 8 + be/src/vec/exec/format/parquet/vparquet_reader.cpp | 6 +- be/src/vec/exec/format/parquet/vparquet_reader.h | 2 +- be/src/vec/exec/format/table/iceberg_reader.cpp | 48 +- be/src/vec/exec/format/table/iceberg_reader.h | 2 +- .../exec/format/table/max_compute_jni_reader.cpp | 6 +- be/src/vec/functions/function_string.cpp | 160 +++++- be/test/io/fs/local_file_system_test.cpp | 50 ++ .../common/inverted_index_common_test.cpp | 343 +++++++++++++ cloud/src/meta-service/meta_service.h | 1 + cloud/src/recycler/s3_accessor.cpp | 3 +- cloud/src/recycler/s3_accessor.h | 1 + cloud/src/recycler/s3_obj_client.cpp | 1 + cloud/test/s3_accessor_test.cpp | 68 +++ .../java/org/apache/doris/hudi/HudiJniScanner.java | 16 +- .../src/main/java/org/apache/doris/hudi/Utils.java | 12 +- .../doris/maxcompute/MaxComputeJniScanner.java | 47 +- .../common/security/authentication/HadoopUGI.java | 103 ---- .../org/apache/doris/analysis/DropUserStmt.java | 4 +- .../org/apache/doris/analysis/OutFileClause.java | 21 +- .../org/apache/doris/analysis/UserIdentity.java | 4 + .../doris/catalog/BuiltinScalarFunctions.java | 6 + .../main/java/org/apache/doris/catalog/Column.java | 14 + .../main/java/org/apache/doris/catalog/Env.java | 46 +- .../main/java/org/apache/doris/catalog/MTMV.java | 2 +- .../java/org/apache/doris/catalog/OlapTable.java | 20 +- .../apache/doris/common/util/PropertyAnalyzer.java | 5 +- .../apache/doris/datasource/ExternalCatalog.java | 6 + .../org/apache/doris/datasource/FileScanNode.java | 1 - .../doris/datasource/hive/HMSExternalCatalog.java | 20 +- .../doris/datasource/hive/HMSExternalTable.java | 26 +- .../datasource/hive/HiveMetaStoreClientHelper.java | 20 +- .../apache/doris/datasource/hudi/HudiUtils.java | 50 ++ .../doris/datasource/hudi/source/HudiScanNode.java | 71 +-- .../datasource/iceberg/IcebergExternalCatalog.java | 3 +- .../datasource/iceberg/IcebergMetadataCache.java | 14 +- .../datasource/iceberg/IcebergMetadataOps.java | 69 ++- .../iceberg/IcebergRestExternalCatalog.java | 2 - .../datasource/iceberg/IcebergTransaction.java | 3 +- .../maxcompute/MaxComputeExternalCatalog.java | 57 +++ .../maxcompute/source/MaxComputeScanNode.java | 13 + .../operations/ExternalMetadataOperations.java | 4 +- .../datasource/operations/ExternalMetadataOps.java | 4 + .../datasource/paimon/PaimonExternalCatalog.java | 88 ++-- .../property/constants/MCProperties.java | 8 + .../apache/doris/httpv2/rest/GetLogFileAction.java | 38 +- .../apache/doris/job/disruptor/TaskDisruptor.java | 11 +- .../apache/doris/job/scheduler/JobScheduler.java | 4 +- .../load/routineload/RoutineLoadTaskScheduler.java | 2 +- .../org/apache/doris/mtmv/MTMVPartitionUtil.java | 16 +- .../org/apache/doris/nereids/StatementContext.java | 10 + .../glue/translator/PhysicalPlanTranslator.java | 2 + .../nereids/rules/rewrite/CheckPrivileges.java | 6 +- .../doris/nereids/stats/StatsCalculator.java | 131 +++++ .../functions/executable/StringArithmetic.java | 69 +++ .../expressions/functions/scalar/LtrimIn.java | 84 ++++ .../expressions/functions/scalar/RtrimIn.java | 84 ++++ .../trees/expressions/functions/scalar/TrimIn.java | 84 ++++ .../expressions/visitor/ScalarFunctionVisitor.java | 15 + .../trees/plans/commands/ExplainCommand.java | 4 + .../plans/commands/info/ShowCreateMTMVInfo.java | 13 +- .../trees/plans/logical/LogicalHudiScan.java | 2 +- .../org/apache/doris/persist/BatchDropInfo.java | 4 + .../java/org/apache/doris/persist/DropInfo.java | 2 +- .../java/org/apache/doris/persist/EditLog.java | 22 +- .../java/org/apache/doris/qe/SessionVariable.java | 2 +- .../java/org/apache/doris/qe/ShowExecutor.java | 12 +- .../apache/doris/service/FrontendServiceImpl.java | 4 + .../apache/doris/httpv2/GetLogFileActionTest.java | 60 +++ gensrc/thrift/FrontendService.thrift | 1 + gensrc/thrift/PlanNodes.thrift | 4 + .../data/account_p0/test_information_schema.out | 7 + .../outfile/test_outfile_complex_type.out | 25 + .../outfile/test_outfile_jsonb_and_variant.out | 25 + .../iceberg/iceberg_read_unitycatalog_table.out | 40 ++ .../hudi/test_hudi_partition_prune.out | 357 ++++++++++++++ .../string_functions/test_trim_in.out | 547 +++++++++++++++++++++ .../org/apache/doris/regression/suite/Suite.groovy | 2 + .../account_p0/test_information_schema.groovy | 22 + .../suites/account_p0/test_system_user.groovy | 39 ++ .../suites/auth_p0/test_select_view_auth.groovy | 89 ++++ .../bloom_filter_p0/test_bloom_filter.groovy | 33 ++ .../outfile/test_outfile_complex_type.groovy | 106 ++++ .../outfile/test_outfile_jsonb_and_variant.groovy | 104 ++++ .../iceberg/iceberg_read_unitycatalog_table.groovy | 62 +++ .../jdbc/test_clickhouse_jdbc_catalog.groovy | 6 - .../jdbc/test_jdbc_catalog_push_cast.groovy | 2 + .../hudi/test_hudi_partition_prune.groovy | 333 +++++++++++++ .../test_external_catalog_maxcompute.groovy | 5 +- .../test_inverted_index_writer_exception.groovy | 89 ++++ .../suites/job_p0/test_base_insert_job.groovy | 42 +- .../suites/manager/test_manager_interface_1.groovy | 122 ----- .../suites/manager/test_manager_interface_4.groovy | 146 ++++++ .../string_functions/test_trim_in.groovy | 204 ++++++++ 127 files changed, 4629 insertions(+), 761 deletions(-) create mode 100644 be/src/olap/rowset/segment_v2/inverted_index_common.h create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/common/inverted_index_common_test.cpp delete mode 100644 fe/fe-common/src/main/java/org/apache/doris/common/security/authentication/HadoopUGI.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/LtrimIn.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/RtrimIn.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/TrimIn.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/httpv2/GetLogFileActionTest.java create mode 100644 regression-test/data/export_p0/outfile/test_outfile_complex_type.out create mode 100644 regression-test/data/export_p0/outfile/test_outfile_jsonb_and_variant.out create mode 100644 regression-test/data/external_table_p0/iceberg/iceberg_read_unitycatalog_table.out create mode 100644 regression-test/data/external_table_p2/hudi/test_hudi_partition_prune.out create mode 100644 regression-test/data/query_p0/sql_functions/string_functions/test_trim_in.out create mode 100644 regression-test/suites/account_p0/test_system_user.groovy create mode 100644 regression-test/suites/auth_p0/test_select_view_auth.groovy create mode 100644 regression-test/suites/export_p0/outfile/test_outfile_complex_type.groovy create mode 100644 regression-test/suites/export_p0/outfile/test_outfile_jsonb_and_variant.groovy create mode 100644 regression-test/suites/external_table_p0/iceberg/iceberg_read_unitycatalog_table.groovy create mode 100644 regression-test/suites/external_table_p2/hudi/test_hudi_partition_prune.groovy create mode 100644 regression-test/suites/inverted_index_p0/test_inverted_index_writer_exception.groovy create mode 100644 regression-test/suites/manager/test_manager_interface_4.groovy create mode 100644 regression-test/suites/query_p0/sql_functions/string_functions/test_trim_in.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org