This is an automated email from the ASF dual-hosted git repository. dataroaring pushed a change to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git
from b240a393747 [Bug](agg-state) set agg_state's be_exec_version on cloud mode (#36822) new d9589864ad7 [improvement](mysql catalog) disable mysql AbandonedConnectionCleanup Thread (#36655) new d66b29242aa [Feature](json_functions) support json-keys (#36411) new 836274e4522 [chore](client) Reopen client if exception is catched (#36808) new 2a274af831c [Bug](materialized-view) fix result is nulable have wrong value on multi_distinct_sum (#36766) new 202a2cee858 [fix](statistics)Use ConcurrentHashMap to avoid ConcurrentModificationException (#36452) new 96fda76d0d9 [test](mtmv)Add predicate filter case for various join methods (#32888) new f3200c44334 [minor](compile) Fix compiling in debug mode (#36838) new d6576d55d1f [Fix](inverted index) fix wrong segment file path when doing segcompaction (#36825) new 3632df71233 [fix](cloud) Disable stream load and http stream 2PC for MoW table (#36816) new 5dbe997b321 [fix](statistics)Fix select mv with specified partitions bug. (#36817) new fc8d749a4c9 [Chore](execution) remove unused function get_least_supertype (#36743) new be5f699e1b3 [chore](Azure) Print Azure request failed message (#36794) new 2125f70f1f5 [fix](fe) Skip building MTMV cache in the checking compatibility mode (#36844) new 5087f7d7650 [fix](arrow-flight-sql) Fix arrow flight result sink (#36827) new 64f1c90c0ff [fix](protocol) only return multi result when CLIENT_MULTI_STATEMENTS been set (#36759) new 3060f4f3890 [improve](udf) support java-udf static load (#34980) new 5519241e02d [ci](cloud) adjust regression conf (#36846) new 34839a347cb [test](mtmv)add join infer and derive test case (#32860) new 940cbbe235f [fix](generated column) static variables should not be used in ExpressionToExpr (#36824) new 61da3a07f65 [regression-test](prepared statement) fix unstable prepared_stmt_p0 (#36833) new b0f65ae8e35 [fix](schemachange) Avoid drop index in checking compatibility mode and checkpoint thread (#36820) new 7d09230ed6b [Chore](GA)Use github's codeowner to implement maintainer review (#36852) new c1fe915f93f [Fix](delete command) Mark delete sign when do delete command in MoW table (#35917) new f21c845687d [case](udf) Only one backend, skip scp udf file (#36810) new 91768833b69 [test] fix workload policy test failed (#36837) new 1efbb90b052 [fix](array)fix array with empty arg in be behavior (#36845) new d269560e588 [test](mtmv)Add group by aggregate negative case (#36562) new bb59b4df273 [opt](Nereids) Optimize findValidItems method to handle circular dependencies (#36839) new 0c5ce6e0546 [enhance](Azure) Check delete operation's response on Azure Blob Storage (#36800) new f44dcd2f425 [fix](spill) fix memory orphan check failure of partitioned hash join (#36806) new 5821f0f93bb [refactor](inverted index) Refactor the idx storage format to avoid cyclic references in Thrift files. (#36757) new 470030e4ce5 [fix](pipeline) fix exception safety issue in MultiCastDataStreamer (#36748) new 6731e94231f [test]add check for query release when p0 finish (#36660) new 8d4e6e23108 [bug](meta) fix can't deserialize meta from gson about polymorphic function class (#36847) new d22f4b14e45 [enhance](mtmv)support partition tvf (#36479) new 978aba32bca [improvement](meta) Switch meta serialization to gson 4 (#36568) new e945a1b5815 [fix](load) fix no error url if no partition can be found (#36831) new 49df2694238 [improvement](clone) dead be will abort sched task (#36795) new 2589dd5bdf5 [improvement](balance) partition rebalance chose disk by rr (#36826) new f0951e172e3 [chore](rpc) Throw exception when use RPC in ckpt thread or the compatiblility mode (#36856) new afde3109137 [fix](load) Fix wrong results for high-concurrent loading (#36841) new 9a9fb7d8052 [feat](Nereids) after partition prune, output rows of scan node only contains rows from selected partitions (#36760) new 3934e21c2f2 [chore](query) print query id when killed by timeout checker (#36868) new 6f924c7fdf3 [fix](regression test) Disable the case in cloud mode (#36769) new fd6ecbc9b42 [Featrue](default value) add pi as default value (#36280) new 51ab613b275 [Enhance](Routine Load) enhance routine load get topic metadata (#35651) new af68f527e5d [fix](test)fix regression test case failure (#36391) new 8c5eddf7d2e [enhancement](compaction) adjust compaction concurrency based on compaction score and workload (#36672) new 230d7ff94e1 [regression](kerberos)add hive kerberos docker regression env (#36430) new 2bc30552971 [test](auth)add upgrade and downgrade compatibility test case (#34489) new 82d98671d29 [Chore](test) add WideInteger unit test from clickhouse (#36752) new 08de3637b2e [Refactor](scanner) remove the unless timer in scanner (#36746) new 8b19a6cc984 [feature](Azure) Implement generate_presigned_url function for Azure object client (#36829) new 1256101233d [fix](bitmap) incorrect type of BitmapValue with fastunion (#36834) new 5f3abcc92ea [fix](tvf) Partition columns in CTAS need to be compatible with the STRING type of external tables/TVF (#35489) new 4bbc7d41dbb [Improvement](multicatalog) support read tencent dlc table on lakefs (#36823) new f472248665b [fix](ms) Fix txn approximate size (#36880) new f67517b849a [enhancement](regression-test) fix data comparison error (#36821) new 08588c494ee [chore](autobucket) add autobucket test and log (#36874) new 54d74cbcd9c [fix](oom) avoid oom when a lot of tablets fail on load (#36873) new 074b75bb12d [Fix]add log when npe (#36876) new fff9f4a40ad [Regression test]Add some partition test for streamload 2pc regression test (#36379) new b99b3fd6715 [regression] add regression-test for s3 tvf (#35406) new e50cade2969 [opt](log)password should not be output in log (#34324) new ce9e274d0c6 [refactor](nereids) Remove SlotBinder and FunctionBinder (#36872) new 16912fbc9b6 [fix](loadcase) error message changes (#36903) new 081e219d26f [test](migrate) move 2 cases from p2 to p0 (#36787) new cc26e6b5f05 [Feat](Nereids) support use cbo rule hint (#35925) new f4f09b7e13b [opt](s3) auto retry when meeting 429 error (#35396) new 81aa4c3d38f [fix](statistics) External table partition stats improve and add test case. (#36884) new d3874d5f6eb [feat](Nereids) push down predicates with multi columns through LogicalWindow and LogicalPartitionTopN (#36828) new c6c63535430 [chore](memo) record every group expression est. rows (#36879) new 4a2c7552259 [improvement](sqlserver catalog) Configurable whether to use encrypt when connecting to SQL Server using the catalog (#36659) new a44b29691b4 [fix](regression-case) add wait for partition_col_stats case (#36899) new 607461b870e [fix](script) do not prepare lakesoul data when --stop (#36181) new 9994c5f4b23 [fix](Azure) Use robust logic to check there is no multipart upload for Azure (#36904) new d6d27870725 [optimize](restore) update replica version after restore (#36148) new bc8fdf3805e [fix](restore) avoid NPE for restore job (#36395) new 9dbd24a6fa4 [feature](Azure) Implement azure table value function (#36917) new 7caa0c721c1 [fix](fe) CloudPartition returns cached version in the checkpoint thread (#36933) new c3bfc4d6755 [chore](restore) Log partition visible version (#36920) new a82d437597c [fix](group commit) Group commit http stream should not begin txn (#36926) new dfad8877cad [enhancement](compaction) optimizing memory usage for compaction (#36492) new 3b9baac876b [fix](fe ut) fix unstable SystemInfoServiceTest (#36893) new d14a5ebca3e [improvement](partition rebalance) improve partition rebalance choose candidate speed (#36509) new 46ca397d762 [fix](regression) fix regression test case failure (#36870) new 193044a24a3 [fix](cloud) Fix loss some tag info in cloud (#36866) new 0629c562518 [opt](mow) reduce memory usage for mow table compaction (#36865) new 7f80190486e [improvement](statistics)Use real base index id to fetch stats cache. (#36914) new 80d30ce543b [refactor](minor) Delete non-pipeline profile reporting (#36952) new aae4f81477d [fix](autoinc) avoid duplicated auto inc when role of fe changes (#36960) new 9a160a03db8 [fix](doap) Fix DOAP syntax (#36956) new 8d2a260ffc7 [test](statisitics)Add partition stats test for mtmv. (#36849) new 8a6f1ade71e [test](tvf) move p2 tvf tests from p2 to p0 (#36871) new c99001d2b7e [enhancement](index compaction) Enable index compaction by default (#36812) new 405ecde16ae [fix](inverted index)Make build index operation only affect base index (#36869) new 70512be3de7 [tests](inverted index)Add and improve add/drop index cases (#36811) new d32d2974e05 [feat](function) Function to encode/decode varchar (#36649) new 42ca7f8acc3 [Bug](cast) fix cast string to int return wrong result (#36788) new d8353739da3 [Fix](Prepared Statment) use fixed charset to init StringLiteral (#36860) new 296d439b72c [mv](nereids) add expression cost to filter (#36789) new 7ad2ce07930 [feature](Azure) Consider delete non-existent file always successful on Azure (#36932) new b3d40668af0 [improvement](statistics)Disable fetch stats for iceberg table through Iceberg api by default. (#36931) new 2d4f44b2135 [refactor](pipeline) Delete unused functions (#36972) new 29ff425267d [Fix](partial) Fix partial update delete case (#36985) new b64a84d7e34 [opt](function) Optimize the trim function for single-char inputs (#36497) new fef6c7df5b8 [Fix](Variant) fix variant partial update with row store enabled (#36793) The 107 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .asf.yaml | 1 + .github/CODEOWNERS | 18 + .licenserc.yaml | 2 +- be/src/agent/agent_server.cpp | 3 + be/src/agent/heartbeat_server.cpp | 7 +- be/src/agent/task_worker_pool.cpp | 8 + be/src/agent/task_worker_pool.h | 2 + be/src/agent/utils.cpp | 18 +- be/src/cloud/cloud_base_compaction.cpp | 10 + be/src/cloud/cloud_cumulative_compaction.cpp | 13 +- be/src/common/config.cpp | 18 +- be/src/common/config.h | 17 +- be/src/http/action/http_stream.cpp | 3 + be/src/http/action/stream_load.cpp | 3 + be/src/io/file_factory.cpp | 2 +- be/src/io/fs/azure_obj_storage_client.cpp | 183 ++- be/src/io/fs/azure_obj_storage_client.h | 5 +- be/src/io/fs/obj_storage_client.h | 12 +- be/src/io/fs/s3_file_reader.cpp | 109 +- be/src/io/fs/s3_file_reader.h | 24 +- be/src/io/fs/s3_file_system.cpp | 5 +- be/src/io/fs/s3_file_writer.cpp | 20 +- be/src/io/fs/s3_obj_storage_client.cpp | 21 +- be/src/io/fs/s3_obj_storage_client.h | 2 +- be/src/olap/base_compaction.cpp | 10 + be/src/olap/base_tablet.cpp | 8 +- be/src/olap/base_tablet.h | 5 + be/src/olap/compaction.cpp | 68 +- be/src/olap/compaction.h | 2 + be/src/olap/cumulative_compaction.cpp | 15 +- be/src/olap/iterators.h | 15 +- be/src/olap/merger.cpp | 67 +- be/src/olap/merger.h | 6 +- be/src/olap/olap_server.cpp | 85 +- be/src/olap/rowset/rowset_meta.h | 15 + be/src/olap/rowset/segcompaction.cpp | 2 +- be/src/olap/rowset/segment_v2/segment_writer.cpp | 2 +- be/src/olap/storage_engine.cpp | 20 - be/src/olap/tablet_meta.cpp | 28 +- be/src/olap/tablet_meta.h | 4 +- be/src/olap/tablet_reader.h | 2 + be/src/olap/utils.h | 2 + be/src/pipeline/exec/multi_cast_data_streamer.cpp | 20 +- be/src/pipeline/exec/multi_cast_data_streamer.h | 2 - .../exec/partitioned_hash_join_sink_operator.cpp | 22 +- be/src/pipeline/exec/result_sink_operator.cpp | 3 +- be/src/pipeline/exec/scan_operator.cpp | 6 - be/src/pipeline/exec/scan_operator.h | 6 - be/src/pipeline/pipeline_fragment_context.cpp | 3 +- be/src/runtime/buffer_control_block.cpp | 13 +- be/src/runtime/buffer_control_block.h | 4 + be/src/runtime/fragment_mgr.cpp | 70 +- be/src/runtime/group_commit_mgr.cpp | 31 +- be/src/runtime/group_commit_mgr.h | 1 + be/src/runtime/query_context.h | 1 - be/src/runtime/routine_load/data_consumer.cpp | 2 +- be/src/util/bitmap_value.h | 5 +- be/src/util/jni-util.cpp | 20 + be/src/util/jni-util.h | 3 + be/src/util/s3_util.h | 1 + .../src/util/simd/reverse_copy_bytes.h | 31 +- be/src/util/simd/vstring_function.h | 196 +-- be/src/util/string_parser.hpp | 5 + be/src/util/system_metrics.cpp | 4 + be/src/util/system_metrics.h | 2 + be/src/vec/columns/column_object.cpp | 18 +- be/src/vec/columns/column_object.h | 8 - be/src/vec/common/schema_util.cpp | 159 +-- be/src/vec/common/schema_util.h | 11 - be/src/vec/data_types/get_least_supertype.cpp | 368 +---- be/src/vec/data_types/get_least_supertype.h | 27 +- .../data_types/serde/data_type_object_serde.cpp | 10 +- be/src/vec/exec/scan/mysql_scanner.cpp | 6 +- be/src/vec/exec/scan/vmeta_scanner.cpp | 23 + be/src/vec/exec/scan/vmeta_scanner.h | 2 + .../functions/array/function_array_constructor.cpp | 10 +- be/src/vec/functions/function_decode_varchar.cpp | 123 ++ be/src/vec/functions/function_encode_varchar.cpp | 115 ++ be/src/vec/functions/function_jsonb.cpp | 174 +++ be/src/vec/functions/function_map.cpp | 19 +- be/src/vec/functions/function_string.cpp | 54 +- be/src/vec/functions/simple_function_factory.h | 4 + be/src/vec/olap/vertical_block_reader.cpp | 18 +- be/src/vec/olap/vertical_block_reader.h | 3 +- be/src/vec/olap/vertical_merge_iterator.cpp | 29 +- be/src/vec/olap/vertical_merge_iterator.h | 25 +- be/src/vec/runtime/vdata_stream_recvr.cpp | 19 - be/src/vec/runtime/vdata_stream_recvr.h | 11 - be/src/vec/sink/vrow_distribution.cpp | 17 +- be/test/olap/base_compaction_test.cpp | 84 ++ be/test/olap/rowid_conversion_test.cpp | 6 +- be/test/util/bitmap_value_test.cpp | 23 + be/test/vec/common/pod_array_test.cpp | 3 + be/test/vec/common/wide_integer_test.cpp | 197 +++ be/test/vec/core/get_common_type_test.cpp | 4 +- .../function_compressed_materialization_test.cpp | 225 +++ be/test/vec/olap/vertical_compaction_test.cpp | 14 +- cloud/src/meta-service/txn_kv.cpp | 2 +- cloud/src/recycler/azure_obj_client.cpp | 160 ++- cloud/src/recycler/obj_store_accessor.h | 1 + doap_Doris.rdf | 6 +- .../data/multi_catalog/datev2_csv/create_table.hql | 20 + .../data/multi_catalog/datev2_csv/data.tar.gz | Bin 0 -> 184 bytes .../scripts/data/multi_catalog/datev2_csv/run.sh | 13 + .../data/multi_catalog/datev2_orc/create_table.hql | 20 + .../data/multi_catalog/datev2_orc/data.tar.gz | Bin 0 -> 459 bytes .../scripts/data/multi_catalog/datev2_orc/run.sh | 13 + .../multi_catalog/datev2_parquet/create_table.hql | 20 + .../data/multi_catalog/datev2_parquet/data.tar.gz | Bin 0 -> 384 bytes .../data/multi_catalog/datev2_parquet/run.sh | 13 + .../hive_upper_case_orc/create_table.hql | 21 + .../multi_catalog/hive_upper_case_orc/data.tar.gz | Bin 0 -> 521 bytes .../data/multi_catalog/hive_upper_case_orc/run.sh | 13 + .../hive_upper_case_parquet/create_table.hql | 21 + .../hive_upper_case_parquet/data.tar.gz | Bin 0 -> 690 bytes .../multi_catalog/hive_upper_case_parquet/run.sh | 13 + .../parquet_lz4_compression/create_table.hql | 31 + .../parquet_lz4_compression/data.tar.gz | Bin 0 -> 11375 bytes .../multi_catalog/parquet_lz4_compression/run.sh | 13 + .../parquet_lzo_compression/create_table.hql | 31 + .../parquet_lzo_compression/data.tar.gz | Bin 0 -> 28433 bytes .../multi_catalog/parquet_lzo_compression/run.sh | 13 + .../test_compress_partitioned}/create_table.hql | 56 +- .../multi_catalog/test_compress_partitioned/run.sh | 22 + .../data/regression/crdmm_data/create_table.hql | 162 +++ .../scripts/data/regression/crdmm_data/data.tar.gz | Bin 0 -> 2035 bytes .../hive/scripts/data/regression/crdmm_data/run.sh | 14 + .../data/tvf/test_hdfs_tvf_compression/run.sh | 19 + .../hive/scripts/data/tvf/test_tvf/run.sh | 19 + .../docker-compose/hive/scripts/hive-metastore.sh | 13 +- .../scripts/suites/test_hive_compress_type/run.sh | 22 - .../suites/test_hive_to_date/create_table.hql | 52 - .../scripts/suites/test_hive_to_date/data.tar.gz | Bin 745 -> 0 bytes .../hive/scripts/suites/test_hive_to_date/run.sh | 12 - .../create_kerberos_credential_cache_files.sh | 33 + .../kerberos/common/conf/doris-krb5.conf | 52 + .../common/hadoop/apply-config-overrides.sh | 31 + .../kerberos/common/hadoop/hadoop-run.sh | 42 + .../kerberos/entrypoint-hive-master-2.sh | 36 + .../kerberos/entrypoint-hive-master.sh | 34 + .../kerberos/health-checks/hadoop-health-check.sh | 39 + .../kerberos/health-checks/health.sh | 34 + .../docker-compose/kerberos/kerberos.yaml.tpl | 73 + .../kerberos/sql/create_kerberos_hive_table.sql | 17 + .../kerberos/two-kerberos-hives/auth-to-local.xml | 29 + .../two-kerberos-hives/hive2-default-fs-site.xml | 25 + .../kerberos/two-kerberos-hives/update-location.sh | 25 + docker/thirdparties/run-thirdparties-docker.sh | 126 +- .../doris/common/classloader/ScannerLoader.java | 20 + .../apache/doris/common/jni/utils/ExpiringMap.java | 91 ++ .../java/org/apache/doris/udf/BaseExecutor.java | 1 + .../java/org/apache/doris/udf/UdafExecutor.java | 2 + .../java/org/apache/doris/udf/UdfExecutor.java | 44 +- .../org/apache/doris/jdbc/MySQLJdbcExecutor.java | 1 + .../org/apache/doris/catalog/AggStateType.java | 8 +- .../main/java/org/apache/doris/common/Config.java | 13 + .../org/apache/doris/common/FeMetaVersion.java | 5 +- .../common/security/authentication/HadoopUGI.java | 4 +- .../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 1 + .../antlr4/org/apache/doris/nereids/DorisParser.g4 | 3 +- .../antlr4/org/apache/doris/nereids/PLParser.g4 | 1 + .../java/org/apache/doris/alter/AlterJobV2.java | 2 +- .../apache/doris/alter/CloudSchemaChangeJobV2.java | 13 +- .../apache/doris/alter/SchemaChangeHandler.java | 20 +- .../org/apache/doris/alter/SchemaChangeJobV2.java | 3 +- .../java/org/apache/doris/analysis/ColumnDef.java | 9 + .../apache/doris/analysis/CreateFunctionStmt.java | 41 +- .../org/apache/doris/analysis/CreateTableStmt.java | 12 +- .../java/org/apache/doris/analysis/DeleteStmt.java | 3 +- .../apache/doris/analysis/DistributionDesc.java | 8 + .../apache/doris/analysis/DropFunctionStmt.java | 9 + .../doris/analysis/HashDistributionDesc.java | 1 + .../apache/doris/analysis/ImportColumnDesc.java | 3 + .../analysis/ModifyTablePropertiesClause.java | 33 +- .../org/apache/doris/analysis/PartitionDesc.java | 4 + .../doris/analysis/RandomDistributionDesc.java | 5 + .../apache/doris/analysis/ShowColumnStatsStmt.java | 4 +- .../org/apache/doris/analysis/StorageBackend.java | 2 + .../org/apache/doris/analysis/StringLiteral.java | 5 +- .../java/org/apache/doris/backup/Repository.java | 48 +- .../org/apache/doris/backup/RepositoryMgr.java | 36 +- .../java/org/apache/doris/backup/RestoreJob.java | 13 +- .../apache/doris/catalog/AggregateFunction.java | 15 +- .../doris/catalog/AutoIncrementGenerator.java | 9 +- .../doris/catalog/BuiltinScalarFunctions.java | 12 + .../doris/catalog/BuiltinTableValuedFunctions.java | 2 + .../main/java/org/apache/doris/catalog/Env.java | 24 +- .../java/org/apache/doris/catalog/Function.java | 25 + .../org/apache/doris/catalog/JdbcResource.java | 3 + .../main/java/org/apache/doris/catalog/MTMV.java | 3 +- .../java/org/apache/doris/catalog/OlapTable.java | 41 +- .../java/org/apache/doris/catalog/Replica.java | 9 + .../org/apache/doris/catalog/TableProperty.java | 26 +- .../doris/clone/DynamicPartitionScheduler.java | 59 +- .../apache/doris/clone/PartitionRebalancer.java | 82 +- .../java/org/apache/doris/clone/Rebalancer.java | 3 + .../org/apache/doris/clone/TabletScheduler.java | 58 +- .../apache/doris/cloud/catalog/CloudPartition.java | 6 +- .../apache/doris/cloud/rpc/MetaServiceProxy.java | 11 + .../doris/cloud/system/CloudSystemInfoService.java | 12 +- .../java/org/apache/doris/common/FeConstants.java | 1 + .../doris/common/proc/PartitionsProcDir.java | 77 +- .../apache/doris/common/util/DebugPointUtil.java | 10 +- .../org/apache/doris/common/util/LocationPath.java | 15 + .../apache/doris/common/util/PropertyAnalyzer.java | 52 +- .../apache/doris/datasource/ExternalCatalog.java | 9 +- .../apache/doris/datasource/InternalCatalog.java | 38 +- .../doris/datasource/hive/HMSExternalCatalog.java | 6 +- .../doris/datasource/hive/HMSExternalTable.java | 8 +- .../doris/datasource/hive/HiveMetaStoreCache.java | 4 +- .../datasource/hive/HiveMetaStoreClientHelper.java | 4 +- .../datasource/hive/ThriftHMSCachedClient.java | 2 +- .../datasource/iceberg/IcebergMetadataCache.java | 5 +- .../datasource/jdbc/client/JdbcMySQLClient.java | 2 + .../datasource/paimon/PaimonExternalCatalog.java | 3 +- .../datasource/property/PropertyConverter.java | 3 +- .../property/constants/AzureProperties.java | 2 + .../org/apache/doris/fs/PersistentFileSystem.java | 28 +- .../apache/doris/fs/remote/RemoteFileSystem.java | 5 + .../org/apache/doris/fs/remote/S3FileSystem.java | 3 +- .../apache/doris/fs/remote/dfs/DFSFileSystem.java | 13 +- .../doris/load/loadv2/LoadJobFinalOperation.java | 28 +- .../load/loadv2/MiniLoadTxnCommitAttachment.java | 16 +- .../doris/load/routineload/KafkaProgress.java | 48 +- .../load/routineload/KafkaRoutineLoadJob.java | 25 +- .../routineload/RLTaskTxnCommitAttachment.java | 13 +- .../doris/load/routineload/RoutineLoadJob.java | 120 +- .../load/routineload/RoutineLoadProgress.java | 11 +- .../load/routineload/RoutineLoadStatistic.java | 10 +- .../org/apache/doris/master/ReportHandler.java | 4 +- .../org/apache/doris/mysql/MysqlCapability.java | 6 +- .../doris/mysql/privilege/UserPropertyInfo.java | 32 +- .../org/apache/doris/nereids/StatementContext.java | 12 +- .../org/apache/doris/nereids/cost/CostModelV1.java | 8 +- .../hint/UseCboRuleHint.java} | 37 +- .../doris/nereids/jobs/executor/Rewriter.java | 6 +- .../nereids/jobs/rewrite/CostBasedRewriteJob.java | 74 + .../nereids/jobs/rewrite/CustomRewriteJob.java | 5 + .../jobs/rewrite/RootPlanTreeRewriteJob.java | 4 + .../doris/nereids/parser/LogicalPlanBuilder.java | 19 + .../doris/nereids/parser/PartitionTableInfo.java | 48 +- .../apache/doris/nereids/properties/FuncDeps.java | 25 +- .../properties/SelectHintUseCboRule.java} | 37 +- .../doris/nereids/rules/analysis/BindRelation.java | 9 +- .../doris/nereids/rules/analysis/BindSink.java | 57 +- .../rules/analysis/EliminateLogicalSelectHint.java | 12 + .../nereids/rules/analysis/ExpressionAnalyzer.java | 107 +- .../doris/nereids/rules/analysis/SlotBinder.java | 320 ----- .../nereids/rules/analysis/SubExprAnalyzer.java | 3 + .../exploration/mv/MaterializedViewUtils.java | 2 + .../rules/expression/rules/FunctionBinder.java | 365 ----- .../doris/nereids/rules/rewrite/ColumnPruning.java | 2 +- .../nereids/rules/rewrite/EliminateGroupByKey.java | 2 +- .../PushDownFilterThroughPartitionTopN.java | 21 +- .../rules/rewrite/PushDownFilterThroughWindow.java | 15 +- .../doris/nereids/stats/StatsCalculator.java | 393 ++++-- .../functions/scalar/DecodeAsVarchar.java | 75 + .../functions/scalar/EncodeAsBigInt.java | 69 + .../expressions/functions/scalar/EncodeAsInt.java | 69 + .../functions/scalar/EncodeAsLargeInt.java | 68 + .../functions/scalar/EncodeAsSmallInt.java | 69 + .../expressions/functions/scalar/JsonKeys.java | 84 ++ .../expressions/functions/table/Partitions.java | 58 + .../expressions/functions/udf/AliasUdfBuilder.java | 30 +- .../trees/expressions/functions/udf/JavaUdf.java | 13 +- .../nereids/trees/expressions/literal/Literal.java | 9 +- .../expressions/visitor/ScalarFunctionVisitor.java | 30 + .../visitor/TableValuedFunctionVisitor.java | 5 + .../trees/plans/commands/CreateTableCommand.java | 17 +- .../trees/plans/commands/DeleteFromCommand.java | 7 + .../plans/commands/DeleteFromUsingCommand.java | 10 +- .../trees/plans/commands/UpdateCommand.java | 6 +- .../trees/plans/commands/info/CreateTableInfo.java | 20 +- .../trees/plans/commands/info/DefaultValue.java | 5 + .../commands/info/DistributionDescriptor.java | 4 + .../commands/insert/GroupCommitInsertExecutor.java | 4 + .../trees/plans/logical/LogicalOlapScan.java | 8 +- .../apache/doris/persist/AnalyzeDeletionLog.java | 17 +- .../org/apache/doris/persist/CreateTableInfo.java | 17 +- .../java/org/apache/doris/persist/HbPackage.java | 22 +- .../apache/doris/persist/PartitionPersistInfo.java | 1 + .../apache/doris/persist/ReplicaPersistInfo.java | 65 +- .../apache/doris/persist/RoutineLoadOperation.java | 21 +- .../GsonPreProcessable.java} | 24 +- .../org/apache/doris/persist/gson/GsonUtils.java | 51 +- .../apache/doris/planner/StreamLoadPlanner.java | 1 + .../apache/doris/plugin/DynamicPluginLoader.java | 5 + .../java/org/apache/doris/qe/ConnectContext.java | 4 +- .../java/org/apache/doris/qe/ConnectProcessor.java | 8 +- .../main/java/org/apache/doris/qe/Coordinator.java | 21 + .../java/org/apache/doris/qe/GlobalVariable.java | 9 + .../org/apache/doris/qe/MysqlConnectProcessor.java | 4 +- .../java/org/apache/doris/qe/OriginStatement.java | 10 +- .../java/org/apache/doris/qe/SessionVariable.java | 2 +- .../java/org/apache/doris/qe/ShowExecutor.java | 6 +- .../apache/doris/service/FrontendServiceImpl.java | 2 + .../arrowflight/DorisFlightSqlProducer.java | 2 +- .../arrowflight/FlightSqlConnectProcessor.java | 22 +- .../apache/doris/statistics/HMSAnalysisTask.java | 4 +- .../apache/doris/statistics/OlapAnalysisTask.java | 2 +- .../apache/doris/statistics/StatisticsBuilder.java | 7 +- .../apache/doris/statistics/StatisticsCache.java | 29 + .../main/java/org/apache/doris/system/Backend.java | 3 +- .../java/org/apache/doris/system/HeartbeatMgr.java | 10 + .../ExternalFileTableValuedFunction.java | 2 +- .../doris/tablefunction/MetadataGenerator.java | 114 +- .../tablefunction/MetadataTableValuedFunction.java | 2 + .../PartitionsTableValuedFunction.java | 243 ++++ .../doris/tablefunction/S3TableValuedFunction.java | 36 +- .../doris/tablefunction/TableValuedFunctionIf.java | 2 + .../java/org/apache/doris/task/AgentBatchTask.java | 10 + .../CleanUDFCacheTask.java} | 31 +- .../org/apache/doris/task/CreateReplicaTask.java | 22 +- .../java/org/apache/doris/task/LoadTaskInfo.java | 3 + .../doris/transaction/DatabaseTransactionMgr.java | 67 +- .../apache/doris/transaction/TransactionState.java | 1 + .../doris/transaction/TxnCommitAttachment.java | 48 +- .../analysis/CreateTableAsSelectStmtTest.java | 3 +- .../doris/catalog/DynamicPartitionTableTest.java | 38 + .../apache/doris/clone/BeDownCancelCloneTest.java | 148 ++ .../java/org/apache/doris/clone/PathSlotTest.java | 65 + .../doris/cluster/DecommissionBackendTest.java | 1 - .../datasource/property/PropertyConverterTest.java | 2 +- .../routineload/RoutineLoadTaskSchedulerTest.java | 3 +- .../doris/nereids/properties/FuncDepsTest.java | 13 +- .../rules/analysis/FillUpMissingSlotsTest.java | 7 +- .../expression/ExpressionRewriteTestHelper.java | 4 +- .../nereids/rules/expression/FoldConstantTest.java | 6 +- .../expression/SimplifyArithmeticRuleTest.java | 8 +- .../rules/expression/SimplifyRangeTest.java | 4 +- .../rules/rewrite/EliminateGroupByKeyTest.java | 21 +- .../apache/doris/system/SystemInfoServiceTest.java | 15 +- .../transaction/GlobalTransactionMgrTest.java | 5 +- .../apache/doris/utframe/MockedBackendFactory.java | 8 + gensrc/script/doris_builtins_functions.py | 13 + gensrc/thrift/AgentService.thrift | 9 +- gensrc/thrift/FrontendService.thrift | 1 + gensrc/thrift/PlanNodes.thrift | 8 + gensrc/thrift/Types.thrift | 15 +- regression-test/conf/regression-conf.groovy | 4 + .../data/compaction/test_full_compaction.out | 2 + .../test_full_compaction_by_table_id.out | 2 + .../data/correctness_p0/test_default_pi.out | 28 + .../correctness_p0/test_default_pi_streamload.csv | 2 + .../agg_state/nereids/test_agg_state_nereids.out | 2 +- .../data/datatype_p0/agg_state/test_agg_state.out | 2 +- .../data/datatype_p0/json/json_cast.out | 12 + .../test_delete_generated_column.out | 4 +- .../data/delete_p0/test_delete_on_value.out | 14 +- .../hive/test_external_credit_data.out | 12 + .../hive/test_upper_case_column_name.out | 89 ++ .../hive/write/test_hive_ctas_to_doris.out | 37 + .../kerberos/test_single_hive_kerberos.out} | 9 +- .../kerberos/test_two_hive_kerberos.out | 12 + .../external_table_p0/tvf/test_ctas_with_hdfs.out | 383 ++++++ .../tvf/test_hdfs_tvf_compression.out | 0 .../tvf/test_hms_partitions_tvf.out | 8 + .../external_table_p0/tvf/test_partitions_tvf.out | 23 + .../tvf/test_path_partition_keys.out | 0 .../tvf/test_path_partition_keys/dt1=cyw/a.csv | 0 .../tvf/test_path_partition_keys/dt1=cyw/b.csv | 0 .../tvf/test_path_partition_keys/dt1=hello/c.csv | 0 .../test_path_partition_keys/dt2=two/dt1=cyw/a.csv | 0 .../test_path_partition_keys/dt2=two/dt1=cyw/b.csv | 0 .../dt2=two/dt1=hello/c.csv | 0 .../tvf/test_tvf_p2.out | 0 .../test_index_change_on_new_column.out | 4 + ...out => test_index_change_on_renamed_column.out} | 9 +- ...st_index_change_with_cumulative_compaction.out} | 0 .../test_index_change_with_full_compaction.out} | 0 .../javaudf_p0/test_javaudf_static_load_test.out | 27 + .../data/jsonb_p0/test_jsonb_load_and_function.out | 105 ++ .../{stream_load => http_stream}/all_types.csv | 0 .../http_stream/test_http_stream_properties.out | 1452 ++++++++++---------- .../data/load_p0/stream_load/test_error_url_1.csv | 1 + .../load_p0/stream_load/test_stream_load_2pc.out | 464 ++++++- .../stream_load/two_phase_commit_basic_data.csv | 20 + regression-test/data/load_p0/tvf/test_s3_tvf.out | 358 ++++- .../diffrent_serialize/diffrent_serialize.out | 14 + .../nereids_function_p0/scalar_function/Array.out | 6 + .../data/nereids_function_p0/scalar_function/J.out | 105 ++ .../delete/delete_mow_partial_update.out | 12 +- .../nereids_p0/explain/test_pushdown_explain.out | 4 +- .../nereids_rules_p0/eager_aggregate/basic.out | 78 +- .../eager_aggregate/basic_one_side.out | 65 +- .../push_down_count_through_join.out | 821 +++++++++-- .../push_down_count_through_join_one_side.out | 698 +++++++++- .../eager_aggregate/push_down_max_through_join.out | 418 +++++- .../eager_aggregate/push_down_min_through_join.out | 418 +++++- .../eager_aggregate/push_down_sum_through_join.out | 447 +++++- .../push_down_sum_through_join_one_side.out | 418 +++++- .../infer_set_operator_distinct.out | 896 ++++++++++++ .../push_down_distinct_through_join.out | 17 +- .../push_down_filter_through_window.out | 31 + .../string_functions/test_code_varchar.out | 85 ++ .../data/query_p0/system/test_table_options.out | 12 +- .../schema_change_p0/test_dup_schema_key_add.out | 25 + .../test_dup_schema_key_change_modify.out | 323 +++++ .../schema_change_p0/test_dup_schema_key_drop.out | 0 .../test_dup_schema_value_change_add.out | 0 .../test_unique_schema_key_change_add.out | 22 +- .../test_unique_schema_key_change_modify.out | 28 +- ...ue_add.out => test_unique_schema_value_add.out} | 0 ...nge.out => test_unique_schema_value_modify.out} | 0 .../test_unique_schema_value_modify1.out | 81 ++ .../test_new_partial_update_delete.out | 105 ++ .../test_partial_update_after_delete.out} | 10 +- .../partial_update/test_partial_update_delete.out | 12 +- regression-test/data/variant_p0/delete_update.out | 4 +- .../apache/doris/regression/RegressionTest.groovy | 17 +- .../org/apache/doris/regression/suite/Suite.groovy | 17 +- .../java/org/apache/doris/udf/StaticIntTest.java | 29 +- .../cloud_p0/conf/regression-conf-custom.groovy | 2 + regression-test/pipeline/cloud_p0/run.sh | 7 +- .../cloud_p1/conf/regression-conf-custom.groovy | 2 + regression-test/pipeline/external/conf/be.conf | 4 + regression-test/pipeline/external/conf/fe.conf | 2 + .../pipeline/external/conf/regression-conf.groovy | 5 + regression-test/pipeline/p0/conf/be.conf | 1 + regression-test/pipeline/p1/conf/be.conf | 1 + .../test_master_slave_consistency_auth.groovy | 323 +++++ .../suites/auth_p0/test_select_column_auth.groovy | 126 ++ regression-test/suites/auth_up_down_p0/load.groovy | 191 +++ .../auth_up_down_p0/test_grant_revoke_auth.groovy | 75 + .../test_backup_restore_version_revert.groovy | 91 ++ .../check_before_quit/check_before_quit.groovy | 74 + .../compaction_width_array_column.groovy | 137 ++ .../correctness/test_trim_new_parameters.groovy | 3 + .../test_ctas_mv/test_ctas_mv.groovy | 6 +- .../suites/correctness_p0/test_default_pi.groovy | 123 ++ .../agg_state/max/test_agg_state_max.groovy | 2 +- .../suites/datatype_p0/json/json_cast.groovy | 6 +- .../hive/ddl/test_hive_ddl.groovy | 4 +- .../hive/hive_tpch_sf1_orc.groovy | 4 +- .../hive/hive_tpch_sf1_parquet.groovy | 4 +- .../hive/test_external_credit_data.groovy | 29 +- .../hive/test_upper_case_column_name.groovy | 103 ++ .../hive/write/test_hive_ctas_to_doris.groovy | 100 ++ .../kerberos/test_single_hive_kerberos.groovy | 101 ++ .../kerberos/test_two_hive_kerberos.groovy | 72 + .../tvf/test_ctas_with_hdfs.groovy | 129 ++ .../tvf/test_hdfs_tvf_compression.groovy | 10 +- .../tvf/test_hms_partitions_tvf.groovy | 46 + .../tvf/test_partitions_tvf.groovy | 78 ++ .../tvf/test_path_partition_keys.groovy | 10 +- .../tvf/test_tvf_p2.groovy | 8 +- .../spill/partitioned_agg_fault_injection.groovy | 149 ++ .../partitioned_hash_join_fault_injection.groovy | 216 +++ .../spill/spill_sort_fault_injection.groovy | 158 +++ ...d_index_with_direct_schema_change_fault.groovy} | 42 +- ...ld_index_with_light_schema_change_fault.groovy} | 37 +- .../{ => index_change}/test_add_drop_index.groovy | 0 .../test_add_drop_index_ignore_case_column.groovy | 0 ...=> test_add_drop_index_on_table_with_mv.groovy} | 96 +- .../test_add_drop_index_repeatly.groovy} | 60 +- .../test_add_drop_index_with_data.groovy | 0 .../test_add_drop_index_with_delete_data.groovy | 0 .../{ => index_change}/test_build_index.groovy | 0 .../test_build_index_with_clone_by_docker.groovy | 0 .../test_index_change_on_new_column.groovy | 8 +- ... => test_index_change_on_renamed_column.groovy} | 37 +- ...index_change_with_cumulative_compaction.groovy} | 6 +- ... test_index_change_with_full_compaction.groovy} | 8 +- .../test_variant_index_format_v1.groovy | 4 +- .../test_javaudf_static_load_test.groovy | 81 ++ .../jsonb_p0/test_jsonb_load_and_function.groovy | 41 + .../test_cloud_http_stream_2pc_mow.groovy | 72 + .../test_cloud_stream_load_2pc_mow.groovy | 70 + .../stream_load/test_stream_load_2pc.groovy | 582 +++++++- .../stream_load/test_stream_load_error_url.groovy | 94 ++ .../suites/load_p0/tvf/ddl/nest_tbl_basic_tvf.sql | 29 + .../load_p0/tvf/ddl/nest_tbl_basic_tvf_drop.sql | 1 + .../suites/load_p0/tvf/test_s3_tvf.groovy | 526 ++++++- .../load_p2/broker_load/test_broker_load.groovy | 13 +- .../diffrent_serialize/diffrent_serialize.groovy | 15 + .../scalar_function/Array.groovy | 5 + .../nereids_function_p0/scalar_function/J.groovy | 42 + .../nereids_p0/stats/partition_col_stats.groovy | 12 +- .../nereids_rules_p0/eager_aggregate/basic.groovy | 77 +- .../eager_aggregate/basic_one_side.groovy | 74 +- .../push_down_count_through_join.groovy | 193 ++- .../push_down_count_through_join_one_side.groovy | 193 ++- .../push_down_max_through_join.groovy | 109 +- .../push_down_min_through_join.groovy | 108 +- .../push_down_sum_through_join.groovy | 108 +- .../push_down_sum_through_join_one_side.groovy | 110 +- .../infer_set_operator_distinct.groovy | 185 +++ .../dimension_join_agg_negative.groovy | 480 +++++++ .../mv/dimension_predicate/full_join_filter.groovy | 367 +++++ .../dimension_predicate/inner_join_filter.groovy | 368 +++++ .../left_anti_join_filter.groovy | 349 +++++ .../mv/dimension_predicate/left_join_filter.groovy | 386 ++++++ .../left_semi_join_filter.groovy | 342 +++++ .../right_anti_join_filter.groovy | 349 +++++ .../dimension_predicate/right_join_filter.groovy | 386 ++++++ .../right_semi_join_filter.groovy | 343 +++++ .../inner_join_infer_and_derive.groovy | 284 ++++ .../left_join_infer_and_derive.groovy | 244 ++++ .../right_join_infer_and_derive.groovy | 244 ++++ .../push_down_distinct_through_join.groovy | 13 +- .../push_down_filter_through_window.groovy | 44 + .../push_down_limit_distinct.groovy | 4 +- .../noStatsRfPrune/query1.groovy | 2 +- .../noStatsRfPrune/query30.groovy | 2 +- .../noStatsRfPrune/query81.groovy | 2 +- .../no_stats_shape/query1.groovy | 2 +- .../no_stats_shape/query30.groovy | 2 +- .../no_stats_shape/query81.groovy | 2 +- .../suites/prepared_stmt_p0/prepared_stmt.groovy | 7 +- .../prepared_stmt_p0/prepared_stmt_in_list.groovy | 2 - .../string_functions/test_code_varchar.groovy | 104 ++ ...e_add.groovy => test_dup_schema_key_add.groovy} | 58 +- .../test_dup_schema_key_drop.groovy | 2 +- ...add.groovy => test_dup_schema_value_add.groovy} | 74 +- .../test_dup_schema_value_drop.groovy | 2 +- .../test_unique_schema_key_change_add.groovy | 36 +- .../test_unique_schema_key_change_drop.groovy | 2 +- .../test_unique_schema_key_change_modify.groovy | 324 ++--- ....groovy => test_unique_schema_value_add.groovy} | 4 +- ...groovy => test_unique_schema_value_drop.groovy} | 2 +- ...oovy => test_unique_schema_value_modify.groovy} | 2 +- ...ovy => test_unique_schema_value_modify1.groovy} | 132 +- ...ovy => test_unique_schema_value_modify2.groovy} | 106 +- ...ovy => test_unique_schema_value_modify3.groovy} | 64 +- .../suites/show_p0/test_show_delete.groovy | 2 +- .../suites/statistics/test_analyze_mtmv.groovy | 701 +++++----- .../statistics/test_external_partition.groovy | 101 ++ .../suites/statistics/test_partition_stats.groovy | 121 +- .../test_new_partial_update_delete.groovy | 256 ++++ .../test_partial_update_after_delete.groovy | 79 ++ .../suites/variant_p0/delete_update.groovy | 8 +- .../test_workload_sched_policy.groovy | 31 +- tools/maintainers/check_review.py | 40 +- tools/maintainers/maintainers.json | 20 - 534 files changed, 24383 insertions(+), 5449 deletions(-) create mode 100644 .github/CODEOWNERS copy fe/fe-core/src/main/java/org/apache/doris/persist/AnalyzeDeletionLog.java => be/src/util/simd/reverse_copy_bytes.h (56%) create mode 100644 be/src/vec/functions/function_decode_varchar.cpp create mode 100644 be/src/vec/functions/function_encode_varchar.cpp create mode 100644 be/test/olap/base_compaction_test.cpp create mode 100644 be/test/vec/common/wide_integer_test.cpp create mode 100644 be/test/vec/function/function_compressed_materialization_test.cpp create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_csv/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_csv/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_csv/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_orc/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_orc/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_orc/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_parquet/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_parquet/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/datev2_parquet/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/hive_upper_case_orc/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/hive_upper_case_orc/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/hive_upper_case_orc/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/hive_upper_case_parquet/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/hive_upper_case_parquet/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/hive_upper_case_parquet/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_lz4_compression/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_lz4_compression/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_lz4_compression/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_lzo_compression/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_lzo_compression/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/parquet_lzo_compression/run.sh rename docker/thirdparties/docker-compose/hive/scripts/{suites/test_hive_compress_type => data/multi_catalog/test_compress_partitioned}/create_table.hql (68%) create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/test_compress_partitioned/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/regression/crdmm_data/create_table.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/regression/crdmm_data/data.tar.gz create mode 100755 docker/thirdparties/docker-compose/hive/scripts/data/regression/crdmm_data/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/tvf/test_hdfs_tvf_compression/run.sh create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/tvf/test_tvf/run.sh delete mode 100644 docker/thirdparties/docker-compose/hive/scripts/suites/test_hive_compress_type/run.sh delete mode 100644 docker/thirdparties/docker-compose/hive/scripts/suites/test_hive_to_date/create_table.hql delete mode 100644 docker/thirdparties/docker-compose/hive/scripts/suites/test_hive_to_date/data.tar.gz delete mode 100644 docker/thirdparties/docker-compose/hive/scripts/suites/test_hive_to_date/run.sh create mode 100644 docker/thirdparties/docker-compose/kerberos/ccache/create_kerberos_credential_cache_files.sh create mode 100644 docker/thirdparties/docker-compose/kerberos/common/conf/doris-krb5.conf create mode 100755 docker/thirdparties/docker-compose/kerberos/common/hadoop/apply-config-overrides.sh create mode 100755 docker/thirdparties/docker-compose/kerberos/common/hadoop/hadoop-run.sh create mode 100755 docker/thirdparties/docker-compose/kerberos/entrypoint-hive-master-2.sh create mode 100755 docker/thirdparties/docker-compose/kerberos/entrypoint-hive-master.sh create mode 100755 docker/thirdparties/docker-compose/kerberos/health-checks/hadoop-health-check.sh create mode 100644 docker/thirdparties/docker-compose/kerberos/health-checks/health.sh create mode 100644 docker/thirdparties/docker-compose/kerberos/kerberos.yaml.tpl create mode 100644 docker/thirdparties/docker-compose/kerberos/sql/create_kerberos_hive_table.sql create mode 100755 docker/thirdparties/docker-compose/kerberos/two-kerberos-hives/auth-to-local.xml create mode 100755 docker/thirdparties/docker-compose/kerberos/two-kerberos-hives/hive2-default-fs-site.xml create mode 100755 docker/thirdparties/docker-compose/kerberos/two-kerberos-hives/update-location.sh create mode 100644 fe/be-java-extensions/java-common/src/main/java/org/apache/doris/common/jni/utils/ExpiringMap.java copy fe/fe-core/src/main/java/org/apache/doris/{persist/AnalyzeDeletionLog.java => nereids/hint/UseCboRuleHint.java} (56%) copy fe/fe-core/src/main/java/org/apache/doris/{persist/AnalyzeDeletionLog.java => nereids/properties/SelectHintUseCboRule.java} (52%) delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/analysis/SlotBinder.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rules/FunctionBinder.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DecodeAsVarchar.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/EncodeAsBigInt.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/EncodeAsInt.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/EncodeAsLargeInt.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/EncodeAsSmallInt.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/JsonKeys.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/table/Partitions.java copy fe/fe-core/src/main/java/org/apache/doris/persist/{AnalyzeDeletionLog.java => gson/GsonPreProcessable.java} (60%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/tablefunction/PartitionsTableValuedFunction.java copy fe/fe-core/src/main/java/org/apache/doris/{persist/AnalyzeDeletionLog.java => task/CleanUDFCacheTask.java} (52%) create mode 100644 fe/fe-core/src/test/java/org/apache/doris/clone/BeDownCancelCloneTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/clone/PathSlotTest.java create mode 100644 regression-test/data/correctness_p0/test_default_pi.out create mode 100644 regression-test/data/correctness_p0/test_default_pi_streamload.csv rename regression-test/data/{external_table_p2 => external_table_p0}/hive/test_external_credit_data.out (55%) create mode 100644 regression-test/data/external_table_p0/hive/test_upper_case_column_name.out create mode 100644 regression-test/data/external_table_p0/hive/write/test_hive_ctas_to_doris.out copy regression-test/data/{load_p0/stream_load/test_stream_load_2pc.out => external_table_p0/kerberos/test_single_hive_kerberos.out} (60%) create mode 100644 regression-test/data/external_table_p0/kerberos/test_two_hive_kerberos.out create mode 100644 regression-test/data/external_table_p0/tvf/test_ctas_with_hdfs.out rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_hdfs_tvf_compression.out (100%) create mode 100644 regression-test/data/external_table_p0/tvf/test_hms_partitions_tvf.out create mode 100644 regression-test/data/external_table_p0/tvf/test_partitions_tvf.out rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys.out (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys/dt1=cyw/a.csv (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys/dt1=cyw/b.csv (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys/dt1=hello/c.csv (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys/dt2=two/dt1=cyw/a.csv (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys/dt2=two/dt1=cyw/b.csv (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys/dt2=two/dt1=hello/c.csv (100%) rename regression-test/data/{external_table_p2 => external_table_p0}/tvf/test_tvf_p2.out (100%) copy regression-test/data/inverted_index_p0/index_change/{test_index_change_on_new_column.out => test_index_change_on_renamed_column.out} (52%) rename regression-test/data/inverted_index_p0/index_change/{test_index_change_with_compaction.out => test_index_change_with_cumulative_compaction.out} (100%) copy regression-test/data/{compaction/test_compaction_dup_keys.out => inverted_index_p0/index_change/test_index_change_with_full_compaction.out} (100%) create mode 100644 regression-test/data/javaudf_p0/test_javaudf_static_load_test.out copy regression-test/data/load_p0/{stream_load => http_stream}/all_types.csv (100%) create mode 100644 regression-test/data/load_p0/stream_load/test_error_url_1.csv create mode 100644 regression-test/data/load_p0/stream_load/two_phase_commit_basic_data.csv create mode 100644 regression-test/data/nereids_rules_p0/push_down_filter_through_window/push_down_filter_through_window.out create mode 100644 regression-test/data/query_p0/sql_functions/string_functions/test_code_varchar.out create mode 100644 regression-test/data/schema_change_p0/test_dup_schema_key_add.out create mode 100644 regression-test/data/schema_change_p0/test_dup_schema_key_change_modify.out copy be/src/pch/pch.cc => regression-test/data/schema_change_p0/test_dup_schema_key_drop.out (100%) copy be/src/pch/pch.cc => regression-test/data/schema_change_p0/test_dup_schema_value_change_add.out (100%) copy regression-test/data/schema_change_p0/{test_unique_model_schema_value_add.out => test_unique_schema_value_add.out} (100%) copy regression-test/data/schema_change_p0/{test_unique_model_schema_value_change.out => test_unique_schema_value_modify.out} (100%) create mode 100644 regression-test/data/schema_change_p0/test_unique_schema_value_modify1.out create mode 100644 regression-test/data/unique_with_mow_p0/partial_update/test_new_partial_update_delete.out copy regression-test/data/{inverted_index_p0/index_change/test_index_change_on_new_column.out => unique_with_mow_p0/partial_update/test_partial_update_after_delete.out} (67%) copy fe/fe-core/src/main/java/org/apache/doris/persist/AnalyzeDeletionLog.java => regression-test/java-udf-src/src/main/java/org/apache/doris/udf/StaticIntTest.java (59%) create mode 100644 regression-test/suites/auth_p0/test_master_slave_consistency_auth.groovy create mode 100644 regression-test/suites/auth_p0/test_select_column_auth.groovy create mode 100644 regression-test/suites/auth_up_down_p0/load.groovy create mode 100644 regression-test/suites/auth_up_down_p0/test_grant_revoke_auth.groovy create mode 100644 regression-test/suites/backup_restore/test_backup_restore_version_revert.groovy create mode 100644 regression-test/suites/check_before_quit/check_before_quit.groovy create mode 100644 regression-test/suites/compaction/compaction_width_array_column.groovy create mode 100644 regression-test/suites/correctness_p0/test_default_pi.groovy rename regression-test/suites/{external_table_p2 => external_table_p0}/hive/test_external_credit_data.groovy (88%) create mode 100644 regression-test/suites/external_table_p0/hive/test_upper_case_column_name.groovy create mode 100644 regression-test/suites/external_table_p0/hive/write/test_hive_ctas_to_doris.groovy create mode 100644 regression-test/suites/external_table_p0/kerberos/test_single_hive_kerberos.groovy create mode 100644 regression-test/suites/external_table_p0/kerberos/test_two_hive_kerberos.groovy create mode 100644 regression-test/suites/external_table_p0/tvf/test_ctas_with_hdfs.groovy rename regression-test/suites/{external_table_p2 => external_table_p0}/tvf/test_hdfs_tvf_compression.groovy (92%) create mode 100644 regression-test/suites/external_table_p0/tvf/test_hms_partitions_tvf.groovy create mode 100644 regression-test/suites/external_table_p0/tvf/test_partitions_tvf.groovy rename regression-test/suites/{external_table_p2 => external_table_p0}/tvf/test_path_partition_keys.groovy (95%) rename regression-test/suites/{external_table_p2 => external_table_p0}/tvf/test_tvf_p2.groovy (93%) create mode 100644 regression-test/suites/fault_injection_p0/spill/partitioned_agg_fault_injection.groovy create mode 100644 regression-test/suites/fault_injection_p0/spill/partitioned_hash_join_fault_injection.groovy create mode 100644 regression-test/suites/fault_injection_p0/spill/spill_sort_fault_injection.groovy copy regression-test/suites/{inverted_index_p0/test_build_index_with_clone_by_docker.groovy => fault_injection_p0/test_build_index_with_direct_schema_change_fault.groovy} (67%) copy regression-test/suites/{inverted_index_p0/test_build_index_with_clone_by_docker.groovy => fault_injection_p0/test_build_index_with_light_schema_change_fault.groovy} (69%) rename regression-test/suites/inverted_index_p0/{ => index_change}/test_add_drop_index.groovy (100%) rename regression-test/suites/inverted_index_p0/{ => index_change}/test_add_drop_index_ignore_case_column.groovy (100%) copy regression-test/suites/inverted_index_p0/index_change/{test_index_change_on_new_column.groovy => test_add_drop_index_on_table_with_mv.groovy} (53%) copy regression-test/suites/inverted_index_p0/{test_build_index_with_clone_by_docker.groovy => index_change/test_add_drop_index_repeatly.groovy} (58%) rename regression-test/suites/inverted_index_p0/{ => index_change}/test_add_drop_index_with_data.groovy (100%) rename regression-test/suites/inverted_index_p0/{ => index_change}/test_add_drop_index_with_delete_data.groovy (100%) rename regression-test/suites/inverted_index_p0/{ => index_change}/test_build_index.groovy (100%) rename regression-test/suites/inverted_index_p0/{ => index_change}/test_build_index_with_clone_by_docker.groovy (100%) copy regression-test/suites/inverted_index_p0/index_change/{test_index_change_on_new_column.groovy => test_index_change_on_renamed_column.groovy} (75%) copy regression-test/suites/inverted_index_p0/index_change/{test_index_change_with_compaction.groovy => test_index_change_with_cumulative_compaction.groovy} (98%) rename regression-test/suites/inverted_index_p0/index_change/{test_index_change_with_compaction.groovy => test_index_change_with_full_compaction.groovy} (98%) create mode 100644 regression-test/suites/javaudf_p0/test_javaudf_static_load_test.groovy create mode 100644 regression-test/suites/load_p0/http_stream/test_cloud_http_stream_2pc_mow.groovy create mode 100644 regression-test/suites/load_p0/stream_load/test_cloud_stream_load_2pc_mow.groovy create mode 100644 regression-test/suites/load_p0/tvf/ddl/nest_tbl_basic_tvf.sql create mode 100644 regression-test/suites/load_p0/tvf/ddl/nest_tbl_basic_tvf_drop.sql create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_2_join_agg/dimension_join_agg_negative.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/full_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/inner_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/left_anti_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/left_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/left_semi_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/right_anti_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/right_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/dimension_predicate/right_semi_join_filter.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/join_infer_derive/inner_join_infer_and_derive.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/join_infer_derive/left_join_infer_and_derive.groovy create mode 100644 regression-test/suites/nereids_rules_p0/mv/join_infer_derive/right_join_infer_and_derive.groovy create mode 100644 regression-test/suites/nereids_rules_p0/push_down_filter_through_window/push_down_filter_through_window.groovy create mode 100644 regression-test/suites/query_p0/sql_functions/string_functions/test_code_varchar.groovy rename regression-test/suites/schema_change_p0/{test_dup_schema_key_change_add.groovy => test_dup_schema_key_add.groovy} (95%) rename regression-test/suites/schema_change_p0/{test_dup_schema_value_change_add.groovy => test_dup_schema_value_add.groovy} (95%) rename regression-test/suites/schema_change_p0/{test_unique_model_schema_value_add.groovy => test_unique_schema_value_add.groovy} (99%) rename regression-test/suites/schema_change_p0/{test_unique_model_schema_value_change_drop.groovy => test_unique_schema_value_drop.groovy} (99%) rename regression-test/suites/schema_change_p0/{test_unique_model_schema_value_change.groovy => test_unique_schema_value_modify.groovy} (99%) rename regression-test/suites/schema_change_p0/{test_unique_model_schema_value_change1.groovy => test_unique_schema_value_modify1.groovy} (92%) rename regression-test/suites/schema_change_p0/{test_unique_model_schema_value_change2.groovy => test_unique_schema_value_modify2.groovy} (93%) rename regression-test/suites/schema_change_p0/{test_unique_model_schema_value_change3.groovy => test_unique_schema_value_modify3.groovy} (92%) create mode 100644 regression-test/suites/statistics/test_external_partition.groovy create mode 100644 regression-test/suites/unique_with_mow_p0/partial_update/test_new_partial_update_delete.groovy create mode 100644 regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_after_delete.groovy delete mode 100644 tools/maintainers/maintainers.json --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org