This is an automated email from the ASF dual-hosted git repository. w41ter pushed a change to branch auto-pick-49870-branch-2.1 in repository https://gitbox.apache.org/repos/asf/doris.git
discard fab97fd4b23 [feature](restore) Overwrite the schema different view when force_replace enabled (#49870) add d8a274251eb branch-2.1: [feature](function) support utf8 input in initcap #49846 (#49977) add e70a3ab8b16 branch-2.1: [fix] (streamload) fixed the issue of data loss due to concurrency wh… #48948 (#49937) add ba1ad12a210 branch-2.1: [Fix](Serde) Support hive compatible output format #49036 (#49831) add 9960b0960e7 branch-2.1: [bug](auto partition) Fix be crash with single replica insert (#48929) add b9d447741e8 Revert "branch-2.1: [Fix](Serde) Support hive compatible output format #49036" (#49986) add 6e448d3a562 [feat](test)add some be ut for orc/parquet reader (#49418) (#49948) add 7ba2f870879 branch-2.1: [fix](binlog) Replaced partition should be record to Dropped Resources #48686 (#49789) add d87409c5cad [fix](inverted index) Downgrade ICU version to support lower OS versions #47664 (#50005) add 06ab763efbe branch-2.1: [fix](parquet)fix when hive_parquet_use_column_names=false && read partition tb cause be core. #49966 (#50008) add bbdb057e2c9 branch-2.1: [fix](nereids) EliminateGroupByConstant should replace agg's group by after removing constant group by keys #49473 (#50044) add fe634555bd2 [fix](variant)fix core in column_object when sort from empty block (#50035) add aa4b54952cd branch-2.1: [enhancement]Optimize GeoFunctions for const columns #34396 (#50067) add da8722f7035 branch-2.1: chore: disable download md5sum check by default #50012 (#50047) add afaab7ff98c branch-2.1-pick: [Opt](log) Add and fix logs for delete bitmaps (#50060) add c38ca0cd461 branch-2.1: [test]add test for restore schema not consist #49849 (#50070) add 2ef136cad61 [fix](variant) building index on the variant column is prohibited (#49159) (#50028) add 2aa9cb22768 branch-2.1: [fix](lzo) fix lzo decompression failed #49538 (#49634) add ea29bc523e7 branch-2.1: [Enhancement](GEO) Support Multipolygon and some spatial functions (#50073) add 41b5866c3e4 [fix](regression) fix the failed of cold_heat_separation_p2 (#49625) (#50090) add c3a201dcbf2 branch-2.1: [fix](agg) prevent core dump in ColumnArray::size_at when handling type mismatch in streaming_agg_serialize_to_column #50001 (#50095) add 77ea907b548 branch-2.1: [Bug](materialized-view) Fixed the problem of using drop table force and create mv stmt at the… #41580 (#50133) add 4146cbbbbbd branch-2.1-pick: [Opt](mow) Forbid time_series compaction policy on unique table (#49905) (#50132) add 89862856fe5 print error info when parse_conf_cache_paths failed, so that user know how to correct it (#50131) add 64815c6403a branch-2.1: [fix](dialect)fix starrocks dialect #50099 (#50165) add 94f5fd77285 [chore] Updated submodule orc to orc-for-doris-21 branch. (#50189) add 967d0a59b9a branch-2.1: [fix](load) reset routine load task EOF sign correctly #50048 (#50179) add 048537cd036 branch-2.1:[fix](nereids)Use utf-8 when convert string like literal to double. (#50085) (#50155) add 481fca67661 [revert](statistics)Still use sample analyze sql when sample full table. (#50199) add 01b5cc4f1f4 [opt](mtmv) Doesn't throw npe when not set distribution info which should be random (#49402) add d575a0921aa [fix](hive) Fix hive metastore client socket timeout (#50192) add 188cbabb586 [enhance](auth)Remove restrictions on user creation and other operations when enabling ranger/LDAP (#50137) add 1c90fc6c029 branch-2.1: [fix](connect) fix wrong format causing connection fail #50214 (#50217) add 3088aff43c4 branch-2.1: [Fix](case) Fix case that use time series compaction on unique table (#50194) (#50228) add 9123d73ed8c Branch-2.1 Cherry-pick [Fix](Variant) fix variant cast to jsonb into wrong NULL values (#50235) add b9bb9e1611c branch-2.1: [fix](Export) fix the lock leak issue of Export #50088 (#50219) add 34cb4f05e83 [branch-2.1]fix task queue core (#50236) add 1efe62c7ba7 branch-2.1: [opt](hive) add option to get schema from table object #50038 (#50269) add a193f16a5aa branch-2.1:[fix](auditlog)Set sqlHash in executeInternalQuery (#49984) (#50271) add af0bca698ad [Branch-2.1](Parquet) add a memory tracker to parquet meta (#50130) add 98f5d95fba8 branch-2.1: [feat](function) SUBSTRING_INDEX function delimiter supports dynamic #50149 (#50303) add b8660682176 [chore] Update submodule orc to orc-for-doris-21 branch in build.sh. (#50304) add b0c8cb0818d branch-2.1: [Bug](function) fix Could not find function explode_json_array_json_outer #50164 (#50227) add e5a9c2552d7 [chore] Add Clang 18/19 Support #47438 (#50300) add cf72fa82e2d [Improve](explode) explode function support multi param (#50310) add bc68a8da070 branch-2.1: remove visible rowset from memory during deletion transaction (#50329) add 91eed373beb branch-2.1: [fix](array_map) fix array_map functions avoid core #50201 (#50331) add dd43f135495 branch-2.1:[fix](ut)Fix StmtExecutorTest (#50322) (#50362) add 90e22197ff0 [fix](json-functions)fix json-replace/insert/set/array behavior with complex type #50308 (#50309) add 0710d9b2d6a branch-2.1: [fix](orc) Should not pass selection vector when decode child column of List or Map #50136 (#50316) add 619a491e98a branch-2.1: [Fix](mow) Fix `DeleteBitmap::cardinality` (#50404) add d23bd872471 branch-2.1: [fix](txn) Restart fe after commit txn causes `loadedTblIndexes` lossing #50123 (#50206) add 79d135994fb [fix](regression test) fix case variant_github_events_nonConcurrent_p2(#50437) (#50438) add fcc05d630b8 [chore](show engines)Change `palo` to `Doris` (#47861) (#50459) add b3e55d10644 [log](mow) reduce log for data load on mow table (#47647) (#50491) add 2b62fb1a593 [fix](audit) fix potential audit log missing issue (#50357) (#50501) add 8cd9fd1e892 branch-2.1: [fix](memory) Fix `thread_mem_tracker()` performance (#50524) add 4e8148105aa [fix](serde)Fixed the issue that serde may cause be core when reading schema changed text table. (#50105) (#50504) add 3660139c641 branch-2.1: [fix](path gc) Fix path gc race with publish task #50343 (#50520) add 5be25565031 [enhancement](compaction) replace hardcoded compaction thresholds with config (#49662) (#50514) add 4b3dd6c10a6 branch-2.1: [feat](func) any function supports json #50311 (#50484) add dfc1dbfb590 branch-2.1: [bugfix](chdfs) fix hash collision in chdfs file system cache #49486 (#50545) add 98be2cedcf7 branch-2.1: [fix](constant fold)Make sure FE cast double to varchar generate identical result with BE. #50425 (#50548) add af4195e399e branch-2.1: [fix](geo) Fix ST_Contains behavior #50115 (#50569) add 4aff17f3554 branch-2.1: [fix](docker hive3) hive server oom and not auto-restart #50456 (#50507) add 6dee1fe623e [Chore](column) change ColumnFixedLengthObject log fatal to throw exception (#50540) add 65151b46aa8 branch-2.1: [improve](routine load) add more metrics to observe the routine load job #48209 (#48765) add a9b948f476d branch-2.1: [fix](catalog) do cache load when cache value is not present #50188 (#50451) add c3812b382b1 branch-2.1: [fix](nereids) fix bug of MergePercentileToArray #49773 (#50603) add d667b5af385 [branch-2.1](function) Fix unexpected result of unix_timestamp when input is out of bound (#49430) (#50609) add babb98f10cb [branch-2.1](function) fix wrong length check of function array_range (#49993) (#50605) add 1de9e7f9e8f branch-2.1: [fix](view)fix reset view def for restore wrong replace #50567 (#50600) add 02c3157e4c6 [branch-2.1](function) fix wrong floor of function date_diff when unit less than day (#49429) (#50606) add a066374f94c [opt](paimon/iceberg)upgrade paimon to 1.0.1, iceberg to 1.6.1 for 2.1 (#50612) add e1c50c8e398 branch-2.1: [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV #50537 (#50627) add 1228f36e8b4 [feature](restore) Overwrite the schema different view when force_replace enabled (#49870) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (fab97fd4b23) \ N -- N -- N refs/heads/auto-pick-49870-branch-2.1 (1228f36e8b4) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .gitmodules | 2 +- be/CMakeLists.txt | 5 +- be/src/agent/be_exec_version_manager.h | 2 +- be/src/agent/task_worker_pool.cpp | 7 +- be/src/common/config.cpp | 7 +- be/src/common/config.h | 5 + be/src/exec/lzo_decompressor.cpp | 18 +- be/src/geo/geo_common.h | 7 +- be/src/geo/geo_types.cpp | 1029 ++++++++++++++- be/src/geo/geo_types.h | 59 + be/src/geo/wkt_parse_type.h | 2 + be/src/geo/wkt_yacc.y | 37 +- be/src/olap/base_compaction.cpp | 2 +- be/src/olap/data_dir.cpp | 47 +- be/src/olap/olap_server.cpp | 16 +- be/src/olap/rowset/beta_rowset_writer.cpp | 5 +- be/src/olap/rowset_builder.cpp | 12 +- be/src/olap/tablet.cpp | 37 +- be/src/olap/tablet_manager.cpp | 2 +- be/src/olap/tablet_meta.cpp | 16 +- be/src/olap/tablet_meta.h | 2 + be/src/olap/task/engine_publish_version_task.cpp | 88 +- be/src/olap/txn_manager.cpp | 15 +- be/src/olap/txn_manager.h | 6 +- be/src/pipeline/exec/exchange_sink_buffer.cpp | 2 +- be/src/pipeline/exec/exchange_sink_buffer.h | 2 +- be/src/pipeline/exec/hashjoin_probe_operator.cpp | 4 +- be/src/pipeline/exec/table_function_operator.cpp | 6 +- be/src/pipeline/pipeline_fragment_context.cpp | 2 +- be/src/pipeline/task_queue.cpp | 34 +- be/src/pipeline/task_queue.h | 9 +- be/src/runtime/exec_env.h | 4 + be/src/runtime/exec_env_init.cpp | 4 +- be/src/runtime/fragment_mgr.cpp | 2 +- be/src/runtime/plan_fragment_executor.cpp | 2 +- be/src/runtime/query_context.cpp | 5 +- be/src/runtime/query_context.h | 4 +- be/src/runtime/routine_load/data_consumer.cpp | 6 + be/src/runtime/tablets_channel.cpp | 14 +- be/src/runtime/thread_context.h | 4 +- be/src/util/datetype_cast.hpp | 8 +- be/src/util/doris_metrics.cpp | 10 + be/src/util/doris_metrics.h | 5 + .../aggregate_function_collect.h | 3 +- .../aggregate_function_min_max.cpp | 2 +- .../aggregate_function_sequence_match.h | 10 +- be/src/vec/columns/column_decimal.cpp | 2 +- be/src/vec/columns/column_fixed_length_object.h | 55 +- be/src/vec/columns/column_object.cpp | 8 +- be/src/vec/columns/column_vector.cpp | 2 +- be/src/vec/common/assert_cast.h | 1 + .../vec/data_types/serde/data_type_jsonb_serde.cpp | 4 +- .../vec/data_types/serde/data_type_jsonb_serde.h | 3 + .../data_types/serde/data_type_object_serde.cpp | 6 + .../vec/data_types/serde/data_type_object_serde.h | 5 +- .../data_types/serde/data_type_struct_serde.cpp | 6 + be/src/vec/exec/format/csv/csv_reader.cpp | 6 +- .../file_reader/new_plain_text_line_reader.cpp | 13 +- be/src/vec/exec/format/orc/vorc_reader.cpp | 22 +- .../vec/exec/format/parquet/parquet_thrift_util.h | 2 +- .../exec/format/parquet/vparquet_file_metadata.cpp | 10 +- .../exec/format/parquet/vparquet_file_metadata.h | 6 +- be/src/vec/exec/format/parquet/vparquet_reader.cpp | 3 +- be/src/vec/exec/jni_connector.h | 2 +- be/src/vec/exec/vtable_function_node.cpp | 3 +- .../table_function/table_function_factory.cpp | 13 +- .../exprs/table_function/table_function_factory.h | 17 +- be/src/vec/exprs/table_function/vexplode_v2.cpp | 209 +++ .../table_function/vexplode_v2.h} | 40 +- .../vec/functions/array/function_array_range.cpp | 12 +- be/src/vec/functions/date_time_transforms.h | 28 +- be/src/vec/functions/function_binary_arithmetic.h | 6 +- be/src/vec/functions/function_cast.h | 15 +- .../function_date_or_datetime_computation.h | 8 +- .../vec/functions/function_datetime_floor_ceil.cpp | 6 +- be/src/vec/functions/function_fake.cpp | 58 +- be/src/vec/functions/function_json.cpp | 19 +- be/src/vec/functions/function_string.cpp | 53 +- be/src/vec/functions/function_string.h | 85 +- be/src/vec/functions/function_timestamp.cpp | 3 +- be/src/vec/functions/functions_geo.cpp | 474 +++++-- be/src/vec/functions/functions_geo.h | 5 +- be/src/vec/functions/simple_function_factory.h | 17 +- be/src/vec/runtime/vdatetime_value.cpp | 4 +- be/src/vec/runtime/vdatetime_value.h | 104 +- be/src/vec/sink/vrow_distribution.cpp | 3 + be/src/vec/sink/vrow_distribution.h | 3 + be/src/vec/sink/writer/async_result_writer.cpp | 54 +- be/src/vec/sink/writer/vtablet_writer.cpp | 9 +- be/test/geo/geo_types_test.cpp | 1353 +++++++++++++++++++- be/test/olap/delta_writer_test.cpp | 23 +- .../olap/engine_storage_migration_task_test.cpp | 7 +- be/test/olap/segment_cache_test.cpp | 8 +- be/test/olap/tablet_cooldown_test.cpp | 3 +- be/test/olap/txn_manager_test.cpp | 52 +- .../vec/aggregate_functions/agg_min_max_test.cpp | 29 + be/test/vec/columns/column_object_test.cpp | 37 + be/test/vec/columns/common_column_test.h | 111 ++ .../data_types/serde/data_type_serde_csv_test.cpp | 232 ++++ be/test/vec/exec/orc/orc_convert_dict_test.cpp | 237 ++++ .../exec/orc/orc_convert_to_orc_literal_test.cpp | 216 ++++ be/test/vec/exec/orc/orc_memory_stream_test.h | 102 ++ be/test/vec/exec/orc/orc_reader_fill_data_test.cpp | 475 +++++++ .../vec/exec/orc/orc_reader_init_column_test.cpp | 359 ++++++ be/test/vec/function/function_geo_test.cpp | 151 ++- be/test/vec/function/function_string_test.cpp | 17 + be/test/vec/function/function_test_util.cpp | 95 +- be/test/vec/function/function_test_util.h | 3 +- be/test/vec/function/table_function_test.cpp | 163 ++- be/test/vec/runtime/vdatetime_value_test.cpp | 203 +++ build.sh | 2 +- .../docker-compose/hive/hive-3x.yaml.tpl | 2 + .../create_hive_orc_tables.hql | 11 + .../orc/complex_data_orc/000000_0 | Bin 0 -> 561 bytes .../main/java/org/apache/doris/common/Config.java | 2 +- fe/fe-core/pom.xml | 16 +- .../java/org/apache/doris/alter/RollupJobV2.java | 6 +- .../apache/doris/alter/SchemaChangeHandler.java | 18 + .../org/apache/doris/analysis/CreateRoleStmt.java | 6 - .../org/apache/doris/analysis/CreateUserStmt.java | 8 - .../org/apache/doris/analysis/DropRoleStmt.java | 6 - .../org/apache/doris/analysis/DropUserStmt.java | 7 - .../apache/doris/analysis/FunctionCallExpr.java | 2 + .../java/org/apache/doris/analysis/GrantStmt.java | 5 - .../doris/analysis/LambdaFunctionCallExpr.java | 3 + .../java/org/apache/doris/analysis/RevokeStmt.java | 5 - .../java/org/apache/doris/binlog/DBBinlog.java | 9 + .../doris/catalog/BuiltinScalarFunctions.java | 6 + .../catalog/BuiltinTableGeneratingFunctions.java | 10 + .../main/java/org/apache/doris/catalog/Env.java | 11 +- .../java/org/apache/doris/catalog/OlapTable.java | 11 +- .../main/java/org/apache/doris/catalog/View.java | 3 +- .../apache/doris/common/util/PropertyAnalyzer.java | 6 +- .../apache/doris/datasource/InternalCatalog.java | 2 +- .../doris/datasource/hive/HMSExternalCatalog.java | 9 +- .../doris/datasource/hive/HMSExternalTable.java | 23 +- .../datasource/hive/ThriftHMSCachedClient.java | 2 +- .../datasource/iceberg/source/IcebergScanNode.java | 42 +- .../apache/doris/datasource/kafka/KafkaUtil.java | 60 +- .../doris/datasource/metacache/MetaCache.java | 13 +- .../datasource/paimon/PaimonExternalCatalog.java | 11 +- .../datasource/paimon/PaimonExternalTable.java | 2 +- .../datasource/paimon/PaimonMetadataCache.java | 2 +- .../apache/doris/datasource/paimon/PaimonUtil.java | 2 +- .../datasource/paimon/source/PaimonScanNode.java | 7 +- .../main/java/org/apache/doris/load/ExportJob.java | 1 - .../doris/load/routineload/RoutineLoadJob.java | 8 +- .../load/routineload/RoutineLoadTaskInfo.java | 7 + .../java/org/apache/doris/metric/MetricRepo.java | 20 + .../java/org/apache/doris/mtmv/MTMVJobInfo.java | 2 +- .../org/apache/doris/mysql/AcceptListener.java | 3 +- .../doris/nereids/parser/LogicalPlanBuilder.java | 19 +- .../rules/analysis/EliminateGroupByConstant.java | 5 +- .../expression/rules/FoldConstantRuleOnFE.java | 23 + .../rules/rewrite/MergePercentileToArray.java | 34 +- .../expressions/functions/generator/Explode.java | 61 +- .../generator/ExplodeJsonArrayJsonOuter.java | 4 +- .../functions/generator/ExplodeOuter.java | 61 +- .../expressions/functions/scalar/JsonArray.java | 33 +- .../expressions/functions/scalar/JsonInsert.java | 33 +- .../expressions/functions/scalar/JsonObject.java | 36 +- .../expressions/functions/scalar/JsonReplace.java | 33 +- .../expressions/functions/scalar/JsonSet.java | 33 +- .../scalar/{JsonArray.java => StDisjoint.java} | 30 +- .../scalar/{JsonArray.java => StIntersects.java} | 30 +- .../scalar/{JsonArray.java => StTouches.java} | 30 +- .../functions/scalar/SubstringIndex.java | 11 - .../trees/expressions/literal/DoubleLiteral.java | 30 + .../expressions/literal/StringLikeLiteral.java | 3 +- .../expressions/visitor/ScalarFunctionVisitor.java | 15 + .../persist/ReplacePartitionOperationLog.java | 18 +- .../apache/doris/plugin/audit/AuditLogBuilder.java | 4 +- .../plugin/dialect/HttpDialectConverterPlugin.java | 2 +- .../org/apache/doris/qe/AuditEventProcessor.java | 28 +- .../java/org/apache/doris/qe/AuditLogHelper.java | 7 +- .../org/apache/doris/qe/MysqlConnectProcessor.java | 2 +- .../java/org/apache/doris/qe/ShowExecutor.java | 2 +- .../java/org/apache/doris/qe/StmtExecutor.java | 4 + .../WorkloadRuntimeStatusMgr.java | 13 +- .../apache/doris/service/FrontendServiceImpl.java | 35 +- .../org/apache/doris/statistics/AnalysisJob.java | 6 +- .../apache/doris/statistics/OlapAnalysisTask.java | 6 +- .../apache/doris/transaction/TransactionState.java | 1 + .../org/apache/doris/catalog/CreateViewTest.java | 10 + .../org/apache/doris/datasource/MetaCacheTest.java | 157 +++ .../doris/load/routineload/RoutineLoadJobTest.java | 4 +- .../org/apache/doris/mtmv/MTMVJobInfoTest.java | 45 + .../rules/rewrite/MergePercentileToArrayTest.java | 13 + .../functions/generator/ExplodeOuterTest.java | 95 ++ .../functions/generator/ExplodeTest.java | 95 ++ .../expressions/literal/DoubleLiteralTest.java | 49 + .../expressions/literal/StringLikeLiteralTest.java | 7 + .../doris/qe/StmtExecutorInternalQueryTest.java | 45 + .../apache/doris/statistics/AnalysisJobTest.java | 27 + .../doris/statistics/OlapAnalysisTaskTest.java | 8 +- fe/pom.xml | 13 +- .../doris/broker/hdfs/FileSystemManager.java | 2 +- gensrc/thrift/FrontendService.thrift | 4 + .../data/datatype_p0/complex_types/test.json | 3 + .../hive/test_external_catalog_hive_partition.out | Bin 2711 -> 4455 bytes .../hive/test_hive_get_schema_from_table.out | Bin 0 -> 6103 bytes .../hive/test_hive_orc_predicate.out | Bin 463 -> 2463 bytes .../hive/test_hive_use_meta_cache.out | Bin 2041 -> 2089 bytes .../external_table_p0/tvf/lzo/test_compress.lzo | Bin 0 -> 256 bytes .../test_no_compress_with_empty_block_begin.lzo | Bin 0 -> 200 bytes .../lzo/test_no_compress_with_empty_block_end.lzo | Bin 0 -> 196 bytes .../test_no_compress_with_empty_block_middle.lzo | Bin 0 -> 188 bytes .../external_table_p0/tvf/test_local_tvf_lzo.out | Bin 0 -> 899 bytes .../data/function_p0/test_substring_index.out | Bin 0 -> 2304 bytes .../function_p0/test_substring_index_columns.out | Bin 0 -> 1124 bytes .../function_p0/test_substring_index_simple.out | Bin 0 -> 725 bytes .../data/jsonb_p0/test_jsonb_any_aggregate.out | Bin 0 -> 539 bytes .../create_without_distribute.out | Bin 0 -> 237 bytes .../nereids_function_p0/scalar_function/Array.out | Bin 730458 -> 733828 bytes .../datetime_functions/test_date_function.out | Bin 10015 -> 10112 bytes .../datetime_functions/test_date_function_v2.out | Bin 0 -> 430 bytes .../spatial_functions/test_gis_function.out | Bin 1438 -> 7825 bytes .../merge_percentile_to_array.out | Bin 723 -> 2204 bytes ...t_auto_partition_with_single_replica_insert.csv | 78 ++ ...t_auto_partition_with_single_replica_insert.out | Bin 0 -> 7985 bytes .../data/query_p0/aggregate/array_agg.out | Bin 8132 -> 8211 bytes .../query_p0/cast/test_complextype_to_json.out | Bin 2450 -> 2124 bytes .../array_functions/test_array_functions.out | Bin 28536 -> 28513 bytes .../json_function/test_query_json_array.out | Bin 485 -> 1395 bytes .../json_function/test_query_json_insert.out | Bin 423 -> 1785 bytes .../json_function/test_query_json_object.out | Bin 524 -> 1959 bytes .../json_function/test_query_json_replace.out | Bin 543 -> 1752 bytes .../json_function/test_query_json_set.out | Bin 385 -> 1594 bytes .../spatial_functions/test_gis_function.out | Bin 1604 -> 2684 bytes .../sql_functions/table_function/explode.out | Bin 25904 -> 27843 bytes .../table_function/explode_json_array.out | Bin 6692 -> 6751 bytes regression-test/data/variant_p0/cast.out | Bin 0 -> 247 bytes .../data/variant_p0/sql/sort_permute.out | Bin 0 -> 24264 bytes .../apache/doris/regression/suite/Syncer.groovy | 36 +- .../test_backup_restore_schema_not_consist.groovy | 140 ++ .../test_backup_restore_with_view.groovy | 2 + .../add_drop_partition.groovy | 41 +- .../add_drop_partition_by_hdfs.groovy | 60 +- .../create_table_use_dynamic_partition.groovy | 38 +- ...eate_table_use_dynamic_partition_by_hdfs.groovy | 55 +- .../create_table_use_partition_policy.groovy | 17 +- ...reate_table_use_partition_policy_by_hdfs.groovy | 25 +- .../create_table_use_policy.groovy | 17 +- .../create_table_use_policy_by_hdfs.groovy | 27 +- .../load_colddata_to_hdfs.groovy | 22 +- .../modify_replica_use_partition.groovy | 582 +++++---- .../modify_replica_use_partition_by_hdfs.groovy | 579 +++++---- .../table_modify_resouce_and_policy.groovy | 15 +- .../table_modify_resouce_and_policy_by_hdfs.groovy | 23 +- .../test_show_storage_policy_using.groovy | 2 +- .../test_single_replica_compaction.groovy | 3 +- .../unique/test_unique_auto_inc_concurrent.groovy | 1 - .../complex_types/test_load_with_functions.groovy | 81 ++ .../decimalv3/test_decimalv3_overflow.groovy | 1 - .../test_external_catalog_hive_partition.groovy | 9 + .../hive/test_hive_get_schema_from_table.groovy | 62 + .../hive/test_hive_orc_predicate.groovy | 5 + .../hive/test_hive_use_meta_cache.groovy | 25 +- .../tvf/test_local_tvf_lzo.groovy | 58 + .../suites/function_p0/test_substring_index.groovy | 137 ++ .../test_substring_index_columns.groovy | 114 ++ .../function_p0/test_substring_index_simple.groovy | 89 ++ .../test_dup_table_inverted_index.groovy | 1 - .../jsonb_p0/test_jsonb_any_aggregate.groovy | 109 ++ .../data/{test_schedule.csv => test_metrics.csv} | 0 .../routine_load/test_routine_load_eof.groovy | 29 +- ...eof.groovy => test_routine_load_metrics.groovy} | 170 ++- .../create_without_distribute.groovy | 148 +++ .../mv_with_force_drop/mv_with_force_drop.groovy | 52 + .../scalar_function/Array.groovy | 37 +- .../aggregate/aggregate_groupby_constant.groovy | 26 + .../fold_constant_string_arithmatic.groovy | 386 +++--- .../datetime_functions/test_date_function.groovy | 4 + .../test_date_function_v2.groovy | 53 + .../spatial_functions/test_gis_function.groovy | 305 +++++ .../merge_percentile_to_array.groovy | 21 + ...uto_partition_with_single_replica_insert.groovy | 78 ++ .../test_path_gc_with_publish_version.groovy | 77 ++ .../suites/query_p0/aggregate/array_agg.groovy | 29 + .../array_functions/test_array_functions.groovy | 22 - .../json_function/test_query_json_array.groovy | 51 + .../json_function/test_query_json_insert.groovy | 55 + .../json_function/test_query_json_object.groovy | 56 + .../json_function/test_query_json_replace.groovy | 55 + .../json_function/test_query_json_set.groovy | 55 + .../spatial_functions/test_gis_function.groovy | 81 ++ .../sql_functions/table_function/explode.groovy | 44 + .../table_function/explode_array_decimal.groovy | 2 +- .../table_function/explode_json_array.groovy | 29 +- .../test_mow_time_series_compaction.groovy | 81 ++ .../load.groovy | 11 +- regression-test/suites/variant_p0/cast.groovy | 60 + .../suites/variant_p0/sql/sort_permute.sql | 1037 +++++++++++++++ .../suites/variant_p0/with_index/var_index.groovy | 24 + thirdparty/build-thirdparty.sh | 6 +- thirdparty/vars.sh | 8 +- tools/lzo/README.md | 37 + tools/lzo/build.sh | 20 + tools/lzo/lzo_writer.cpp | 282 ++++ 299 files changed, 12406 insertions(+), 1929 deletions(-) create mode 100644 be/src/vec/exprs/table_function/vexplode_v2.cpp copy be/src/vec/{exec/format/parquet/vparquet_file_metadata.h => exprs/table_function/vexplode_v2.h} (50%) create mode 100644 be/test/vec/columns/common_column_test.h create mode 100644 be/test/vec/exec/orc/orc_convert_dict_test.cpp create mode 100644 be/test/vec/exec/orc/orc_convert_to_orc_literal_test.cpp create mode 100644 be/test/vec/exec/orc/orc_memory_stream_test.h create mode 100644 be/test/vec/exec/orc/orc_reader_fill_data_test.cpp create mode 100644 be/test/vec/exec/orc/orc_reader_init_column_test.cpp create mode 100644 docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/create_hive_orc_tables.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/orc/complex_data_orc/000000_0 copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonArray.java => StDisjoint.java} (59%) copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonArray.java => StIntersects.java} (59%) copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonArray.java => StTouches.java} (60%) create mode 100644 fe/fe-core/src/test/java/org/apache/doris/mtmv/MTMVJobInfoTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/generator/ExplodeOuterTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/functions/generator/ExplodeTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/literal/DoubleLiteralTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/qe/StmtExecutorInternalQueryTest.java create mode 100644 regression-test/data/datatype_p0/complex_types/test.json create mode 100644 regression-test/data/external_table_p0/hive/test_hive_get_schema_from_table.out create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_compress.lzo create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_no_compress_with_empty_block_begin.lzo create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_no_compress_with_empty_block_end.lzo create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_no_compress_with_empty_block_middle.lzo create mode 100644 regression-test/data/external_table_p0/tvf/test_local_tvf_lzo.out create mode 100644 regression-test/data/function_p0/test_substring_index.out create mode 100644 regression-test/data/function_p0/test_substring_index_columns.out create mode 100644 regression-test/data/function_p0/test_substring_index_simple.out create mode 100644 regression-test/data/jsonb_p0/test_jsonb_any_aggregate.out create mode 100644 regression-test/data/mtmv_p0/test_create_without_distribute/create_without_distribute.out create mode 100644 regression-test/data/nereids_p0/sql_functions/datetime_functions/test_date_function_v2.out create mode 100644 regression-test/data/partition_p0/auto_partition/test_auto_partition_with_single_replica_insert.csv create mode 100644 regression-test/data/partition_p0/auto_partition/test_auto_partition_with_single_replica_insert.out create mode 100644 regression-test/data/variant_p0/cast.out create mode 100644 regression-test/data/variant_p0/sql/sort_permute.out create mode 100644 regression-test/suites/backup_restore/test_backup_restore_schema_not_consist.groovy create mode 100644 regression-test/suites/datatype_p0/complex_types/test_load_with_functions.groovy create mode 100644 regression-test/suites/external_table_p0/hive/test_hive_get_schema_from_table.groovy create mode 100644 regression-test/suites/external_table_p0/tvf/test_local_tvf_lzo.groovy create mode 100644 regression-test/suites/function_p0/test_substring_index.groovy create mode 100644 regression-test/suites/function_p0/test_substring_index_columns.groovy create mode 100644 regression-test/suites/function_p0/test_substring_index_simple.groovy create mode 100644 regression-test/suites/jsonb_p0/test_jsonb_any_aggregate.groovy copy regression-test/suites/load_p0/routine_load/data/{test_schedule.csv => test_metrics.csv} (100%) copy regression-test/suites/load_p0/routine_load/{test_routine_load_eof.groovy => test_routine_load_metrics.groovy} (51%) create mode 100644 regression-test/suites/mtmv_p0/test_create_without_distribute/create_without_distribute.groovy create mode 100644 regression-test/suites/mv_p0/mv_with_force_drop/mv_with_force_drop.groovy create mode 100644 regression-test/suites/nereids_p0/sql_functions/datetime_functions/test_date_function_v2.groovy create mode 100644 regression-test/suites/partition_p0/auto_partition/test_auto_partition_with_single_replica_insert.groovy create mode 100644 regression-test/suites/path_gc_p0/test_path_gc_with_publish_version.groovy create mode 100644 regression-test/suites/unique_with_mow_p0/test_mow_time_series_compaction.groovy create mode 100644 regression-test/suites/variant_p0/cast.groovy create mode 100644 regression-test/suites/variant_p0/sql/sort_permute.sql create mode 100644 tools/lzo/README.md create mode 100644 tools/lzo/build.sh create mode 100644 tools/lzo/lzo_writer.cpp --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org