This is an automated email from the ASF dual-hosted git repository. dataroaring pushed a change to branch auto-pick-49905-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git
omit 3606bbfd795 [Opt](mow) Forbid time_series compaction policy on unique table (#49905) add dbf122c25d5 [revert](statistics)Still use sample analyze sql when sample full table. (#50144) add fa2790d5caa branch-3.0: [fix](group commit)Group Commit with stream load mode should wait schema change done #49854 (#50117) add 43d3266c7fe branch-3.0: [fix](mtmv) Fix exception when calc mtmv function dependency but the table in mtmv def sql is deleted #50096 (#50122) add 1578cec7de4 branch-3.0: [Bug](materialized-view) Fixed the problem of using drop table force and create mv stmt at the… #41580 (#50134) add c767276f9a5 [fix](variant)fix core in column_object when sort from empty block (#50033) add af6b068ab3a branch-3.0: [Fix](filecache) Fix file cache sync clear API failing to delete correctly due to relative paths #50111 (#50154) add e277cfb83f4 branch-3.0: [fix](connect) fix wrong format causing connection fail #50214 (#50216) add 5449db8907e branch-3.0: [Fix](case) Fix case that use time series compaction on unique table #50194 (#50223) add 9009e51c03c branch-3.0: [fix](transaction) remove visible rowset from memory during deletion transaction #50066 (#50103) add 0e8cfbd2b3f branch-3.0: [fix](transaction) limit abort txn reason to avoid value length exceeds limit error #50152 (#50208) add e89ed5eebcc branch-3.0: [fix](load) reset routine load task EOF sign correctly #50048 (#50178) add a79b5e8cd9a branch-3.0: [feature](restore) Support force_replace different schema of view for restore #49870 (#49978) add 23af843d7bd [Cherry-pick](branch-3.0) Pick "[Enhancement](Compaction) Add cumulative compaction delay strategy (#48759)" (#49883) add af1a5d00146 branch-3.0: [opt](nereids) set column stats unkown by default when derive Not expressoin #48864 (#49023) add 98700203388 [fix](function) fix error result when STR_TO_DATE input all space (#4… (#48921) add 76b47321338 branch-3.0: [fix](mtmv) Fix materialized rewrite oom when the num of relation mapping is too large #48887 (#49801) add fe577524230 branch-3.0: [Improvement]Add query start datetime #48906 (#48991) add 95bba76d13d [Bug](fix) fix the percentile func result do not equal the percentile array rewrite result (#49377) add a6f8b57dd6f branch-3.0: [fix](multi-catalog) Fix bug: "Can not create a Path from an empty string" (#49382) (#49642) add 5d002d31235 branch-3.0: [opt](nereids) skip run PruneOlapScanTablet when exists lots of InPredicate (#49388) add 053ce2d4828 branch-3.0: [opt](s3client) Add AWS SDK logger for recycler with error logging and enhance S3 client tests #49422 (#49676) add 87d6dc18752 branch-3.0: [fix](nereids)canInferNotNullForMarkSlot method get wrong result if fold constant rule is disabled (#49650) add b3c7f5d5ffc branch-3.0: [fix](system) fix alter system modify hostname with valid ip exception #49551 (#49560) add 35548b4d184 branch-3.0: [feature](function) support utf8 input in initcap #49846 (#49933) add e7d4b9f538b branch-3.0: [Enhancement] Support some spatial functions (#48695) (#50061) add c2976b57509 branch-3.0: [fix](paimon) Covert Paimon DeletionFile Path to StoragePath in fe #49645 (#49750) add 42d6afaf620 branch-3.0: [fix](meta) do not check replica allocation when replay #49569 (#49603) add dfad916a40c branch-3.0: [bugfix](hive) fix_hive_metastore_client_socket_timeout #47378 (#50222) add ae320038777 branch-3.0: [fix](nereids) fix generate column need add cast in stream load #49167 (#50029) add 962c00940ce branch-3.0: [fix](Nereids) cse extract wrong expression from lambda expressions #49166 (#49941) add 750da9f6474 branch-3.0-pick: [Fix](cloud-mow) Fix race between `CloudMetaMgr::sync_tablet_rowsets` and `CloudSchemaChangeJob::_convert_historical_rowsets` (#50051) (#50081) add 39e26d29003 branch-3.0:[fix](nereids)Use utf-8 when convert string like literal to double. (#50085) (#50153) add d22a26e101d branch-3.0: [Fix](inverted index) fix rename column build index bug #50056 (#50169) add a2a87f2ecb5 branch-3.0-pick: [Fix](cloud-mow) Handle tablet delete bitmap calculation task's return value unifiedly in CloudEngineCalcDeleteBitmapTask::execute #50019 (#50045) add 415c2fc9c8b Branch-3.0 Cherry-pick [Fix](Variant) fix variant cast to jsonb into wrong NULL values (#50180) (#50234) add 328c69465e7 branch-3.0: [fix](Export) fix the lock leak issue of Export #50088 (#50218) add a461be6abff branch-3.0: [fix](agg) prevent core dump in ColumnArray::size_at when handling type mismatch in streaming_agg_serialize_to_column #50001 (#50098) add 4d575fd7fff branch-3.0: [fix](hive/iceberg) rectify the fs name if path already contains fs #49998 (#50197) add 11fdbb57eaf branch-3.0: [enhancement](memoryfailed) throw exception instead of log fatal during memory allocate failed #49876 (#49896) add 45569bb3f03 branch-3.0: [Fix](function) fix wrong length check of function array_range #49993 (#49997) add b6de0499814 branch-3.0:[fix](statistics)No need to forward show table stats command. (#50207) (#50229) add e450a7d7e16 [branch-3.0](lock) Remove SpinLock compeletely (#49972) add 52c31d5ccf6 branch-3.0: [fix](nereids) EliminateGroupByConstant should replace agg's group by after removing constant group by keys #49473 (#50043) add 1db091ae334 branch-3.0: [fix](parquet)fix when hive_parquet_use_column_names=false && read partition tb cause be core. #49966 (#50007) add a8fd878ec2c branch-3.0: [fix](mc)Fixed the issue that maxcompute catalog can only read part of the timestamp data #49600 (#49705) add ebbe891b0f0 branch-3.0: [fix](oss) the write to hive table on oss-hdfs may fail (#49754) (#50284) add b2b0dae8963 branch-3.0: [Fix](TrinoConnector) it will return error when query `information_schema.tables` within `trino-connector` catalog #49912 (#50006) add 8969a6bd145 branch-3.0: [opt](hive) add option to get schema from table object #50038 (#50268) add 0577ffde415 branch-3.0: [fix](iceberg) Fix the failure of creating a table in OBS #49983 (#50018) add ae11bd4f6d9 branch-3.0: [chore] Updated submodule orc to orc-for-doris-21 branch. (#50190) add 8aff2301b61 [deps](jindofs) add jindofs for 2.1 (#49259)(#49371)(#49374)(#49502)(#49503)(#49886)(#49903)(#49963) (#50283) add a72ce5eb008 branch-3.0: [Fix](compaction) Only print delete compaction log when there is a delete rowset #49953 (#50291) add 681ac90ba15 branch-3.0: [fix](load) fix routine load job progress fallback after FE master node restart #50221 (#50282) add df504139b8b branch-3.0: [fix](cloud) remove unnecessary DCHECK existence when delete file cache directory #50049 (#50258) add 657003297e7 branch-3.0: [fix](txn) Restart fe after commit txn causes `loadedTblIndexes` lossing #50123 (#50205) add 77fe6b8109d [opt](deps) patch re2 to add ignore_replace_escape option (#50124) (#50324) add 65a742b4d75 branch-3.0: [fix](lzo) fix lzo decompression failed (#49538) (#50323) add ab89bb6d53c branch-3.0: [Fix](Catalog) Close system resources when dropping catalog (#49621) (#49936) add 440d4d8de6c branch-3.0: [fix](trino connector catalog) enable self-attachment for Java agents and adjust settings for Mac systems #49520 (#49680) add 12572b01bc7 branch-3.0: [fix](cloud-mow)Schema change fail should release delete bitmap lock #49889 (#50335) add 8894c73ee8a branch-3.0: [fix](profile) Fix incorrect check of Profile.shouldStoreToStorage #49925 (#49991) add 68c292081e0 branch-3.0: [Opt](cloud) Refactor `OlapScanLocalState::hold_tablets` (#49945) (#50332) add 1fdf36aeb51 branch-3.0: [fix](serDe) global function could not deserialization from image #50279 (#50347) add 785af8c7252 branch-3.0: [Fix](vault) Remove double slashes when s3 vault prefix is empty #50352 (#50377) add 21a440df3ff branch-3.0: [fix](orc) Should not pass selection vector when decode child column of List or Map #50136 (#50317) add 15d698eaf96 branch-3.0: [enhance](hive) support skip.header.line.count #49929 (#49975) add 0fb1395effd [fix](compaction) fix time series compaction time threshold (#50306) (#50391) add a9da4deb318 [opt](paimon/iceberg)upgrade paimon to 1.0.1, iceberg to 1.6.1 (#49280) add 790ab9e6fb1 [enhance](third-party) Add pugixml library (#49238) (#50396) add d4b3dc640a4 branch-3.0: [opt](Nereids) avoid generate nested alias expr when plan insert values (#50386) add 55630ff2609 branch-3.0:[fix](auditlog)Set sqlHash in executeInternalQuery (#49984) (#50365) add 54c43a13c53 [fix](cloud) batch process ttl cache block gc to limit lock held time once in a time (pick#50387) (#50402) add 79fcf4fb905 branch-3.0: [fix](s3client) Avoild dead loop when storage not support `ListObjectsV2` #50252 (#50413) add 92b9fbea349 [enhancement](statistics) Add segment footer open stats to profile (#50326) (#50416) add c5c18915648 branch-3.0: [enhance](mtmv)Only restrict MTMV to not allow concurrent insert overwrite execution #48673 (#49964) add 1bf4983bdf5 branch-3.0: [fix](Nereids) fix regression framework compare issue and fix code point count (#49575) (#49741) add 18f43b0bdcf [Opt](mow) Forbid time_series compaction policy on unique table (#49905) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (3606bbfd795) \ N -- N -- N refs/heads/auto-pick-49905-branch-3.0 (18f43b0bdcf) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/build-thirdparty.yml | 21 +- .gitmodules | 2 +- be/src/cloud/cloud_compaction_action.cpp | 3 +- be/src/cloud/cloud_cumulative_compaction.h | 3 + .../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 41 +- .../cloud/cloud_engine_calc_delete_bitmap_task.h | 4 +- be/src/cloud/cloud_meta_mgr.cpp | 15 + be/src/cloud/cloud_meta_mgr.h | 4 + be/src/cloud/cloud_schema_change_job.cpp | 23 +- be/src/cloud/cloud_schema_change_job.h | 1 + be/src/cloud/cloud_storage_engine.cpp | 54 +- be/src/cloud/cloud_storage_engine.h | 4 +- be/src/cloud/cloud_tablet.cpp | 9 +- be/src/cloud/cloud_tablet.h | 3 + be/src/cloud/cloud_tablets_channel.cpp | 2 +- be/src/common/config.cpp | 16 +- be/src/common/config.h | 14 + be/src/common/object_pool.h | 12 +- be/src/exec/lzo_decompressor.cpp | 18 +- be/src/geo/geo_common.h | 7 +- be/src/geo/geo_types.cpp | 988 ++++++++++++++ be/src/geo/geo_types.h | 59 + be/src/geo/wkt_parse_type.h | 2 + be/src/geo/wkt_yacc.y | 37 +- be/src/http/action/compaction_action.cpp | 9 + be/src/io/cache/block_file_cache.cpp | 18 +- be/src/io/cache/block_file_cache.h | 1 + be/src/io/cache/fs_file_cache_storage.cpp | 3 +- be/src/io/file_factory.cpp | 32 +- be/src/io/file_factory.h | 3 + be/src/io/fs/s3_obj_storage_client.cpp | 6 + be/src/olap/compaction.cpp | 25 +- be/src/olap/compaction.h | 4 + be/src/olap/cumulative_compaction.cpp | 7 + .../cumulative_compaction_time_series_policy.cpp | 37 +- be/src/olap/delta_writer.h | 1 - be/src/olap/delta_writer_v2.h | 1 - be/src/olap/memtable_writer.cpp | 18 +- be/src/olap/memtable_writer.h | 6 +- be/src/olap/olap_server.cpp | 56 + be/src/olap/rowset/beta_rowset.cpp | 5 +- be/src/olap/rowset/beta_rowset.h | 4 +- be/src/olap/rowset/beta_rowset_reader.cpp | 2 +- be/src/olap/rowset/beta_rowset_writer.h | 5 +- be/src/olap/rowset/beta_rowset_writer_v2.h | 19 +- be/src/olap/rowset/segment_creator.h | 6 - be/src/olap/rowset/segment_v2/segment.cpp | 21 +- be/src/olap/rowset/segment_v2/segment.h | 10 +- be/src/olap/rowset/vertical_beta_rowset_writer.cpp | 9 - be/src/olap/segment_loader.cpp | 2 +- be/src/olap/storage_engine.cpp | 24 +- be/src/olap/storage_engine.h | 10 +- be/src/olap/tablet.cpp | 6 - be/src/olap/tablet_schema.cpp | 7 +- be/src/olap/task/index_builder.cpp | 3 +- be/src/olap/txn_manager.cpp | 5 +- be/src/pipeline/exec/data_queue.h | 3 +- be/src/pipeline/exec/olap_scan_operator.cpp | 94 +- be/src/runtime/load_channel.cpp | 3 +- be/src/runtime/load_channel.h | 3 +- be/src/runtime/load_stream_writer.h | 1 - be/src/runtime/query_statistics.h | 7 +- be/src/runtime/record_batch_queue.cpp | 3 +- be/src/runtime/record_batch_queue.h | 5 +- be/src/runtime/tablets_channel.cpp | 8 +- be/src/runtime/tablets_channel.h | 3 +- be/src/runtime/user_function_cache.cpp | 1 - be/src/util/lru_multi_cache.h | 38 +- be/src/util/lru_multi_cache.inline.h | 24 +- be/src/util/s3_util.cpp | 49 +- be/src/util/spinlock.h | 62 - be/src/util/threadpool.cpp | 5 + be/src/util/trace.h | 1 - be/src/util/uuid_generator.h | 8 +- .../aggregate_function_collect.h | 3 +- .../aggregate_function_percentile.cpp | 1 + .../aggregate_function_percentile.h | 2 +- .../aggregate_functions/aggregate_function_sort.h | 6 +- .../aggregate_function_window_funnel.h | 4 +- be/src/vec/columns/column_object.cpp | 8 +- be/src/vec/common/assert_cast.h | 1 + .../data_types/serde/data_type_object_serde.cpp | 6 + .../vec/data_types/serde/data_type_object_serde.h | 5 +- .../file_reader/new_plain_text_line_reader.cpp | 14 +- be/src/vec/exec/format/orc/vorc_reader.cpp | 14 +- be/src/vec/exec/format/parquet/vparquet_reader.cpp | 3 +- .../vec/functions/array/function_array_range.cpp | 4 +- be/src/vec/functions/function_cast.h | 15 +- be/src/vec/functions/function_string.cpp | 53 +- be/src/vec/functions/functions_geo.cpp | 69 +- be/src/vec/runtime/vdatetime_value.cpp | 6 - be/src/vec/sink/writer/vhive_partition_writer.cpp | 13 - be/src/vec/sink/writer/vtablet_writer.cpp | 12 +- be/src/vec/sink/writer/vtablet_writer.h | 7 +- be/test/geo/geo_types_test.cpp | 1351 ++++++++++++++++++++ be/test/io/cache/block_file_cache_test.cpp | 64 + be/test/io/fs/s3_obj_storage_client_test.cpp | 171 +++ be/test/io/fs/s3_obj_stroage_client_mock_test.cpp | 121 ++ be/test/olap/cumulative_compaction_test.cpp | 31 + ...mulative_compaction_time_series_policy_test.cpp | 11 +- be/test/olap/index_builder_test.cpp | 175 +++ be/test/olap/txn_manager_test.cpp | 44 + be/test/util/threadpool_test.cpp | 9 +- be/test/vec/columns/column_object_test.cpp | 37 + be/test/vec/columns/common_column_test.h | 111 ++ be/test/vec/exec/parquet/parquet_thrift_test.cpp | 1 - be/test/vec/function/function_string_test.cpp | 2 + be/test/vec/runtime/vdatetime_value_test.cpp | 45 + build.sh | 37 +- cloud/src/common/config.h | 11 + cloud/src/meta-service/meta_service_job.cpp | 2 +- cloud/src/recycler/s3_accessor.cpp | 21 +- cloud/src/recycler/s3_obj_client.cpp | 11 + cloud/test/CMakeLists.txt | 4 + cloud/test/s3_accessor_mock_test.cpp | 43 +- common/cpp/aws_logger.h | 68 + conf/be.conf | 2 +- conf/fe.conf | 2 +- dist/LICENSE-dist.txt | 1 + dist/licenses/LICENSE-pugixml.txt | 24 + .../create_hive_orc_tables.hql | 11 + .../scripts/create_preinstalled_scripts/run74.hql | 53 + .../scripts/create_preinstalled_scripts/run76.hql | 21 + .../orc/complex_data_orc/000000_0 | Bin 0 -> 561 bytes .../partition_col=,/000000_0 | Bin 0 -> 408 bytes .../partition_col=a, b, c/000000_0 | Bin 0 -> 408 bytes .../partition_col=a, b/000000_0 | Bin 0 -> 408 bytes .../text_table_compressed_skip_header/000000_0.gz | Bin 0 -> 149 bytes .../text/text_table_normal_skip_header/000000_0 | 20 + .../doris/maxcompute/MaxComputeColumnValue.java | 63 +- .../trinoconnector/TrinoConnectorPluginLoader.java | 8 + fe/fe-core/pom.xml | 16 +- .../java/org/apache/doris/alter/RollupJobV2.java | 6 +- .../doris/analysis/ModifyNodeHostNameClause.java | 2 - .../apache/doris/analysis/ShowTableStatsStmt.java | 5 - .../java/org/apache/doris/backup/RestoreJob.java | 99 +- .../doris/catalog/BuiltinAggregateFunctions.java | 2 +- .../doris/catalog/BuiltinScalarFunctions.java | 6 + .../apache/doris/catalog/ColocateTableIndex.java | 8 +- .../main/java/org/apache/doris/catalog/Env.java | 2 +- .../java/org/apache/doris/catalog/FunctionSet.java | 9 + .../apache/doris/catalog/GlobalFunctionMgr.java | 2 +- .../main/java/org/apache/doris/catalog/MTMV.java | 3 +- .../java/org/apache/doris/catalog/TableIf.java | 1 + .../transaction/CloudGlobalTransactionMgr.java | 3 + .../org/apache/doris/common/profile/Profile.java | 41 +- .../doris/common/util/DynamicPartitionUtil.java | 19 +- .../org/apache/doris/common/util/LocationPath.java | 5 +- .../org/apache/doris/datasource/CatalogIf.java | 2 +- .../org/apache/doris/datasource/CatalogMgr.java | 2 +- .../apache/doris/datasource/ExternalCatalog.java | 25 +- .../doris/datasource/hive/HMSExternalCatalog.java | 24 +- .../doris/datasource/hive/HMSExternalTable.java | 23 +- .../doris/datasource/hive/HiveMetaStoreCache.java | 21 +- .../doris/datasource/hive/HiveProperties.java | 22 +- .../datasource/hive/ThriftHMSCachedClient.java | 2 +- .../doris/datasource/hive/source/HiveScanNode.java | 3 + .../datasource/iceberg/IcebergExternalCatalog.java | 8 + .../datasource/iceberg/IcebergMetadataOps.java | 3 + .../datasource/iceberg/source/IcebergScanNode.java | 42 +- .../doris/datasource/jdbc/JdbcExternalCatalog.java | 8 +- .../maxcompute/source/MaxComputeScanNode.java | 2 +- .../datasource/paimon/PaimonExternalCatalog.java | 11 +- .../datasource/paimon/PaimonExternalTable.java | 2 +- .../datasource/paimon/PaimonMetadataCache.java | 2 +- .../apache/doris/datasource/paimon/PaimonUtil.java | 2 +- .../datasource/paimon/source/PaimonScanNode.java | 13 +- .../datasource/property/PropertyConverter.java | 3 +- .../trinoconnector/TrinoConnectorPluginLoader.java | 8 + .../doris/fs/remote/SwitchingFileSystem.java | 2 +- .../insertoverwrite/InsertOverwriteManager.java | 3 +- .../doris/insertoverwrite/InsertOverwriteUtil.java | 9 +- .../main/java/org/apache/doris/load/ExportJob.java | 1 - .../org/apache/doris/load/StreamLoadHandler.java | 18 +- .../load/routineload/KafkaRoutineLoadJob.java | 6 + .../load/routineload/RoutineLoadTaskInfo.java | 7 + .../main/java/org/apache/doris/mtmv/MTMVCache.java | 3 +- .../org/apache/doris/mysql/AcceptListener.java | 3 +- .../mysql/privilege/AccessControllerManager.java | 8 +- .../post/CommonSubExpressionCollector.java | 24 +- .../processor/post/CommonSubExpressionOpt.java | 2 +- .../doris/nereids/rules/analysis/BindSink.java | 1 + .../rules/analysis/EliminateGroupByConstant.java | 5 +- .../mv/AbstractMaterializedViewRule.java | 11 +- .../mv/AsyncMaterializationContext.java | 3 +- .../rules/exploration/mv/mapping/Mapping.java | 4 +- .../exploration/mv/mapping/RelationMapping.java | 29 +- .../doris/nereids/stats/FilterEstimation.java | 12 +- .../functions/executable/StringArithmetic.java | 52 +- .../expressions/functions/scalar/StDisjoint.java | 72 ++ .../expressions/functions/scalar/StIntersects.java | 72 ++ .../expressions/functions/scalar/StTouches.java | 72 ++ .../expressions/literal/StringLikeLiteral.java | 3 +- .../visitor/ExpressionColumnFilterConverter.java | 5 + .../expressions/visitor/ScalarFunctionVisitor.java | 15 + .../trees/plans/commands/info/CreateTableInfo.java | 25 +- .../trees/plans/logical/LogicalOlapScan.java | 11 +- .../apache/doris/nereids/types/AggStateType.java | 1 + .../apache/doris/nereids/util/ExpressionUtils.java | 11 +- .../apache/doris/plugin/audit/AuditLogBuilder.java | 29 +- .../java/org/apache/doris/qe/StmtExecutor.java | 4 + .../org/apache/doris/statistics/AnalysisJob.java | 6 +- .../apache/doris/statistics/OlapAnalysisTask.java | 6 +- .../GroupCommitTableValuedFunction.java | 6 + .../apache/doris/transaction/TransactionState.java | 1 + .../apache/doris/common/profile/ProfileTest.java | 263 ++++ .../apache/doris/common/util/LocationPathTest.java | 33 +- .../doris/datasource/RefreshCatalogTest.java | 2 +- .../InsertOverwriteManagerTest.java | 30 +- .../insertoverwrite/InsertOverwriteUtilTest.java | 36 +- .../doris/nereids/mv/RelationMappingTest.java | 158 +++ .../postprocess/CommonSubExpressionTest.java | 46 +- .../nereids/rules/analysis/GenerateFunction.java | 1 + .../rules/exploration/mv/HyperGraphAggTest.java | 3 +- .../nereids/rules/exploration/mv/MappingTest.java | 24 +- .../nereids/rules/expression/FoldConstantTest.java | 2 +- .../apache/doris/nereids/sqltest/SqlTestBase.java | 3 +- .../doris/nereids/trees/expressions/UdfTest.java | 10 +- .../expressions/literal/StringLikeLiteralTest.java | 7 + .../util/CanInferNotNullForMarkSlotTest.java | 87 ++ .../doris/plugin/audit/AuditLogBuilderTest.java | 48 + .../doris/qe/StmtExecutorInternalQueryTest.java | 45 + .../apache/doris/statistics/AnalysisJobTest.java | 27 + .../doris/statistics/OlapAnalysisTaskTest.java | 8 +- fe/pom.xml | 12 +- .../data/correctness/test_str_to_date.out | Bin 443 -> 471 bytes .../objects3.csv | 8 + .../stream_load_and_mysql_load.out | Bin 897 -> 1082 bytes .../hive/test_external_catalog_hive_partition.out | Bin 2711 -> 4455 bytes .../hive/test_hive_get_schema_from_table.out | Bin 0 -> 6103 bytes .../hive/test_hive_orc_predicate.out | Bin 463 -> 2463 bytes .../hive/test_hive_partitions.out | Bin 3171 -> 3333 bytes .../hive/test_text_skip_header.out | Bin 0 -> 755 bytes .../iceberg/write/test_iceberg_write_insert.out | Bin 142167 -> 162889 bytes .../paimon/test_paimon_deletion_vector_oss.out | Bin 0 -> 525 bytes .../external_table_p0/tvf/lzo/test_compress.lzo | Bin 0 -> 256 bytes .../test_no_compress_with_empty_block_begin.lzo | Bin 0 -> 200 bytes .../lzo/test_no_compress_with_empty_block_end.lzo | Bin 0 -> 196 bytes .../test_no_compress_with_empty_block_middle.lzo | Bin 0 -> 188 bytes .../external_table_p0/tvf/test_local_tvf_lzo.out | Bin 0 -> 899 bytes .../maxcompute/test_max_compute_timestamp.out | Bin 3944 -> 5359 bytes ...oud_sc_convert_data_replaced_on_new_tablet.out} | Bin 188 -> 209 bytes .../data/function_p0/test_function_string.out | Bin 188 -> 247 bytes .../test_env_db_dropped_mtmv.out} | Bin 188 -> 127 bytes .../nereids_function_p0/scalar_function/Array.out | Bin 769953 -> 773323 bytes .../test_aggregate_percentile_no_cast.out | Bin 1410 -> 1426 bytes .../test_aggregate_window_functions.out | Bin 21104 -> 21134 bytes .../spatial_functions/test_gis_function.out | Bin 1539 -> 6772 bytes .../data/query_p0/aggregate/aggregate.out | Bin 9762 -> 9841 bytes .../data/query_p0/aggregate/array_agg.out | Bin 8132 -> 8211 bytes .../spatial_functions/test_gis_function.out | Bin 1604 -> 2684 bytes .../string_functions/test_string_function.out | Bin 4890 -> 4892 bytes regression-test/data/variant_p0/cast.out | Bin 0 -> 247 bytes .../data/variant_p0/sql/sort_permute.out | Bin 0 -> 24264 bytes .../org/apache/doris/regression/suite/Suite.groovy | 10 +- .../pipeline/cloud_p0/conf/be_custom.conf | 3 + .../pipeline/cloud_p1/conf/be_custom.conf | 2 + regression-test/pipeline/p0/conf/be.conf | 1 + regression-test/pipeline/p1/conf/be.conf | 3 + ...t_backup_restore_force_replace_diff_view.groovy | 84 ++ .../test_single_replica_compaction.groovy | 3 +- .../test_time_series_compaction_policy.groovy | 30 + .../suites/correctness/test_str_to_date.groovy | 4 + .../stream_load_and_mysql_load.groovy | 36 + .../test_external_catalog_hive_partition.groovy | 9 + .../hive/test_hive_get_schema_from_table.groovy | 62 + .../hive/test_hive_orc_predicate.groovy | 5 + .../hive/test_hive_partitions.groovy | 6 +- .../hive/test_text_skip_header.groovy | 45 + .../iceberg/write/test_iceberg_write_insert.groovy | 23 +- .../paimon/test_paimon_deletion_vector_oss.groovy | 60 + .../test_trinoconnector_information_schema.groovy | 44 + .../tvf/test_local_tvf_lzo.groovy | 58 + .../maxcompute/test_max_compute_timestamp.groovy | 54 + ..._cloud_multi_segments_re_calc_in_publish.groovy | 105 +- ...d_sc_convert_data_replaced_on_new_tablet.groovy | 123 ++ .../test_sc_fail_release_delete_bitmap_lock.groovy | 136 ++ ...st_cumu_compaction_delay_fault_injection.groovy | 567 ++++++++ .../suites/function_p0/test_function_string.groovy | 11 + .../test_iot_auto_detect_concurrent.groovy | 14 +- .../test_dup_table_inverted_index.groovy | 1 - .../data/test_routine_load_progress.csv | 4 + .../routine_load/test_routine_load_eof.groovy | 29 +- .../routine_load/test_routine_load_progress.groovy | 130 ++ .../suites/mtmv_p0/test_env_db_dropped_mtmv.groovy | 4 + .../mv_with_force_drop/mv_with_force_drop.groovy | 52 + .../scalar_function/Array.groovy | 33 +- .../aggregate/aggregate_groupby_constant.groovy | 26 + .../fold_constant/fold_constant_cast.groovy | 15 +- .../fold_constant_date_arithmatic.groovy | 1 + .../fold_constant_string_arithmatic.groovy | 548 ++++---- .../spatial_functions/test_gis_function.groovy | 248 ++++ .../suites/nereids_rules_p0/cse/cse.groovy | 39 +- .../mv/many_self_join/many_self_join.groovy | 92 ++ .../suites/query_p0/aggregate/aggregate.groovy | 40 + .../suites/query_p0/aggregate/array_agg.groovy | 31 + .../array_functions/test_array_functions.groovy | 22 - .../spatial_functions/test_gis_function.groovy | 81 ++ .../test_schema_change_with_group_commit.groovy | 112 ++ regression-test/suites/variant_p0/cast.groovy | 60 + .../suites/variant_p0/sql/sort_permute.sql | 1037 +++++++++++++++ thirdparty/CHANGELOG.md | 12 + thirdparty/build-thirdparty.sh | 28 + thirdparty/download-thirdparty.sh | 15 + .../patches/re2-2021-02-02-ignore-replace.patch | 63 + thirdparty/vars.sh | 14 + tools/lzo/README.md | 37 + tools/lzo/build.sh | 20 + tools/lzo/lzo_writer.cpp | 282 ++++ 309 files changed, 10036 insertions(+), 1236 deletions(-) delete mode 100644 be/src/util/spinlock.h create mode 100644 be/test/io/fs/s3_obj_storage_client_test.cpp create mode 100644 be/test/io/fs/s3_obj_stroage_client_mock_test.cpp create mode 100644 be/test/vec/columns/common_column_test.h create mode 100644 common/cpp/aws_logger.h create mode 100644 dist/licenses/LICENSE-pugixml.txt create mode 100644 docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/create_hive_orc_tables.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run74.hql create mode 100755 docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/run76.hql create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/orc/complex_data_orc/000000_0 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/partition_tables/string_partition_table_with_comma/partition_col=,/000000_0 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/partition_tables/string_partition_table_with_comma/partition_col=a, b, c/000000_0 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/partition_tables/string_partition_table_with_comma/partition_col=a, b/000000_0 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/text/text_table_compressed_skip_header/000000_0.gz create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/text/text_table_normal_skip_header/000000_0 create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StDisjoint.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StIntersects.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/StTouches.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/common/profile/ProfileTest.java copy be/src/geo/wkt_parse_type.h => fe/fe-core/src/test/java/org/apache/doris/insertoverwrite/InsertOverwriteUtilTest.java (59%) create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/mv/RelationMappingTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/util/CanInferNotNullForMarkSlotTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/plugin/audit/AuditLogBuilderTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/qe/StmtExecutorInternalQueryTest.java create mode 100644 regression-test/data/ddl_p0/test_create_table_generated_column/objects3.csv create mode 100644 regression-test/data/external_table_p0/hive/test_hive_get_schema_from_table.out create mode 100644 regression-test/data/external_table_p0/hive/test_text_skip_header.out create mode 100644 regression-test/data/external_table_p0/paimon/test_paimon_deletion_vector_oss.out create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_compress.lzo create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_no_compress_with_empty_block_begin.lzo create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_no_compress_with_empty_block_end.lzo create mode 100644 regression-test/data/external_table_p0/tvf/lzo/test_no_compress_with_empty_block_middle.lzo create mode 100644 regression-test/data/external_table_p0/tvf/test_local_tvf_lzo.out copy regression-test/data/{function_p0/test_function_string.out => fault_injection_p0/cloud/test_cloud_sc_convert_data_replaced_on_new_tablet.out} (56%) copy regression-test/data/{function_p0/test_function_string.out => mtmv_p0/test_env_db_dropped_mtmv.out} (51%) create mode 100644 regression-test/data/variant_p0/cast.out create mode 100644 regression-test/data/variant_p0/sql/sort_permute.out create mode 100644 regression-test/suites/backup_restore/test_backup_restore_force_replace_diff_view.groovy create mode 100644 regression-test/suites/external_table_p0/hive/test_hive_get_schema_from_table.groovy create mode 100644 regression-test/suites/external_table_p0/hive/test_text_skip_header.groovy create mode 100644 regression-test/suites/external_table_p0/paimon/test_paimon_deletion_vector_oss.groovy create mode 100644 regression-test/suites/external_table_p0/trino_connector/test_trinoconnector_information_schema.groovy create mode 100644 regression-test/suites/external_table_p0/tvf/test_local_tvf_lzo.groovy create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_cloud_sc_convert_data_replaced_on_new_tablet.groovy create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_sc_fail_release_delete_bitmap_lock.groovy create mode 100644 regression-test/suites/fault_injection_p0/test_cumu_compaction_delay_fault_injection.groovy create mode 100644 regression-test/suites/load_p0/routine_load/data/test_routine_load_progress.csv create mode 100644 regression-test/suites/load_p0/routine_load/test_routine_load_progress.groovy create mode 100644 regression-test/suites/mv_p0/mv_with_force_drop/mv_with_force_drop.groovy copy fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/literal/StringLikeLiteralTest.java => regression-test/suites/nereids_rules_p0/cse/cse.groovy (54%) create mode 100644 regression-test/suites/nereids_rules_p0/mv/many_self_join/many_self_join.groovy create mode 100644 regression-test/suites/schema_change_p0/test_schema_change_with_group_commit.groovy create mode 100644 regression-test/suites/variant_p0/cast.groovy create mode 100644 regression-test/suites/variant_p0/sql/sort_permute.sql create mode 100644 thirdparty/patches/re2-2021-02-02-ignore-replace.patch create mode 100644 tools/lzo/README.md create mode 100644 tools/lzo/build.sh create mode 100644 tools/lzo/lzo_writer.cpp --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org