This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch auto-pick-56076-branch-3.1
in repository https://gitbox.apache.org/repos/asf/doris.git
discard b559022dde5 [test](iceberg) add iceberg rest obs gcs hdfs test (#56076)
add 247bab28ccb branch-3.1: [opt](properties) remove old dlf properties
#55555 (#56196)
add b0402c31755 branch-3.1: [fix](jdbc catalog) Use SQL to get column
without using ` enclosed #55922 (#56217)
add 8763934eb29 branch-3.1: [fix](test) Fix mv case wrongly and fix mv
rewrite fail when sync mv used all agg table group by field #55878 (#56174)
add 6ff6fe39088 branch-3.1: [fix](iceberg) Fix classloader usage in the
Iceberg system table scanner #56150 (#56220)
add c4f3594f794 branch-3.1: [fix](export) avoid throw npe when export task
has illegal url #56161 (#56223)
add 98b23ae7991 branch-3.1: [Fix](Catalog)S3A: Support assuming IAM role
via ProfileCredentialsProvider #56213 (#56250)
add d08e2b2ecbf branch-3.1: [fix](multi-catalog) should set
initedScanRangeLocations after getScanRangeLocations #56245 (#56265)
add 3d43e02e95c branch-3.1: [fix](inverted index) enable custom analyzer
support for match without index #55858 (#56267)
add 29fb03f4180 branch-3.1: [feat](table) let compress type be configable
#56074 (#56276)
add 57bfe708522 branch-3.1: [feat](compaction) Make base compaction output
rowset write filecache more adaptive #54694 (#56278)
add a8522da8024 branch-3.1: [fix](load_stream) close brpc stream after
load stream is closed #56120 (#56287)
add f63d5709c9c branch-3.1 [fix](regression) multi-contains in
ExplainAction print undefined string #46095 (#56288)
add e33a0c379a2 branch-3.1: [enhance](mtmv)Base table changes should not
cause nested MTMV to schema change status #56244 (#56298)
add e4f1e1e4451 branch-3.1: [fix](script) Fix recycler cannot find
`core-site.xml` and `hdfs-site.xml` #56248 (#56317)
add a38ccb6a103 branch-3.1: [Fix](s3) Fix hdfs will throw an exception if
the URL verification fails #56268 (#56320)
add 62ee0c8ee0e branch-3.1: [opt](paimon) Optimize Paimon Time Travel
Implementation and Fix Schema Consistency Issues #56023 (#56338)
add d0dbf4d5bb9 branch-3.1: [chore](test)Icebebrg test uses doris's fileio
#56193 (#56369)
add 7dc4d3ac356 branch-3.1: [opt](iceberg) opt the error msg of iceberg
scan node #56327 (#56370)
add da836fa628b branch-3.1: [metrics](warmup) add bvar for skipped warmup
rowsets #56301 (#56373)
add 553f742143b branch-3.1: [feature](udf) Support for IP types in Java
UDF #44871 (#56346)
add 89927436379 branch-3.1: [fix](load) fix s3 load check failed when no
source file found #56319 (#56376)
add 9dab3cbfd2f branch-3.1: [enhancement](filecache) fix
read_cache_file_directly #54503 (#56378)
add a3f7212b4db branch-3.1: [improve](bin) do not chmod if current user
has x and r privilige #56351 (#56379)
add 3c8ea2e9a19 [test](iceberg) add iceberg rest obs gcs hdfs test (#56076)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (b559022dde5)
\
N -- N -- N refs/heads/auto-pick-56076-branch-3.1 (3c8ea2e9a19)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/cloud/cloud_base_compaction.cpp | 10 +-
be/src/cloud/cloud_warm_up_manager.cpp | 3 +
be/src/common/config.cpp | 3 +
be/src/common/config.h | 3 +
be/src/io/cache/block_file_cache.cpp | 81 ++-
be/src/io/cache/block_file_cache.h | 83 ++-
be/src/io/cache/block_file_cache_factory.cpp | 13 +
be/src/io/cache/block_file_cache_factory.h | 1 +
be/src/io/cache/cached_remote_file_reader.cpp | 53 +-
be/src/io/cache/file_block.h | 8 +
be/src/io/fs/file_writer.h | 6 +
be/src/olap/compaction.cpp | 44 +-
be/src/olap/compaction.h | 5 +
be/src/olap/rowset/rowset.cpp | 31 +
be/src/olap/rowset/rowset.h | 4 +
be/src/runtime/load_stream.cpp | 25 +-
be/src/runtime/load_stream.h | 4 +-
be/src/vec/exec/jni_connector.cpp | 12 +-
be/src/vec/functions/match.cpp | 11 +-
be/src/vec/sink/load_stream_map_pool.cpp | 6 +-
be/src/vec/sink/load_stream_map_pool.h | 1 +
be/src/vec/sink/load_stream_stub.cpp | 11 +-
be/src/vec/sink/load_stream_stub.h | 4 +-
be/test/cloud/cloud_compaction_test.cpp | 45 ++
be/test/io/cache/block_file_cache_test.cpp | 176 +++++
.../io/cache/block_file_cache_test_lru_dump.cpp | 99 +++
bin/start_be.sh | 6 +-
cloud/script/start.sh | 7 +-
docker/runtime/doris-compose/cluster.py | 4 +-
.../create_preinstalled_scripts/paimon/run09.sql | 24 +-
.../doris/iceberg/IcebergSysTableJniScanner.java | 60 +-
.../doris/common/jni/utils/JavaUdfDataType.java | 8 +
.../doris/common/jni/utils/TypeNativeBytes.java | 16 +
.../apache/doris/common/jni/utils/UdfUtils.java | 6 +
.../apache/doris/common/jni/vec/ColumnType.java | 20 +
.../apache/doris/common/jni/vec/VectorColumn.java | 79 +++
.../main/java/org/apache/doris/catalog/Type.java | 4 +-
.../main/java/org/apache/doris/common/Config.java | 9 +
.../java/org/apache/doris/catalog/BrokerMgr.java | 5 +-
.../java/org/apache/doris/catalog/HMSResource.java | 3 -
.../org/apache/doris/catalog/TableProperty.java | 8 +-
.../org/apache/doris/common/util/PrintableMap.java | 10 +-
.../apache/doris/common/util/PropertyAnalyzer.java | 34 +-
.../datasource/iceberg/source/IcebergScanNode.java | 13 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 4 +-
.../lakesoul/LakeSoulExternalCatalog.java | 3 +-
.../datasource/paimon/PaimonExternalTable.java | 27 +-
.../apache/doris/datasource/paimon/PaimonUtil.java | 221 +-----
.../datasource/paimon/source/PaimonScanNode.java | 32 +-
.../property/ConnectorPropertiesUtils.java | 22 +
.../datasource/property/ConnectorProperty.java | 2 +
.../datasource/property/PropertyConverter.java | 281 --------
.../property/constants/DLFProperties.java | 60 --
.../metastore/AliyunDLFBaseProperties.java | 7 +-
.../property/metastore/AliyunDLFProperties.java | 115 ---
.../property/storage/HdfsPropertiesUtils.java | 13 +-
.../datasource/property/storage/S3Properties.java | 3 +
.../doris/load/loadv2/BrokerLoadPendingTask.java | 2 +
.../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 4 +-
.../org/apache/doris/mtmv/MTMVRelationManager.java | 2 +-
.../apache/doris/common/util/PrintableMapTest.java | 261 +++++++
.../datasource/property/PropertyConverterTest.java | 777 ---------------------
.../metastore/AliyunDLFBasePropertiesTest.java | 12 +
.../tvf/source/MetadataScanNodeTest.java | 166 +++++
gensrc/proto/internal_service.proto | 1 +
.../jdbc/test_doris_jdbc_catalog.out | 13 +-
.../paimon/paimon_time_travel.out | 98 +++
.../tvf/test_s3_tvf_globlist.out} | 32 +-
.../analyzer/test_custom_analyzer.out | 3 +
.../test_base_alter_col_type_multi_level_mtmv.out | 2 +-
.../test_base_drop_col_multi_level_mtmv.out | 2 +-
.../mtmv_p0/test_base_drop_multi_level_mtmv.out | 2 +-
.../test_base_rename_col_multi_level_mtmv.out | 2 +-
.../mtmv_p0/test_base_rename_multi_level_mtmv.out | 2 +-
.../mtmv_p0/test_base_replace_multi_level_mtmv.out | 4 +-
.../data/mtmv_p0/test_multi_level_mtmv.out | 2 +-
.../data/nereids_p0/javaudf/test_javaudf_ip.out | 42 ++
.../doris/regression/action/ExplainAction.groovy | 2 +-
.../java/org/apache/doris/udf/IPV4TypeTest.java | 74 ++
.../java/org/apache/doris/udf/IPV6TypeTest.java | 73 ++
.../doris/udf/{MySumArrayInt.java => MySumIP.java} | 48 +-
.../cache/http/test_list_cache_file.groovy | 3 +
.../test_filecache_with_base_compaction.groovy | 8 +-
...ilecache_with_base_compaction_thresthold.groovy | 756 ++++++++++++++++++++
.../test_export_table_with_label_retry.groovy | 3 +
.../test_iceberg_partition_evolution.groovy | 2 +-
.../jdbc/test_doris_jdbc_catalog.groovy | 17 +
.../paimon/paimon_time_travel.groovy | 119 +++-
.../tvf/test_s3_tvf_globlist.groovy | 54 ++
.../iceberg_on_hms_and_filesystem_and_dlf.groovy | 3 +-
.../analyzer/test_custom_analyzer.groovy | 23 +
...ksk.groovy => test_s3_load_with_no_file.groovy} | 53 +-
...est_base_alter_col_type_multi_level_mtmv.groovy | 2 +-
.../test_base_drop_col_multi_level_mtmv.groovy | 2 +-
.../mtmv_p0/test_base_drop_multi_level_mtmv.groovy | 2 +-
.../test_base_rename_col_multi_level_mtmv.groovy | 2 +-
.../test_base_rename_multi_level_mtmv.groovy | 2 +-
.../test_base_replace_multi_level_mtmv.groovy | 2 +-
.../suites/mv_p0/agg_table_mv/agg_table_mv.groovy | 81 +++
.../nereids_p0/javaudf/test_javaudf_ip.groovy | 146 ++++
.../mv/aggregate/agg_sync_mv.groovy | 106 +--
.../mv/aggregate/agg_sync_mv.groovy | 102 +--
.../query_p0/system/test_table_properties.groovy | 3 +
103 files changed, 3125 insertions(+), 1840 deletions(-)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/DLFProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/AliyunDLFProperties.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/util/PrintableMapTest.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/property/PropertyConverterTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/tvf/source/MetadataScanNodeTest.java
copy regression-test/data/{load_p0/broker_load/test_s3_load_without_aksk.out
=> external_table_p0/tvf/test_s3_tvf_globlist.out} (77%)
create mode 100644 regression-test/data/nereids_p0/javaudf/test_javaudf_ip.out
create mode 100644
regression-test/java-udf-src/src/main/java/org/apache/doris/udf/IPV4TypeTest.java
create mode 100644
regression-test/java-udf-src/src/main/java/org/apache/doris/udf/IPV6TypeTest.java
copy
regression-test/java-udf-src/src/main/java/org/apache/doris/udf/{MySumArrayInt.java
=> MySumIP.java} (60%)
create mode 100644
regression-test/suites/compaction/test_filecache_with_base_compaction_thresthold.groovy
create mode 100644
regression-test/suites/external_table_p0/tvf/test_s3_tvf_globlist.groovy
copy
regression-test/suites/load_p0/broker_load/{test_s3_load_without_aksk.groovy =>
test_s3_load_with_no_file.groovy} (62%)
create mode 100644
regression-test/suites/mv_p0/agg_table_mv/agg_table_mv.groovy
create mode 100644
regression-test/suites/nereids_p0/javaudf/test_javaudf_ip.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
