This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a change to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 82d3208e61d Fix bug (#32454)
discard 6fd30086367 Support auto analyze mv (#32433)
discard d0dfa7374b9 Unit test (#32398)
discard 12584e93db1 refactor2 (#32278)
discard ddef6d8f5c0 Refactor. (#32273)
discard d009946129c support window (#32094)
discard b9598a16a6e Check column health value earlier, show job priority.
(#32064)
discard 0a0032db7e3 Support show auto analyze pending jobs. (#31926)
discard 42201c4b7a0 Support follower sync query columns to master. (#31859)
discard ebe2a3b2188 Support column level health value. (#31794)
discard b619d3f327b High priority queue and map. (#31509)
discard eb66b2733a0 Collect high priority columns. (#31235)
add 5a18a456fb0 [fix](multicatalog) fix error reading data on tencent ofs
after jdk17 (#32816)
add d6ddd7ae7a2 [Bug](repeat) fix core dump coz output slot'order on
repeat node not match with pre repeat exprs (#32662)
add 53c602f36eb [fix](ci) temporarily exclude some external case (#32859)
add 099eaa0adc0 [fix](planner)the decimal type of's precision and scale
setope ration codn is wrong (#32787)
add b238287be07 [fix](Nereids): handle distinct and nullable property when
rewriting sum literal (#32778)
add 2ee8bf15237 [Bug](materialized-view) do not check key/value column
when index is dup or mow (#32695)
add faa30524739 [fix](memory) Fix task repeat attach task DCHECK failed
#32784
add 173abb39a55 [fix](merge-cloud) Add retry when delete bitmap lock
expired (#32829)
add 45ed0b843a5 [fix](tpcds-tool) Fix the echo in create-tpcds-tables.sh
(#32415)
add 30bce1cda4a [feature](merge-cloud) Support userid in cloud for
`internal copy into` (#32616)
add 6531ad5a690 [feature](cloud) Retry when FE receives E-230 msg in cloud
mode (#32510)
add cf73907c8b6 [feature](merge-cloud) Add several multiple dimensions
cloud metrics (#32556)
add fd13c8eb220 Fix bug in follow cooldowned data (#32798)
add 6a6da0fabb5 [chore](ci) temporarily exclude external case #32863
add 49995aa0553 [Fix](bvar) Fix bloom filter bvar fault
add e4ea2eeafd0 [Bug](pipelineX) fix memleak in stream agg (#32862)
add 51b8476fa4f [Fix](tests) add more trino-connector regression tests
(#32753)
add b2af9d4139f Add log while deserialize column statistics failed.
(#32858)
add e421c0bfdac [fix](scanner) cached blocks may be empty when
VFileScanner return NOT_FOUND (#32745)
add 1a93cef5283 [fix](test)Throw daemon exception transfer to the main
thread (#32835)
add 2174912a65f [fix](smooth-upgrade) Fix function now upgrade compatible
#32807
add 6c24a0a6bf0 [Fix](function) Fix unix_timestamp core for string input
(#32871)
add 47564a8e46a [chore](ci) fix coredump collect (#32707)
add db927a2b0a9 [minor](test) Add Iceberg hadoop catalog FE unit test
(#32449)
add 629fb6cb4e3 [fix](test) fix duplicated catalog name in regression
cases (#32442)
add 86760555f55 [enhancement](statistics) excluded delta rows num for
rollup&mv tablets (#32568)
add c84463fe99a [feature](cloud) Support path prefix for HDFS storage
vault. (#32681)
new f2b82d7d807 Collect high priority columns. (#31235)
new 9d3215c67ef High priority queue and map. (#31509)
new 42e015268ca Support column level health value. (#31794)
new 31832f62d69 Support follower sync query columns to master. (#31859)
new 37153f9b87e Support show auto analyze pending jobs. (#31926)
new e15dd810d6e Check column health value earlier, show job priority.
(#32064)
new 6962ea7c8d2 support window (#32094)
new 0e4b54e40e4 Refactor. (#32273)
new 0ba19d4c14b refactor2 (#32278)
new aaefb01357c Unit test (#32398)
new ee75305b067 Support auto analyze mv (#32433)
new b364eb3731d Fix bug (#32454)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (82d3208e61d)
\
N -- N -- N refs/heads/high-priority-column (b364eb3731d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 12 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/agent/be_exec_version_manager.h | 1 +
be/src/agent/task_worker_pool.cpp | 4 +
be/src/cloud/cloud_meta_mgr.cpp | 16 +-
be/src/cloud/cloud_meta_mgr.h | 5 +-
be/src/cloud/cloud_storage_engine.cpp | 17 +-
be/src/cloud/cloud_stream_load_executor.cpp | 51 ++
.../cloud_stream_load_executor.h} | 18 +-
be/src/cloud/cloud_tablet.cpp | 5 +
be/src/cloud/config.cpp | 2 +
be/src/cloud/config.h | 3 +
be/src/io/hdfs_util.cpp | 26 +
be/src/io/hdfs_util.h | 6 +
be/src/olap/primary_key_index.h | 8 +-
be/src/olap/rowset/segment_v2/bloom_filter.h | 44 +-
.../segment_v2/bloom_filter_index_writer.cpp | 4 +-
.../rowset/segment_v2/bloom_filter_index_writer.h | 6 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 12 +-
be/src/olap/rowset/segment_v2/segment_iterator.h | 4 +-
be/src/olap/storage_policy.cpp | 2 +-
be/src/olap/tablet.cpp | 44 +-
be/src/olap/task/engine_batch_load_task.cpp | 1 -
be/src/olap/task/engine_batch_load_task.h | 2 -
be/src/olap/task/engine_checksum_task.cpp | 10 +-
be/src/olap/task/engine_checksum_task.h | 2 -
be/src/olap/task/engine_clone_task.cpp | 1 -
be/src/olap/task/engine_clone_task.h | 2 -
be/src/olap/task/engine_index_change_task.cpp | 17 +-
be/src/olap/task/engine_index_change_task.h | 3 -
be/src/olap/task/engine_publish_version_task.cpp | 8 +-
be/src/olap/task/engine_task.h | 5 +
.../exec/streaming_aggregation_operator.cpp | 9 +
.../pipeline/exec/streaming_aggregation_operator.h | 21 +
be/src/pipeline/pipeline_x/dependency.h | 1 +
be/src/pipeline/task_scheduler.cpp | 2 +-
be/src/runtime/exec_env_init.cpp | 7 +-
be/src/runtime/stream_load/stream_load_executor.h | 4 +-
be/src/runtime/tablets_channel.cpp | 1 +
be/src/runtime/thread_context.h | 1 +
.../aggregate_functions/aggregate_function_uniq.h | 1 +
be/src/vec/exec/scan/scanner_context.cpp | 23 +-
be/src/vec/exec/scan/scanner_scheduler.cpp | 14 +-
be/src/vec/exec/scan/vfile_scanner.cpp | 11 +-
.../function_date_or_datetime_computation.cpp | 5 +
.../function_date_or_datetime_computation.h | 35 +
be/src/vec/functions/function_timestamp.cpp | 18 +-
be/src/vec/functions/simple_function_factory.h | 2 +-
be/src/vec/runtime/vdatetime_value.cpp | 2 +-
.../main/java/org/apache/doris/common/Config.java | 3 +
.../java/org/apache/doris/analysis/Analyzer.java | 18 +
.../org/apache/doris/analysis/CreateUserStmt.java | 27 +
.../apache/doris/analysis/NativeInsertStmt.java | 2 +-
.../apache/doris/catalog/CloudTabletStatMgr.java | 2 +-
.../org/apache/doris/catalog/HdfsStorageVault.java | 43 +-
.../org/apache/doris/catalog/StorageVault.java | 9 +-
.../doris/cloud/catalog/CloudClusterChecker.java | 28 +-
.../cloud/datasource/CloudInternalCatalog.java | 58 ++
.../doris/cloud/system/CloudSystemInfoService.java | 2 +-
.../java/org/apache/doris/common/FeConstants.java | 2 +
.../apache/doris/fs/remote/dfs/DFSFileSystem.java | 4 +-
.../org/apache/doris/metric/AutoMappedMetric.java | 4 +
.../java/org/apache/doris/metric/CloudMetrics.java | 110 +++
.../org/apache/doris/metric/JsonMetricVisitor.java | 7 +-
.../main/java/org/apache/doris/metric/Metric.java | 5 +
.../org/apache/doris/metric/MetricCalculator.java | 75 ++
.../java/org/apache/doris/metric/MetricRepo.java | 262 +++---
.../org/apache/doris/metric/MetricVisitor.java | 4 +-
.../doris/metric/PrometheusMetricVisitor.java | 7 +-
.../doris/metric/SimpleCoreMetricVisitor.java | 7 +-
.../org/apache/doris/mysql/privilege/Auth.java | 65 +-
.../glue/translator/PhysicalPlanTranslator.java | 22 +-
.../nereids/rules/rewrite/SumLiteralRewrite.java | 81 +-
.../mv/SelectMaterializedIndexWithAggregate.java | 34 +-
.../nereids/trees/expressions/literal/Literal.java | 6 +-
.../commands/insert/AbstractInsertExecutor.java | 8 +-
.../plans/commands/insert/OlapInsertExecutor.java | 6 +-
.../java/org/apache/doris/persist/PrivInfo.java | 5 +-
.../java/org/apache/doris/qe/AuditLogHelper.java | 3 +
.../java/org/apache/doris/qe/ConnectProcessor.java | 1 +
.../java/org/apache/doris/qe/StmtExecutor.java | 24 +-
.../apache/doris/service/FrontendServiceImpl.java | 10 +-
.../apache/doris/statistics/ColumnStatistic.java | 2 +-
.../apache/doris/statistics/StatisticsCache.java | 2 +-
.../org/apache/doris/task/PublishVersionTask.java | 19 +-
.../doris/transaction/PublishVersionDaemon.java | 46 +
.../external/iceberg/IcebergHadoopCatalogTest.java | 92 ++
.../rules/rewrite/SumLiteralRewriteTest.java | 67 +-
.../org/apache/doris/persist/PrivInfoTest.java | 2 +-
fs_brokers/apache_hdfs_broker/bin/start_broker.sh | 2 +-
gensrc/thrift/AgentService.thrift | 2 +
.../hive/test_trino_hive_parquet.out} | 0
.../hive/test_trino_hive_schema_evolution.out} | 0
.../hive/test_trino_hive_serde_prop.out} | 0
.../hive/test_trino_hive_tpch_sf1_orc.out} | 0
.../hive/test_trino_hive_tpch_sf1_parquet.out} | 0
.../hive/test_trino_prepare_hive_data_in_case.out} | 0
.../mv_p0/test_dup_mv_plus/test_dup_mv_plus.out | 2 +-
.../test_dup_mv_repeat/test_dup_mv_repeat.out | 5 +
.../data/nereids_rules_p0/sumRewrite.out | 47 +-
.../datetime_functions/test_date_function.out | 33 +
regression-test/pipeline/cloud_p0/run.sh | 14 +-
regression-test/pipeline/common/doris-utils.sh | 5 +-
regression-test/pipeline/common/teamcity-utils.sh | 16 +
.../pipeline/external/conf/regression-conf.groovy | 2 +
.../pipeline/p0/conf/regression-conf.groovy | 2 +
.../auth/test_grant_revoke_cluster_role.groovy | 0
.../auth/test_grant_revoke_cluster_to_user.groovy | 0
.../cloud_p0/query_retry/test_retry_e-230.groovy | 143 ++++
.../paimon/test_paimon_catalog.groovy | 2 +-
.../paimon/test_paimon_statistics.groovy | 2 +-
.../paimon/test_paimon_table_stats.groovy | 2 +-
.../hive/test_trino_different_parquet_types.groovy | 247 ++++++
.../hive/test_trino_hive_parquet.groovy | 270 ++++++
.../hive/test_trino_hive_schema_evolution.groovy | 128 +++
.../hive/test_trino_hive_serde_prop.groovy | 84 ++
.../hive/test_trino_hive_tablesample_p0.groovy | 99 +++
.../hive/test_trino_hive_tpch_sf1_orc.groovy | 933 +++++++++++++++++++++
.../hive/test_trino_hive_tpch_sf1_parquet.groovy | 932 ++++++++++++++++++++
.../test_trino_prepare_hive_data_in_case.groovy | 103 +++
.../suites/mv_p0/ssb/q_1_1/q_1_1.groovy | 3 -
.../suites/mv_p0/ssb/q_4_1/q_4_1.groovy | 3 -
.../mv_p0/test_dup_mv_plus/test_dup_mv_plus.groovy | 12 +-
.../test_dup_mv_repeat/test_dup_mv_repeat.groovy | 47 ++
.../ut/testProjectionMV1/testProjectionMV1.groovy | 1 -
.../suites/nereids_p0/datatype/test_cast.groovy | 5 +
.../suites/nereids_rules_p0/sumRewrite.groovy | 37 +-
.../diff_data/stress_test_diff_date_list.groovy | 11 +
.../stress_test_high_concurrency_load.groovy | 11 +
.../same_data/stress_test_same_date_range.groovy | 11 +
.../stress_test_two_stream_load.groovy | 18 +
.../datetime_functions/test_date_function.groovy | 17 +
.../suites/statistics/test_update_rows_mv.groovy | 112 +++
tools/tpcds-tools/bin/create-tpcds-tables.sh | 2 +-
132 files changed, 4564 insertions(+), 461 deletions(-)
create mode 100644 be/src/cloud/cloud_stream_load_executor.cpp
copy be/src/{olap/task/engine_task.h => cloud/cloud_stream_load_executor.h}
(74%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/metric/CloudMetrics.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/external/iceberg/IcebergHadoopCatalogTest.java
copy regression-test/data/external_table_p0/{hive/test_hive_parquet.out =>
trino_connector/hive/test_trino_hive_parquet.out} (100%)
copy
regression-test/data/external_table_p0/{hive/test_hive_schema_evolution.out =>
trino_connector/hive/test_trino_hive_schema_evolution.out} (100%)
copy regression-test/data/external_table_p0/{hive/test_hive_serde_prop.out =>
trino_connector/hive/test_trino_hive_serde_prop.out} (100%)
copy regression-test/data/external_table_p0/{hive/hive_tpch_sf1_orc.out =>
trino_connector/hive/test_trino_hive_tpch_sf1_orc.out} (100%)
copy regression-test/data/external_table_p0/{hive/hive_tpch_sf1_orc.out =>
trino_connector/hive/test_trino_hive_tpch_sf1_parquet.out} (100%)
copy
regression-test/data/external_table_p0/{hive/test_prepare_hive_data_in_case.out
=> trino_connector/hive/test_trino_prepare_hive_data_in_case.out} (100%)
create mode 100644
regression-test/data/mv_p0/test_dup_mv_repeat/test_dup_mv_repeat.out
rename regression-test/suites/{cloud =>
cloud_p0}/auth/test_grant_revoke_cluster_role.groovy (100%)
rename regression-test/suites/{cloud =>
cloud_p0}/auth/test_grant_revoke_cluster_to_user.groovy (100%)
create mode 100644
regression-test/suites/cloud_p0/query_retry/test_retry_e-230.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_different_parquet_types.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_hive_parquet.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_hive_schema_evolution.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_hive_serde_prop.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_hive_tablesample_p0.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_hive_tpch_sf1_orc.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_hive_tpch_sf1_parquet.groovy
create mode 100644
regression-test/suites/external_table_p0/trino_connector/hive/test_trino_prepare_hive_data_in_case.groovy
create mode 100644
regression-test/suites/mv_p0/test_dup_mv_repeat/test_dup_mv_repeat.groovy
create mode 100644 regression-test/suites/statistics/test_update_rows_mv.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
