This is an automated email from the ASF dual-hosted git repository.
lijibing pushed a change to branch high-priority-column
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 5944b418dfa support window (#32094)
discard 8d62e3d55bb Check column health value earlier, show job priority.
(#32064)
discard f21a600b7ee Support show auto analyze pending jobs. (#31926)
discard 27f92e518c5 Support follower sync query columns to master. (#31859)
discard 9a3470cbb4d Support column level health value. (#31794)
discard 404d160e81e High priority queue and map. (#31509)
discard a816e7c646c Collect high priority columns. (#31235)
add 5985044be28 [feature](merge-cloud) implement alter table property of
cloud mode (#31887)
add 6c6466b465d [release](build script) fix build release bug when build
multiple version on same machine #32104
add 5242a80d2bf [feat](Nereids): use table map to construct struct info
(#32058)
add 0bbcca42f11 [opt](routine-load) end Kafka consume when meets partition
EOF #32046
add 18322cf4b8b [feature](Cloud) Add property storage vault for OlapTable
(#31628)
add cd59bdcc1ac [Fix](nereids) fix date function rewrite (#32060)
add 6c6627338ae [fix](planner) remove input slot for aggregate slot which
is not materialized (#32092)
add 1776f79c292 [fix](function) incorrect result of eq_for_null (#32103)
add f35820abcb6 [bugfix](becore) be will core when stop because the map is
modified during iterator (#32105)
add 56a04bac9f8 [Fix](merge-cloud) calculate delete bitmap during cloud
full compaction (#32113)
add db2920a8145 [enhance](mtmv)mtmv support hive default partition (#32051)
add 73b743c4d04 [fix](merge-clod) Disable BACKUP and RESTORE in the cloud
mode (#32123)
add edd77da43d4 [feature](merge-cloud) Remove deprecated `temporary` in
`CreateRowsetRequest` (#2766) (#31903)
add 37a1ca73418 [enhance](Cache) Control whether writing into file cache
for query and load (#32099)
add 08f2f3de775 [fix](merge-cloud) Keep PartitionInfo compatible with the
cloud mode (#32008)
add aa7571fab1c [fix](merge-cloud) Keep RecyclePartitionInfo compatible
with the cloud mode (#32102)
add f7776bbbf3e [fix](merge-cloud) Keep UserProperty compatible with the
cloud mode (#32118)
add 4c775a6a3c9 [bugfix](becore) has to use value to capture lambda value
to avoid core during callback (#32132)
add e55d343430d [Fix](auto-inc) Fix partial update auto inc unique table
case failure #32114
add 47be7c5e173 [test-framework](cloud) add necessary config and function
for run cloud cases (#32127)
add dc7fcd0032b [fix](cloud) fix auto analyze triggering failure (#32139)
add 23aaf0f368f [Chore](top-n) check runtime predicate inited when scan
operator open (#32140)
add 1aa2d91574f [fix](audit-loader) fix invalid token check logic (#32095)
add a34eb8afdf0 [fix](ui) fix database cannot be choosed bug (#32091)
add 56d6d262709 [Fix](cloud) fix build index for cloud mode (#32143)
add 0b29a76838d [Opt](exec) use libbase64 to replace base64 code in doris
(#32078)
add 293e8426056 [Fix](trino-connector) Fix the bug of query wrongs when
using trino-connector (#32100)
add 803ab515589 [opt](statistics) Add wait row count reported logic for
sample analyze. (#32030)
add 2fed65897cd [Refactor](exectuor)Add schema type table active_queries
(#32057)
add b1cae7cc008 [fix](memory) Fix LRU cache deleter and memory tracking
(#32080)
add 5abeab4fe27 [feat](Nereids) update struct info map when there is new
expr (#32119)
new 0b5a2a58b8c Collect high priority columns. (#31235)
new 077a4c0575c High priority queue and map. (#31509)
new 5cac30ed252 Support column level health value. (#31794)
new 9764ef3aa89 Support follower sync query columns to master. (#31859)
new b7145ca484b Support show auto analyze pending jobs. (#31926)
new 16a1d332ae7 Check column health value earlier, show job priority.
(#32064)
new c73acc0b8ea support window (#32094)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (5944b418dfa)
\
N -- N -- N refs/heads/high-priority-column (c73acc0b8ea)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/cmake/thirdparty.cmake | 1 +
be/src/cloud/cloud_delete_task.cpp | 2 +-
be/src/cloud/cloud_delta_writer.cpp | 2 +-
be/src/cloud/cloud_full_compaction.cpp | 29 +-
be/src/cloud/cloud_full_compaction.h | 2 -
be/src/cloud/cloud_meta_mgr.cpp | 33 ++-
be/src/cloud/cloud_meta_mgr.h | 8 +-
be/src/cloud/cloud_rowset_builder.cpp | 12 +-
be/src/cloud/cloud_schema_change_job.cpp | 4 +-
be/src/cloud/cloud_storage_engine.cpp | 138 ++++++----
be/src/cloud/cloud_storage_engine.h | 2 +-
be/src/cloud/cloud_tablet.cpp | 13 +-
be/src/cloud/cloud_tablet.h | 5 +
be/src/cloud/cloud_tablet_mgr.cpp | 38 ++-
be/src/cloud/cloud_txn_delete_bitmap_cache.cpp | 23 +-
be/src/cloud/cloud_txn_delete_bitmap_cache.h | 7 +-
be/src/exec/olap_utils.h | 36 ---
be/src/exec/schema_scanner.cpp | 3 +
.../schema_active_queries_scanner.cpp | 165 ++++++++++++
.../schema_active_queries_scanner.h} | 52 ++--
.../io/cache/block/cached_remote_file_reader.cpp | 11 -
be/src/io/fs/local_file_writer.cpp | 2 +-
be/src/olap/compaction.cpp | 7 +-
be/src/olap/delta_writer_context.h | 1 +
be/src/olap/lru_cache.cpp | 48 +---
be/src/olap/lru_cache.h | 52 +---
be/src/olap/page_cache.cpp | 18 +-
be/src/olap/page_cache.h | 39 +--
be/src/olap/rowset/beta_rowset_reader.cpp | 2 +
be/src/olap/rowset/beta_rowset_writer.cpp | 7 +-
.../segment_v2/bitshuffle_page_pre_decoder.h | 7 +-
be/src/olap/rowset/segment_v2/encoding_info.h | 4 +-
.../rowset/segment_v2/inverted_index_cache.cpp | 36 +--
.../olap/rowset/segment_v2/inverted_index_cache.h | 26 +-
be/src/olap/rowset/segment_v2/page_io.cpp | 17 +-
be/src/olap/schema_cache.h | 23 +-
be/src/olap/segment_loader.cpp | 20 +-
be/src/olap/segment_loader.h | 8 +-
be/src/olap/storage_engine.cpp | 16 +-
be/src/olap/storage_engine.h | 5 +-
be/src/olap/tablet_meta.cpp | 5 +-
be/src/olap/tablet_meta.h | 7 +-
be/src/olap/tablet_reader.cpp | 2 +
be/src/olap/tablet_schema_cache.cpp | 21 +-
be/src/olap/tablet_schema_cache.h | 6 +-
be/src/olap/txn_manager.cpp | 21 +-
be/src/olap/txn_manager.h | 7 +
be/src/runtime/load_channel_mgr.cpp | 11 +-
be/src/runtime/memory/cache_manager.cpp | 9 +-
be/src/runtime/memory/cache_manager.h | 29 +-
be/src/runtime/memory/cache_policy.cpp | 4 +-
be/src/runtime/memory/cache_policy.h | 10 +-
be/src/runtime/memory/lru_cache_policy.h | 80 +++++-
be/src/runtime/memory/lru_cache_value_base.h | 51 ++++
be/src/runtime/routine_load/data_consumer.cpp | 15 +-
be/src/runtime/routine_load/data_consumer.h | 1 +
be/src/runtime/runtime_predicate.h | 2 +-
be/src/runtime/tablets_channel.cpp | 1 +
be/src/service/point_query_executor.cpp | 19 +-
be/src/service/point_query_executor.h | 49 ++--
be/src/util/doris_metrics.cpp | 4 -
be/src/util/doris_metrics.h | 2 -
be/src/util/obj_lru_cache.cpp | 6 +-
be/src/util/obj_lru_cache.h | 42 +--
be/src/util/url_coding.cpp | 175 ++----------
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 2 +-
.../format/table/trino_connector_jni_reader.cpp | 40 +--
be/src/vec/functions/comparison_equal_for_null.cpp | 2 +-
be/src/vec/functions/function_bitmap.cpp | 6 +-
be/src/vec/functions/function_string.cpp | 6 +-
be/src/vec/runtime/vdata_stream_mgr.cpp | 13 +-
be/src/vec/sink/writer/vtablet_writer.cpp | 14 +-
be/test/olap/lru_cache_test.cpp | 90 ++++---
be/test/olap/page_cache_test.cpp | 43 +--
build-for-release.sh | 1 +
cloud/src/meta-service/meta_service.cpp | 113 +++-----
cloud/src/meta-service/meta_service_resource.cpp | 4 +-
cloud/test/fdb_injection_test.cpp | 2 -
cloud/test/meta_service_http_test.cpp | 2 -
cloud/test/meta_service_job_test.cpp | 1 -
cloud/test/meta_service_test.cpp | 2 -
cloud/test/schema_kv_test.cpp | 2 -
.../trinoconnector/TrinoConnectorJniScanner.java | 2 +-
.../main/java/org/apache/doris/common/Config.java | 6 +
.../main/java/org/apache/doris/alter/Alter.java | 30 +--
.../apache/doris/alter/SchemaChangeHandler.java | 26 +-
.../org/apache/doris/analysis/SchemaTableType.java | 3 +-
.../org/apache/doris/backup/BackupHandler.java | 5 +
.../doris/catalog/BuiltinTableValuedFunctions.java | 2 -
.../apache/doris/catalog/CatalogRecycleBin.java | 16 ++
.../java/org/apache/doris/catalog/OlapTable.java | 7 +
.../org/apache/doris/catalog/PartitionInfo.java | 20 ++
.../java/org/apache/doris/catalog/SchemaTable.java | 9 +
.../org/apache/doris/catalog/TableProperty.java | 17 ++
.../cloud/alter/CloudSchemaChangeHandler.java | 256 ++++++++++++++++++
.../cloud/datasource/CloudInternalCatalog.java | 16 +-
.../apache/doris/common/util/PropertyAnalyzer.java | 12 +
.../apache/doris/datasource/InternalCatalog.java | 6 +
.../doris/datasource/hive/HMSExternalTable.java | 6 +-
.../source/TrinoConnectorScanNode.java | 11 +-
.../org/apache/doris/httpv2/rest/LoadAction.java | 7 +-
.../org/apache/doris/load/loadv2/TokenManager.java | 61 ++++-
.../apache/doris/mysql/privilege/UserProperty.java | 7 +
.../apache/doris/nereids/memo/StructInfoMap.java | 60 ++++-
.../expression/rules/DateFunctionRewrite.java | 4 +-
.../expressions/functions/table/ActiveQueries.java | 59 ----
.../visitor/TableValuedFunctionVisitor.java | 5 -
.../org/apache/doris/planner/AggregationNode.java | 11 +
.../org/apache/doris/planner/OlapTableSink.java | 4 +
.../apache/doris/service/FrontendServiceImpl.java | 30 ++-
.../apache/doris/statistics/OlapAnalysisTask.java | 2 +-
.../doris/statistics/util/StatisticsUtil.java | 53 +++-
.../ActiveQueriesTableValuedFunction.java | 91 -------
.../doris/tablefunction/MetadataGenerator.java | 71 ++++-
.../tablefunction/MetadataTableValuedFunction.java | 3 +-
.../doris/tablefunction/TableValuedFunctionIf.java | 2 -
.../doris/datasource/RefreshCatalogTest.java | 4 +-
.../doris/nereids/memo/StructInfoMapTest.java | 101 +++++++
.../apache/doris/utframe/TestWithFeService.java | 25 ++
gensrc/proto/cloud.proto | 6 +-
gensrc/proto/internal_service.proto | 1 +
gensrc/proto/olap_file.proto | 6 +-
gensrc/thrift/DataSinks.thrift | 2 +
gensrc/thrift/Descriptors.thrift | 3 +-
gensrc/thrift/FrontendService.thrift | 5 +-
gensrc/thrift/PlanNodes.thrift | 4 +-
.../test_inlineview_with_project.out | 10 +
.../data/correctness_p0/test_null_equal.out | 5 +
.../unique/test_unique_table_auto_inc.out | 22 +-
.../jdbc/test_mariadb_jdbc_catalog.out | 1 +
.../jdbc/test_mysql_jdbc_catalog.out | 1 +
.../jdbc/test_mysql_jdbc_catalog_nereids.out | 1 +
.../jdbc/test_mysql_jdbc_driver5_catalog.out | 1 +
.../test_hive_default_mtmv.out} | 19 +-
.../date_function_rewrite.out} | 0
regression-test/framework/pom.xml | 153 ++++++++---
.../org/apache/doris/regression/Config.groovy | 298 ++++++++++++++++++++-
.../apache/doris/regression/ConfigOptions.groovy | 200 +++++++++++++-
.../org/apache/doris/regression/suite/Suite.groovy | 249 +++++++++++++++++
.../pipeline/cloud_p0/conf/fe_custom.conf | 1 +
.../pipeline/cloud_p1/conf/fe_custom.conf | 1 +
.../suites/compaction/test_full_compaction.groovy | 11 +-
.../test_inlineview_with_project.groovy | 44 +++
.../suites/correctness_p0/test_null_equal.groovy | 51 ++++
.../unique/test_unique_table_auto_inc.groovy | 3 +-
.../tvf/queries/test_queries_tvf.groovy | 2 +-
.../index_change/test_index_change_3.groovy | 1 +
.../inverted_index_p0/test_create_index_1.groovy | 1 +
.../inverted_index_p0/test_create_index_2.groovy | 2 +
.../inverted_index_p0/test_create_index_3.groovy | 1 +
.../load_p0/stream_load/test_stream_load.groovy | 2 +-
.../test_stream_load_move_memtable.groovy | 8 +-
.../suites/mtmv_p0/test_hive_default_mtmv.groovy | 111 ++++++++
.../suites/nereids_function_p0/tvf/tvf.groovy | 2 +-
.../date_function_rewrite.groovy | 30 +--
.../test_active_queries.groovy} | 15 +-
.../test_backend_active_tasks.groovy | 0
ui/src/pages/layout/index.tsx | 108 +++++---
ui/src/pages/playground/tree/index.tsx | 140 +++++-----
ui/src/router/renderRouter.tsx | 37 ++-
ui/src/utils/utils.ts | 10 +-
161 files changed, 3127 insertions(+), 1337 deletions(-)
create mode 100644 be/src/exec/schema_scanner/schema_active_queries_scanner.cpp
copy be/src/{olap/delta_writer_context.h =>
exec/schema_scanner/schema_active_queries_scanner.h} (52%)
create mode 100644 be/src/runtime/memory/lru_cache_value_base.h
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cloud/alter/CloudSchemaChangeHandler.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/table/ActiveQueries.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/tablefunction/ActiveQueriesTableValuedFunction.java
copy regression-test/data/{correctness_p0/test_inlineview_with_project.out =>
mtmv_p0/test_hive_default_mtmv.out} (51%)
copy
regression-test/data/{datatype_p0/decimalv3/test_decimalv3_key/test_decimalv3_key.out
=> nereids_rules_p0/date_function_rewrite/date_function_rewrite.out} (100%)
create mode 100644 regression-test/suites/mtmv_p0/test_hive_default_mtmv.groovy
copy be/src/runtime/memory/cache_policy.cpp =>
regression-test/suites/nereids_rules_p0/date_function_rewrite/date_function_rewrite.groovy
(59%)
copy
regression-test/suites/query_p0/{meta_scan/test_backend_active_tasks.groovy =>
schema_table/test_active_queries.groovy} (70%)
rename regression-test/suites/query_p0/{meta_scan =>
schema_table}/test_backend_active_tasks.groovy (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
