This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a change to branch auto-pick-48864-branch-3.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard cd85cf55ccf [opt](nereids) set column stats unkown by default when
derive Not expressoin (#48864)
add b24ac3b51a5 branch-3.0: [fix](schema-change) Remove incorrect
assertion for tablet state after committing sc job #48219 (#48439)
add 7c5c78f3ba7 branch-3.0: [fix](cloud) dup FDCache reset before
FileCache dtor causing crash #48915 (#49016)
add 92015b93ffb branch-3.0: [fix](test) fix duplicate variable define
#48939 (#48945)
add e533c75bea3 branch-3.0: [fix](case) fix
insert_group_commit_into_unique_sync_mode #48384 (#48558)
add 6344bda53b0 branch-3.0: [improve](routine load) introduce routine load
abnormal job monitor metrics #48171 (#49045)
add 84f61c986bc branch-3.0-pick: [Fix](cloud) Fix dup key problem when
`enable_new_tablet_do_compaction=true` (#48399) (#49019)
add 6f1814cec04 branch-3.0-pick: [Fix](case) Fix
`test_config_prune_delete_sign` when `force_olap_table_replication_num=3`
(#48778) (#49018)
add d147868eea3 branch-3.0: [Bug](function) add index check on function
like #47991 (#48018)
add c9e3e18afe7 branch-3.0: [Fix](sc) Don't save base tablet's compaction
jobs to new tablet's `TabletJobInfoPB` #48960 (#49035)
add 5f03c9025f7 branch-3.0: [fix](statistics)Control memory use for sample
partition column and key column. #46534 (#48922)
add bc1f6b32b94 branch-3.0: [improvement](statistics)Add session variable
for partition sample count. #48218 (#49091)
add 3d1eb35bbff branch-3.0: [feat](binlog) filter the async mv binlogs
#49028 (#49098)
add 40805f2e4fc branch-3.0: [fix](nereids)fix the
cascadesContext.getMemo()==null #48771 (#49094)
add e73c5bde214 branch-3.0: [fix](auth)fix check internal priv when drop
db of external catalog (#47876)
add 484625df8f9 branch-3.0: [opt](mtmv) Opt materialized view rewrite
performance when the num of struct infos are huge #48782 (#48855)
add baff13ef466 branch-3.0: [fix](Nereids) fix substring with only one
parameter #48957 (#49029)
add cdbb07a57a4 branch-3.0: [fix](Nereids) fix split part with regex not
exist in source string #48895 (#48909)
add 380d5355a21 branch-3.0: [fix](sql cache) fix prepare statement with
sql cache throw NullPointerException #48902 (#48976)
add 1e9bea28fd1 branch-3.0: [improve](restore) Link existing rowset files
with source rowset id #48435 (#48999)
add 58760b1de5c branch-3.0: [feat](storage vault) Add object storage op
check when creating resource #48073 (#48880)
add cb9c5076ef9 branch-3.0: [improvement](statistics)Improve analyze
partition column and key column corner case. #48757 (#49100)
add a88ef51f38d [fix](pipeline) Do not schedule finalized task again
(#49007)
add 9c59134b703 branch-3.0: [fix](multi table load) error URL does not
depend on the value of _number_filtered_rows #49111 (#49130)
add ab4f189fd11 branch-3.0: [fix](regression) Avoid defined global
variables in backup-restore case script #49102 (#49133)
add 38724151b1e branch-3.0: [improve](mow) improve mow get_agg by cache
#48968 (#49110)
add 07ebb00a8ed branch-3.0: [fix][cloud] Prevent fe
CloudReplica.getBackendIdImpl consuming too much CPU when high-frequency stream
loads #48564 (#49108)
add 252645c99cc branch-3.0: [Fix](function) Fix wrong FE fold constant
implementation of function date_format #49032 (#49085)
add 9e3f1ac739c branch-3.0: [improvement](ccr) Add and adjust result for
get_lag #48953 (#49054)
add 655aa0e97f3 branch-3.0: [feat](load) stream load supports loading JSON
compressed format #48990 (#49044)
add aa13ed6657d branch-3.0: [fix](nereids) fix convert to date literal
throw exception #48980 (#48773)
add 9c78d4f7da0 [fix](cloud-mow)Add more calculate delete bitmap fail case
(#49090)
add 1b3f158095f branch-3.0: [fix](memory) Fix LRUCachePolicy
initialization and registration order #49117 (#49124)
add 1404d32f294 branch-3.0: [fix](group commit)Fix replay wal fail problem
on agg state type #49081 (#49145)
add 410823f4027 [Chore](runtime-filter) remove wrong check and set disable
when SyncSizeClosure meet eof status (#49185)
add 3d6b90a58de [opt](nereids) set column stats unkown by default when
derive Not expressoin (#48864)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (cd85cf55ccf)
\
N -- N -- N refs/heads/auto-pick-48864-branch-3.0 (3d6b90a58de)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/cloud/cloud_compaction_stop_token.cpp | 125 ++
.../cloud_compaction_stop_token.h} | 24 +-
.../cloud/cloud_cumulative_compaction_policy.cpp | 7 +-
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 3 +-
be/src/cloud/cloud_meta_mgr.cpp | 5 +
be/src/cloud/cloud_schema_change_job.cpp | 14 +-
be/src/cloud/cloud_storage_engine.cpp | 65 +
be/src/cloud/cloud_storage_engine.h | 8 +
be/src/cloud/cloud_stream_load_executor.cpp | 4 +-
be/src/cloud/pb_convert.cpp | 8 +
be/src/common/config.cpp | 2 +
be/src/common/config.h | 2 +
be/src/exprs/runtime_filter.cpp | 5 +-
be/src/http/action/stream_load.cpp | 4 -
be/src/io/fs/multi_table_pipe.cpp | 5 +-
be/src/olap/snapshot_manager.cpp | 8 +-
be/src/olap/tablet_meta.cpp | 70 +-
be/src/olap/tablet_meta.h | 8 +
be/src/pipeline/task_scheduler.cpp | 7 +-
be/src/runtime/exec_env_init.cpp | 1 -
be/src/runtime/memory/cache_policy.cpp | 1 -
be/src/runtime/memory/lru_cache_policy.h | 2 +
be/src/runtime/snapshot_loader.cpp | 890 ++++++----
be/src/runtime/snapshot_loader.h | 3 +
be/src/service/backend_service.cpp | 8 +-
be/src/util/load_util.cpp | 24 +
be/src/util/stopwatch.hpp | 5 +-
be/src/vec/functions/like.cpp | 2 +-
be/test/util/load_util_test.cpp | 64 +
cloud/src/meta-service/meta_service_job.cpp | 91 +-
.../java/org/apache/doris/analysis/DropDbStmt.java | 10 +-
.../java/org/apache/doris/backup/RestoreJob.java | 5 +-
.../org/apache/doris/binlog/BinlogConfigCache.java | 70 +-
.../org/apache/doris/binlog/BinlogLagInfo.java | 17 +-
.../org/apache/doris/binlog/BinlogManager.java | 22 +
.../java/org/apache/doris/binlog/BinlogUtils.java | 27 +-
.../org/apache/doris/catalog/AzureResource.java | 58 +-
.../apache/doris/catalog/ColocateTableIndex.java | 17 +-
.../org/apache/doris/catalog/MetadataViewer.java | 16 +-
.../java/org/apache/doris/catalog/S3Resource.java | 84 +-
.../main/java/org/apache/doris/catalog/Table.java | 4 +
.../org/apache/doris/clone/DiskRebalancer.java | 8 +-
.../apache/doris/clone/PartitionRebalancer.java | 5 +-
.../org/apache/doris/clone/TabletSchedCtx.java | 42 +-
.../org/apache/doris/clone/TabletScheduler.java | 18 +-
.../apache/doris/cloud/catalog/CloudReplica.java | 4 +-
.../transaction/CloudGlobalTransactionMgr.java | 34 +-
.../doris/common/NereidsSqlCacheManager.java | 19 +
.../apache/doris/common/proc/ReplicasProcNode.java | 5 +-
.../apache/doris/common/proc/TabletsProcDir.java | 7 +-
.../org/apache/doris/fs/obj/AzureObjStorage.java | 47 +-
.../java/org/apache/doris/fs/obj/ObjStorage.java | 4 +
.../java/org/apache/doris/fs/obj/S3ObjStorage.java | 88 +
.../main/java/org/apache/doris/load/DeleteJob.java | 2 +-
.../doris/load/routineload/KafkaProgress.java | 3 +
.../load/routineload/KafkaRoutineLoadJob.java | 14 +
.../doris/load/routineload/RoutineLoadJob.java | 16 +
.../doris/load/routineload/RoutineLoadManager.java | 6 +
.../java/org/apache/doris/metric/MetricRepo.java | 110 +-
.../org/apache/doris/nereids/NereidsPlanner.java | 15 +-
.../org/apache/doris/nereids/StatementContext.java | 2 +-
.../apache/doris/nereids/memo/StructInfoMap.java | 9 +-
.../exploration/mv/MaterializedViewUtils.java | 2 +-
.../expression/rules/FoldConstantRuleOnFE.java | 19 +-
.../executable/DateTimeExtractAndTransform.java | 8 +-
.../functions/executable/StringArithmetic.java | 10 +-
.../trees/expressions/literal/DateLiteral.java | 16 +-
.../trees/plans/commands/ExecuteCommand.java | 12 +-
.../apache/doris/nereids/types/DateTimeV2Type.java | 10 +-
.../org/apache/doris/nereids/util/DateUtils.java | 8 +-
.../doris/nereids/util/TypeCoercionUtils.java | 3 +-
.../org/apache/doris/planner/OlapScanNode.java | 7 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 11 +
.../java/org/apache/doris/qe/SessionVariable.java | 14 +
.../apache/doris/service/FrontendServiceImpl.java | 2 +
.../apache/doris/statistics/BaseAnalysisTask.java | 2 +-
.../apache/doris/statistics/OlapAnalysisTask.java | 386 +++--
.../doris/statistics/StatisticConstants.java | 4 +
.../doris/statistics/util/StatisticsUtil.java | 18 +
.../ExternalFileTableValuedFunction.java | 1 +
.../doris/transaction/DatabaseTransactionMgr.java | 5 +-
.../apache/doris/catalog/AzureResourceTest.java | 57 +
.../org/apache/doris/catalog/S3ResourceTest.java | 35 +
.../doris/nereids/memo/StructInfoMapTest.java | 15 +-
.../trees/expressions/literal/DateLiteralTest.java | 1 +
.../doris/statistics/OlapAnalysisTaskTest.java | 628 +++++--
gensrc/proto/cloud.proto | 1 +
gensrc/proto/olap_file.proto | 7 +
gensrc/thrift/FrontendService.thrift | 2 +
.../test_insert_table_with_dump_nereids_memo.out} | Bin 125 -> 126 bytes
...ut => test_cloud_mow_new_tablet_compaction.out} | Bin 171 -> 206 bytes
...test_cloud_mow_stream_load_with_commit_fail.out | Bin 134 -> 446 bytes
.../fault_injection_p0/cloud/test_stream_load0.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load1.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load2.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load3.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load4.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load5.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load6.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load7.csv | 2 +
.../load_p0/stream_load/test_json_compress.out | Bin 0 -> 25202 bytes
.../data/nereids_syntax_p0/test_cast_datetime.out | Bin 107 -> 258 bytes
.../doris/regression/action/TestAction.groovy | 2 +-
.../vault_p0/conf/regression-conf-custom.groovy | 1 -
.../test_ddl_database_external_auth.groovy} | 46 +-
.../test_backup_store_with_db_properties.groovy | 2 +-
.../test_backup_store_with_db_properties_kv.groovy | 2 +-
.../ccr_syncer_p1/test_backup_restore.groovy | 9 +-
.../warm_up/hotspot/test_warmup_show_stmt_2.groovy | 2 +-
.../test_config_prune_delete_sign.groovy | 1 -
...test_insert_table_with_dump_nereids_memo.groovy | 58 +
.../presto/scalar/timestamptz/TestOperators.sql | 1784 ++++++++++----------
.../test_cloud_mow_new_tablet_compaction.groovy | 143 ++
...t_cloud_mow_stream_load_with_commit_fail.groovy | 340 +++-
...nsert_group_commit_into_unique_sync_mode.groovy | 2 +-
...t_metrics.csv => test_abnormal_job_monitor.csv} | 0
...> test_routin_load_abnormal_job_monitor.groovy} | 139 +-
.../load_p0/stream_load/test_json_compress.groovy | 149 ++
.../cache/parse_sql_from_sql_cache.groovy | 7 +-
.../cache/prepare_stmt_with_sql_cache.groovy | 33 +-
.../fold_constant_date_arithmatic.groovy | 9 +
.../fold_constant_string_arithmatic.groovy | 9 +
.../nereids_syntax_p0/test_cast_datetime.groovy | 511 +++++-
123 files changed, 4899 insertions(+), 1903 deletions(-)
create mode 100644 be/src/cloud/cloud_compaction_stop_token.cpp
copy be/src/{http/action/show_hotspot_action.h =>
cloud/cloud_compaction_stop_token.h} (67%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/catalog/AzureResourceTest.java
copy regression-test/data/{correctness_p0/test_equal_for_null.out =>
correctness/test_insert_table_with_dump_nereids_memo.out} (87%)
copy
regression-test/data/fault_injection_p0/cloud/{test_cloud_partial_update_update_tmp_rowset_fail.out
=> test_cloud_mow_new_tablet_compaction.out} (69%)
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load0.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load1.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load2.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load3.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load4.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load5.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load6.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load7.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_json_compress.out
copy regression-test/suites/{auth_p0/test_use_encryptkey_auth.groovy =>
auth_call/test_ddl_database_external_auth.groovy} (54%)
create mode 100644
regression-test/suites/correctness/test_insert_table_with_dump_nereids_memo.groovy
create mode 100644
regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_new_tablet_compaction.groovy
copy regression-test/suites/load_p0/routine_load/data/{test_metrics.csv =>
test_abnormal_job_monitor.csv} (100%)
copy
regression-test/suites/load_p0/routine_load/{test_routine_load_metrics.groovy
=> test_routin_load_abnormal_job_monitor.groovy} (66%)
create mode 100644
regression-test/suites/load_p0/stream_load/test_json_compress.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
