This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch branch-catalog-spi
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 1d2b1c199a1 [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
omit e83f2b77bc4 [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
omit 8a636c3469b [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
omit a07216ef102 [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
omit 930e4778064 [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
omit 55c991d0e87 [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
omit ea8b1c1e0ff [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
omit bce28b223d3 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
omit 7ef93fe07e4 [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
omit 44bf35e586e [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
omit b417c55f92a [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
omit 556712a211b [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
omit 9303692c30b [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
omit 7495ae4452d [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
omit 179d9ab3d69 update P5 handoff and fix compile issue
omit ed5dfe22503 [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
omit e4c507abc0b [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
omit a177977e7a7 [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
omit b48f83dd401 [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
omit d33d03f68d3 [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
omit 78dc41156df [doc](connector) add project tracking system for catalog
SPI migration
add d8fd23f7f38 [fix](iceberg) Allow optional position delete fields
without nulls (#65401)
add 68ec8d08499 [feature](be) Add ORC reader for format v2 (#65183)
add 3a5c02d7c03 [improve](metrics) Export file cache remote index byte
metrics (#65398)
add 4106b17900f [fix](regression) Wait for schema change in
rewrite_when_dml (#65408)
add 355ede4577f [improvement](cloud) Use rendezvous hashing for colocate
tablet placement (#64638)
add 0af6eaca00c [fix](regression) Use single bucket for unique key delete
compaction cases (#65352)
add 0ddf9fb574b [doc](connector) add project tracking system for catalog
SPI migration
add 13d31e09c2c [feat](connector) P0 SPI baseline + DDL/Partition + import
gate (T03-T27) (#63582)
add 041ffe3b8aa [P1-T03-T05] route plugin-driven scans first in nereids
translator (#63641)
add 7f893b4e55c [feat](connector) P2 migrate trino-connector to catalog
SPI (T01-T13) (#64096)
add 470ade67f3b [feat](connector) P3 hudi connector hardening + test
baseline + dispatch design (hybrid, T02-T08) (#64143)
add 3d9b085250f [refactor](connector) P4 maxcompute: remove legacy
subsystem from fe-core + make fe-core odps-free (T07-T09) (#64300)
add bff6abfe140 update P5 handoff and fix compile issue
add fd6302a0137 [refactor](catalog) P5 paimon: migrate to catalog SPI +
cutover (#64446) (#64446)
add 5b85d9fc644 [refactor](catalog) P5 paimon: remove legacy subsystem
from fe-core + make fe-core paimon-SDK-free (T29) (#64653)
add d79efb4a58d [refactor](catalog) P3b: consolidate kerberos
authentication into fe-kerberos (#64655)
add c4791ca4b48 [refactor](catalog) P6 iceberg: migrate to catalog SPI +
cutover + remove legacy fe-core subsystem (#64688)
add 768e074426d [fix](catalog) jdbc: keep driver classloaders alive per
URL to stop Metaspace leak
add 53dc6361401 [fix](catalog) P4 maxcompute: drop dangling legacy
MaxComputeExternalTableTest after rebase
add c211c1aa276 [fix](catalog) port upstream #65332/#65094 datasource
fixes into SPI connectors
add 68807c22cfb [fix](catalog) tier3 #65094: preserve external-table
top-level column-name case on the read path
add f3a8c71c73f [feat](catalog) P6.6-C6 #63068 SPI: neutral
delegated-credential DTO + user-session capability
add da2a6c658ce [feat](catalog) P6.6-C6 #63068 FE: capability-gated
credential injection + per-user cache bypass
add 49034126a2e [feat](catalog) P6.6-C6 #63068 iceberg: per-user REST
session routing (metadata + scan/write/procedure)
add d9586ea409e [doc](catalog) P6.6-C6 #63068 OIDC session migration:
design + research notes + HANDOFF (Tasks 0-7 DONE)
add ca246b1d81e [feat](catalog) P6.6-C6 #63068 FE: re-migrate
ExternalDatabaseSessionContextTest (cross-user cache-leakage data-flow)
add 18af39c179a [doc](catalog) P6.6-C6 #63068 HANDOFF: record
cache-leakage data-flow test + Task 0 retained-base verify
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1d2b1c199a1)
\
N -- N -- N refs/heads/branch-catalog-spi (18af39c179a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/common/metrics/doris_metrics.cpp | 5 +
be/src/common/metrics/doris_metrics.h | 2 +
.../core/data_type_serde/data_type_array_serde.h | 1 +
.../data_type_serde/data_type_datetimev2_serde.h | 1 +
.../core/data_type_serde/data_type_datev2_serde.h | 1 +
.../core/data_type_serde/data_type_decimal_serde.h | 1 +
be/src/core/data_type_serde/data_type_map_serde.h | 1 +
.../data_type_serde/data_type_nullable_serde.h | 1 +
.../core/data_type_serde/data_type_number_serde.h | 1 +
be/src/core/data_type_serde/data_type_serde.cpp | 849 ++
be/src/core/data_type_serde/data_type_serde.h | 12 +
.../core/data_type_serde/data_type_string_serde.h | 1 +
.../core/data_type_serde/data_type_struct_serde.h | 1 +
.../data_type_serde/data_type_timestamptz_serde.h | 1 +
be/src/exec/scan/file_scanner_v2.cpp | 6 +-
.../table/iceberg_delete_file_reader_helper.cpp | 40 +-
be/src/format/table/iceberg_reader.cpp | 25 +-
be/src/format/table/iceberg_reader_mixin.h | 23 +-
be/src/format_v2/column_mapper.h | 4 +-
be/src/format_v2/orc/orc_reader.cpp | 2375 +++++
be/src/format_v2/orc/orc_reader.h | 180 +
be/src/format_v2/orc/orc_search_argument.cpp | 1404 +++
.../orc/orc_search_argument.h} | 26 +-
be/src/format_v2/table/hive_reader.cpp | 96 +
be/src/format_v2/table/hive_reader.h | 8 +
be/src/format_v2/table/iceberg_reader.cpp | 113 +-
be/src/format_v2/table/iceberg_reader.h | 18 +-
be/src/format_v2/table_reader.cpp | 13 +-
be/src/io/cache/block_file_cache_profile.cpp | 12 +
be/src/io/cache/block_file_cache_profile.h | 2 +
be/test/exec/scan/file_scanner_v2_test.cpp | 8 +-
.../iceberg_delete_file_reader_helper_test.cpp | 121 +
be/test/format_v2/orc/orc_reader_test.cpp | 9610 ++++++++++++++++++++
be/test/format_v2/table/hive_reader_test.cpp | 88 +-
be/test/format_v2/table/iceberg_reader_test.cpp | 179 +
be/test/util/doris_metrics_test.cpp | 36 +
.../main/java/org/apache/doris/common/Config.java | 6 +
.../apache/doris/catalog/ColocateTableIndex.java | 3 +
.../cloud/catalog/CloudColocatePlacement.java | 64 +
.../apache/doris/cloud/catalog/CloudReplica.java | 42 +-
.../doris/cloud/system/CloudSystemInfoService.java | 144 +
.../org/apache/doris/system/SystemInfoService.java | 4 +
.../cloud/catalog/CloudColocatePlacementTest.java | 232 +
.../doris/cloud/catalog/CloudReplicaTest.java | 15 +
.../test_cloud_colocate_consistent_hash_join.out} | 10 +-
...test_cloud_colocate_consistent_hash_join.groovy | 67 +
...est_file_cache_remote_index_byte_metrics.groovy | 155 +
.../test_compaction_uniq_keys_with_delete.groovy | 1 +
...test_compaction_uniq_keys_with_delete_ck.groovy | 1 +
.../mv/dml/rewrite/rewrite_when_dml.groovy | 9 +
50 files changed, 15895 insertions(+), 123 deletions(-)
create mode 100644 be/src/format_v2/orc/orc_reader.cpp
create mode 100644 be/src/format_v2/orc/orc_reader.h
create mode 100644 be/src/format_v2/orc/orc_search_argument.cpp
copy be/src/{format/table/hive/hive_orc_nested_column_utils.h =>
format_v2/orc/orc_search_argument.h} (55%)
create mode 100644 be/test/format_v2/orc/orc_reader_test.cpp
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/cloud/catalog/CloudColocatePlacement.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/cloud/catalog/CloudColocatePlacementTest.java
copy
regression-test/data/{correctness_p0/test_rf_in_list_not_erased_by_scope_range.out
=> cloud_p0/multi_cluster/test_cloud_colocate_consistent_hash_join.out} (78%)
create mode 100644
regression-test/suites/cloud_p0/multi_cluster/test_cloud_colocate_consistent_hash_join.groovy
create mode 100644
regression-test/suites/cloud_p0/test_file_cache_remote_index_byte_metrics.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
