This is an automated email from the ASF dual-hosted git repository. morningman pushed a change to branch branch-1.2-unstable in repository https://gitbox.apache.org/repos/asf/doris.git
discard 8579043085 [temp](statistics) disable statistic tables add 30f36070b5 [test](multi-catalog)Regression test for external hive parquet table (#13611) add 7eed5a292c [feature-wip](multi-catalog) Support hive partition cache (#14134) add fc70179acb [multi-catalog](fix) the eof of lazy read columns may be not equal to the eof of predicate columns (#14212) new 9de1fec6cc [temp](statistics) disable statistic tables This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (8579043085) \ N -- N -- N refs/heads/branch-1.2-unstable (9de1fec6cc) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: be/src/exec/text_converter.hpp | 2 +- be/src/vec/exec/format/parquet/parquet_common.cpp | 7 + .../exec/format/parquet/vparquet_column_reader.cpp | 4 +- .../exec/format/parquet/vparquet_group_reader.cpp | 5 +- be/src/vec/exec/format/parquet/vparquet_reader.cpp | 4 +- .../docker-compose/hive/scripts/create.hql | 32 + .../docker-compose/hive/scripts/hive-metastore.sh | 2 + .../nation=cn/city=beijing/beijing1 | Bin 0 -> 160180 bytes .../nation=cn/city=shanghai/shanghai1 | Bin 0 -> 159227 bytes .../partition_table/nation=jp/city=tokyo/tokyo1 | Bin 0 -> 80147 bytes .../partition_table/nation=rus/city=moscow/moscow1 | Bin 0 -> 80595 bytes .../nation=us/city=chicago/chicago1 | Bin 0 -> 158429 bytes .../nation=us/city=washington/washington1 | Bin 0 -> 159229 bytes docs/en/docs/admin-manual/config/fe-config.md | 52 + docs/zh-CN/docs/admin-manual/config/fe-config.md | 43 +- .../maint-monitor/monitor-metrics/metrics.md | 5 + .../java/org/apache/doris/analysis/ColumnDef.java | 4 +- .../main/java/org/apache/doris/catalog/Env.java | 8 + .../org/apache/doris/catalog/PartitionKey.java | 21 +- .../org/apache/doris/catalog/RefreshManager.java | 3 +- .../doris/catalog/external/EsExternalDatabase.java | 24 +- .../doris/catalog/external/EsExternalTable.java | 82 +- .../doris/catalog/external/ExternalDatabase.java | 27 +- .../doris/catalog/external/ExternalTable.java | 43 +- .../catalog/external/HMSExternalDatabase.java | 24 +- .../doris/catalog/external/HMSExternalTable.java | 136 +- .../main/java/org/apache/doris/common/Config.java | 28 + .../{SessionContext.java => CacheException.java} | 9 +- .../org/apache/doris/datasource/CatalogMgr.java | 25 +- .../apache/doris/datasource/EsExternalCatalog.java | 7 + .../apache/doris/datasource/ExternalCatalog.java | 7 +- .../doris/datasource/ExternalMetaCacheMgr.java | 95 + .../doris/datasource/ExternalSchemaCache.java | 131 + ...SessionContext.java => HMSClientException.java} | 9 +- .../doris/datasource/HMSExternalCatalog.java | 15 + .../datasource/PooledHiveMetaStoreClient.java | 42 +- .../doris/datasource/hive/HiveMetaStoreCache.java | 423 + .../hive/HivePartition.java} | 27 +- .../java/org/apache/doris/persist/EditLog.java | 8 +- .../org/apache/doris/persist/OperationType.java | 1 + .../java/org/apache/doris/planner/ScanNode.java | 1 - .../planner/external/ExternalFileScanNode.java | 12 +- .../doris/planner/external/HiveScanProvider.java | 151 +- .../doris/planner/external/HudiScanProvider.java | 7 +- .../planner/external/IcebergScanProvider.java | 9 +- .../doris/planner/external/QueryScanProvider.java | 14 +- .../java/org/apache/doris/qe/StmtExecutor.java | 2 +- .../external_catalog_p0/hive/test_hive_parquet.out | 10112 +++++++++++++++++++ .../hive/test_hive_parquet.groovy | 184 + 49 files changed, 11431 insertions(+), 416 deletions(-) create mode 100644 docker/thirdparties/docker-compose/hive/scripts/parquet/partition_table/nation=cn/city=beijing/beijing1 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/parquet/partition_table/nation=cn/city=shanghai/shanghai1 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/parquet/partition_table/nation=jp/city=tokyo/tokyo1 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/parquet/partition_table/nation=rus/city=moscow/moscow1 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/parquet/partition_table/nation=us/city=chicago/chicago1 create mode 100644 docker/thirdparties/docker-compose/hive/scripts/parquet/partition_table/nation=us/city=washington/washington1 copy fe/fe-core/src/main/java/org/apache/doris/datasource/{SessionContext.java => CacheException.java} (81%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/ExternalMetaCacheMgr.java create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/ExternalSchemaCache.java copy fe/fe-core/src/main/java/org/apache/doris/datasource/{SessionContext.java => HMSClientException.java} (81%) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveMetaStoreCache.java copy fe/fe-core/src/main/java/org/apache/doris/{nereids/pattern/generator/javaast/ClassOrInterfaceType.java => datasource/hive/HivePartition.java} (52%) create mode 100644 regression-test/data/external_catalog_p0/hive/test_hive_parquet.out create mode 100644 regression-test/suites/external_catalog_p0/hive/test_hive_parquet.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org