Csaba Ringhofer has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24177
Change subject: WIP IMPALA-14806: Cache IcebergContentFileStore ...................................................................... WIP IMPALA-14806: Cache IcebergContentFileStore This change was split out from larger change https://gerrit.cloudera.org/#/c/24049/ It also affects https://gerrit.cloudera.org/#/c/24091/ With this patch Iceberg file descriptors are cached in IcebergFileContentStore instead of TPartialTableInfo. TPartialInfo is still cached without files but doesn't seem to have significant size.. Based on experiments this both makes mem need smaller and planning much faster by not needing to convert TPartialTableInfo to IcebergFileContentStore in each query. TODO: measure again, numbers look a bit different than in https://gerrit.cloudera.org/#/c/24049/ Change-Id: Ic93eeb3a90a280a7138672affd71ac6f87df71a1 --- M fe/src/main/java/org/apache/impala/catalog/IcebergContentFileStore.java M fe/src/main/java/org/apache/impala/catalog/IcebergTable.java M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/DirectMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/IcebergMetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/LocalIcebergTable.java M fe/src/main/java/org/apache/impala/catalog/local/MetaProvider.java M fe/src/main/java/org/apache/impala/catalog/local/MetaProviderDecorator.java M fe/src/main/java/org/apache/impala/catalog/local/MultiMetaProvider.java M fe/src/test/java/org/apache/impala/catalog/local/MetaProviderDecoratorTest.java 10 files changed, 162 insertions(+), 17 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/77/24177/1 -- To view, visit http://gerrit.cloudera.org:8080/24177 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ic93eeb3a90a280a7138672affd71ac6f87df71a1 Gerrit-Change-Number: 24177 Gerrit-PatchSet: 1 Gerrit-Owner: Csaba Ringhofer <[email protected]>
