[
https://issues.apache.org/jira/browse/HBASE-28805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17880526#comment-17880526
]
Hudson commented on HBASE-28805:
--------------------------------
Results for branch branch-2
[build #1140 on
builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1140/]:
(x) *{color:red}-1 overall{color}*
----
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1140/General_20Nightly_20Build_20Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1140/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1140/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1140/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk17 hadoop3 checks{color}
-- For more information [see jdk17
report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1140/JDK17_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> Implement chunked persistence of backing map for persistent bucket cache.
> -------------------------------------------------------------------------
>
> Key: HBASE-28805
> URL: https://issues.apache.org/jira/browse/HBASE-28805
> Project: HBase
> Issue Type: Task
> Components: BucketCache
> Affects Versions: 2.6.0, 3.0.0-beta-1, 4.0.0-alpha-1, 2.7.0
> Reporter: Janardhan Hungund
> Assignee: Janardhan Hungund
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0-alpha-1, 2.7.0, 3.0.0-beta-2, 2.6.1
>
>
> The persistent bucket cache implementation feature relies on the persistence
> of backing map to a persistent file. the protobuf APIs are used to serialise
> the backing map and its related structures into the file. An asynchronous
> thread periodically flushes the contents of backing map to the persistence
> file.
> The protobuf library has a limitation of 2GB on the size of protobuf
> messages. If the size of backing map increases beyond 2GB, an unexpected
> exception is reported in the asynchronous thread and stops the persister
> thread. This causes the persistent file go out of sync with the actual bucket
> cache. Due to this, the bucket cache shrinks to a smaller size after a cache
> restart. Checksum errors are also reported.
> This Jira tracks the implementation of introducing chunking of the backing
> map to persistence such that every protobuf is smaller than 2GB in size.
> Thanks,
> Janardhan
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
