[
https://issues.apache.org/jira/browse/HBASE-29348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HBASE-29348:
-----------------------------------
Labels: pull-request-available (was: )
> NPE While reading store files for compaction causing hfiles not be cleaned in
> date tiered compaction
> ----------------------------------------------------------------------------------------------------
>
> Key: HBASE-29348
> URL: https://issues.apache.org/jira/browse/HBASE-29348
> Project: HBase
> Issue Type: Bug
> Components: Compaction
> Affects Versions: 2.5.11
> Reporter: Kiran Kumar Maturi
> Priority: Minor
> Labels: pull-request-available
>
> In our production clusters we are observing null pointer exception during
> compaction which avoids the compaction and causes the hfiles to grow
> indefinitely . We are observing this only for date tiered compaction
> This is the first NPE that is observed
> {{}}
> {code:java}
> Exception in thread "regionserver/regionserverXXXX:60020-shortCompactions-8"
> java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.regionserver.HStoreFile.getMaximumTimestamp(HStoreFile.java:647)
> at
> org.apache.hadoop.hbase.regionserver.StoreFileComparators$GetMaxTimestamp.applyAsLong(StoreFileComparators.java:84)
> at
> org.apache.hadoop.hbase.regionserver.StoreFileComparators$GetMaxTimestamp.applyAsLong(StoreFileComparators.java:80)
> at java.util.Comparator.lambda$comparingLong$6043328a$1(Comparator.java:511)
> at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:217)
> at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:216)
> at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:216)
> at java.util.Comparator.lambda$thenComparing$36697e65$1(Comparator.java:216)
> at java.util.TimSort.countRunAndMakeAscending(TimSort.java:355)
> at java.util.TimSort.sort(TimSort.java:220)
> at java.util.Arrays.sort(Arrays.java:1438)
> at
> org.apache.hbase.thirdparty.com.google.common.collect.ImmutableList.sortedCopyOf(ImmutableList.java:347)
> at
> org.apache.hadoop.hbase.regionserver.DefaultStoreFileManager.addCompactionResults(DefaultStoreFileManager.java:128)
> at
> org.apache.hadoop.hbase.regionserver.StoreEngine.replaceStoreFiles(StoreEngine.java:497)
> at
> org.apache.hadoop.hbase.regionserver.HStore.replaceStoreFiles(HStore.java:1251)
> at
> org.apache.hadoop.hbase.regionserver.HStore.removeUnneededFiles(HStore.java:1577)
> at
> org.apache.hadoop.hbase.regionserver.HStore.requestCompaction(HStore.java:1445)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit.selectCompaction(CompactSplit.java:444)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit.access$200(CompactSplit.java:65)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:628)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:716)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:750)
>
> {code}
> {{After this the hfiles keep growing as compaction fails with the following
> exception}}
> {{}}
> {code:java}
> Exception in thread "regionserver/regionserverXXXX:60020-shortCompactions-3"
> java.lang.IllegalArgumentException
> at
> org.apache.hbase.thirdparty.com.google.common.base.Preconditions.checkArgument(Preconditions.java:131)
> at
> org.apache.hadoop.hbase.regionserver.compactions.SortedCompactionPolicy.getCurrentEligibleFiles(SortedCompactionPolicy.java:172)
> at
> org.apache.hadoop.hbase.regionserver.compactions.SortedCompactionPolicy.preSelectCompactionForCoprocessor(SortedCompactionPolicy.java:53)
> at
> org.apache.hadoop.hbase.regionserver.DateTieredStoreEngine$DateTieredCompactionContext.preSelect(DateTieredStoreEngine.java:68)
> at
> org.apache.hadoop.hbase.regionserver.HStore.requestCompaction(HStore.java:1454)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit.selectCompaction(CompactSplit.java:444)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit.access$200(CompactSplit.java:65)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.doCompaction(CompactSplit.java:628)
> at
> org.apache.hadoop.hbase.regionserver.CompactSplit$CompactionRunner.run(CompactSplit.java:716)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:750){code}
> {{}}{{ }}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
