[
https://issues.apache.org/jira/browse/HBASE-29611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18028097#comment-18028097
]
Wellington Chevreuil commented on HBASE-29611:
----------------------------------------------
[~anuj.sharma], could you please explain the root cause here, then? I'm
struggling to understand it properly, IRC, the "refresh files" call causes a
new filelist to be created by the replica, then the subsequent flushes on
active would also produce new filelist files and new calls for "refresh files"
do not get the most up to date file list file, but how is that possible?
In any case, replica cluster must never update or create any file list file
ever, as this could lead to data loss.
> With FILE based SFT, the list of HFiles we maintain in .filelist is not
> getting updated for read replica
> --------------------------------------------------------------------------------------------------------
>
> Key: HBASE-29611
> URL: https://issues.apache.org/jira/browse/HBASE-29611
> Project: HBase
> Issue Type: Sub-task
> Reporter: Anuj Sharma
> Assignee: Anuj Sharma
> Priority: Major
>
> Repro steps:
> * Create two clusters on same storage location
> * Created table on active cluster
> * Refreshed meta on replica -> can list the new table
> * Added some rows, flushed the table on active cluster
> * Refreshed hfiles on replica -> can see the data rows
> * Added one more row and flushed the table again. Another hfile was created.
>
> {noformat}
> drwxr-xr-x 3 andor staff 96 Sep 12 11:43 .filelist
> -rw-r--r-- 1 andor staff 5024 Sep 12 11:41 2539b1fd589b43d392b333896a615911
> -rw-r--r-- 1 andor staff 4956 Sep 12 11:42
> ea70ac19c6bc42bcb1ac33961b1605b3{noformat}
>
> * Refresh hfiles again on replica cluster, but can't see the new row. Also
> if you check .filelist it does not have newly added hfiles entry.
> {noformat}
> $ cat
> hbase/data/default/andor/97f8ce9ed533d7508ecc88876601aa60/cf/.filelist/f2.1757695318604
> 鴸3%
> 2539b1fd589b43d392b333896a615911'%
> 2539b1fd589b43d392b333896a615911'{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
