[ 
https://issues.apache.org/jira/browse/HBASE-29611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18028311#comment-18028311
 ] 

Wellington Chevreuil commented on HBASE-29611:
----------------------------------------------

{quote}
In the current scenario, what is happening is that for the first time 
read-replica is loading the list of Hfiles from the file in .filelist created 
by active cluster but then it is creating the new file with greater timestamp. 
Now we have two files in .filelist. On the subsequent flush from active the 
file in .filelist created by the active gets updated but the file created by 
read-replica is not. While loading again (from read replica) in the 
refresh_hfiles as we take the file with higher timestamp, which is the file 
created by read-replica for the first time, gets loaded which does not have an 
updated list of hfiles.
{quote}

Thanks for explaining this, [~anuj.sharma]. So a flush does not cause the FILE 
SFT to create a new file in .filelist with a new timestamp? 

> With FILE based SFT, the list of HFiles we maintain in .filelist is not 
> getting updated for read replica
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-29611
>                 URL: https://issues.apache.org/jira/browse/HBASE-29611
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Anuj Sharma
>            Assignee: Anuj Sharma
>            Priority: Major
>
> Repro steps:
>  * Create two clusters on same storage location
>  * Created table on active cluster
>  * Refreshed meta on replica -> can list the new table
>  * Added some rows, flushed the table on active cluster
>  * Refreshed hfiles on replica -> can see the data rows
>  * Added one more row and flushed the table again. Another hfile was created.
>  
> {noformat}
> drwxr-xr-x  3 andor  staff    96 Sep 12 11:43 .filelist
> -rw-r--r--  1 andor  staff  5024 Sep 12 11:41 2539b1fd589b43d392b333896a615911
> -rw-r--r--  1 andor  staff  4956 Sep 12 11:42 
> ea70ac19c6bc42bcb1ac33961b1605b3{noformat}
>  
>  * Refresh hfiles again on replica cluster, but can't see the new row. Also 
> if you check .filelist it does not have newly added hfiles entry.
> {noformat}
> $ cat 
> hbase/data/default/andor/97f8ce9ed533d7508ecc88876601aa60/cf/.filelist/f2.1757695318604
> 鴸3%
>  2539b1fd589b43d392b333896a615911'%
>  2539b1fd589b43d392b333896a615911'{noformat}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to