[GitHub] [iceberg] xuzhiwen1255 opened a new issue, #6800: Do you need to save all historical json files after cleaning up expired snapshots?

[via GitHub]

xuzhiwen1255 opened a new issue, #6800:
URL: https://github.com/apache/iceberg/issues/6800

   ### Query engine
   
   _No response_
   
   ### Question
   
   <img width="1086" alt="image" 
src="https://user-images.githubusercontent.com/105710753/217992943-217a18fc-708d-42a6-bb2b-8dd2ac355d64.png";>
   
   After cleaning and cleaning out expired snapshots and orphan files, the 
metadata-log still records all the metadata.json information.I don't think it 
makes sense since we've cleaned out expired snapshots and orphan files, and the 
file pointed to by metadatalog in the old metadatajson doesn't exist anymore,so 
I suggest that you can clean up the contents of the metadata-log after cleaning 
up expired snapshots and orphan files, and only keep the snapshot information 
that still exists.
   
   If I understand wrong, please correct me, thank you.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org