xuzhiwen1255 commented on issue #6800: URL: https://github.com/apache/iceberg/issues/6800#issuecomment-1425256351
> I think this is worth thinking about but I'm not sure it is as simple as this. Currently we don't really consider the json files to really have the same lifecycle as other metadata files. They aren't really expired since they aren't actually part of the history ... However, if you write to iceberg through flink and have high real-time requirements, then the ck interval will be very short. If it runs for a long time, I think the metadata-log may be relatively large, although recording this It doesn't take up too much space, but it's redundant. After all, the manifest-list file has been deleted, which makes it meaningless. But I don't know if there are other considerations in the design here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
