ajantha-bhat commented on code in PR #9454:
URL: https://github.com/apache/iceberg/pull/9454#discussion_r1458121128
##########
core/src/main/java/org/apache/iceberg/ManifestFilterManager.java:
##########
@@ -289,13 +321,38 @@ private void invalidateFilteredCache() {
cleanUncommitted(SnapshotProducer.EMPTY_SET);
}
+ private void recordPartitionMinDataSequenceNumber(ManifestFile manifest) {
Review Comment:
> Can we explore the option of leveraging the partition stats spec added
Wow. That sounds like a nice usecase 👍
For each partition, we do keep the snapshot id that last updated that
partition. Using the snapshot id we can extract the data sequence numbers from
the snapshot.
@zinking: The current status of the partition stats project can be tracked
from this: https://github.com/apache/iceberg/issues/8450
Another alternative approach is to convert equality delete to position
delete (this work is pending), So we can reuse the `rewritePositionDeletes`.
But it is a long route.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
