pvary commented on PR #13579: URL: https://github.com/apache/iceberg/pull/13579#issuecomment-3284994351
My main question here is: - Do we want to extract the manifest rewrite planner to the core? Big part of the code is reading the current manifest entries, and filtering out not needed ones. In Spark we did this by spark sql. Here we did this with java, but we might be better of having a generic api which returns the files to scan which scan returns the data and the delete file entries. Another thing to consider is that the V4 API will have auto compaction for manifests. We might just skip this and wait for it to arrive. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
