amogh-jahagirdar opened a new pull request, #11957: URL: https://github.com/apache/iceberg/pull/11957
Leaving in draft now, but in an effort to save executor memory as part of the broadcast of data to. file scoped deletes, we can remove the referenced manifest location because that's only needed on the driver at commit time. Added a builder to FileMetadata which would null out the referenced manifest location. Additional driver memory is consumed via a mapping of delete to referenced manifest location which is used at commit time to rebuild the delete file with the manifest so that the commit optimization which uses referenced manifest location can be leveraged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
