kevinjqliu commented on issue #1162: URL: https://github.com/apache/iceberg-python/issues/1162#issuecomment-2361643354
One realization is that the manifest cache is implemented as a global cache. https://github.com/apache/iceberg-python/blob/de47590c6ac4f507cb2337c20504a62c484339f9/pyiceberg/table/snapshots.py#L234-L238 And kept in memory until eviction. And since `ManifestFile` has an IO component, I think the file descriptors are kept alive and never cleaned up. Why does this only affect M1 Mac? I have no idea. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
