Declow commented on issue #2325: URL: https://github.com/apache/iceberg-python/issues/2325#issuecomment-3191580872
For my toy example here it was not that bad. When I used our production setup with a lot more manifest files the service went from using 800MB RAM to reaching it max of 1556MB and crashing within 5 minutes. It was using almost 10MB for each commit maybe more. When I fixed the issue it on the service by removing the cache everything was stable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
