fengjiajie opened a new pull request, #11073:
URL: https://github.com/apache/iceberg/pull/11073

   We are currently using Flink's Local Env mode (executing Flink tasks within 
the local JVM). We are starting many "Flink query Iceberg tasks" sequentially 
within the lifecycle of a single JVM (which can be considered a long-running 
service).
   
   After the JVM runs for a while, we can observe a metaspace memory leak. By 
examining the leaking ClassLoaders, we found that Iceberg's ExecutorService is 
registered to the ShutdownHook (GC root).
   
   
![image](https://github.com/user-attachments/assets/246c6005-feb5-4e69-8269-8cb50955bd1a)
   
![image](https://github.com/user-attachments/assets/b970b2d2-0fb5-48e8-9edb-bcf8f406a70a)
   
   
   I noticed that these ExecutorServices are actively shut down. Theoretically, 
they don't need to be registered to the ShutdownHook.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to