andygrove commented on issue #4576: URL: https://github.com/apache/datafusion-comet/issues/4576#issuecomment-5850511906
Closing this, since the investigation is done. Allocator-level accounting shipped as observability in #5934 and #6162. The comments above explain why neither the tracked balance nor cgroup `memory.current` can drive a guard. #6163 deprecated `spark.comet.exec.memoryPool.fraction`, and #6167 follows up by reporting resident anonymous memory. @comphead, #5666 does not depend on this being open, but reopen it if you would rather track the experiment here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
