adriangb opened a new pull request, #26217: URL: https://github.com/apache/datafusion/pull/26217
mimalloc returns freed memory to the OS after 10ms by default. Query execution allocates and frees large buffers repeatedly, so pages are decommitted and faulted back in, and the kernel spends a large share of the runtime zeroing them (35% of samples in clear_page_erms on TPC-H Q18). Set purge_delay to -1 at startup unless MIMALLOC_PURGE_DELAY is set. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
