xinyiZzz opened a new issue, #9580: URL: https://github.com/apache/incubator-doris/issues/9580
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description ## Motivation 1. High concurrent query performance is poor, among which Spin Lock in tcmalloc has a large CPU ratio; 2. The cache utilization in PageCache, MemPool, and Vec Allocator needs to be further improved; 3. Multiple memory allocators from Impala, ClickHouse, and Doris coexist, which leads to optimization difficulties; (Similar problems exist while turning on or off the vectorization engine) ## Expected Return 1. Unified memory allocator; 2. More memory reuse; 3. Improve cache hit rate and reduce cache size; 4. Try to introduce other memory frameworks such as JeMalloc; 5. Reduce additional costs such as mem tracker; ## Optimization direction 1. Stress testing on more test sets to find memory hotspots; 2. Test the performance of multiple memory allocators currently existing in Doris in different scenarios, unify and optimize them; 3. Try to introduce tests such as JeMalloc; 4. 5. When the line storage engine is removed, remove the outdated memory-related code at the same time; ### Solution _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
