Lchangliang opened a new pull request, #23561: URL: https://github.com/apache/doris/pull/23561
## Proposed changes Issue Number: close #xxx In current segment cache, the key is rowset_id and the value is the vector of segments. And the segment cache size comes from be/src/runtime/exec_env_init.cpp. ``` uint64_t fd_number = config::min_file_descriptor_number; struct rlimit l; int ret = getrlimit(RLIMIT_NOFILE, &l); fd_number = static_cast<uint64_t>(l.rlim_cur); uint64_t segment_cache_capacity = fd_number * 2 / 5; SegmentLoader::create_global_instance(segment_cache_capacity); ``` Even the segment cache capacity is calculated by fd_number * 2 / 5. There's still some probability that the problem 'too many open file' will trigger. So we need more granular statistics. <!--Describe your changes.--> ## Further comments If this is a relatively large or complex change, kick off the discussion at [d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
