CalvinKirs opened a new pull request, #46184:
URL: https://github.com/apache/doris/pull/46184
### Background
In the current file system implementation, the fs.disable.cache parameter
allows disabling FS caching. While this provides flexibility, it introduces
several critical issues:
```
1: 22537201 721190432 java.util.HashMap$Node
2: 21559238 689895616 javax.management.MBeanAttributeInfo
3: 21559098 517418352 javax.management.Attribute
4: 19380247 465125928
org.apache.hadoop.metrics2.impl.MetricCounterLong
5: 122603 461180096 [J
6: 294309 255533536 [B
7: 724598 252264048 [Ljava.lang.Object;
8: 2012368 189047432 [C
9: 159442 131064400 [Ljava.util.HashMap$Node;
10: 114752 88075072 [Ljavax.management.MBeanAttributeInfo;
11: 1899581 45589944 java.lang.String
12: 1720140 41283360
org.apache.hadoop.metrics2.impl.MetricGaugeLong
```
#### Unbounded FS Instance Creation
When fs.disable.cache=true, a new FS instance is created for every access,
preventing instance reuse.
#### Resource Leakage
Associated objects, such as thread metrics and connection pools, are not
properly released due to excessive FS instance creation, leading to memory
leaks.
#### Performance Degradation
Frequent creation and destruction of FS instances impose significant
overhead, especially in high-concurrency scenarios.
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR should
merge into -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
