freemandealer opened a new issue, #14012: URL: https://github.com/apache/doris/issues/14012
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues. ### Description For table with hundreds of text type columns, flushing its memory table may cost huge memory. These memory are consumed when initializing page builder, as it reserve 1MB for each column. Shrink the reservation may reduce memory consumption substantially in load process, making Doris more capable for larger load concurrency. ### Solution 1. Reduce default reserved buffer for each Page Builder from 1M to 64KB and let it grow if needed. 2. Provide tests to see if this brings any performance degrading. ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
