yixiutt opened a new pull request, #9915:
URL: https://github.com/apache/incubator-doris/pull/9915
1. seperate base and cu compaction thread pool
origin thread pool may all be held by base compaction, a case is
be has 8 dirs, each dir can have 4 task at the same time, even
every dir will reserve one slot for cumu compaction, (4-1)*8=24 is
much more bigger than max compaction thread num 10.
2.set base compaction idle schedule to run in low priority
3.remove base compaction for dup key if no delete_predict applied,
base compaction waste a lot of cpu&io for dup model.
4.add a max_rowset_num limit for base compaction in case base compaction
run too long
# Proposed changes
Issue Number: close #xxx
## Problem Summary:
Describe the overview of changes.
## Checklist(Required)
1. Does it affect the original behavior: (Yes/No/I Don't know)
2. Has unit tests been added: (Yes/No/No Need)
3. Has document been added or modified: (Yes/No/No Need)
4. Does it need to update dependencies: (Yes/No)
5. Are there any changes that cannot be rolled back: (Yes/No)
## Further comments
If this is a relatively large or complex change, kick off the discussion at
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you
chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
