luozenglin opened a new pull request, #20066:
URL: https://github.com/apache/doris/pull/20066

   
   # Proposed changes
   
   Issue Number: close #xxx
   
   ## Problem summary
   
   Suppose three queries are executed in a resource group with a memory_limit 
of 8G, and they consume memory of query_a = 3G, query_b = 3G, and query_c = 3G. 
The total memory used is counted as 9G when the resource group GC is executed, 
which exceeds the resource group limit and cancels query_a. 
   
   When the resource group is next GC, the memory of query_a may not be freed 
yet, and it will be counted again in the total memory consumed by that resource 
group, which again exceeds the resource group limit and cancels query_b. 
   
   From the user's perspective, it is fine to execute query_a and query_b at 
the same time, but executing query_ a, query_b and query_c will be cancelled 
for two queries, which is not as expected.
   
   This pr skips the queries that are cancelled when counting the memory used 
by the resource group. If this causes the process memory to grow, the process 
gc will handle it.
   
   ## Checklist(Required)
   
   * [ ] Does it affect the original behavior
   * [ ] Has unit tests been added
   * [ ] Has document been added or modified
   * [ ] Does it need to update dependencies
   * [ ] Is this PR support rollback (If NO, please explain WHY)
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at 
[d...@doris.apache.org](mailto:d...@doris.apache.org) by explaining why you 
chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to