sollhui opened a new pull request, #39975:
URL: https://github.com/apache/doris/pull/39975

   We encountered a scenario where a large number of small transactions were 
generated, resulting in an impact on query performance:
   Kafka's data comes in batches of very small data every very short time, 
which leads to tasks being frequently scheduled and ending very quickly, 
resulting in a large number of small transactions.
   
   To solve this problem, we delay the scheduling of tasks that perceive EOF. 
which will not delay data consumption, for perceiving EOF indicates that the 
consumption speed is greater than the production speed
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to