victorsheng opened a new issue, #17271: URL: https://github.com/apache/dolphinscheduler/issues/17271
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement. ### Description In the Apache Dolphinscheduler project, we previously encountered a scenario where one worker group remained fully loaded for an extended period, preventing new tasks from being dispatched. This bottleneck caused the master node's task dispatch process to become blocked, halting workflow progress. To address this issue, we propose the following improvements: Introduce a configurable parameter (defaulting to single-queue mode) to support switching between single-queue and multi-queue modes. Modify the MasterPriorityQueue implementation to handle task distribution across multiple queues when multi-queue mode is enabled, ensuring tasks are dispatched based on workload conditions and worker group availability. ### Use case _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
