ankitsultana opened a new issue, #15842: URL: https://github.com/apache/pinot/issues/15842
MSE Query Parallelism as it stands is quite complicated for users to understand. There are some other issues with it too: * Options like `stageParallelism` can or cannot apply based on Runtime conditions which are complicated to understand for users. * There are overlapping responsibilities. e.g. partition_parallelism is largely the same as stageParallelism. * Names are confusing. e.g. "partition_size" controls the number of workers in the leaf stage. * ... etc. This is covered in detail in the following doc which also proposes a new behavior that the new optimizer will follow: https://docs.google.com/document/d/1h_IgCiUU4u0xQQ6lz4ZhzH0htd6NaJV8lFBE59MeQZA/edit?tab=t.0#heading=h.aq4kaj522uyn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
