jadami10 opened a new issue, #11894: URL: https://github.com/apache/pinot/issues/11894
We tried scaling up an upsert table and rebalancing. With MinimizeDataMovement, we still saw effectively every single segment moving to a different server. Upsert tables are more complicated because every segment for a partition has to live on the same server, so you typically need to scale up to some factor of your total partitions. But even then, the algorithm should strictly move partitions to new servers when scaling up. And in the case you do use a factor of total partitions, the end result should be some partitions are moved off of all existing servers to new serers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
