rajagopr opened a new pull request, #13597: URL: https://github.com/apache/pinot/pull/13597
### What Added support to upload segments in batch mode when METADATA upload type is used. The new API endpoint `/segmentList` is introduced which supports this capability. ### Why Segment assignment was observed to be a bottleneck when multiple segments were getting updated at the same time. This was due to the fact that each segment could be updated only after acquiring the table update lock. The issue significantly affected ingestion and segment refresh when multiple minions (~100) were working at the same time. ### How With this change a bunch of segments could be updated in one-go after acquiring the table update lock. ### Testing Added integration test which adds multiple segments in batch mode. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
