klsince opened a new pull request, #16017: URL: https://github.com/apache/pinot/pull/16017
Like upsert table, the dedup table should use StrictRealtimeSegmentAssignment, i.e. the new segments should be put on the same hosts where the table partition's all other segments are kept, following the segment assignment as tracked in IdealState instead of the current InstancePartition which may provide a different host to hold the segment. Meanwhile, dedup table can move its segments out of TTL to other tiers more freely, so the StrictRealtimeSegmentAssignment has been extended to support multi tiers in this PR. However, note that upsert table can not move its segments out of TTL to new tiers due to the associated validDocIds bitmaps. After we add support to move bitmaps with segments, we can allow upsert tables to use mutli tiers too, which is to be extended separately. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
