PeterCorless commented on issue #5554: URL: https://github.com/apache/pinot/issues/5554#issuecomment-2688973704
A comment from the StarTree docs (emphasis added): > Why can't we use the copy already in deep-store? _The segment in deep store is compressed, and typically will not have all indexes, especially if you've added indexes or derived columns to the segment later on._ We use a separate location and copy for the tiered storage query execution, so we can keep it uncompressed and exactly in sync with what would have been on the server. Think of this S3 bucket as an exact replacement for the storage that would've been on the servers locally, with one major difference that we'll keep only 1 copy in S3 vs replication number of copies locally. Source: https://dev.startree.ai/docs/manage-data/set-up-tiered-storage/architecture -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
