pradeepgv42 opened a new issue #5554:
URL: https://github.com/apache/incubator-pinot/issues/5554
Currently IIUC all the segments need to be on disk to be able to query them.
Usually, queries to older data tends to be lower or clients would be okay
with
in-curing latency for queries on older data.
Using this assumption, we could possibly keep the segments older than X days
on deep storage and not load them onto the servers.
Couple of ways to deal with this based on discussions on slack:
1) Using presto on top of pinto and make presto-pinot be able to query
segments on S3 directly.
2) When the query arrives lazy load the segment and return the results.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
