lgo opened a new issue #5879: URL: https://github.com/apache/incubator-pinot/issues/5879
From Slack: > joey: the controller is pulling the entire segment. Does that happen for every segment? Is it just pulling it to grab the metadata, or does it persist additional data? > That seems like a gnarly bottleneck if we're pushing TBs of data from a Spark app. > kishore: its just pulling it for metadata > there is a way to push the metadata as well > so that it does not pull the entire segment > we should make that the default cc @kishoreg ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
