wirybeaver opened a new issue, #9709: URL: https://github.com/apache/pinot/issues/9709
Pinot in Uber downloads offline segments from users’ HDFS directory. When the pinot server is restarted, it would extract segment download URIs from segments’ metadata stored in Zookeeper and then reload all segments from HDFS. If customers incidentally delete the HDFS copy, the download uri becomes a sort of dangling pointer but the pinot server is not aware of that. When the server is restarted later on, it will set the segment replica to ERROR state and the number of segment available replicas is dropped by one. Even though the deep storage goes away, the server can download segments from peers to improve the data availability. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org For additional commands, e-mail: commits-h...@pinot.apache.org
