chenboat commented on code in PR #12317:
URL: https://github.com/apache/pinot/pull/12317#discussion_r1480634720
##########
pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/BaseSegmentFetcher.java:
##########
@@ -109,6 +111,46 @@ public File fetchUntarSegmentToLocalStreamed(URI uri, File
dest, long rateLimit,
throw new UnsupportedOperationException();
}
+ /**
+ * @param segmentName
+ * @param uriSupplier the supplier to the list of segment download uris.
+ * @param dest The destination to put the downloaded segment.
+ * @return true if and only if the segment fetch is successful. This method
keeps retrying (with exponential backoff)
+ * of the following steps until segment download is successful or the retry
limit is reached whichever comes first 1)
+ * Find servers hosting the segment in ONLINE state from the External View
of the table. 2) Shuffle the list of
+ * servers. 3) Go through the list of server http download URIs to fetch the
segment until success.
+ * @throws Exception
+ */
+ @Override
+ public boolean fetchSegmentToLocal(String segmentName, Supplier<List<URI>>
uriSupplier, File dest)
+ throws Exception {
Review Comment:
ditto as my comments above.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@pinot.apache.org
For additional commands, e-mail: commits-h...@pinot.apache.org
