anuragrai16 opened a new pull request, #17380: URL: https://github.com/apache/pinot/pull/17380
This PR is a follow up of https://github.com/apache/pinot/pull/17264 that added a computation of data-only CRC for segments and uploaded it to ZK. It introduces a new parameter `useDataCrcIfAvailable` to the `replaceSegmentIfCrcMismatch` method, enabling more intelligent segment replacement decisions by distinguishing between data changes and index-only changes. The data CRC is not used in explicit Reload and Replace calls from Helix, essentially keeping the behaviour same. It is only used in the flow of `RealtimeTableDataManager.doAddOnlineSegment()` and `OfflineTableDataManager.doAddOnlineSegment()` , where the decisions of downloading segments (even if a local copy may be present) is taken based on the CRC. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
