anuragrai16 commented on issue #17233: URL: https://github.com/apache/pinot/issues/17233#issuecomment-3556906195
+1 , I think a data-only CRC instead of completely skipping CRC check might be better here. There are still more corner cases with data only CRCs as well. eg. using ingestion transformations like `now()` causes the data to mismatch as well across replicas, which will lead to false-positive segment downloads from deep-store as well. We've internally switched to a table-level configuration for skipCRC temporarily, so we can work around enabling this for offline tables. But, a good long-term fix is needed for the CRC mismatch issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
