andygrove commented on issue #25841: URL: https://github.com/apache/datafusion/issues/25841#issuecomment-5895362869
@villebro suggested a refinement in https://github.com/apache/datafusion-ballista/pull/2498#discussion_r4125396205: when both sides have an `e_tag`, compare only that, then `version`, and fall back to size and modification time only when neither is available. On stores whose ETag is derived from the content, such as S3, comparing only the ETag keeps a cache hit when a file is rewritten with identical bytes, which the size and mtime check counts as a change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
