huaxingao commented on PR #6252: URL: https://github.com/apache/iceberg/pull/6252#issuecomment-1763425359
@atifiu That's right. If the filters are not completely evaluated on iceberg, then Spark has to evaluate the filters, the Min/Max/Count values might change after the filtering. Therefore, we can't rely on the statistical information for Min/Max/Count. I also suspect that the timezone could be the reason that the filter isn't fully pushed down, but I can't be certain without examining the details. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
