srilman commented on issue #491: URL: https://github.com/apache/iceberg-python/issues/491#issuecomment-1974819638
> When the filter is always true for all output files, we can skip the row-level filter in DataScan.to_arrow I have a somewhat working implementation of this optimization where I expand `_InclusiveMetricsEvaluator` to return 3 different values, ROWS_MIGHT_MATCH, ROWS_CANNOT_MATCH, and (the new one) ROWS_ALWAYS_MATCH. Updating the tests now, and will try to get a PR out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
