sdd opened a new pull request, #241: URL: https://github.com/apache/iceberg-rust/pull/241
A very early-stage PR to propose an initial design for a partition evaluator to reject files in the table scan's file planner that don't match the scan's filter. Which issue does this PR close? Closes https://github.com/apache/iceberg-rust/issues/152 partly. Rationale for this change Add the ability to use the TableScan's filter in the file planner to filter out files whose partition values don't match the filter. What changes are included in this PR? * Add an optional `Predicate` to `TableScan`, with which to filter the files (and eventually rows) returned by the scan * Add a `case_sensitive` flag to `TableScan` to (eventually) allow case-sensitivity of filtering to be selectable * Add `PartitionEvaluator`: a new struct that handles evaluating whether data files (and eventually manifests, perhaps rows?) should be present in the results of a scan * Creates a cache of `PartitionEvaluator`s, using its entries to filter out manifest entries that don't pass the scan's filter. Are these changes tested? Not yet. Unit and integration tests to follow with the implementation, once the design has been approved. Are there any user-facing changes? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
