Fokko commented on PR #1665: URL: https://github.com/apache/iceberg-python/pull/1665#issuecomment-2661321735
@kevinjqliu Yes, that is an issue, but we don't respect this for any of the operations (`append`, etc). Doing this would make the operations expensive so we could leave this up to the user. Two more opinionated approaches are: - Don't allow `join_cols` if the table has identifier fields. - Remove the `join_cols` column. But I think it might be _too_ opinionated. Would love to hear what others think. @ananthdurai Kevin already provided an excellent answer, If you want to learn more, I would recommend reading the docs on [hidden partition pruning](https://iceberg.apache.org/docs/nightly/partitioning/). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
