sungwy commented on issue #953: URL: https://github.com/apache/iceberg-python/issues/953#issuecomment-2250984811
Hi @cfrancois7 I investigated this a little more, and I think there could be a limitation on pyarrow in supporting predicate pushdown for nested fields. Here's a related open issue I found on this topic: https://github.com/apache/arrow/issues/20203 I'm running into the following error when I make a change to the pyarrow expression to attempt to refer to the column name as 'employment.status' > pyarrow.lib.ArrowInvalid: No match for FieldRef.Name(employment.status) in id: int32 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
