Fokko commented on issue #813: URL: https://github.com/apache/iceberg-rust/issues/813#issuecomment-2550722785
So we have the table schema, and we have the file schema, and we must assume that they are **different**. This can be in the case that you mentioned above, where there is a different arrow type, but more obvious is in the case of schema evolution. Iceberg is lazy, and will not rewrite the historical data until it needs to update the Parquet file. For the data itself, we should project it into the schema of the table. For the filtering situation, we want to cast the type to the physical type (and also look up the file by ID!). This ties also in with the second part of https://github.com/apache/iceberg-rust/issues/777#issuecomment-2538223320 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
