viirya commented on issue #244: URL: https://github.com/apache/iceberg-rust/issues/244#issuecomment-2020967730
Thanks @liurenjie1024. I read through the summary above. I think currently #245 has done the first one `Collect leave column ids after schema pruning, and translate it to ProjectionMask`. The `select` API can select root/nested columns. When building table scan, #245 takes the field ids from selected fields and pass to arrow reader builder. When the arrow reader goes to read files, it uses these field ids to find corresponding leaf column indices from Parquet schema. The leaf column indices are used to construct `ProjectionMask` and pass to the Parquet record batch reader to project columns when reading Parquet files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
