vustef opened a new issue, #1766: URL: https://github.com/apache/iceberg-rust/issues/1766
### Is your feature request related to a problem or challenge? The [spec ](https://iceberg.apache.org/spec/#reserved-field-ids)defines metadata columns, one of which is the `_file` column. This column seems instrumental for write operations positional deletes in future, as well as for having some ways for users to identify rows (combination of filepath + position) ### Describe the solution you'd like The solution should allow building a TableScan with option to return metadata columns (in this case `_file`). When that happens, the library should return batches that include this extra column. The column should be encoded in such a way that it doesn't add much memory overhead. Since arrow doesn't support constant vectors, perhaps RLE could be used. ### Willingness to contribute I can contribute to this feature independently -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
