GitHub user dentiny added a comment to the discussion: Ideas: add directory support for `FileIO`
> We can expose a list operation in FileIO. This isn't being added solely for > this discussion; our compaction and vacuum features will require this > functionality as well. Sorry if I mis-understand. Iceberg is a location-unaware specification, which means data file could be placed anywhere, it's valid implementation as long as manifest files could track them. For compaction, my understanding, is to (1) read data files and deletion files / deletion vector (2) apply certain compaction strategies (i.e. sorting) (3) rewrite data files into destination So we don't actually require list operation involved here? GitHub link: https://github.com/apache/iceberg-rust/discussions/1246#discussioncomment-12967384 ---- This is an automatically sent email for issues@iceberg.apache.org. To unsubscribe, please send an email to: issues-unsubscr...@iceberg.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
