GitHub user liurenjie1024 added a comment to the discussion: Ideas: add directory support for `FileIO`
Thanks @dentiny for raising this. `FileIO` is an abstraction over different storage systems, and we should only provide a minimum interface so that most storage systems can fit into it. As with directory operation, I don't think we should provide that for several reasons: 1. Apache iceberg spec has no requirement for file location, the file hierarchy you see is just default implementation, but not required in iceberg spec. 2. Most object stores's support for directory is limited and inefficient. GitHub link: https://github.com/apache/iceberg-rust/discussions/1246#discussioncomment-12958300 ---- This is an automatically sent email for issues@iceberg.apache.org. To unsubscribe, please send an email to: issues-unsubscr...@iceberg.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
