GitHub user dentiny added a comment to the discussion: Ideas: add directory support for `FileIO`
Thank you for the reply! I agree with your point, "directory" concepts, AFAIK, exists mostly on POSIX system and GCS. Right now I'm implementing a filesystem based catalog, which definitely requires directory-related access, it's awkward to use file_io` for file-centric operations, while `std::fs` for directory operation. Take duckdb as an example, it has a filesystem interface, but not all the operations apply to all detailed filesystem instances. For example, `pipe` only apply to local filesystem: https://github.com/duckdb/duckdb/blob/0069af20abea2660d67849257bc568570388d50c/src/include/duckdb/common/file_system.hpp#L173-L174, and set the default behavior to throw (for other filesystems). I used as a temporary workaround and leave the discussion thread here, and I completely understand and agree with your argument, would like to hear if you have other suggestions. :( GitHub link: https://github.com/apache/iceberg-rust/discussions/1246#discussioncomment-12958326 ---- This is an automatically sent email for issues@iceberg.apache.org. To unsubscribe, please send an email to: issues-unsubscr...@iceberg.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
