GitHub user dentiny added a comment to the discussion: Ideas: add directory support for `FileIO`
Thank you for the thoughtful reply! I think all points you've made make sense to me. As a newcomer, one thing I found filesystem catalog attractive is, it provides a way to demonstrate what metadata file and manifest files looks like in a straightforward way; rest catalog with "file" schema also generates a few files (manifest files and manifest list), but metadata files and version hint file seems to stored internally (i.e. in sqlite). > You could then implement an FS catalog outside of iceberg-rust as a > third-party catalog. Sure! I have an internal implementation for FS catalog, which only implements limited `TableUpdate`s; I will try to get more updates covered and put on my github for public access at least. > We can expose a list operation in FileIO. This isn't being added solely for > this discussion; our compaction and vacuum features will require this > functionality as well. Nice! I'll definitely rely on the feature. GitHub link: https://github.com/apache/iceberg-rust/discussions/1246#discussioncomment-12966963 ---- This is an automatically sent email for issues@iceberg.apache.org. To unsubscribe, please send an email to: issues-unsubscr...@iceberg.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
