marvinlanhenke commented on issue #356: URL: https://github.com/apache/iceberg-rust/issues/356#issuecomment-2081495685
> I'm not seeing a concrete proposal on which to comment, but the broad theme of moving closer to the actual object store APIs is IMO a good idea. > > That being said, I feel I should point out that such an abstraction already exists, is natively supported by both the Rust arrow and Datafusion projects, and already has OpenDAL bindings, namely object_store... Perhaps this is therefore already a solved problem? ...with the disclaimer, that I have little to no experience regarding the intricacies of object store APIs; I (also) think we should avoid "reinventing the wheel" here and use already existing solutions; with that in mind if `FileIO` becomes a trait and we can use an existing implementation e.g. opendal or object_store - I have little to no worries about this proposed change... ...hope this makes any sense at all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
