jaychia commented on PR #9836: URL: https://github.com/apache/iceberg/pull/9836#issuecomment-1979626594
> Given that this mainly targets pyiceberg, I think this doc should live in https://github.com/apache/iceberg-python/ Hello! The Daft query engine integrates with `pyiceberg` currently as a user API, but actually isn't tied to the PyIceberg project. In fact, we are actively exploring moving over to iceberg-rs as that project matures and we contribute functionality to it, for more native integrations with Daft on our Rust layer. Daft is a fully featured distributed query engine, and we are actively working on non-PyIceberg specific functionality that is more applicable to the wider Iceberg ecosystem (e.g. partitioned writes, compaction stored procedures, orphan file pruning procedures etc). This is in contrast to pyiceberg-only integrations such as Pandas/Arrow which really just use pyiceberg for retrieving data into Python memory. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
