kevinjqliu opened a new issue, #1647: URL: https://github.com/apache/iceberg-rust/issues/1647
### Apache Iceberg Rust version None ### Describe the bug When using datafusion in rust and python, `Fatal Python error: Bus error` usually means there is an issue with the FFI boundary. Also see https://github.com/apache/datafusion-python/issues/1217 For example, datafusion 48 -> 49 has a breaking change. Thus mixing code built with datafusion 48 and datafusion 49 will throw the above error. This is mostly presented in the python ecosystem since installing the datafusion package usually picks the latest version. This is what happened in https://github.com/apache/iceberg-rust/pull/1635 and pinning the datafusion version to 47 resolved the issue. Going forward, we have to be mindful of which datafusion version we use in the repo and also to build `pyiceberg-core`. This will determine which datafusion python version we can use. ### To Reproduce _No response_ ### Expected behavior _No response_ ### Willingness to contribute None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
