MaxiBoether opened a new issue, #45277:
URL: https://github.com/apache/arrow/issues/45277

   ### Describe the enhancement requested
   
   I installed `pyarrow` via pip without specifying a concrete version (which 
was my fault). Another requirement forced pip to download pyarrow 17. At the 
same time, I installed libarrow 18 via apt in my build container. I have a 
custom C++ Python extension which via CMake got compiled against the system 
libarrow 18. In Python, I read a pyarrow table, passed this to the C++ 
extension, and then on `GetColumnByName` my application segfaulted. It took me 
a bit to realize that I have a version mismatch between python and C++, I 
presume the memory layouts of the tables in memory are a bit different, which 
probably caused the segfault. Now it is all working fine again.
   
   I wonder there should be something like a magic version byte that gets 
updated when the in-memory layout changes. This way, I could have avoided 
debugging this and gotten a better error message instead. While this might not 
be a common problem, it could help avoid issues like the segfault I encountered.
   
   ### Component(s)
   
   C++, Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to