hussein-awala opened a new pull request, #458: URL: https://github.com/apache/iceberg-python/pull/458
closes: #451 The C++ implementation of Arrow has different types of lists (https://arrow.apache.org/docs/cpp/api/datatype.html#_CPPv4N5arrow12BaseListTypeE), but these types are not correctly implemented in Python, where there is no common superclass for them, they extend the DataType class directly. `LargeListType` and `FixedSizeListType` are also lists but with some extra characteristics, so they should be accepted by PyIceberg, and transformed to ListType as the PyArrow `ListType`. In the mentioned issue, PyArrow map the Polars list to a `LargeListType` instead of `ListType` and that's why it fails. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
