C-Loftus commented on issue #989:
URL: https://github.com/apache/iceberg-go/issues/989#issuecomment-5355669021
@tanmayrauth I believe we still need to bump the arrow-go version due to
some of the reasons specified in #1569 Please let me know if I am mistaken
though.
- At least from what I'm seeing still, I can build a table with a geometry
column, but reading a table with a geometry column written by iceberg-go
v0.6.1-0.20260819204557-80630b4df4a4 fails in Scan(...).ToArrowRecords:
`invalid: mismatch storage type 'extension_type<storage=binary>' for
extension type 'extension_type<storage=binary>'`
- I believe the cause is that geoarrow-go 20260728 writes the column with
the Parquet GEOMETRY(crs=...) logical type. On read, pqarrow rebuilds a
`WKBType` from it via `ArrowTypeFromParquet`, which tags the CRS as srid, while
the stored ARROW:schema carries authority_code. The types compare unequal, and
`applyOriginalStorageMetadata` in arrow-go
v18.7.1-0.20260727191739-1b1f82f5848c still expects the inferred type to be
bare storage, so it errors.
- From what I can tell, this has been fixed in
https://github.com/apache/arrow-go/pull/1051 in the upstream arrow-go library,
but there hasn't been a release and thus it hasn't been pulled into iceberg-go
yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
