rshkv commented on PR #863:
URL: https://github.com/apache/iceberg-rust/pull/863#issuecomment-2646010721
> BTW maybe it's easier to discuss if you can push some sample code.
Pushed my work-in-progress. Currently failing here:
```
Incorrect datatype for StructArray field \"column_sizes\", expected
Map(Field {
name: \"key_value\",
data_type: Struct([
Field { name: \"key\", data_type: Int32, nullable: false, dict_id: 0,
dict_is_ordered: false, metadata: {\"PARQUET:field_id\": \"117\"} },
Field { name: \"value\", data_type: Int64, nullable: false, dict_id: 0,
dict_is_ordered: false, metadata: {\"PARQUET:field_id\": \"118\"} }]),
nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, false)
got
Map(Field {
name: \"key_value\",
data_type: Struct([
Field { name: \"key\", data_type: Int32, nullable: false, dict_id: 0,
dict_is_ordered: false, metadata: {} },
Field { name: \"value\", data_type: Int64, nullable: false, dict_id: 0,
dict_is_ordered: false, metadata: {} }]),
nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, false)
```
> Not sure if I understand it correctly, this sounds like just some
limitations of `arrow-rs` and can be solved easily by adding some new APIs,
instead of some fundamental difficulty.
That's right. Going to open a PR with `arrow-rs`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
