GabrielM98 commented on issue #404: URL: https://github.com/apache/iceberg-go/issues/404#issuecomment-2830909201
Thanks for the quick response @zeroshade!
> can you share the full schema
The schema looks like so...
```json
{
"type": "struct",
"schema-id": 0,
"fields": [
{
"id": 1,
"name": "event_metadata",
"required": false,
"type": {
"type": "struct",
"fields": [
{
"id": 6,
"name": "uuid",
"required": false,
"type": "string"
},
{
"id": 7,
"name": "source",
"required": false,
"type": {
"type": "struct",
"fields": [
{
"id": 12,
"name": "type",
"required": false,
"type": "string"
},
{
"id": 13,
"name": "id",
"required": false,
"type": "string"
},
{
"id": 14,
"name": "service_id",
"required": false,
"type": "string"
}
]
}
},
{
"id": 8,
"name": "subjects",
"required": false,
"type": {
"type": "list",
"element-id": 15,
"element": {
"type": "struct",
"fields": [
{
"id": 16,
"name": "type",
"required": false,
"type": "string"
},
{
"id": 17,
"name": "id",
"required": false,
"type": "string"
},
{
"id": 18,
"name": "service_id",
"required": false,
"type": "string"
}
]
},
"element-required": false
}
},
{
"id": 9,
"name": "timing",
"required": false,
"type": {
"type": "struct",
"fields": [
{
"id": 19,
"name": "created_at",
"required": false,
"type": "timestamptz"
},
{
"id": 20,
"name": "emitted_at",
"required": false,
"type": "timestamptz"
}
]
}
},
{
"id": 10,
"name": "collection",
"required": false,
"type": {
"type": "struct",
"fields": [
{
"id": 21,
"name": "collections",
"required": false,
"type": {
"type": "list",
"element-id": 22,
"element": {
"type": "struct",
"fields": [
{
"id": 23,
"name": "type",
"required": false,
"type": "string"
},
{
"id": 24,
"name": "id",
"required": false,
"type": "string"
},
{
"id": 25,
"name": "service_id",
"required": false,
"type": "string"
}
]
},
"element-required": false
}
}
]
}
},
{
"id": 11,
"name": "parent_event_uuid",
"required": false,
"type": "string"
}
]
}
},
{
"id": 2,
"name": "update_type",
"required": false,
"type": "string"
},
{
"id": 3,
"name": "old_value",
"required": false,
"type": "string"
},
{
"id": 4,
"name": "new_value",
"required": false,
"type": "string"
},
{
"id": 5,
"name": "user_uuid",
"required": false,
"type": "string"
}
]
}
```
> the code used to write the data?
The data is being written via the Kafka Connect Apache Iceberg Sink
Connector, which we're building as per [these
instructions](https://iceberg.apache.org/docs/nightly/kafka-connect/#installation)
from the Iceberg docs, using the latest version (`1.8.1`). I also used PySpark
(via a Docker container running the `tabulario/spark-iceberg:3.5.5_1.8.1`
image) to write to the same table, but still experienced the same issue when
attempting to query it via `iceberg-go`.
> I'm also curious if you try reading the data with pyiceberg whether you
run into the same issue or not.
Will give this a go on Monday 👍
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
