fuzing commented on issue #12895:
URL: https://github.com/apache/iceberg/issues/12895#issuecomment-2841985828
@jesumyip - Good call - I hand transcribed that one line (in the bash
script), it was supposed to go into /tmp (so no need to create localized tmp
folder within the container if you do it that way). Our setup is quite
different in that we copy/unpack a number of other connectors and telemetry
stuff. Happy that this worked for you.
One other thing - we're using the jsonToMap transformer to create Iceberg
Maps (as opposed to the default Structs for nested structures). We have some
variable key meta-data that comes into our tables, and structs would cause
numerous (continuous) table schema evolutions with the changes (Map is more
flexible in this regard in that Maps accept arbitrary key/value pairs, provided
the value of the same type).
We also actually turn table creation and schema evolution off once the
initial tables are created, so after they're created we flip these lines to
"false":
```
"iceberg.tables.auto-create-enabled": "true",
"iceberg.tables.evolve-schema-enabled": "true",
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
