fuzing commented on issue #12895: URL: https://github.com/apache/iceberg/issues/12895#issuecomment-2841985828
@jesumyip - Good call - I hand transcribed that one line (in the bash script), it was supposed to go into /tmp (so no need to create localized tmp folder within the container if you do it that way). Our setup is quite different in that we copy/unpack a number of other connectors and telemetry stuff. Happy that this worked for you. One other thing - we're using the jsonToMap transformer to create Iceberg Maps (as opposed to the default Structs for nested structures). We have some variable key meta-data that comes into our tables, and structs would cause numerous (continuous) table schema evolutions with the changes (Map is more flexible in this regard in that Maps accept arbitrary key/value pairs, provided the value of the same type). We also actually turn table creation and schema evolution off once the initial tables are created, so after they're created we flip these lines to "false": ``` "iceberg.tables.auto-create-enabled": "true", "iceberg.tables.evolve-schema-enabled": "true", ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org