[I] kafka-connector | org.apache.kafka.connect.storage.StringConverter for value not working [iceberg]

[via GitHub]

raphaelauv opened a new issue, #11871:
URL: https://github.com/apache/iceberg/issues/11871

   ### Apache Iceberg version
   
   1.7.1 (latest release)
   
   ### Query engine
   
   Kafka Connect
   
   ### Please describe the bug 🐞
   
   if i produce a message in string for key and value
   
   
![image](https://github.com/user-attachments/assets/cd2f35a2-62f4-4443-ac43-81c5a26f460c)
   
   then the connector 
   
   ```json
   {
     "name": "string-event",
     "config": {
       "connector.class": "org.apache.iceberg.connect.IcebergSinkConnector",
       "tasks.max": "1",
       "topics": "aaaaaaa",
       "iceberg.tables.auto-create-enabled": "true",
       "iceberg.tables": "default.events",
       "iceberg.catalog.type": "rest",
       "iceberg.catalog.uri": "http://iceberg_rest:8181";,
       "iceberg.catalog.warehouse": "s3://test-bucket/iceberg/",
       "iceberg.catalog.s3.endpoint": "http://minio:9000";,
       "iceberg.catalog.s3.path-style-access": "true",
       "iceberg.catalog.s3.access-key-id": 
"${file:/secrets/credentials.properties:AWS_ACCESS_KEY_ID}",
       "iceberg.catalog.s3.secret-access-key": 
"${file:/secrets/credentials.properties:AWS_SECRET_ACCESS_KEY}",
       "key.converter": "org.apache.kafka.connect.storage.StringConverter",
       "value.converter": "org.apache.kafka.connect.storage.StringConverter",
       "iceberg.control.commit.interval-ms": "10000"
     }
   }
   ```
   
   fail with
   
   ```log
   Caused by: java.lang.IllegalArgumentException: Not a struct type: string
   at org.apache.iceberg.types.Type.asStructType(Type.java:72)
   at 
org.apache.iceberg.connect.data.IcebergWriterFactory.autoCreateTable(IcebergWriterFactory.java:83)
   at 
org.apache.iceberg.connect.data.IcebergWriterFactory.createWriter(IcebergWriterFactory.java:62)
   at 
org.apache.iceberg.connect.data.SinkWriter.lambda$writerForTable$3(SinkWriter.java:139)
   at java.base/java.util.HashMap.computeIfAbsent(Unknown Source)
   at 
org.apache.iceberg.connect.data.SinkWriter.writerForTable(SinkWriter.java:138)
   at 
org.apache.iceberg.connect.data.SinkWriter.lambda$routeRecordStatically$1(SinkWriter.java:98)
   at java.base/java.util.Arrays$ArrayList.forEach(Unknown Source)
   at 
org.apache.iceberg.connect.data.SinkWriter.routeRecordStatically(SinkWriter.java:96)
   at org.apache.iceberg.connect.data.SinkWriter.save(SinkWriter.java:85)
   at java.base/java.util.ArrayList.forEach(Unknown Source)
   at org.apache.iceberg.connect.data.SinkWriter.save(SinkWriter.java:68)
   at org.apache.iceberg.connect.channel.Worker.save(Worker.java:124)
   at 
org.apache.iceberg.connect.channel.CommitterImpl.save(CommitterImpl.java:88)
   at org.apache.iceberg.connect.IcebergSinkTask.put(IcebergSinkTask.java:87)
   at 
org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:605)
   ```
   
   even with a string value contianing a json
   
   
![image](https://github.com/user-attachments/assets/3562a461-d5d7-4418-ad72-ac52bf1b4af4)
   
   
   ### Willingness to contribute
   
   - [ ] I can contribute a fix for this bug independently
   - [ ] I would be willing to contribute a fix for this bug with guidance from 
the Iceberg community
   - [ ] I cannot contribute a fix for this bug at this time


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org