fokoenecke opened a new issue, #13236:
URL: https://github.com/apache/iceberg/issues/13236

   ### Query engine
   
   _No response_
   
   ### Question
   
   Yesterday we updated our kafka connect from using the databricks iceberg 
sink connector plugin to the one from the iceberg repository. This worked fine, 
but there was some confusion. After updating, we suddenly had multiple consumer 
groups, some prefixed with `cg-control` and some with `connect`. The `connect` 
ones were processed, but the `cg-control`s were not.
   
   Both documentations (from [the 
old](https://github.com/databricks/iceberg-kafka-connect?tab=readme-ov-file#apache-iceberg-sink-connector)
 and the [new plugin](url)) state, that the default for the groups should be 
`cg-control`, but after reading some source code, it seems the official iceberg 
one has `connect` hardcoded as a prefix and the configuration parameter 
`iceberg.control.group-id-prefix` is never used.
   
   I don't know if we missed something, but this caused some confusion. Our 
solution was waiting for the old groups to be processed and then deleting them. 
I think it would have been cleaner to "reuse" them.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to