tarciosaraiva opened a new issue, #13787: URL: https://github.com/apache/iceberg/issues/13787
### Query engine None. ### Question Hi there, I'd like some recommendation on control topic that is used for Iceberg connectors and how to best partition them. Our current setup involves a few Kafka Connect clusters interacting with the same Kafka Cluster. The Iceberg connectors provisioned in those Kafka Connect clusters though are consuming and producing to the same `control-iceberg` topic with one partition. Based on my understanding this `control-iceberg` topic behaves similarly to the Kafka Connect control topics and having multiple connectors using the same control topic could be a direction. However I'm uncertain if it is the best direction here. Having a control topic with a single partition would work well only if a single connector was using it in my opinion. For our scenario above we would either: - Increase the number of partitions for the control topic - Ensure we have a single control topic per connector I'm curious what would the recommendation be for this situation. Thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
