[
https://issues.apache.org/jira/browse/KAFKA-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17226725#comment-17226725
]
Bruno Cadonna commented on KAFKA-10686:
---------------------------------------
Hi [~lkokhreidze], I guess this ticket makes sense. Looking forward to your KIP!
You might want to look into KIP-441 to see how a Kafka Streams client passes
its task lags to the assignor. I can imagine that you want to use a similar
mechanism to pass information about a Kafka Streams client to the assignor.
> Pluggable standby tasks assignor for Kafka Streams
> --------------------------------------------------
>
> Key: KAFKA-10686
> URL: https://issues.apache.org/jira/browse/KAFKA-10686
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: Levani Kokhreidze
> Priority: Major
>
> In production, Kafka Streams instances often run across different clusters
> and availability zones. In order to guarantee high availability of the Kafka
> Streams deployments, users would need more granular control over which on
> instances standby tasks can be created.
> Idea of this ticket is to expose interface for Kafka Streams which can be
> implemented by users to control where standby tasks can be created.
> Kafka Streams can have RackAware assignment as a default implementation that
> will take into account `rack.id` of the application and make sure that
> standby tasks are created on different racks.
> Point of this ticket though is to give more flexibility to users on standby
> task creation, in cases where just rack awareness is not enough.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)