[
https://issues.apache.org/jira/browse/KAFKA-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17823303#comment-17823303
]
Greg Harris commented on KAFKA-10582:
-------------------------------------
Hi [~frankgrimes97] Thanks for finding this ticket.
I think this one is actually caused by
https://issues.apache.org/jira/browse/KAFKA-10586 because it involves the topic
being created after MM2 is running, rather than an existing topic being added
to the dedicated config.
So upgrading to a version with KAFKA-15732 patched but without
_dedicated.mode.enable.internal.rest=true_ would still exhibit this problem.
> Mirror Maker 2 not replicating new topics until restart
> -------------------------------------------------------
>
> Key: KAFKA-10582
> URL: https://issues.apache.org/jira/browse/KAFKA-10582
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 2.5.1
> Environment: RHEL 7 Linux.
> Reporter: Robert Martin
> Priority: Minor
>
> We are using Mirror Maker 2 from the 2.5.1 release for replication on some
> clusters. Replication is working as expected for existing topics. When we
> create a new topic, however, Mirror Maker 2 creates the replicated topic as
> expected but never starts replicating it. If we restart Mirror Maker 2
> within 2-3 minutes the topic starts replicating as expected. From
> documentation we haveve seen it appears this should start replicating without
> a restart based on the settings we have.
> *Example:*
> Create topic "mytesttopic" on source cluster
> MirrorMaker 2 creates "source.mytesttopioc" on target cluster with no issue
> MirrorMaker 2 does not replicate "mytesttopic" -> "source.mytesttopic"
> Restart MirrorMaker 2 and now replication works for "mytesttopic" ->
> "source.mytesttopic"
> *Example config:*
> name = source->target
> group.id = source-to-target
> clusters = source, target
> source.bootstrap.servers = sourcehosts:9092
> target.bootstrap.servers = targethosts:9092
> source->target.enabled = true
> source->target.topics = .*
> target->source = false
> target->source.topics = .*
> replication.factor=3
> checkpoints.topic.replication.factor=3
> heartbeats.topic.replication.factor=3
> offset-syncs.topic.replication.factor=3
> offset.storage.replication.factor=3
> status.storage.replication.factor=3
> config.storage.replication.factor=3
> tasks.max = 16
> refresh.topics.enabled = true
> sync.topic.configs.enabled = true
> refresh.topics.interval.seconds = 300
> refresh.groups.interval.seconds = 300
> readahead.queue.capacity = 100
> emit.checkpoints.enabled = true
> emit.checkpoints.interval.seconds = 5
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
