[
https://issues.apache.org/jira/browse/KAFKA-17784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
George Yang updated KAFKA-17784:
--------------------------------
Description:
When I use k8s deployment with mirrormaker v3.7.1, and deploy one kafka node in
each data center, I always got the crashloopbackoff error, please see the
attachment.
The configuration of mirrormaker is:
```configuration
clusters = idca, idcb
idca.bootstrap.servers = 192.168.2.146:13399
idcb.bootstrap.servers = 192.168.2.147:13399
idca->idcb.enabled = true
idca->idcb.topics = .*
idcb->idca.enabled = true
idcb->idca.topics = .*
replication.factor=1
tasks.max=6
emit.checkpoints.interval.seconds=5
idca.producer.acks=all
idca.producer.batch.size=50000
idca.consumer.auto.offset.reset=latest
idcb.consumer.auto.offset.reset=latest
idca.consumer.max.poll.interval.ms=20000
idcb.consumer.max.poll.interval.ms=20000
refresh.topics.enabled=true
refresh.topics.interval.seconds=5
refresh.groups.enabled=true
refresh.groups.interval.seconds=5
dedicated.mode.enable.internal.rest = true
idca.scheduled.rebalance.max.delay.ms=20000
idcb.scheduled.rebalance.max.delay.ms=20000
checkpoints.topic.replication.factor=3
heartbeats.topic.replication.factor=3
offset-syncs.topic.replication.factor=3
offset.storage.replication.factor=3
status.storage.replication.factor=3
```
was:
When I use k8s deployment with mirrormaker v3.7.1, and deploy one kafka node in
each data center, I always got the crashloopbackoff error, please see the
attachment.
The configuration of mirrormaker is:
```configuration
# specify any number of cluster aliases
clusters = idca, idcb
# connection information for each cluster
# This is a comma separated host:port pairs for each cluster
# for e.g. "A_host1:9092, A_host2:9092, A_host3:9092"
idca.bootstrap.servers = 192.168.2.146:13399
idcb.bootstrap.servers = 192.168.2.147:13399
# enable and configure individual replication flows
idca->idcb.enabled = true
# regex which defines which topics gets replicated.
idca->idcb.topics = .*
idcb->idca.enabled = true
idcb->idca.topics = .*
# Setting replication factor of newly created remote topics
replication.factor=1
tasks.max=6
emit.checkpoints.interval.seconds=5
idca.producer.acks=all
idca.producer.batch.size=50000
#idcb.producer.enable.idempotence=true
idca.consumer.auto.offset.reset=latest
idcb.consumer.auto.offset.reset=latest
idca.consumer.max.poll.interval.ms=20000
idcb.consumer.max.poll.interval.ms=20000
refresh.topics.enabled=true
refresh.topics.interval.seconds=5
refresh.groups.enabled=true
refresh.groups.interval.seconds=5
dedicated.mode.enable.internal.rest = true
idca.scheduled.rebalance.max.delay.ms=20000
idcb.scheduled.rebalance.max.delay.ms=20000
############################# Internal Topic Settings
#############################
# The replication factor for mm2 internal topics "heartbeats",
"idcb.checkpoints.internal" and
# "mm2-offset-syncs.idcb.internal"
# For anything other than development testing, a value greater than 1 is
recommended to ensure availability such as 3.
checkpoints.topic.replication.factor=3
heartbeats.topic.replication.factor=3
offset-syncs.topic.replication.factor=3
# The replication factor for connect internal topics
"mm2-configs.idcb.internal", "mm2-offsets.idcb.internal" and
# "mm2-status.idcb.internal"
# For anything other than development testing, a value greater than 1 is
recommended to ensure availability such as 3.
offset.storage.replication.factor=3
status.storage.replication.factor=3
```
> Mirror Maker2 Pod CrashLoopbackOff
> ----------------------------------
>
> Key: KAFKA-17784
> URL: https://issues.apache.org/jira/browse/KAFKA-17784
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 3.7.1
> Reporter: George Yang
> Priority: Blocker
> Attachments: connect-1.log
>
>
> When I use k8s deployment with mirrormaker v3.7.1, and deploy one kafka node
> in each data center, I always got the crashloopbackoff error, please see the
> attachment.
>
> The configuration of mirrormaker is:
> ```configuration
> clusters = idca, idcb
> idca.bootstrap.servers = 192.168.2.146:13399
> idcb.bootstrap.servers = 192.168.2.147:13399
> idca->idcb.enabled = true
> idca->idcb.topics = .*
> idcb->idca.enabled = true
> idcb->idca.topics = .*
> replication.factor=1
> tasks.max=6
> emit.checkpoints.interval.seconds=5
> idca.producer.acks=all
> idca.producer.batch.size=50000
> idca.consumer.auto.offset.reset=latest
> idcb.consumer.auto.offset.reset=latest
> idca.consumer.max.poll.interval.ms=20000
> idcb.consumer.max.poll.interval.ms=20000
> refresh.topics.enabled=true
> refresh.topics.interval.seconds=5
> refresh.groups.enabled=true
> refresh.groups.interval.seconds=5
> dedicated.mode.enable.internal.rest = true
> idca.scheduled.rebalance.max.delay.ms=20000
> idcb.scheduled.rebalance.max.delay.ms=20000
> checkpoints.topic.replication.factor=3
> heartbeats.topic.replication.factor=3
> offset-syncs.topic.replication.factor=3
> offset.storage.replication.factor=3
> status.storage.replication.factor=3
> ```
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
