kafka启动报错"A broker is already registered on the path /brokers/ids/1"解决方案

问题

kafka挂掉后,启动报错日志如下

[2020-03-19 17:50:58,123] FATAL Fatal error during KafkaServerStartable startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
java.lang.RuntimeException: A broker is already registered on the path /brokers/ids/1. This probably indicates that you either have configured a brokerid that is already in use,or else you have shutdown this broker and restarted it faster than the zookeeper timeout so it appears to be re-registering.
        at kafka.utils.ZkUtils.registerBrokerInZk(ZkUtils.scala:408)
        at kafka.utils.ZkUtils.registerBrokerInZk(ZkUtils.scala:394)
        at kafka.server.KafkaHealthcheck.register(KafkaHealthcheck.scala:71)
        at kafka.server.KafkaHealthcheck.startup(KafkaHealthcheck.scala:51)
        at kafka.server.KafkaServer.startup(KafkaServer.scala:269)
        at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:39)
        at kafka.Kafka$.main(Kafka.scala:67)
        at kafka.Kafka.main(Kafka.scala)
[2020-03-19 17:50:58,123] INFO [Kafka Server 1],shutting down (kafka.server.KafkaServer)

分析

This probably indicates that you either have configured a brokerid that is already in use提示可知,zookeeper中可能已经注册了此broker id,正常情况下,你应该不会启动两个相同broker id的kafka server(除非你没注意弄错了使得两个kafka server用了相同的broker id)

于是我用$KAFKA安装包下带有的zookeeper client 连接了zk server,看一下kafka broker的注册情况

$KAFKA/bin/zookeeper-shell.sh 192.168.0.1:2181 ls /brokers/ids

执行后显示

Connecting to 192.168.0.1:2181

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[1,2,3]

然而实际情况是,broker id为1的kafka server并没有启动起来。原因是这台机器之前因为卡死被物理重启,kafka broker没有正常下线,zk上还保留着它的broker id。

解决方案

找到原因后,解决就很简单了,把注册在zookeeper上的这个broker id delete掉就行了

$KAFKA/bin/zookeeper-shell.sh 192.168.0.1:2181 delete  /brokers/ids/1

然后再启动观察日志就正常了。

相关文章

文章浏览阅读4.1k次。kafka认证_kafka认证
文章浏览阅读4.8k次,点赞4次,收藏11次。kafka常用参数_kaf...
文章浏览阅读1.4k次,点赞25次,收藏10次。Kafka 生产者发送...
文章浏览阅读854次,点赞22次,收藏24次。点对点模型:适用于...
文章浏览阅读1.5k次,点赞2次,收藏3次。kafka 自动配置在Ka...
文章浏览阅读1.3w次,点赞6次,收藏33次。Offset Explorer(...