Kafka 问题 WARN [Producer clientId=console-producer] 连接到节点时出错.......java.net.UnknownHostException

问题描述

我正在尝试在 kubernetes 中设置 kafka。一切都开始正常，包括zookeeper和kafka-server，根据他们的日志，但是当我尝试在某个主题上生成消息时，它显示“连接到节点时出错”。任何人都可以查看下面的 yaml 文件和错误并告诉我是什么问题。谢谢。详情如下：

zookeeper/deployment.yaml

apiVersion: apps/v1
kind: Deployment
Metadata:
  name: zookeeper-cluster1
  namespace: default
  labels:
    app: zookeeper-cluster1
spec:
  replicas: 1
  selector:
    matchLabels:
      app: zookeeper-cluster1
  template:
    Metadata:
      labels:
        name: zookeeper-cluster1
        app: zookeeper-cluster1
    spec:
      hostname: zookeeper-cluster1
      containers:
        - name: zookeeper-cluster1
          image: wurstmeister/zookeeper:latest
          imagePullPolicy: IfNotPresent
          ports:
            - containerPort: 2181
            - containerPort: 2888
            - containerPort: 3888

zookeeper/service.yaml

apiVersion: v1
kind: Service
Metadata:
  name: zookeeper-cluster1
  namespace: default
  labels:
    app: zookeeper-cluster1
spec:
  type: NodePort
  selector:
    app: zookeeper-cluster1
  ports:
    - name: zookeeper-cluster1
      protocol: TCP
      port: 2181
      targetPort: 2181
    - name: zookeeper-follower-cluster1
      protocol: TCP
      port: 2888
      targetPort: 2888
    - name: zookeeper-leader-cluster1
      protocol: TCP
      port: 3888
      targetPort: 3888

kafka/deployment.yaml

apiVersion: apps/v1
kind: Deployment
Metadata:
  name: kafka-cluster
  namespace: default
  labels:
    app: kafka-cluster
spec:
  replicas: 1
  selector:
    matchLabels:
      app: kafka-cluster
  template:
    Metadata:
      labels:
        name: kafka-cluster
        app: kafka-cluster
    spec:
      hostname: kafka-cluster
      containers:
        - name: kafka-cluster
          image: wurstmeister/kafka:latest
          imagePullPolicy: IfNotPresent
          env:
            - name: KAFKA_ADVERTISED_LISTENERS
              value: PLAINTEXT://kafka-cluster:9092
            - name: KAFKA_ZOOKEEPER_CONNECT
              value: zookeeper-cluster1:2181
            - name: KAFKA_LISTENERS
              value: PLAINTEXT://0.0.0.0:9092
          ports:
            - containerPort: 9092

kafka/service.yaml

apiVersion: v1
kind: Service
Metadata:
  name: kafka-cluster
  namespace: default
  labels:
    app: kafka-cluster
spec:
  type: NodePort
  selector:
    app: kafka-cluster
  ports:
    - name: kafka-cluster
      protocol: TCP
      port: 9092
      targetPort: 9092

kafkacat 输出

kafkacat -b 172.17.0.2:30511 -L

Metadata for all topics (from broker -1: 172.17.0.2:30511/bootstrap):
 1 brokers:
  broker 1001 at kafka-cluster:9092
 0 topics:

生成消息时出错

    bin/kafka-console-producer.sh --topic admintome-test1 --bootstrap-server 172.17.0.2:30511
    >as
[2021-02-10 15:58:04,696] WARN [Producer clientId=console-producer] Error connecting to node kafka-cluster:9092 (id: 1001 rack: null) (org.apache.kafka.clients.NetworkClient)
java.net.UnkNownHostException: kafka-cluster: Name or service not kNown
    at java.base/java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
    at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:929)
    at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1515)
    at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:848)
    at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1505)
    at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1364)
    at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1298)
    at org.apache.kafka.clients.ClientUtils.resolve(ClientUtils.java:110)
    at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.currentAddress(ClusterConnectionStates.java:403)
    at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.access$200(ClusterConnectionStates.java:363)
    at org.apache.kafka.clients.ClusterConnectionStates.currentAddress(ClusterConnectionStates.java:151)
    at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:958)
    at org.apache.kafka.clients.NetworkClient.access$600(NetworkClient.java:74)
    at org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.maybeUpdate(NetworkClient.java:1131)
    at org.apache.kafka.clients.NetworkClient$DefaultMetadataUpdater.maybeUpdate(NetworkClient.java:1019)
    at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:542)
    at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:325)
    at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240)
    at java.base/java.lang.Thread.run(Thread.java:834)

kafka-server 日志

[2021-02-10 10:50:01,044] INFO [TransactionCoordinator id=1001] Starting up. (kafka.coordinator.transaction.TransactionCoordinator)
[2021-02-10 10:50:01,091] INFO [Transaction Marker Channel Manager 1001]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager)
[2021-02-10 10:50:01,091] INFO [TransactionCoordinator id=1001] Startup complete. (kafka.coordinator.transaction.TransactionCoordinator)
[2021-02-10 10:50:01,312] INFO Updated cache from existing <empty> to latest FinalizedFeaturesAndEpoch(features=Features{},epoch=0). (kafka.server.FinalizedFeatureCache)
[2021-02-10 10:50:01,508] INFO [ExpirationReaper-1001-Alteracls]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2021-02-10 10:50:01,641] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessthread)
[2021-02-10 10:50:01,701] INFO [SocketServer brokerId=1001] Starting socket server acceptors and processors (kafka.network.socketServer)
[2021-02-10 10:50:01,708] INFO [SocketServer brokerId=1001] Started data-plane acceptor and processor(s) for endpoint : ListenerName(PLAINTEXT) (kafka.network.socketServer)
[2021-02-10 10:50:01,708] INFO [SocketServer brokerId=1001] Started socket server acceptors and processors (kafka.network.socketServer)
[2021-02-10 10:50:01,716] INFO Kafka version: 2.7.0 (org.apache.kafka.common.utils.AppInfoParser)
[2021-02-10 10:50:01,716] INFO Kafka commitId: 448719dc99a19793 (org.apache.kafka.common.utils.AppInfoParser)
[2021-02-10 10:50:01,716] INFO Kafka startTimeMs: 1612954201709 (org.apache.kafka.common.utils.AppInfoParser)
[2021-02-10 10:50:01,718] INFO [KafkaServer id=1001] started (kafka.server.KafkaServer)
[2021-02-10 10:50:02,005] INFO [broker-1001-to-controller-send-thread]: Recorded new controller,from Now on will use broker 1001 (kafka.server.brokerToControllerRequestThread)

动物园管理员日志

2021-02-10 10:49:44,841 [myid:] - INFO  [main:ServerCnxnFactory@117] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
2021-02-10 10:49:44,845 [myid:] - INFO  [main:NIOServerCnxnFactory@89] - binding to port 0.0.0.0/0.0.0.0:2181
2021-02-10 10:49:59,583 [myid:] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@215] - Accepted socket connection from /172.18.0.4:60322
2021-02-10 10:49:59,588 [myid:] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:ZooKeeperServer@949] - Client attempting to establish new session at /172.18.0.4:60322
2021-02-10 10:49:59,590 [myid:] - INFO  [SyncThread:0:FileTxnLog@213] - Creating new log file: log.1
2021-02-10 10:49:59,601 [myid:] - INFO  [SyncThread:0:ZooKeeperServer@694] - Established session 0x10007ad45a10000 with negotiated timeout 18000 for client /172.18.0.4:60322
2021-02-10 10:49:59,669 [myid:] - INFO  [Processthread(sid:0 cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when processing sessionid:0x10007ad45a10000 type:create cxid:0x2 zxid:0x3 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for /brokers
2021-02-10 10:49:59,679 [myid:] - INFO  [Processthread(sid:0 cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when processing sessionid:0x10007ad45a10000 type:create cxid:0x6 zxid:0x7 txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for /config
2021-02-10 10:49:59,686 [myid:] - INFO  [Processthread(sid:0 cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when processing sessionid:0x10007ad45a10000 type:create cxid:0x9 zxid:0xa txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = NoNode for /admin
2021-02-10 10:49:59,948 [myid:] - INFO  [Processthread(sid:0 cport:2181)::PrepRequestProcessor@653] - Got user-level KeeperException when processing sessionid:0x10007ad45a10000 type:create cxid:0x17 zxid:0x15 txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode = NoNode for /cluster
2021-02-10 10:50:01,804 [myid:] - INFO  [Processthread(sid:0 cport:2181)::PrepRequestProcessor@596] - Got user-level KeeperException when processing sessionid:0x10007ad45a10000 type:multi cxid:0x3e zxid:0x1e txntype:-1 reqpath:n/a aborting remaining multi ops. Error Path:/admin/preferred_replica_election Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election

解决方法

暂无找到可以解决该程序问题的有效方法，小编努力寻找整理中！

如果你已经找到好的解决方法，欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@）

apache-kafka apache-zookeeper java java kubernetes