kafka安装
1.下载地址:
kafka下载地址
zookeeper下载地址(前文有安装教程)
2.解压:
tar -xvf kafka_2.11-0.11.0.0.tgz
3.修改配置文件
cd /home/software/kafka_2.11-0.11.0.0/config
vim server.properties
broker.id=1
log.dirs=/home/software/kafka_2.11-0.11.0.0/kafka-log
zookeeper.connect=hadoop01:2181,hadoop02:2181,hadoop03:2181
4.启动zookeeper
cd /home/software/zookeeper-3.6.3/bin
sh zkServer.sh start
sh zkServer.sh status
5.启动kafka
cd /home/software/kafka_2.11-0.11.0.0/bin
sh kafka-server-start.sh …/config/server.properties
kafka使用
1.创建一个主题
另起一个窗口
cd /home/software/zookeeper-3.6.3/bin
sh kafka-topics.sh --create --zookeeper hadoop01:2181/kafka --replication-factor 1 --partitions 1 --topic enbook
2.查看kafka主题
sh kafka-topics.sh --list --zookeeper hadoop01:2181
3.在enbook主题上启动一个生产
sh kafka-console-producer.sh --broker-list hadoop01:9092, hadoop02:9092, hadoop03:9092 --topic enbook
下图生产数据了两行数据
4.在enbook主题上启动一个消费者
另起一个窗口
cd /home/software/zookeeper-3.6.3/bin
sh kafka-console-consumer.sh --zookeeper hadoop01:2181 --topic enbook --from-beginning
下图消费了刚刚生产的数据