zl程序教程

您现在的位置是:首页 >  大数据

当前栏目

Kafka单节点多broker的部署和使用

Kafka节点部署 Broker 使用
2023-09-14 09:14:45 时间
拷贝配置文件三份:
	[hadoop@hadoop000 config]$ cp server.properties server-1.properties
	[hadoop@hadoop000 config]$ cp server.properties server-2.properties
	[hadoop@hadoop000 config]$ cp server.properties server-3.properties

修改每个配置文件:
	[hadoop@hadoop000 config]$ vi server-1.properties 
	[hadoop@hadoop000 config]$ vi server-2.properties 
	[hadoop@hadoop000 config]$ vi server-3.properties 

分别修改broker.id :分别为1 2 3
listeners :分别为 9093 9094 9095
log.dirs :分别为: kafka-logs-1 kafka-logs-2 kafka-logs-3
在这里插入图片描述
在这里插入图片描述

启动:-daemon(以后台的方式启动)

kafka-server-start.sh -daemon $KAFKA_HOME/config/server-1.properties &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server-2.properties &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server-3.properties &
创建三副本topic
kafka-topics.sh --create --zookeeper hadoop000:2181 --replication-factor 3 --partitions 1 --topic my-replication-topic

查看topic的详细信息:Leader:主节点 Isr:活的id

[hadoop@hadoop000 config]$ kafka-topics.sh --describe --zookeeper hadoop000:2181
Topic:hello_topic	PartitionCount:1	ReplicationFactor:1	Configs:
	Topic: hello_topic	Partition: 0	Leader: 0	Replicas: 0	Isr: 0
Topic:my-replication-topic	PartitionCount:1	ReplicationFactor:3	Configs:
	Topic: my-replication-topic	Partition: 0	Leader: 1	Replicas: 1,2,3	Isr: 1,2,3
启动生产者:
kafka-console-producer.sh --broker-list hadoop000:9093,hadoop000:9094,hadoop000:9095 --topic my-replication-topic

启动消费者:
kafka-console-consumer.sh --zookeeper hadoop000:2181 --topic my-replication-topic