Kafka 3.0.0集群部署教程

1、集群规划

主机名	ip地址	node.id	process.roles
kafka1	192.168.0.29	1	broker,controller
Kafka2	192.168.0.30	2	broker,controller
Kafka3	192.168.0.31	3	broker,controller

2、将kafka包上传以上节点/app目录下

mkdir /app

3、解压kafka包 所有节点

tar -zxvf kafka_2.13-3.0.0.tgz

4、修改Raft配置文件

cd kafka_2.13-3.0.0 vi config/kraft/server.properties

192.168.0.29机器配置

process.roles=broker,controller node.id=1 controller.quorum.voters=1@192.168.0.29:9093,2@192.168.0.30:9093,3@192.168.0.31:9093 listeners=PLAINTEXT://192.168.0.29:9092,CONTROLLER://192.168.0.29:9093 advertised.listeners=PLAINTEXT://192.168.0.29:9092

192.168.0.30机器配置

process.roles=broker,controller node.id=2 controller.quorum.voters=1@192.168.0.29:9093,2@192.168.0.30:9093,3@192.168.0.31:9093 listeners=PLAINTEXT://192.168.0.30:9092,CONTROLLER://192.168.0.30:9093 advertised.listeners=PLAINTEXT://192.168.0.30:9092

192.168.0.31机器配置

process.roles=broker,controller node.id=3 controller.quorum.voters=1@192.168.0.29:9093,2@192.168.0.30:9093,3@192.168.0.31:9093 listeners=PLAINTEXT://192.168.0.31:9092,CONTROLLER://192.168.0.31:9093 advertised.listeners=PLAINTEXT://192.168.0.31:9092

5、生成一个唯一的集群ID 第一节点

使用bin目录下的kafka-storage.sh工具为你的新集群生成一个唯一的ID

bin/kafka-storage.sh random-uuid

6、格式化存储数据的目录 所有节点

bin/kafka-storage.sh format -t pdw5bp6oSbCxY59UpqR5Ng -c ./config/kraft/server.properties

meta.properties 文件内容

cat /tmp/kraft-combined-logs/meta.properties

7、开放端口  所有节点

sudo firewall-cmd --state sudo firewall-cmd --zone=public --add-port=9092/tcp --permanent sudo firewall-cmd --zone=public --add-port=9093/tcp --permanent sudo firewall-cmd --reload sudo firewall-cmd --zone=public --list-ports

8、启动 所有节点

bin/kafka-server-start.sh ./config/kraft/server.properties