環(huán)境資源準備
-JDK1.8.0
-centos7
-kafka0.11.0.1
安裝JDK
1、解壓JDK文件
tar -zxvf jdk-*.tar
2、修改/etc/profile
JAVA_HOME=/usr/local/bin/java/1.8.0_152
PATH=$JAVA_HOME/bin:$PATH
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JAVA_HOME
export PATH
export CLASSPATH
3、生效profile文件
source /etc/profile
4、查看安裝是否完成
java -version
kafka安裝
1、解壓kafka
tar -zxvf kafka_2.12-0.11.0.1.tgz
2、重命名解壓的文件
mv kafka_2.12-0.11.0.1 kafka-0.11.0.1
3、啟動zookeeper
./zookeeper-server-start.sh -daemon ../config/zookeeper.properties
4、查看zookeeper是否啟動成功
jps -l
5、啟動kafka
./kafka-server-start.sh ../config/server.properties &
6、查看kafka是否啟動成功
jps
單機版本的kafka啟動完成
測試
1、創(chuàng)建一個topic
sh kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic topic1
2、查看topic是否創(chuàng)建成功
sh kafka-topics.sh --list --zookeeper localhost:2181
3、發(fā)送消息
sh kafka-console-producer.sh --broker-list localhost:9092 --topic topic1
abcdefg
4、客戶端接收消息
sh kafka-console-consumer.sh --zookeeper localhost:2181 --topic topic1 --from-beginning
接單機版配置
環(huán)境準備
| 服務器名稱 | IP | myid | brokerid |
|---|---|---|---|
| centos_1 | 192.168.4.36 | 1 | 1 |
| centos_2 | 192.168.4.10 | 2 | 2 |
| centos_3 | 192.168.4.102 | 3 | 3 |
1、修改/etc/hosts文件，在文件末尾添加
192.168.4.36 centos_1
192.168.4.102 centos_2
192.168.4.10 centos_3
2、將修改的文件復制到centos_2,centos_3上
scp /etc/hosts root@centos_2:/etc/hosts
scp /etc/hosts root@centos_3:/etc/hosts
3、關閉防火墻
systemctl stop firewalld.service #停止firewall
systemctl disable firewalld.service #禁止firewall開機啟動
zookeeper配置（已經存在zookeeper環(huán)境的話可以跳過此步驟）
1、修改zookeeper.properties
##myid所在的目錄
dataDir=/usr/local/bin/kafka/kafka_2.12-0.11.0.1/zookeeper
initLimit=5
syncLimit=2
##IP和server.myid中的myid必須對應
server.1=centos_1:2888:3888
server.2=centos_2:2888:3888
server.3=centos_3:2888:3888
2、將修改的文件復制到centos_2,centos_3上
scp /usr/local/bin/kafka/kafka_2.12-0.11.0.1/config/zookeeper.properties root@centos_2:/usr/local/bin/kafka/kafka_2.12-0.11.0.1/config/zookeeper.properties
scp /usr/local/bin/kafka/kafka_2.12-0.11.0.1/config/zookeeper.properties root@centos_3:/usr/local/bin/kafka/kafka_2.12-0.11.0.1/config/zookeeper.properties
3、分別在dataDir目錄下分別創(chuàng)建myid
4、啟動zookeeper
cd 工作目錄
./zookeeper-server-start.sh -daemon ../config/zookeeper.properties
ssh root@centos_2
cd 工作目錄
./zookeeper-server-start.sh -daemon ../config/zookeeper.properties
ssh root@centos_3
cd 工作目錄
./zookeeper-server-start.sh -daemon ../config/zookeeper.properties
修改service.properties
centos_1:
broker.id =1
listeners=PLAINTEXT://centos_1:9092
zookeeper.connect=centos_1:2181,centos_2:2181,centos_3:2181
centos_2:
broker.id =2
listeners=PLAINTEXT://centos_2:9092
zookeeper.connect=centos_1:2181,centos_2:2181,centos_3:2181
centos_3:
broker.id =3
listeners=PLAINTEXT://centos_3:9092
zookeeper.connect=centos_1:2181,centos_2:2181,centos_3:2181
啟動kafka
./kafka-server-start.sh ../config/server.properties &
集群配置完成
