一、解壓kafka包與配置home環(huán)境
二、server.properties??
1)broker.id=102?
2)刪除topic功能開啟:?delete.topic.enable=true
3)kafka運(yùn)行日志存放路徑:?log.dirs=/opt/module/kafka/logs?
4)配置連接zookeeper集群地址zookeeper.connect=hadoop102:2181,hadoop103:2181,hadoop104:2181/kafka
三、啟動(dòng)?
1)kafka-server-start.sh -daemon $KAFKA_HOME/config/server.properties?
2)kafka-server-stop.sh?
五、命令操作?
1)bin/kafka-topics.sh --bootstrap-server hadoop102:2181 --list?
2)bin/kafka-topics.sh --bootstrap-server hadoop102:2181 --create --topic demo --partitions 2 --replication-factor 2?
3) bin/kafka-topics.sh --bootstrap-server hadoop102:2181 --describe --topic demo?
4)生成者:?kafka-console-producer.sh --bootstrap-server hadoop102:9092 --topic bigdata?
5)消費(fèi)者:kafka-console-consumer.sh --bootstrap-server hadoop102:9092 --topic bigdata
壓力測(cè)試:?
bin/kafka-producer-perf-test.sh --topic test --record-size 100 --num-records 10000 --throughput -1 --producer-props bootstrap.servers=hadoop102:9092,hadoop103:9092,hadoop104:9092
六、依賴引入??
<groupId>org.apache.kafka</groupId>
<artifactId>kafka-clients</artifactId>
<version>2.6.0</version>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-databind</artifactId>
<version>2.7.8</version>
