?
部署redis集群環(huán)境
1)配置6臺(tái)redis服務(wù)器
2)準(zhǔn)備環(huán)境
如下修改每臺(tái)配置文件參數(shù)
IP 規(guī)劃
? redis 服務(wù)器 ip 地址及端口規(guī)劃
– redisA 192.168.4.51?? 6351
– redisB 192.168.4.52?? 6352
– redisC 192.168.4.53?? 6353
– redisD 192.168.4.54?? 6354
– redisE 192.168.4.55?? 6355
– redisF 192.168.4.56??6356
#vim /etc/redis/6379.conf
bind IP 地址?? //只寫物理接口 IP 地址
daemonize yes? //守護(hù)進(jìn)程方式運(yùn)行
port xxxx????? //端口號(hào)不要使用默認(rèn)的6379
cluster-enabled yes??? //開(kāi)啟集群
cluster-config-file nodes.conf? //集群的配置文件不要使用默認(rèn)的名稱
cluster-node-timeout 5000??? //請(qǐng)求超時(shí) 5 秒???
3)修改/etc/init.d/redis.6379啟動(dòng)腳本 并啟動(dòng)redis?
[root@host51 ~]# ss -nuplt | grep redis
tcp??? LISTEN???? 0?????128??? 192.168.4.51:6351????????????????? *:*??????????????????users:(("redis-server",pid=27627,fd=6))
tcp??? LISTEN???? 0?????128? ??192.168.4.51:16351???????????????? *:*??????????????????users:(("redis-server",pid=27627,fd=8))
[root@host51 ~]# #####每臺(tái)都會(huì)有兩個(gè)端口 一個(gè)集群時(shí)集群通信
[root@host53 ~]# ls /var/lib/redis/6379/
dump.rdb???????? nodes-6353.conf ##儲(chǔ)存集群信息文件
4)創(chuàng)建集群
[root@host51 src]# pwd
/root/redis-4.0.8/src/redis-trib.rb 創(chuàng)建集群腳本
把ruby腳本拷貝到系統(tǒng)命令路徑下
[root@host51 src]# echo $PATH
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin
[root@host51 src]# cp redis-trib.rb /usr/local/sbin/
[root@host51 src]# ls /usr/local/sbin/redis-trib.rb
/usr/local/sbin/redis-trib.rb
安裝ruby腳本運(yùn)行環(huán)境包
[root@host51 redis-cluster]# yum -y install ruby rubygems
rpm -ivh --nodeps ruby-devel-2.0.0.648-30.el7.x86_64.rpm
--nodeps 忽略依賴關(guān)系安裝
[root@host51 redis-cluster]# ls
redis-3.2.1.gem? ruby-devel-2.0.0.648-30.el7.x86_64.rpm
[root@host51 redis-cluster]# gem install redis-3.2.1.gem
[root@host51 redis-cluster]# redis-trib.rb help
Usage: redis-trib
? create????????? host1:port1 ... hostN:portN
?? ???????????????--replicas
? check?????????? host:port
? info??????????? host:port
? fix???????????? host:port
????????????????? --timeout
? reshard???????? host:port
????????????????? --from
????????????????? --to
????????? ????????--slots
創(chuàng)建:
[root@host51 ~]# redis-trib.rb create --replicas 1 \
> 192.168.4.51:6351 \
> 192.168.4.52:6352 \
> 192.168.4.53:6353 \
> 192.168.4.54:6354 \
> 192.168.4.55:6355 \
> 192.168.4.56:6356
--replicas 1 表示自動(dòng)為每一個(gè)master節(jié)點(diǎn),分配一個(gè)slave 節(jié)點(diǎn)
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.?? ##成功 16384個(gè)hash槽(slots)
[root@host51 ~]#
M: dcdaea3e76b649b9793b4ba25c0480d09e3071b4 192.168.4.51:6351
?? slots:0-5460 (5461 slots) master
M: ddbfc55da0d4e464fa6a9a295db3cc68b8c5491e 192.168.4.52:6352
?? slots:5461-10922 (5462 slots)master
M: be99e13aad8f225410c258eff4713d8e2e334b02 192.168.4.53:6353
?? slots:10923-16383 (5461 slots)master
key/CRC16的值對(duì)16384取余后的值在那個(gè)范圍內(nèi)就存那臺(tái)redis服務(wù)器
查看集群信息
[root@host51 ~]# cat /var/lib/redis/6379/nodes-6351.conf
be99e13aad8f225410c258eff4713d8e2e334b02 192.168.4.53:6353@16353 master - 01530608195025 3 connected 10923-16383
1203e9088538d89286f2e197b1204615d193f842 192.168.4.55:6355@16355 slavedcdaea3e76b649b9793b4ba25c0480d09e3071b4 0 1530608195000 5 connected
dcdaea3e76b649b9793b4ba25c0480d09e3071b4 192.168.4.51:6351@16351myself,master - 0 1530608195000 1 connected 0-5460
78c10670f14c0697c2372c070c41f7b513fb81c2 192.168.4.56:6356@16356 slaveddbfc55da0d4e464fa6a9a295db3cc68b8c5491e 0 1530608196028 6 connected
ddbfc55da0d4e464fa6a9a295db3cc68b8c5491e 192.168.4.52:6352@16352 master - 01530608197033 2 connected 5461-10922
ec6a17092cef51cae2e3db1f3d15e5d95e9a05bb 192.168.4.54:6354@16354 slavebe99e13aad8f225410c258eff4713d8e2e334b02 0 1530608195000 4 connected
vars currentEpoch 6 lastVoteEpoch 0
使用ruby查看集群信息
[root@host52 ~]# redis-cli -h 192.168.4.52 -p 6352
192.168.4.52:6352> cluster nodes
be99e13aad8f225410c258eff4713d8e2e334b02 192.168.4.53:6353@16353 master - 01530609880570 3 connected 10923-16383
1203e9088538d89286f2e197b1204615d193f842 192.168.4.55:6355@16355 slavedcdaea3e76b649b9793b4ba25c0480d09e3071b4 0 1530609881574 5 connected
78c10670f14c0697c2372c070c41f7b513fb81c2 192.168.4.56:6356@16356 slaveddbfc55da0d4e464fa6a9a295db3cc68b8c5491e 0 1530609879566 6 connected
ec6a17092cef51cae2e3db1f3d15e5d95e9a05bb 192.168.4.54:6354@16354 slavebe99e13aad8f225410c258eff4713d8e2e334b02 0 1530609881574 4 connected
dcdaea3e76b649b9793b4ba25c0480d09e3071b4 192.168.4.51:6351@16351 master - 01530609881072 1 connected 0-5460
ddbfc55da0d4e464fa6a9a295db3cc68b8c5491e 192.168.4.52:6352@16352myself,master - 0 1530609881000 2 connected 5461-10922
192.168.4.52:6352> cluster info
cluster_state:ok
cluster_slots_assigned:16384
cluster_slots_ok:16384
cluster_slots_pfail:0
cluster_slots_fail:0
cluster_known_nodes:6
cluster_size:3
cluster_current_epoch:6
cluster_my_epoch:2
cluster_stats_messages_ping_sent:3343
cluster_stats_messages_pong_sent:2988
cluster_stats_messages_meet_sent:4
cluster_stats_messages_sent:6335
cluster_stats_messages_ping_received:2986
cluster_stats_messages_pong_received:3347
cluster_stats_messages_meet_received:2
cluster_stats_messages_received:6335
驗(yàn)證redis集群是否正常:
[root@host53 ~]# ss -nuplt | grep redis
tcp??? LISTEN???? 0?????128??? 192.168.4.53:6353????????????????? *:*??????????????????users:(("redis-server",pid=984,fd=6))
tcp??? LISTEN???? 0?????128??? 192.168.4.53:16353???????????????? *:*?????????????????? users:(("redis-server",pid=984,fd=8))
[root@host53 ~]# redis-cli -h 192.168.4.51 -p 6351
192.168.4.51:6351> cluster info???#查看本機(jī)信息
192.168.4.51:6351> cluster nodes??#查看集群信息
#################################################################
測(cè)試集群
1 在客戶端訪問(wèn)任意一臺(tái)master角色的redis服務(wù)器,查詢數(shù)據(jù)或存儲(chǔ)數(shù)據(jù)
redis-cli -c -h IP地址 -p端口?????????? ##-c是訪問(wèn)集群
[root@host50 ~]# redis-cli -c -h 192.168.4.51 -p 6351
192.168.4.51:6351> keys *
(empty list or set)
192.168.4.51:6351> set name bob
-> Redirected to slot [5798] located at 192.168.4.52:6352
OK??? #####hash槽5798 存在4.52上 去4.52查看
[root@host52 ~]# redis-cli -h 192.168.4.52 -p 6352
192.168.4.52:6352> keys *
1) "name"
192.168.4.52:6352> get name
"bob"
4.56時(shí)52的從庫(kù) 去4.56查看
[root@host56 ~]# redis-cli -h 192.168.4.56 -p 6356
192.168.4.56:6356> keys *
1) "name"
192.168.4.56:6356> get name
(error) MOVED 5798 192.168.4.52:6352#### 56從庫(kù)有,但從庫(kù)默認(rèn)不能查看值,需設(shè)置
192.168.4.52:6352> set age 19
-> Redirected to slot [741] located at 192.168.4.51:6351
192.168.4.52:6352> get age 因?yàn)閍ge存在51上所以52取值報(bào)錯(cuò),去51上get
(error) MOVED 741 192.168.4.51:6351
192.168.4.51:6351> set age 19
OK
192.168.4.51:6351> get age
"19"
管理集群:redis-trib.rb
redis-trib.rb 腳本
? 語(yǔ)法格式
– Redis-trib.rb
選項(xiàng) 參數(shù)
? 選項(xiàng)
– add-node 添加新節(jié)點(diǎn)
– check 對(duì)節(jié)點(diǎn)主機(jī)做檢查
– reshard 對(duì)節(jié)點(diǎn)主機(jī)重新分片
– add-node --slave 添加從節(jié)點(diǎn)主機(jī)###默認(rèn)為主庫(kù) 加--slave是指定為從庫(kù)
– del-node 刪除節(jié)點(diǎn)主機(jī)
當(dāng)前的主庫(kù)掛掉,他對(duì)應(yīng)的從庫(kù)自動(dòng)升級(jí)為主庫(kù)
[root@host51 ~]# redis-trib.rb help
?check?????????? host:port
[root@host51 ~]# redis-trib.rb check 192.168.4.51:6351
主? 從
51? 55
52? 56
53? 54
現(xiàn)在down掉52 結(jié)果時(shí)56升級(jí)為主從庫(kù)只有兩個(gè) 還是54/55 這時(shí)56主庫(kù)沒(méi)從庫(kù),如果56在down掉整個(gè)集群就掛掉了(可以一諸多從,解決)
這是52再起,會(huì)變成56的從庫(kù)
[root@host51 ~]# redis-trib.rb check 192.168.4.53:6353
>>> Performing Cluster Check (using node 192.168.4.53:6353)
M: be99e13aad8f225410c258eff4713d8e2e334b02 192.168.4.53:6353
?? slots:10923-16383 (5461 slots)master
?? 1 additional replica(s)
S: ddbfc55da0d4e464fa6a9a295db3cc68b8c5491e 192.168.4.52:6352
?? slots: (0 slots) slave
?? replicates78c10670f14c0697c2372c070c41f7b513fb81c2#####(56的ip)
M: 78c10670f14c0697c2372c070c41f7b513fb81c2 192.168.4.56:6356
?? slots:5461-10922 (5462 slots)master
?? 1 additional replica(s)
M: dcdaea3e76b649b9793b4ba25c0480d09e3071b4 192.168.4.51:6351
?? slots:0-5460 (5461 slots) master
?? 1 additional replica(s)
S: 1203e9088538d89286f2e197b1204615d193f842 192.168.4.55:6355
?? slots: (0 slots) slave
?? replicatesdcdaea3e76b649b9793b4ba25c0480d09e3071b4
S: ec6a17092cef51cae2e3db1f3d15e5d95e9a05bb 192.168.4.54:6354
?? slots: (0 slots) slave
?? replicatesbe99e13aad8f225410c258eff4713d8e2e334b02
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
添加(準(zhǔn)備50 57兩臺(tái)redis服務(wù)器)
添加master角色主機(jī) 需從新分片
添加slave
將新主機(jī)添加到集群中
– # ./redis-trib.rb add-node 新主機(jī)Ip:端口192.168.4.51:6351
[root@host51 ~]# redis-trib.rb add-node 192.168.4.50:6350 192.168.4.51:6351
手動(dòng)對(duì)集群進(jìn)行重新分片
– src]# ./redis-trib.rb reshard 192.168.4.51:6351
[root@host51 ~]# redis-trib.rb reshard 192.168.4.51:6351
How many slots do you want to move (from 1 to 16384)? 4096
####4臺(tái)主庫(kù),16384/4=4096(從當(dāng)前集群拿出多少個(gè)hash slots)
What is the receiving node ID? 93b0dd6ce08c2f43c805aee6b3ca7d408f418756
新主庫(kù)id,這個(gè)id可以[root@host50
~]# cat /var/lib/redis/6379/nodes-6350.conf 看也可以
[root@host51 ~]# redis-trib.rb check 192.168.4.51:6351查看
Source node #1:all
Do you want to proceed with the proposed reshard plan (yes/no)? yes
再查看4.51
[root@host51 ~]# redis-trib.rb check 192.168.4.51:6351
M: 93b0dd6ce08c2f43c805aee6b3ca7d408f418756 192.168.4.50:6350
?? slots:0-1364,5461-6826,10923-12287(4096 slots) master
?? 0 additional replica(s) ###(4096個(gè)hash槽)
向新主庫(kù)50上添加slave57
[root@host51 ~]# redis-trib.rb help
add-node??????? new_host:new_portexisting_host:existing_port
??????????????? ??--slave
????????????????? --master-id
添加從節(jié)點(diǎn)
# ./redis-trib.rb add-node --slave --master-id node-id 值
[root@host51 ~]# redis-trib.rb add-node --slave --master-idbe99e13aad8f225410c258eff4713d8e2e334b02 192.168.4.58:6358 192.168.4.51:6351
從節(jié)點(diǎn)ip:端口192.168.4.51:6351
如果不指定主節(jié)點(diǎn)的 id 的話,會(huì)把新節(jié)點(diǎn) 隨機(jī)添加為 從節(jié)點(diǎn) 最少的主的從
[root@host51 ~]# redis-trib.rb add-node --slave 192.168.4.57:6357192.168.4.51:6351
[root@host51 ~]# redis-trib.rb check 192.168.4.51:6351##查看集群信息 查看57是否加入成功
移除slave節(jié)點(diǎn)
[root@host51 ~]# redis-trib.rb del-node 192.168.4.58:6358e928fc152ab568f9a0befc9775b9eb81a1c6ea99
移除master節(jié)點(diǎn)
1)先移出hash sloat
[root@host51 ~]# redis-trib.rb reshard 192.168.4.51:6351
How many slots do you want to move (from 1 to 16384)?4096
有多少hash sloat要移出
What is the receiving node ID?78c10670f14c0697c2372c070c41f7b513fb81c2
誰(shuí)接收移出的hash sloat
Source node #1:93b0dd6ce08c2f43c805aee6b3ca7d408f418756
誰(shuí)移出hash sloat
Source node #2:done? 手動(dòng)輸入done
2)移出
[root@host51 ~]# redis-trib.rb del-node 192.168.4.51:6351 93b0dd6ce08c2f43c805aee6b3ca7d408f418756
移出slave或則master后清空rm
-rf /var/lib/redis/6379/*或者在redis登陸界面輸入
cluster reset 把恢復(fù)成單獨(dú)的redis服務(wù)器
#######################################################
?R?*u?v