【直接從word拷貝出來(lái)的，格式有點(diǎn)混亂，以后我調(diào)整】
一． 環(huán)境準(zhǔn)備（centos 7，以下內(nèi)容酌情考慮，根據(jù)實(shí)際情況配置）
yum install httpd createrepo openssh-clients wget bind-utils -y
rpm -ivh jdk-8u131-linux-x64.rpm
java -version
- 時(shí)鐘同步
sed -i 's/server 0/#server 0/g' /etc/ntp.conf
sed -i 's/server 1/#server 1/g' /etc/ntp.conf
sed -i 's/server 3.centos.pool.ntp.org iburst/server 10.66.76.11 burst iburst/g' /etc/ntp.conf
sed -i 's/server 2.centos.pool.ntp.org iburst/server 10.66.76.12 burst iburst prefer/g' /etc/ntp.conf
echo "logfile /var/log/ntp.log" >>/etc/ntp.conf
systemctl start ntpd
systemctl enable ntpd
- /etc/hosts
cat >> /etc/hosts << EOF
10.66.221.72 v2-test-cdh01
10.66.221.73 v2-test-cdh02
10.66.221.74 v2-test-cdh03
10.66.221.75 v2-test-cdh04
10.66.221.76 v2-test-cdh05
EOF
- /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=v2-hadoop-5
hostnamectl set-hostname v2-cdh0
- iptabels
systemctl stop iptables.service
chkconfig iptables off
systemctl stop firewalld.service
systemctl disable firewalld.service
- 免密登錄
ssh-keygen -t rsa
一路回車(chē)，會(huì)在/root/.ssh目錄下生成id_rsa和id_rsa.pub（公鑰）文件
把公鑰的內(nèi)容復(fù)制到/root/.ssh/authorized_keys這個(gè)文件中，所有想要互訪(fǎng)的機(jī)器公鑰都寫(xiě)入這個(gè)文件即可
- 關(guān)閉HUGEPAGE
echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag
cat >> /etc/rc.local << EOF
echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag
EOF
- 操作系統(tǒng)參數(shù)優(yōu)化
echo "* soft stack 8192" >> /etc/security/limits.conf
echo "* hard stack 8192" >> /etc/security/limits.conf
echo "* soft nofile 65535" >> /etc/security/limits.conf
echo "* hard nofile 65535" >> /etc/security/limits.conf
echo "* soft nproc 65535" >> /etc/security/limits.conf
echo "* hard nproc 65535" >> /etc/security/limits.conf
sysctl -w vm.swappiness=0
echo vm.swappiness = 0 >> /etc/sysctl.conf
二．安裝clouderamanager
所有集群機(jī)器上執(zhí)行
cat >> /etc/yum.repos.d/cloudera-manager.repo << EOF
[cloudera-manager]
name = Cloudera Manager, Version 5.10.1
baseurl = http://10.66.221.72/clouderamanager/
gpgcheck = 0
EOF
創(chuàng)建目錄
mkdir -p /hbase
mkdir -p /data/dfs/dn1
mkdir -p /data/dfs/dn2
mkdir -p /data/dfs/dn3
mkdir -p /data/dfs/nn
mkdir -p /data/dfs/snn
mkdir -p /data/yarn/nm1
mkdir -p /data/yarn/nm2
mkdir -p /data/yarn/nm3
目錄授權(quán)
chown -R hdfs.hadoop /data/dfs
chown -R hdfs.hadoop /data/yarn
在namenode上操作
mkdir /var/www/html/clouderamanager
cd /var/www/html/clouderamanager
復(fù)制文件到當(dāng)前目錄:
CDH-5.10.1-1.cdh5.10.1.p0.10-el7.parcel
CDH-5.10.1-1.cdh5.10.1.p0.10-el7.parcel.sha1
cloudera-manager-agent-5.10.1-1.cm5101.p0.6.el7.x86_64.rpm
cloudera-manager-daemons-5.10.1-1.cm5101.p0.6.el7.x86_64.rpm
cloudera-manager-installer.bin
cloudera-manager-server-5.10.1-1.cm5101.p0.6.el7.x86_64.rpm
cloudera-manager-server-db-2-5.10.1-1.cm5101.p0.6.el7.x86_64.rpm
enterprise-debuginfo-5.10.1-1.cm5101.p0.6.el7.x86_64.rpm
manifest.json
oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
執(zhí)行下面命令
createrepo .
systemctl start httpd.service
cd /var/www/html/clouderamanager/
chmod +x cloudera-manager-installer.bin
./cloudera-manager-installer.bin
一路next ,yes, Ok
安裝完成后打開(kāi)頁(yè)面http://10.66.221.72:7180/
用戶(hù)名：admin
密碼：admin
需要填寫(xiě)的頁(yè)面:
選擇免費(fèi)版
填寫(xiě)集群IP：10.66.221.[72-76]
選擇存儲(chǔ)庫(kù)—》更多選項(xiàng)：刪除所有https://地址，只保留一個(gè)填寫(xiě)http://10.66.0.51/ clouderamanager GPGkey刪除不填
提供ssh登錄憑證：填入root密碼
安裝檢查：需要預(yù)先安裝好jdk1.8
集群設(shè)置—》選擇CDH5服務(wù)：自定義，勾選HBASE\HDFS\HIVE\MAPREDUCE\YARN\ZOOKEEPER
集群設(shè)置—》數(shù)據(jù)庫(kù)設(shè)置：使用自定義數(shù)據(jù)庫(kù)
修改各種目錄點(diǎn)擊安裝
