安裝Hadoop
1.先用ssh工具上傳Hadoop壓縮包
Hadoop壓縮包.png
2.解壓Hadoop壓縮包輸入指令
tar -zxvf hadoop-2.4.1.tar.gz
3.確認防火墻是否關(guān)閉，如果沒關(guān)閉就關(guān)閉。操作如下指令可關(guān)閉防火墻(輸入service iptables stop即可)
1 iptables防火墻狀態(tài)： service iptables status
2 開啟防火墻： service iptables start
關(guān)閉防火墻： service iptables stop
service iptables stop #臨時關(guān)閉，重啟無效
chkconfig iptables off #永久關(guān)閉，重啟生效
- [root@localhost soft]# mv hadoop-2.4.1 hadoop 改名（講解壓后的文件改名為Hadoop）
5.配置靜態(tài)ip地址
[root@master Desktop]# vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=master
重啟虛擬機
[root@master Desktop]# vi /etc/hosts
192.168.232.128 master (本機ip地址，可以通過ifconfig查詢)
[hadoop@master Desktop]$ ping 192.168.164.129
[hadoop@master Desktop]$ ping master
要都能平通
[root@master soft]# cd hadoop
[root@master hadoop]# mkdir tmp
[root@master hadoop]# mkdir hdfs
[root@master hadoop]# mkdir hdfs/data
[root@master hadoop]# mkdir hdfs/name
按下面的指令執(zhí)行
一、配置無密鑰ssh
[hadoop@master-hadoop ~]$ ssh-keygen -t rsa #一直回車生成密鑰
[root@master ~]# cd /root/.ssh
[root@master .ssh]# cat id_rsa.pub >> authorized_keys
二、配置hadoop
1、配置hadoop /etc/profile
[qq@master Desktop]$ su root
Password:
[root@master Desktop]# cd
[root@master ~]# vi /etc/profile
#set java environment
JAVA_HOME=/soft/jdk1.7.0_79
HADOOP_HOME=/soft/hadoop
export PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/etc/sbin:$PATH
[root@master ~]# source /etc/profile
[root@master ~]#
2、(1)配置hadoop hadoop-env.sh
[root@master ~]# cd /soft
[root@master soft]# cd hadoop
[root@master hadoop]# cd etc
[root@master etc]# cd hadoop
[root@master hadoop]# vi hadoop-env.sh
export JAVA_HOME=/soft/jdk1.7.0_79
export HADOOP_CONF_DIR=/soft/hadoop/etc/hadoop/
[root@master hadoop]# source hadoop-env.sh
(2)設(shè)置環(huán)境變量jdk
1 vi ~/.bash_profile
//有以下2行
export JAVA_HOME=/soft/jdk1.7.0_79
export PATH=$JAVA_HOME/bin:$PATH
2 source ~/.bash_profile //立即生效
3、配置hadoop自身文件
（注意配置時，1、xml前面不要出現(xiàn)空格
2、<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> 前面如果有，就刪掉粘貼后的）
[root@master hadoop]# vi core-site.xml
(1) core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
(2) mapred-site.xml
[root@master hadoop]# vi mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9001</value>
</property>
</configuration>
(3) hdfs-site.xml
[root@master hadoop]# vi hdfs-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>dfs.name.dir</name>
<value>/soft/hadoop/hdfs/name</value>
<description>namenode上存儲hdfs名字空間元數(shù)據(jù) </description>
</property>
<property>
<name>dfs.data.dir</name>
<value>/soft/hadoop/hdfs/data</value>
<description>datanode上數(shù)據(jù)塊的物理存儲位置</description>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
<description>副本個數(shù)，配置默認是3,應小于datanode機器數(shù)量</description>
</property>
</configuration>
(4)vi yarn-site.xml
<?xml version="1.0"?>
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address</name>
<value>${yarn.resourcemanager.hostname}:8088</value>
</property>
</configuration>
4 格式化新的分布式文件系統(tǒng)（hdfs namenode -format 或 hadoop namenode -format）
[root@master hadoop]# cd
[root@master ~]# cd /soft/hadoop/sbin
[root@master sbin]# hadoop namenode -format
.....
16/11/06 18:43:18 INFO common.Storage: Storage directory /tmp/hadoop-root/dfs/name has been successfully formatted.
16/11/06 18:43:19 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
16/11/06 18:43:19 INFO util.ExitUtil: Exiting with status 0
16/11/06 18:43:19 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at master/192.168.232.128
************************************************************/
5 啟動線程start-all.sh
[root@master sbin]# ./start-all.sh
6 測試安裝hadoop成功
[root@master sbin]# jps
5395 DataNode
6926 NodeManager
6837 ResourceManager
7045 Jps
5289 NameNode
5624 SecondaryNameNode
7.打開瀏覽器輸入
地址輸入.png
master主機名輸入.png
localhost輸入.png
這樣就成功安裝好hadhoop了
