-安装JDK1.8

https://abc.htmltoo.com/thread-46002.htm

-配置SSH免密登录

https://abc.htmltoo.com/thread-46001.htm


-hadoop:  https://mirrors.bfsu.edu.cn/apache/hadoop/common/

cd  /data/site/htmltoo.opt

wget  https://mirrors.bfsu.edu.cn/apache/hadoop/common/hadoop-3.3.6/hadoop-3.3.6.tar.gz

tar -zxvf hadoop-3.3.6.tar.gz  -C /opt/

mv /opt/hadoop-3.3.6 /opt/hadoop


echo 'export HADOOP_HOME=/opt/hadoop/' >> /etc/profile

echo 'export PATH=$PATH:$HADOOP_HOME/bin' >> /etc/profile

echo 'export PATH=$PATH:$HADOOP_HOME/sbin' >> /etc/profile

source /etc/profile   

echo "export JAVA_HOME=/usr/java/default" >> /opt/hadoop/etc/hadoop/yarn-env.sh

echo "export JAVA_HOME=/usr/java/default" >> /opt/hadoop/etc/hadoop/hadoop-env.sh


hadoop version


---配置Hadoop

vim /opt/hadoop/etc/hadoop/core-site.xml

-在<configuration></configuration>节点内,插入如下内容

    <property>
        <name>hadoop.tmp.dir</name>
        <value>file:/opt/hadoop/tmp</value>
        <description>location to store temporary files</description>
    </property>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>

vim /opt/hadoop/etc/hadoop/hdfs-site.xml

-在<configuration></configuration>节点内,插入如下内容

    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
    <property>
        <name>dfs.namenode.name.dir</name>
        <value>file:/opt/hadoop/tmp/dfs/name</value>
    </property>
    <property>
        <name>dfs.datanode.data.dir</name>
        <value>file:/opt/hadoop/tmp/dfs/data</value>
    </property>


---启动Hadoop

-初始化namenode 。

hadoop namenode -format

-启动Hadoop。

start-dfs.sh

-在弹出的提示中,依次输入yes

start-yarn.sh

---可查看成功启动的进程。

jps

11620 DataNode

11493 NameNode

11782 SecondaryNameNode

11942 ResourceManager

12344 Jps

12047 NodeManager


---浏览器访问

http://<ECS公网IP>:8088和http://<ECS公网IP>:50070。

显示如下界面,则表示Hadoop伪分布式环境已搭建完成。


签名:这个人很懒,什么也没有留下!
最新回复 (0)
返回