hadoop配置和启动详细步骤

1.配置jdk1.1.Alt+p调出sftp窗口1.2.上传说明：如果是上传的文件夹必须是–rput-r“path/filename”1.3.解压缩1.4.配置环境变量vi/etc/profile让这个文件修改后生效source/etc/profile1.5.查看jdk版本2.配置ssh免密登录2.1.1.生成公钥和私钥2.1.2.复制公钥把公钥复制给需要免密登陆的机器1把hadoop的hadoop2.6.4.tar.gz文件上传到一台linux系统（主节点）3.创建一个安装目录mkdir/root/apps4.把hadoop-2.6.4解压到这个apps目录tar–zxvfhadoop-2.6.4.tar.gz/root/apps5.配置hadoop的环境变量vi/etc/profile让prifile文件生效source/etc/profile6.进入hadoop的配置文件目录7.需要配置五个配置文件7.1.core-site.xmlconfigurationpropertynamefs.defaultFS/namevaluehdfs://linux9:9000/value/propertypropertynamehadoop.tmp.dir/namevalue/root/apps/hadoopdata/value/property/configuration7.2.hadoop-env.sh/root/installers/jdk1.8.0_1017.3.mapred-site.xmlconfigurationpropertynamemapreduce.framework.name/namevalueyarn/value/property/configuration7.4.yarn-site.xmlconfigurationpropertynameyarn.resourcemanager.hostname/namevaluelinux9/value/propertypropertynameyarn.nodemanager.aux-services/namevaluemapreduce_shuffle/value/property/configuration7.5.slaves只配置从节点8.把配置好的hadoop文件分发到所有的从节点9.关闭所有集群的防火墙serviceiptablesstop10.设置并且同步系统时间11.格式化这个hdfs在主节点上hadoopnamenode–format12.启动hdfs的服务启动hdfs集群：start-dfs.shjps查看进程主节点上会看到从节点可以看到start-all.shhadoop-daemon.shstartnamenodestart-dfs.sh在浏览器上输入启动yarn服务启动yarn（需要先执行过./sbin/start-dfs.sh）./sbin/start-yarn.sh#启动YARN./sbin/mr-jobhistory-daemon.shstarthistoryserver主节点进程从节点进程Yan可用户端hosts:808814.Hadoop各种启动和停止脚本1.启动hdfs集群（使用hadoop的批量启动脚本）/root/apps/hadoop/sbin/start-dfs.sh2.停止hdfs集群（使用hadoop的批量启动脚本）/root/apps/hadoop/sbin/stop-dfs.sh3.启动单个进程[root@hadoop01~]#/root/apps/hadoop/sbin/hadoop-daemon.shstartnamenode[root@hadoop01~]#/root/apps/hadoop/sbin/hadoop-daemon.shstartdatanode4.停止单个进程[root@hadoop01~]#/root/apps/hadoop/sbin/hadoop-daemon.shstopdatanodestoppingdatanode[root@hadoop01~]#/root/apps/hadoop/sbin/hadoop-daemon.shstopnamenode5．启动yarn集群（使用hadoop的批量启动脚本）/root/apps/hadoop/sbin/start-yarn.sh[root@hadoop01~]#/root/apps/hadoop/sbin/start-yarn.sh6.启动hadoop上的ResourceManager进程/root/apps/hadoop/sbin/yarn-daemon.shstartresourcemanager7.停止yarn/root/apps/hadoop/sbin/stop-yarn.sh[root@hadoop01~]#/root/apps/hadoop/sbin/stop-yarn.sh6.停止hadoop上的resourcemanager/root/apps/hadoop/sbin/yarn-daemon.shstopresourcemanager