Question

以下操作全在 master 上进行

格式化 hdfs 文件系统

hdfs namenode -format

启动 hdfs 和 yarn

start-dfs.sh  //启动 hdfs
start-yarn.sh  //启动 yarn
jps  //查看启动进程

浏览器查看 hdfs： http://192.168.17.10:50070 ，yarn： http://192.168.17.10:8088

注意：master 下只能看到 NameNode、SecondaryNameNode(未配置但依然会启动，配置的话还需要一台虚拟机)、ResourceManager；slave 下有 Datanode、NodeManager

# master 上
[hadoop@master hadoop-2.6.0-cdh5.12.1]$ jps
3809 ResourceManager
3491 NameNode
3668 SecondaryNameNode
4072 Jps

# slave 上
[hadoop@slave2 ~]$ jps
2102 NodeManager
2232 Jps
1998 DataNode

Master 节点无法启动 ResourceManager 解决

进入日志文件查看信息

cd /home/hadoop/hadoop-2.6.0-cdh5.12.1/logs/
tail -100f yarn-hadoop-resourcemanager-master.log

报错信息如下：

Caused by: java.net.BindException: Problem binding to [master::8031] java.net.BindException: 无法指定被请求的地址; For more details see:  http://wiki.apache.org/hadoop/BindException
​	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
​	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
​	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
​	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
​	at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)
​	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:720)
​	at org.apache.hadoop.ipc.Server.bind(Server.java:482)
​	at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:688)
​	at org.apache.hadoop.ipc.Server.<init>(Server.java:2376)
​	at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:1042)
​	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:535)
​	at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
​	at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:887)
​	at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.createServer(RpcServerFactoryPBImpl.java:169)
​	at org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl.getServer(RpcServerFactoryPBImpl.java:132)
​	... 17 more
Caused by: java.net.BindException: 无法指定被请求的地址
​	at sun.nio.ch.Net.bind0(Native Method)
​	at sun.nio.ch.Net.bind(Net.java:433)
​	at sun.nio.ch.Net.bind(Net.java:425)
​	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
​	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
​	at org.apache.hadoop.ipc.Server.bind(Server.java:465)
​	... 25 more
2019-01-23 17:26:56,226 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG: 
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at master/192.168.17.10
************************************************************/

从日志可以看出是 ip 地址绑定出了问题 Caused by: java.net.BindException: Problem binding to [master::8031] java.net.BindException: 无法指定被请求的地址 ，我这里多写了个冒号

重新编辑下 yarn-site.xml，修改如下

<property>
​        <name>yarn.resourcemanager.resource-tracker.address</name>
​        <value>master:8031</value>
</property>

我上文的配置是修改后的，没有错