title: Trying to create single node cluster using hadoop
body: <p>Am facing an issue while creating single node cluster where i have a master(172.16.x.xx) and slave (172.16.x.xxx). Currently when i run start-dfs.sh and start-yarn.sh following are shown in while executing jps,</p>
  
  <pre><code>8085 NodeManager
  7943 ResourceManager
  7772 SecondaryNameNode
  8350 Jps
  </code></pre>
  
  <p><a href="https://i.stack.imgur.com/5rob3.png" rel="nofollow noreferrer">As you can see no datanode displayed in hadoop</a></p>
  
  <p>Below are the configurations that i have used:</p>
  
  <p>core-site.xml configuration</p>
  
  <pre><code>&lt;?xml version="1.0" encoding="UTF-8"?&gt;
  &lt;?xml-stylesheet type="text/xsl" href="configuration.xsl"?&gt;
  
  &lt;configuration&gt;
  &lt;property&gt;
          &lt;name&gt;fs.defaultFS&lt;/name&gt;
          &lt;value&gt;hdfs://master-hostname:9000&lt;/value&gt;
      &lt;/property&gt;
  &lt;property&gt;
  &lt;name&gt;hadoop.tmp.dir&lt;/name&gt;
  &lt;value&gt;/tmp/hdata&lt;/value&gt;
  &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>hdfs-site.xml configuration</p>
  
  <pre><code>&lt;?xml version="1.0" encoding="UTF-8"?&gt;
  &lt;?xml-stylesheet type="text/xsl" href="configuration.xsl"?&gt;
  
  &lt;configuration&gt;
  &lt;property&gt;
              &lt;name&gt;dfs.namenode.name.dir&lt;/name&gt;
              &lt;value&gt;/home/vishnu/hadoopdata/data/namenode&lt;/value&gt;
      &lt;/property&gt;
  
      &lt;property&gt;
              &lt;name&gt;dfs.datanode.data.dir&lt;/name&gt;
              &lt;value&gt;/home/vishnu/hadoopdata/data/datanode&lt;/value&gt;
      &lt;/property&gt;
  &lt;property&gt;
          &lt;name&gt;dfs.replication&lt;/name&gt;
          &lt;value&gt;1&lt;/value&gt;
      &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>mapred-site.xml configuration</p>
  
  <pre><code>&lt;configuration&gt;
  &lt;property&gt; 
        &lt;name&gt;mapred.job.tracker&lt;/name&gt; 
        &lt;value&gt;vishnu-Latitude-3480:9001&lt;/value&gt; 
     &lt;/property&gt;
  &lt;property&gt;
              &lt;name&gt;mapreduce.framework.name&lt;/name&gt;
              &lt;value&gt;yarn&lt;/value&gt;
      &lt;/property&gt;
  &lt;property&gt;
          &lt;name&gt;yarn.app.mapreduce.am.resource.mb&lt;/name&gt;
          &lt;value&gt;512&lt;/value&gt;
  &lt;/property&gt;
  
  &lt;property&gt;
          &lt;name&gt;mapreduce.map.memory.mb&lt;/name&gt;
          &lt;value&gt;256&lt;/value&gt;
  &lt;/property&gt;
  
  &lt;property&gt;
          &lt;name&gt;mapreduce.reduce.memory.mb&lt;/name&gt;
          &lt;value&gt;256&lt;/value&gt;
  &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>yarn-site.xml configuration</p>
  
  <pre><code>&lt;configuration&gt;
  
  &lt;!-- Site specific YARN configuration properties --&gt;
  &lt;property&gt;
              &lt;name&gt;yarn.acl.enable&lt;/name&gt;
              &lt;value&gt;0&lt;/value&gt;
      &lt;/property&gt;
      &lt;property&gt;
              &lt;name&gt;yarn.resourcemanager.hostname&lt;/name&gt;
              &lt;value&gt;localhost&lt;/value&gt;
      &lt;/property&gt;
  &lt;property&gt;
          &lt;name&gt;yarn.nodemanager.resource.memory-mb&lt;/name&gt;
          &lt;value&gt;1536&lt;/value&gt;
  &lt;/property&gt;
  
  &lt;property&gt;
          &lt;name&gt;yarn.scheduler.maximum-allocation-mb&lt;/name&gt;
          &lt;value&gt;1536&lt;/value&gt;
  &lt;/property&gt;
  
  &lt;property&gt;
          &lt;name&gt;yarn.scheduler.minimum-allocation-mb&lt;/name&gt;
          &lt;value&gt;128&lt;/value&gt;
  &lt;/property&gt;
  
  &lt;property&gt;
          &lt;name&gt;yarn.nodemanager.vmem-check-enabled&lt;/name&gt;
          &lt;value&gt;false&lt;/value&gt;
  &lt;/property&gt;
      &lt;property&gt;
              &lt;name&gt;yarn.nodemanager.aux-services&lt;/name&gt;
              &lt;value&gt;mapreduce_shuffle&lt;/value&gt;
      &lt;/property&gt;
  &lt;property&gt;
  &lt;name&gt;yarn.nodemanager.aux-services.mapreduce.shuffle.class&lt;/name&gt;
  &lt;value&gt;org.apache.hadoop.mapred.ShuffleHandler&lt;/value&gt;
  &lt;/property&gt;
  &lt;/configuration&gt;
  </code></pre>
  
  <p>I have copied that same package to my client machine. Below is the log generated in master:</p>
  
  <pre><code>2018-09-25 17:39:49,830 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:50,831 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:51,833 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:52,835 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:53,837 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:54,837 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:55,838 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:56,838 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: hostname/IP:9000. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)
  2018-09-25 17:39:56,985 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Block pool BP-1842429760-172.16.5.93-1537874717995 (Datanode Uuid 0eb1e76d-61a9-4280-aec1-ca83b9da5e33) service to hostname/IP:9000 is shutting down
  org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.UnregisteredNodeException): Unregistered server: DatanodeRegistration(IP:50010, datanodeUuid=0eb1e76d-61a9-4280-aec1-ca83b9da5e33, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-57;cid=CID-846ea28f-1eac-4959-994c-c7c721b37f39;nsid=1040776628;c=1537874717995)
      at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.verifyRequest(NameNodeRpcServer.java:1580)
      at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.sendHeartbeat(NameNodeRpcServer.java:1431)
      at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.sendHeartbeat(DatanodeProtocolServerSideTranslatorPB.java:119)
      at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:30585)
      at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:503)
      at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
      at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:871)
      at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:817)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:422)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1889)
      at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2606)
  
      at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1493)
      at org.apache.hadoop.ipc.Client.call(Client.java:1439)
      at org.apache.hadoop.ipc.Client.call(Client.java:1349)
      at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
      at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
      at com.sun.proxy.$Proxy15.sendHeartbeat(Unknown Source)
      at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolClientSideTranslatorPB.sendHeartbeat(DatanodeProtocolClientSideTranslatorPB.java:166)
      at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.sendHeartBeat(BPServiceActor.java:514)
      at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.offerService(BPServiceActor.java:645)
      at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:841)
      at java.lang.Thread.run(Thread.java:748)
  2018-09-25 17:39:56,985 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool BP-1842429760-172.16.5.93-1537874717995 (Datanode Uuid 0eb1e76d-61a9-4280-aec1-ca83b9da5e33) service to vishnu-Latitude-3480/172.16.5.93:9000
  2018-09-25 17:39:57,086 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool BP-1842429760-172.16.5.93-1537874717995 (Datanode Uuid 0eb1e76d-61a9-4280-aec1-ca83b9da5e33)
  2018-09-25 17:39:57,086 INFO org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl: Removing block pool BP-1842429760-172.16.5.93-1537874717995
  2018-09-25 17:39:57,086 WARN org.apache.hadoop.fs.CachingGetSpaceUsed: Thread Interrupted waiting to refresh disk information: sleep interrupted
  2018-09-25 17:39:59,087 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
  2018-09-25 17:39:59,097 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: 
  /************************************************************
  SHUTDOWN_MSG: Shutting down DataNode at Hostname/IP
  ************************************************************/
  </code></pre>