Hadoop 在 Centos7 下的单机布署(二).HDFS.Pseudo-Distributed Operation\nApache Hadoop 技术栈或者说技术生态圈绝对是一个不容忽视的中坚力量\n前面根据官方的文档给出最新版 Hadoop 在 Centos7 下的单机布署方案，详细可以参考 Hadoop 在 Centos7 下的单机布署(一). Standalone Operation\n这里基于前面的操作，给出最新版 Hadoop 在 Centos7 下 HDFS 的伪分布模式(单机)的布署方案\n此文章借鉴了 Hadoop Wiki 中的部分内容和 Running Hadoop on Ubuntu Linux (Single-Node Cluster) 中的部分操作\n启动 NameNode 与 DataNode 守护进程\nweb 访问 NameNode\n测试 hdfs 的读写\n停止 NameNode 与 DataNode 守护进程\n参考 Hadoop 在 Centos7 下的单机布署(一). Standalone Operation 中的操作构建出脱机版的 Hadoop\n我们在本地尝试执行一个 wordcount 的脱机任务\n[hadoop@much hadoop-2.8.1]$ rm -rf output/\n21centry  etc      input  libexec      NOTICE.txt  sbin\nbin       include  lib    LICENSE.txt  README.txt  share\n[hadoop@much hadoop-2.8.1]$ cat 21centry\n[hadoop@much hadoop-2.8.1]$ bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar    wordcount  ./21centry   ./test_output\n17/08/07 12:05:22 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id\n17/08/07 12:05:22 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=\n17/08/07 12:05:28 INFO input.FileInputFormat: Total input files to process : 1\n17/08/07 12:05:28 INFO mapreduce.JobSubmitter: number of splits:1\n17/08/07 12:05:28 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local279813974_0001\n17/08/07 12:05:28 INFO mapreduce.Job: The url to track the job: http://localhost:8080/\n17/08/07 12:05:28 INFO mapreduce.Job: Running job: job_local279813974_0001\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: OutputCommitter set in config null\n17/08/07 12:05:28 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1\n17/08/07 12:05:28 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: Waiting for map tasks\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: Starting task: attempt_local279813974_0001_m_000000_0\n17/08/07 12:05:28 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]\n17/08/07 12:05:28 INFO mapred.MapTask: Processing split: file:/home/hadoop/hadoop-2.8.1/21centry:0+2637\n17/08/07 12:05:28 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)\n17/08/07 12:05:28 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100\n17/08/07 12:05:28 INFO mapred.MapTask: soft limit at 83886080\n17/08/07 12:05:28 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600\n17/08/07 12:05:28 INFO mapred.MapTask: kvstart = 26214396; length = 6553600\n17/08/07 12:05:28 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer\n17/08/07 12:05:28 INFO mapred.LocalJobRunner:\n17/08/07 12:05:28 INFO mapred.MapTask: Starting flush of map output\n17/08/07 12:05:28 INFO mapred.MapTask: Spilling map output\n17/08/07 12:05:28 INFO mapred.MapTask: bufstart = 0; bufend = 4577; bufvoid = 104857600\n17/08/07 12:05:28 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26212452(104849808); length = 1945/6553600\n17/08/07 12:05:28 INFO mapred.MapTask: Finished spill 0\n17/08/07 12:05:28 INFO mapred.Task: Task:attempt_local279813974_0001_m_000000_0 is done. And is in the process of committing\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: map\n17/08/07 12:05:28 INFO mapred.Task: Task 'attempt_local279813974_0001_m_000000_0' done.\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: Finishing task: attempt_local279813974_0001_m_000000_0\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: map task executor complete.\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: Waiting for reduce tasks\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: Starting task: attempt_local279813974_0001_r_000000_0\n17/08/07 12:05:28 INFO mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@76f76d2b\n17/08/07 12:05:28 INFO reduce.MergeManagerImpl: MergerManager: memoryLimit=334338464, maxSingleShuffleLimit=83584616, mergeThreshold=220663392, ioSortFactor=10, memToMemMergeOutputsThreshold=10\n17/08/07 12:05:28 INFO reduce.EventFetcher: attempt_local279813974_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events\n17/08/07 12:05:28 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local279813974_0001_m_000000_0 decomp: 3374 len: 3378 to MEMORY\n17/08/07 12:05:28 INFO reduce.InMemoryMapOutput: Read 3374 bytes from map-output for attempt_local279813974_0001_m_000000_0\n17/08/07 12:05:28 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3374, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->3374\n17/08/07 12:05:28 INFO reduce.EventFetcher: EventFetcher is interrupted.. Returning\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: 1 / 1 copied.\n17/08/07 12:05:28 INFO reduce.MergeManagerImpl: finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs\n17/08/07 12:05:28 INFO mapred.Merger: Merging 1 sorted segments\n17/08/07 12:05:28 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 3370 bytes\n17/08/07 12:05:28 INFO reduce.MergeManagerImpl: Merged 1 segments, 3374 bytes to disk to satisfy reduce memory limit\n17/08/07 12:05:28 INFO reduce.MergeManagerImpl: Merging 1 files, 3378 bytes from disk\n17/08/07 12:05:28 INFO reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce\n17/08/07 12:05:28 INFO Configuration.deprecation: mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords\n17/08/07 12:05:28 INFO mapred.Task: Task:attempt_local279813974_0001_r_000000_0 is done. And is in the process of committing\n17/08/07 12:05:28 INFO mapred.Task: Task attempt_local279813974_0001_r_000000_0 is allowed to commit now\n17/08/07 12:05:28 INFO output.FileOutputCommitter: Saved output of task 'attempt_local279813974_0001_r_000000_0' to file:/home/hadoop/hadoop-2.8.1/test_output/_temporary/0/task_local279813974_0001_r_000000\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: reduce > reduce\n17/08/07 12:05:28 INFO mapred.Task: Task 'attempt_local279813974_0001_r_000000_0' done.\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: Finishing task: attempt_local279813974_0001_r_000000_0\n17/08/07 12:05:28 INFO mapred.LocalJobRunner: reduce task executor complete.\n17/08/07 12:05:29 INFO mapreduce.Job: Job job_local279813974_0001 running in uber mode : false\n17/08/07 12:05:29 INFO mapreduce.Job:  map 100% reduce 100%\n17/08/07 12:05:29 INFO mapreduce.Job: Job job_local279813974_0001 completed successfully\n17/08/07 12:05:29 INFO mapreduce.Job: Counters: 30\nFILE: Number of bytes read=616258\nFILE: Number of bytes written=1259654\nMap output records=487\nMap output bytes=4577\nMap output materialized bytes=3378\nCombine input records=487\nCombine output records=270\nReduce input groups=270\nReduce shuffle bytes=3378\nReduce input records=270\nReduce output records=270\nTotal committed heap usage (bytes)=440401920\n[hadoop@much hadoop-2.8.1]$ ll test_output/\n-rw-r--r--. 1 hadoop hadoop 2298 Aug  7 12:05 part-r-00000\n-rw-r--r--. 1 hadoop hadoop    0 Aug  7 12:05 _SUCCESS\n[hadoop@much hadoop-2.8.1]$ head -n 20 test_output/part-r-00000\nNote: test_output 目录是在执行过程中被 Hadoop 自动创建的，不用事先自己创建，如果事先自己创建了，会出错，解决办法是在一个有写权限的位置指定一个未被创建的子目录\n21centry    bin  include  lib      LICENSE.txt  README.txt  share\n4300-0.txt  etc  input    libexec  NOTICE.txt   sbin\n[hadoop@much hadoop-2.8.1]$ mkdir hdfs\n[hadoop@much hadoop-2.8.1]$ ll hdfs/\n[hadoop@much hadoop-2.8.1]$ ll hdfs/ -d\ndrwxrwxr-x. 2 hadoop hadoop 6 Aug  7 12:19 hdfs/\n[hadoop@much hadoop-2.8.1]$ cd hdfs/\n[hadoop@much hdfs]$ pwd\n[hadoop@much hadoop-2.8.1]$ ssh localhost\nLast login: Mon Aug  7 11:03:56 2017\nLast login: Mon Aug  7 13:35:02 2017 from localhost\nHDFS 的架构可以参考 Overview of the HDFS Architecture\n这是 Application 与 NameNode 还有 DataNode 之间的交互架构\n这是 DataNodes 之间的复制架构\n[hadoop@much hadoop-2.8.1]$ vim  etc/hadoop/core-site.xml\n[hadoop@much hadoop-2.8.1]$ cat etc/hadoop/core-site.xml\n[hadoop@much hadoop-2.8.1]$ vim  etc/hadoop/hdfs-site.xml\n[hadoop@much hadoop-2.8.1]$ cat etc/hadoop/hdfs-site.xml\n[hadoop@much hadoop-2.8.1]$ bin/hdfs namenode -format\n17/08/07 14:04:21 INFO namenode.NameNode: STARTUP_MSG:\nSTARTUP_MSG:   user = hadoop\nSTARTUP_MSG:   host = much/10.0.2.15\nSTARTUP_MSG:   version = 2.8.1\nSTARTUP_MSG:   classpath = /home/hadoop/hadoop-2.8.1/etc/hadoop:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jsp-api-2.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jersey-json-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jettison-1.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/activation-1.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jets3t-0.9.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/java-xmlbuilder-0.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-configuration-1.6.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-digester-1.8.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-beanutils-1.7.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-beanutils-core-1.8.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/slf4j-api-1.7.10.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/paranamer-2.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/gson-2.2.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/hadoop-auth-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/nimbus-jose-jwt-3.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jcip-annotations-1.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/json-smart-1.1.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/apacheds-i18n-2.0.0-M15.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/api-asn1-api-1.0.0-M20.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/api-util-1.0.0-M20.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/zookeeper-3.4.6.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/curator-framework-2.7.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/curator-client-2.7.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jsch-0.1.51.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/curator-recipes-2.7.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/htrace-core4-4.0.1-incubating.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/junit-4.11.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/hamcrest-core-1.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/mockito-all-1.8.5.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/hadoop-annotations-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-math3-3.1.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/xmlenc-0.52.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/httpclient-4.5.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/httpcore-4.4.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-net-3.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/commons-collections-3.2.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/lib/jetty-sslengine-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/hadoop-common-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/hadoop-common-2.8.1-tests.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/common/hadoop-nfs-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/xmlenc-0.52.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/htrace-core4-4.0.1-incubating.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/hadoop-hdfs-client-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/okhttp-2.4.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/okio-1.4.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/netty-all-4.0.23.Final.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/xercesImpl-2.9.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/xml-apis-1.3.04.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-2.8.1-tests.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-client-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-client-2.8.1-tests.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-native-client-2.8.1-tests.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/hdfs/hadoop-hdfs-nfs-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-collections-3.2.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/fst-2.24.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/javassist-3.18.1-GA.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/objenesis-2.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jetty-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/curator-client-2.7.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/curator-test-2.7.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-math-2.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/zookeeper-3.4.6-tests.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-lang-2.6.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/guava-11.0.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jsr305-3.0.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-logging-1.1.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-cli-1.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jaxb-api-2.2.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/stax-api-1.0-2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/activation-1.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/servlet-api-2.5.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-codec-1.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jetty-util-6.1.26.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jersey-client-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jackson-jaxrs-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jackson-xc-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/guice-servlet-3.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/guice-3.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/javax.inject-1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/aopalliance-1.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jersey-json-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jettison-1.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jaxb-impl-2.2.3-1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/jersey-guice-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/zookeeper-3.4.6.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-api-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-common-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-common-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-tests-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-client-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-server-timeline-pluginstorage-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/yarn/hadoop-yarn-registry-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/jackson-core-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.9.13.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/hadoop-annotations-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/commons-io-2.4.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/leveldbjni-all-1.8.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/junit-4.11.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar:/home/hadoop/hadoop-2.8.1/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.8.1-tests.jar:/contrib/capacity-scheduler/*.jar\nSTARTUP_MSG:   build = https://git-wip-us.apache.org/repos/asf/hadoop.git -r 20fe5304904fc2f5a18053c389e43cd26f7a70fe; compiled by 'vinodkv' on 2017-06-02T06:14Z\nSTARTUP_MSG:   java = 1.8.0_141\n17/08/07 14:04:21 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]\n17/08/07 14:04:21 INFO namenode.NameNode: createNameNode [-format]\nFormatting using clusterid: CID-dabe1865-130e-430c-99e4-d54608b2dad3\n17/08/07 14:04:22 INFO namenode.FSEditLog: Edit logging is async:false\n17/08/07 14:04:22 INFO namenode.FSNamesystem: KeyProvider: null\n17/08/07 14:04:22 INFO namenode.FSNamesystem: fsLock is fair: true\n17/08/07 14:04:22 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false\n17/08/07 14:04:22 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000\n17/08/07 14:04:22 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: The block deletion will start around 2017 Aug 07 14:04:22\n17/08/07 14:04:22 INFO util.GSet: Computing capacity for map BlocksMap\n17/08/07 14:04:22 INFO util.GSet: VM type       = 64-bit\n17/08/07 14:04:22 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB\n17/08/07 14:04:22 INFO util.GSet: capacity      = 2^21 = 2097152 entries\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: dfs.block.access.token.enable=false\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: defaultReplication         = 1\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: maxReplication             = 512\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: minReplication             = 1\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: maxReplicationStreams      = 2\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: encryptDataTransfer        = false\n17/08/07 14:04:22 INFO blockmanagement.BlockManager: maxNumBlocksToLog          = 1000\n17/08/07 14:04:22 INFO namenode.FSNamesystem: fsOwner             = hadoop (auth:SIMPLE)\n17/08/07 14:04:22 INFO namenode.FSNamesystem: supergroup          = supergroup\n17/08/07 14:04:22 INFO namenode.FSNamesystem: isPermissionEnabled = true\n17/08/07 14:04:22 INFO namenode.FSNamesystem: HA Enabled: false\n17/08/07 14:04:22 INFO namenode.FSNamesystem: Append Enabled: true\n17/08/07 14:04:22 INFO util.GSet: Computing capacity for map INodeMap\n17/08/07 14:04:22 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB\n17/08/07 14:04:22 INFO util.GSet: capacity      = 2^20 = 1048576 entries\n17/08/07 14:04:22 INFO namenode.FSDirectory: ACLs enabled? false\n17/08/07 14:04:22 INFO namenode.FSDirectory: XAttrs enabled? true\n17/08/07 14:04:22 INFO namenode.NameNode: Caching file names occurring more than 10 times\n17/08/07 14:04:22 INFO util.GSet: Computing capacity for map cachedBlocks\n17/08/07 14:04:22 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB\n17/08/07 14:04:22 INFO util.GSet: capacity      = 2^18 = 262144 entries\n17/08/07 14:04:22 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033\n17/08/07 14:04:22 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0\n17/08/07 14:04:22 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension     = 30000\n17/08/07 14:04:22 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10\n17/08/07 14:04:22 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10\n17/08/07 14:04:22 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25\n17/08/07 14:04:22 INFO namenode.FSNamesystem: Retry cache on namenode is enabled\n17/08/07 14:04:22 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis\n17/08/07 14:04:22 INFO util.GSet: Computing capacity for map NameNodeRetryCache\n17/08/07 14:04:22 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB\n17/08/07 14:04:22 INFO util.GSet: capacity      = 2^15 = 32768 entries\n17/08/07 14:04:22 INFO namenode.FSImage: Allocated new BlockPoolId: BP-788595051-10.0.2.15-1502085862480\n17/08/07 14:04:22 INFO common.Storage: Storage directory /home/hadoop/hadoop-2.8.1/hdfs/dfs/name has been successfully formatted.\n17/08/07 14:04:22 INFO namenode.FSImageFormatProtobuf: Saving image file /home/hadoop/hadoop-2.8.1/hdfs/dfs/name/current/fsimage.ckpt_0000000000000000000 using no compression\n17/08/07 14:04:22 INFO namenode.FSImageFormatProtobuf: Image file /home/hadoop/hadoop-2.8.1/hdfs/dfs/name/current/fsimage.ckpt_0000000000000000000 of size 323 bytes saved in 0 seconds.\n17/08/07 14:04:22 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0\n17/08/07 14:04:22 INFO util.ExitUtil: Exiting with status 0\n17/08/07 14:04:22 INFO namenode.NameNode: SHUTDOWN_MSG:\nSHUTDOWN_MSG: Shutting down NameNode at much/10.0.2.15\n格式化完成后可以看到新创建的文件夹 hdfs 里多出来了东西\ndrwxrwxr-x. 3 hadoop hadoop 18 Aug  7 14:04 dfs\n[hadoop@much hadoop-2.8.1]$ tree hdfs/\n[hadoop@much hadoop-2.8.1]$ jps\n[hadoop@much hadoop-2.8.1]$ sbin/start-dfs.sh\nlocalhost: starting namenode, logging to /home/hadoop/hadoop-2.8.1/logs/hadoop-hadoop-namenode-much.out\nlocalhost: starting datanode, logging to /home/hadoop/hadoop-2.8.1/logs/hadoop-hadoop-datanode-much.out\n0.0.0.0: starting secondarynamenode, logging to /home/hadoop/hadoop-2.8.1/logs/hadoop-hadoop-secondarynamenode-much.out\n打开放火墙的 50070 端口\n[root@much ~]# firewall-cmd --list-all\n[root@much ~]# firewall-cmd --add-port 50070/tcp\nports: 8080/tcp 50070/tcp\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -ls /\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -mkdir /user\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:34 /user\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -mkdir /user/hduser\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -ls /user\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:35 /user/hduser\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -mkdir /input\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:35 /input\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:35 /user\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -put etc/hadoop/  input\nput: `input': No such file or directory: `hdfs://localhost:9000/user/hadoop/input'\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -put etc/hadoop/  /input\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -ls /input\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:37 /input/hadoop\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -ls /input/hadoop\n-rw-r--r--   1 hadoop supergroup       4942 2017-08-07 14:37 /input/hadoop/capacity-scheduler.xml\n-rw-r--r--   1 hadoop supergroup       1335 2017-08-07 14:37 /input/hadoop/configuration.xsl\n-rw-r--r--   1 hadoop supergroup        318 2017-08-07 14:37 /input/hadoop/container-executor.cfg\n-rw-r--r--   1 hadoop supergroup       1018 2017-08-07 14:37 /input/hadoop/core-site.xml\n-rw-r--r--   1 hadoop supergroup       3719 2017-08-07 14:37 /input/hadoop/hadoop-env.cmd\n-rw-r--r--   1 hadoop supergroup       4745 2017-08-07 14:37 /input/hadoop/hadoop-env.sh\n-rw-r--r--   1 hadoop supergroup       2490 2017-08-07 14:37 /input/hadoop/hadoop-metrics.properties\n-rw-r--r--   1 hadoop supergroup       2598 2017-08-07 14:37 /input/hadoop/hadoop-metrics2.properties\n-rw-r--r--   1 hadoop supergroup       9683 2017-08-07 14:37 /input/hadoop/hadoop-policy.xml\n-rw-r--r--   1 hadoop supergroup       1165 2017-08-07 14:37 /input/hadoop/hdfs-site.xml\n-rw-r--r--   1 hadoop supergroup       1449 2017-08-07 14:37 /input/hadoop/httpfs-env.sh\n-rw-r--r--   1 hadoop supergroup       1657 2017-08-07 14:37 /input/hadoop/httpfs-log4j.properties\n-rw-r--r--   1 hadoop supergroup         21 2017-08-07 14:37 /input/hadoop/httpfs-signature.secret\n-rw-r--r--   1 hadoop supergroup        620 2017-08-07 14:37 /input/hadoop/httpfs-site.xml\n-rw-r--r--   1 hadoop supergroup       3518 2017-08-07 14:37 /input/hadoop/kms-acls.xml\n-rw-r--r--   1 hadoop supergroup       1611 2017-08-07 14:37 /input/hadoop/kms-env.sh\n-rw-r--r--   1 hadoop supergroup       1631 2017-08-07 14:37 /input/hadoop/kms-log4j.properties\n-rw-r--r--   1 hadoop supergroup       5546 2017-08-07 14:37 /input/hadoop/kms-site.xml\n-rw-r--r--   1 hadoop supergroup      13661 2017-08-07 14:37 /input/hadoop/log4j.properties\n-rw-r--r--   1 hadoop supergroup        931 2017-08-07 14:37 /input/hadoop/mapred-env.cmd\n-rw-r--r--   1 hadoop supergroup       1383 2017-08-07 14:37 /input/hadoop/mapred-env.sh\n-rw-r--r--   1 hadoop supergroup       4113 2017-08-07 14:37 /input/hadoop/mapred-queues.xml.template\n-rw-r--r--   1 hadoop supergroup        758 2017-08-07 14:37 /input/hadoop/mapred-site.xml.template\n-rw-r--r--   1 hadoop supergroup         10 2017-08-07 14:37 /input/hadoop/slaves\n-rw-r--r--   1 hadoop supergroup       2316 2017-08-07 14:37 /input/hadoop/ssl-client.xml.example\n-rw-r--r--   1 hadoop supergroup       2697 2017-08-07 14:37 /input/hadoop/ssl-server.xml.example\n-rw-r--r--   1 hadoop supergroup       2191 2017-08-07 14:37 /input/hadoop/yarn-env.cmd\n-rw-r--r--   1 hadoop supergroup       4567 2017-08-07 14:37 /input/hadoop/yarn-env.sh\n-rw-r--r--   1 hadoop supergroup        690 2017-08-07 14:37 /input/hadoop/yarn-site.xml\n关于 hdfs 的文件系统操作命令可以参考 File System Shell Guide\n这时再看 hdfs 目录里的内容\n│   │   ├── BP-788595051-10.0.2.15-1502085862480\n│   │   │   │   ├── dfsUsed\n│   │   │   │   ├── finalized\n│   │   │   │   │   └── subdir0\n│   │   │   │   │       └── subdir0\n│   │   │   │   │           ├── blk_1073741825\n│   │   │   │   │           ├── blk_1073741825_1001.meta\n│   │   │   │   │           ├── blk_1073741826\n│   │   │   │   │           ├── blk_1073741826_1002.meta\n│   │   │   │   │           ├── blk_1073741827\n│   │   │   │   │           ├── blk_1073741827_1003.meta\n│   │   │   │   │           ├── blk_1073741828\n│   │   │   │   │           ├── blk_1073741828_1004.meta\n│   │   │   │   │           ├── blk_1073741829\n│   │   │   │   │           ├── blk_1073741829_1005.meta\n│   │   │   │   │           ├── blk_1073741830\n│   │   │   │   │           ├── blk_1073741830_1006.meta\n│   │   │   │   │           ├── blk_1073741831\n│   │   │   │   │           ├── blk_1073741831_1007.meta\n│   │   │   │   │           ├── blk_1073741832\n│   │   │   │   │           ├── blk_1073741832_1008.meta\n│   │   │   │   │           ├── blk_1073741833\n│   │   │   │   │           ├── blk_1073741833_1009.meta\n│   │   │   │   │           ├── blk_1073741834\n│   │   │   │   │           ├── blk_1073741834_1010.meta\n│   │   │   │   │           ├── blk_1073741835\n│   │   │   │   │           ├── blk_1073741835_1011.meta\n│   │   │   │   │           ├── blk_1073741836\n│   │   │   │   │           ├── blk_1073741836_1012.meta\n│   │   │   │   │           ├── blk_1073741837\n│   │   │   │   │           ├── blk_1073741837_1013.meta\n│   │   │   │   │           ├── blk_1073741838\n│   │   │   │   │           ├── blk_1073741838_1014.meta\n│   │   │   │   │           ├── blk_1073741839\n│   │   │   │   │           ├── blk_1073741839_1015.meta\n│   │   │   │   │           ├── blk_1073741840\n│   │   │   │   │           ├── blk_1073741840_1016.meta\n│   │   │   │   │           ├── blk_1073741841\n│   │   │   │   │           ├── blk_1073741841_1017.meta\n│   │   │   │   │           ├── blk_1073741842\n│   │   │   │   │           ├── blk_1073741842_1018.meta\n│   │   │   │   │           ├── blk_1073741843\n│   │   │   │   │           ├── blk_1073741843_1019.meta\n│   │   │   │   │           ├── blk_1073741844\n│   │   │   │   │           ├── blk_1073741844_1020.meta\n│   │   │   │   │           ├── blk_1073741845\n│   │   │   │   │           ├── blk_1073741845_1021.meta\n│   │   │   │   │           ├── blk_1073741846\n│   │   │   │   │           ├── blk_1073741846_1022.meta\n│   │   │   │   │           ├── blk_1073741847\n│   │   │   │   │           ├── blk_1073741847_1023.meta\n│   │   │   │   │           ├── blk_1073741848\n│   │   │   │   │           ├── blk_1073741848_1024.meta\n│   │   │   │   │           ├── blk_1073741849\n│   │   │   │   │           ├── blk_1073741849_1025.meta\n│   │   │   │   │           ├── blk_1073741850\n│   │   │   │   │           ├── blk_1073741850_1026.meta\n│   │   │   │   │           ├── blk_1073741851\n│   │   │   │   │           ├── blk_1073741851_1027.meta\n│   │   │   │   │           ├── blk_1073741852\n│   │   │   │   │           ├── blk_1073741852_1028.meta\n│   │   │   │   │           ├── blk_1073741853\n│   │   │   │   │           └── blk_1073741853_1029.meta\n│   │   │   │   ├── rbw\n│   │   │   │   └── VERSION\n│   │   │   ├── scanner.cursor\n│   │   │   └── tmp\n│   └── in_use.lock\n│   │   ├── edits_0000000000000000001-0000000000000000001\n│   │   ├── edits_0000000000000000002-0000000000000000003\n│   │   ├── edits_inprogress_0000000000000000004\n│   │   ├── fsimage_0000000000000000000\n│   │   ├── fsimage_0000000000000000000.md5\n│   │   ├── fsimage_0000000000000000003\n│   │   ├── fsimage_0000000000000000003.md5\n│   │   ├── seen_txid\n│   ├── edits_0000000000000000001-0000000000000000001\n│   ├── edits_0000000000000000002-0000000000000000003\n│   ├── fsimage_0000000000000000000\n│   ├── fsimage_0000000000000000000.md5\n│   ├── fsimage_0000000000000000003\n│   ├── fsimage_0000000000000000003.md5\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:37 /input\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:44 /user\n[hadoop@much hadoop-2.8.1]$ bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar  grep  /input/hadoop  /output 'dfs[a-z.]+'\n17/08/07 14:47:25 INFO Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id\n17/08/07 14:47:25 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=\n17/08/07 14:47:25 INFO input.FileInputFormat: Total input files to process : 29\n17/08/07 14:47:25 INFO mapreduce.JobSubmitter: number of splits:29\n17/08/07 14:47:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local223365185_0001\n17/08/07 14:47:25 INFO mapreduce.Job: The url to track the job: http://localhost:8080/\n17/08/07 14:47:25 INFO mapreduce.Job: Running job: job_local223365185_0001\n17/08/07 14:47:25 INFO mapred.LocalJobRunner: OutputCommitter set in config null\n17/08/07 14:47:25 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1\n17/08/07 14:47:25 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false\n17/08/07 14:47:25 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter\n17/08/07 14:47:25 INFO mapred.LocalJobRunner: Waiting for map tasks\n17/08/07 14:47:25 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000000_0\n17/08/07 14:47:26 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1\n17/08/07 14:47:26 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false\n17/08/07 14:47:26 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/log4j.properties:0+13661\n17/08/07 14:47:26 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)\n17/08/07 14:47:26 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100\n17/08/07 14:47:26 INFO mapred.MapTask: soft limit at 83886080\n17/08/07 14:47:26 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600\n17/08/07 14:47:26 INFO mapred.MapTask: kvstart = 26214396; length = 6553600\n17/08/07 14:47:26 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer\n17/08/07 14:47:26 INFO mapred.LocalJobRunner:\n17/08/07 14:47:26 INFO mapred.MapTask: Starting flush of map output\n17/08/07 14:47:26 INFO mapred.MapTask: Spilling map output\n17/08/07 14:47:26 INFO mapred.MapTask: bufstart = 0; bufend = 352; bufvoid = 104857600\n17/08/07 14:47:26 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214348(104857392); length = 49/6553600\n17/08/07 14:47:26 INFO mapred.MapTask: Finished spill 0\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000000_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: map\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000000_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000000_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000001_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/hadoop-policy.xml:0+9683\n17/08/07 14:47:26 INFO mapred.MapTask: bufstart = 0; bufend = 17; bufvoid = 104857600\n17/08/07 14:47:26 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214396(104857584); length = 1/6553600\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000001_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000001_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000001_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000002_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/kms-site.xml:0+5546\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000002_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000002_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000002_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000003_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/capacity-scheduler.xml:0+4942\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000003_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000003_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000003_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000004_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/hadoop-env.sh:0+4745\n17/08/07 14:47:26 INFO mapred.MapTask: bufstart = 0; bufend = 50; bufvoid = 104857600\n17/08/07 14:47:26 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214392(104857568); length = 5/6553600\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000004_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000004_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000004_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000005_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/yarn-env.sh:0+4567\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000005_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000005_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000005_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000006_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/mapred-queues.xml.template:0+4113\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000006_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000006_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000006_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000007_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/hadoop-env.cmd:0+3719\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000007_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000007_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000007_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000008_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/kms-acls.xml:0+3518\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000008_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000008_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000008_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000009_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/ssl-server.xml.example:0+2697\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000009_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000009_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000009_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000010_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/hadoop-metrics2.properties:0+2598\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000010_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000010_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000010_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000011_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/hadoop-metrics.properties:0+2490\n17/08/07 14:47:26 INFO mapred.MapTask: bufstart = 0; bufend = 170; bufvoid = 104857600\n17/08/07 14:47:26 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214364(104857456); length = 33/6553600\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000011_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000011_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000011_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000012_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/ssl-client.xml.example:0+2316\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000012_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000012_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000012_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000013_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/yarn-env.cmd:0+2191\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000013_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000013_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000013_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000014_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/httpfs-log4j.properties:0+1657\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000014_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000014_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000014_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000015_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/kms-log4j.properties:0+1631\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000015_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000015_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000015_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000016_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/kms-env.sh:0+1611\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000016_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000016_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000016_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000017_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/httpfs-env.sh:0+1449\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000017_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000017_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000017_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000018_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/mapred-env.sh:0+1383\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000018_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000018_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000018_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000019_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/configuration.xsl:0+1335\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000019_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000019_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000019_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000020_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/hdfs-site.xml:0+1165\n17/08/07 14:47:26 INFO mapred.MapTask: bufstart = 0; bufend = 84; bufvoid = 104857600\n17/08/07 14:47:26 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214388(104857552); length = 9/6553600\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000020_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000020_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000020_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000021_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/core-site.xml:0+1018\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000021_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000021_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000021_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000022_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/mapred-env.cmd:0+931\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000022_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000022_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000022_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000023_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/mapred-site.xml.template:0+758\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000023_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000023_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000023_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000024_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/yarn-site.xml:0+690\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000024_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000024_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000024_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000025_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/httpfs-site.xml:0+620\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000025_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000025_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000025_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000026_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/container-executor.cfg:0+318\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000026_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000026_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000026_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000027_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/httpfs-signature.secret:0+21\n17/08/07 14:47:26 INFO mapreduce.Job: Job job_local223365185_0001 running in uber mode : false\n17/08/07 14:47:26 INFO mapreduce.Job:  map 100% reduce 0%\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000027_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000027_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000027_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_m_000028_0\n17/08/07 14:47:26 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/input/hadoop/slaves:0+10\n17/08/07 14:47:26 INFO mapred.Task: Task:attempt_local223365185_0001_m_000028_0 is done. And is in the process of committing\n17/08/07 14:47:26 INFO mapred.Task: Task 'attempt_local223365185_0001_m_000028_0' done.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_m_000028_0\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: map task executor complete.\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Waiting for reduce tasks\n17/08/07 14:47:26 INFO mapred.LocalJobRunner: Starting task: attempt_local223365185_0001_r_000000_0\n17/08/07 14:47:26 INFO mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@1608f31e\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: MergerManager: memoryLimit=372139616, maxSingleShuffleLimit=93034904, mergeThreshold=245612160, ioSortFactor=10, memToMemMergeOutputsThreshold=10\n17/08/07 14:47:27 INFO reduce.EventFetcher: attempt_local223365185_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000001_0 decomp: 21 len: 25 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 21 bytes from map-output for attempt_local223365185_0001_m_000001_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 21, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->21\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000026_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 WARN io.ReadaheadPool: Failed readahead on ifile\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000026_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 2, commitMemory -> 21, usedMemory ->23\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000000_0 decomp: 174 len: 178 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 174 bytes from map-output for attempt_local223365185_0001_m_000000_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 174, inMemoryMapOutputs.size() -> 3, commitMemory -> 23, usedMemory ->197\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000013_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000013_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 4, commitMemory -> 197, usedMemory ->199\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000028_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000028_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 5, commitMemory -> 199, usedMemory ->201\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000002_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000002_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 6, commitMemory -> 201, usedMemory ->203\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000015_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000015_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 7, commitMemory -> 203, usedMemory ->205\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000014_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000014_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 8, commitMemory -> 205, usedMemory ->207\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000027_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000027_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 9, commitMemory -> 207, usedMemory ->209\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000004_0 decomp: 29 len: 33 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 29 bytes from map-output for attempt_local223365185_0001_m_000004_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 29, inMemoryMapOutputs.size() -> 10, commitMemory -> 209, usedMemory ->238\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000017_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000017_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 11, commitMemory -> 238, usedMemory ->240\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000016_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000016_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 12, commitMemory -> 240, usedMemory ->242\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000003_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000003_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 13, commitMemory -> 242, usedMemory ->244\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000018_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000018_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 14, commitMemory -> 244, usedMemory ->246\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000005_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000005_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 15, commitMemory -> 246, usedMemory ->248\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000020_0 decomp: 92 len: 96 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 92 bytes from map-output for attempt_local223365185_0001_m_000020_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 92, inMemoryMapOutputs.size() -> 16, commitMemory -> 248, usedMemory ->340\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000007_0 decomp: 29 len: 33 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 29 bytes from map-output for attempt_local223365185_0001_m_000007_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 29, inMemoryMapOutputs.size() -> 17, commitMemory -> 340, usedMemory ->369\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000006_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000006_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 18, commitMemory -> 369, usedMemory ->371\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000019_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000019_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 19, commitMemory -> 371, usedMemory ->373\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000009_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000009_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 20, commitMemory -> 373, usedMemory ->375\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000008_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000008_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 21, commitMemory -> 375, usedMemory ->377\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000021_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000021_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 22, commitMemory -> 377, usedMemory ->379\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000010_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000010_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 23, commitMemory -> 379, usedMemory ->381\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000023_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000023_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 24, commitMemory -> 381, usedMemory ->383\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000022_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000022_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 25, commitMemory -> 383, usedMemory ->385\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000012_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000012_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 26, commitMemory -> 385, usedMemory ->387\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000025_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000025_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 27, commitMemory -> 387, usedMemory ->389\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000024_0 decomp: 2 len: 6 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 2 bytes from map-output for attempt_local223365185_0001_m_000024_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 2, inMemoryMapOutputs.size() -> 28, commitMemory -> 389, usedMemory ->391\n17/08/07 14:47:27 INFO reduce.LocalFetcher: localfetcher#1 about to shuffle output of map attempt_local223365185_0001_m_000011_0 decomp: 109 len: 113 to MEMORY\n17/08/07 14:47:27 INFO reduce.InMemoryMapOutput: Read 109 bytes from map-output for attempt_local223365185_0001_m_000011_0\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 109, inMemoryMapOutputs.size() -> 29, commitMemory -> 391, usedMemory ->500\n17/08/07 14:47:27 INFO reduce.EventFetcher: EventFetcher is interrupted.. Returning\n17/08/07 14:47:27 INFO mapred.LocalJobRunner: 29 / 29 copied.\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: finalMerge called with 29 in-memory map-outputs and 0 on-disk map-outputs\n17/08/07 14:47:27 INFO mapred.Merger: Merging 29 sorted segments\n17/08/07 14:47:27 INFO mapred.Merger: Down to the last merge-pass, with 6 segments left of total size: 338 bytes\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: Merged 29 segments, 500 bytes to disk to satisfy reduce memory limit\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: Merging 1 files, 448 bytes from disk\n17/08/07 14:47:27 INFO reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce\n17/08/07 14:47:27 INFO mapred.Merger: Merging 1 sorted segments\n17/08/07 14:47:27 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 413 bytes\n17/08/07 14:47:27 INFO Configuration.deprecation: mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords\n17/08/07 14:47:27 INFO mapred.Task: Task:attempt_local223365185_0001_r_000000_0 is done. And is in the process of committing\n17/08/07 14:47:27 INFO mapred.Task: Task attempt_local223365185_0001_r_000000_0 is allowed to commit now\n17/08/07 14:47:27 INFO output.FileOutputCommitter: Saved output of task 'attempt_local223365185_0001_r_000000_0' to hdfs://localhost:9000/user/hadoop/grep-temp-410115572/_temporary/0/task_local223365185_0001_r_000000\n17/08/07 14:47:27 INFO mapred.LocalJobRunner: reduce > reduce\n17/08/07 14:47:27 INFO mapred.Task: Task 'attempt_local223365185_0001_r_000000_0' done.\n17/08/07 14:47:27 INFO mapred.LocalJobRunner: Finishing task: attempt_local223365185_0001_r_000000_0\n17/08/07 14:47:27 INFO mapred.LocalJobRunner: reduce task executor complete.\n17/08/07 14:47:27 INFO mapreduce.Job:  map 100% reduce 100%\n17/08/07 14:47:27 INFO mapreduce.Job: Job job_local223365185_0001 completed successfully\n17/08/07 14:47:27 INFO mapreduce.Job: Counters: 35\nFILE: Number of bytes read=10242034\nFILE: Number of bytes written=18885357\nHDFS: Number of bytes read=1879201\nHDFS: Number of bytes written=564\nHDFS: Number of read operations=1021\nHDFS: Number of write operations=32\nMap input records=2176\nMap output bytes=723\nMap output materialized bytes=616\nInput split bytes=3389\nCombine output records=17\nReduce input groups=15\nReduce shuffle bytes=616\nReduce input records=17\nReduce output records=15\nShuffled Maps =29\nMerged Map outputs=29\nGC time elapsed (ms)=98\nTotal committed heap usage (bytes)=15390998528\n17/08/07 14:47:27 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized\n17/08/07 14:47:28 INFO input.FileInputFormat: Total input files to process : 1\n17/08/07 14:47:28 INFO mapreduce.JobSubmitter: number of splits:1\n17/08/07 14:47:28 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_local391964061_0002\n17/08/07 14:47:28 INFO mapreduce.Job: The url to track the job: http://localhost:8080/\n17/08/07 14:47:28 INFO mapreduce.Job: Running job: job_local391964061_0002\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: OutputCommitter set in config null\n17/08/07 14:47:28 INFO output.FileOutputCommitter: File Output Committer Algorithm version is 1\n17/08/07 14:47:28 INFO output.FileOutputCommitter: FileOutputCommitter skip cleanup _temporary folders under output directory:false, ignore cleanup failures: false\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: Waiting for map tasks\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: Starting task: attempt_local391964061_0002_m_000000_0\n17/08/07 14:47:28 INFO mapred.Task:  Using ResourceCalculatorProcessTree : [ ]\n17/08/07 14:47:28 INFO mapred.MapTask: Processing split: hdfs://localhost:9000/user/hadoop/grep-temp-410115572/part-r-00000:0+564\n17/08/07 14:47:28 INFO mapred.MapTask: (EQUATOR) 0 kvi 26214396(104857584)\n17/08/07 14:47:28 INFO mapred.MapTask: mapreduce.task.io.sort.mb: 100\n17/08/07 14:47:28 INFO mapred.MapTask: soft limit at 83886080\n17/08/07 14:47:28 INFO mapred.MapTask: bufstart = 0; bufvoid = 104857600\n17/08/07 14:47:28 INFO mapred.MapTask: kvstart = 26214396; length = 6553600\n17/08/07 14:47:28 INFO mapred.MapTask: Map output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer\n17/08/07 14:47:28 INFO mapred.LocalJobRunner:\n17/08/07 14:47:28 INFO mapred.MapTask: Starting flush of map output\n17/08/07 14:47:28 INFO mapred.MapTask: Spilling map output\n17/08/07 14:47:28 INFO mapred.MapTask: bufstart = 0; bufend = 358; bufvoid = 104857600\n17/08/07 14:47:28 INFO mapred.MapTask: kvstart = 26214396(104857584); kvend = 26214340(104857360); length = 57/6553600\n17/08/07 14:47:28 INFO mapred.MapTask: Finished spill 0\n17/08/07 14:47:28 INFO mapred.Task: Task:attempt_local391964061_0002_m_000000_0 is done. And is in the process of committing\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: map\n17/08/07 14:47:28 INFO mapred.Task: Task 'attempt_local391964061_0002_m_000000_0' done.\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: Finishing task: attempt_local391964061_0002_m_000000_0\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: map task executor complete.\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: Waiting for reduce tasks\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: Starting task: attempt_local391964061_0002_r_000000_0\n17/08/07 14:47:28 INFO mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@41b0aba1\n17/08/07 14:47:28 INFO reduce.MergeManagerImpl: MergerManager: memoryLimit=372139616, maxSingleShuffleLimit=93034904, mergeThreshold=245612160, ioSortFactor=10, memToMemMergeOutputsThreshold=10\n17/08/07 14:47:28 INFO reduce.EventFetcher: attempt_local391964061_0002_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events\n17/08/07 14:47:28 INFO reduce.LocalFetcher: localfetcher#2 about to shuffle output of map attempt_local391964061_0002_m_000000_0 decomp: 390 len: 394 to MEMORY\n17/08/07 14:47:28 INFO reduce.InMemoryMapOutput: Read 390 bytes from map-output for attempt_local391964061_0002_m_000000_0\n17/08/07 14:47:28 INFO reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 390, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->390\n17/08/07 14:47:28 WARN io.ReadaheadPool: Failed readahead on ifile\n17/08/07 14:47:28 INFO reduce.EventFetcher: EventFetcher is interrupted.. Returning\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: 1 / 1 copied.\n17/08/07 14:47:28 INFO reduce.MergeManagerImpl: finalMerge called with 1 in-memory map-outputs and 0 on-disk map-outputs\n17/08/07 14:47:28 INFO mapred.Merger: Merging 1 sorted segments\n17/08/07 14:47:28 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 380 bytes\n17/08/07 14:47:28 INFO reduce.MergeManagerImpl: Merged 1 segments, 390 bytes to disk to satisfy reduce memory limit\n17/08/07 14:47:28 INFO reduce.MergeManagerImpl: Merging 1 files, 394 bytes from disk\n17/08/07 14:47:28 INFO reduce.MergeManagerImpl: Merging 0 segments, 0 bytes from memory into reduce\n17/08/07 14:47:28 INFO mapred.Task: Task:attempt_local391964061_0002_r_000000_0 is done. And is in the process of committing\n17/08/07 14:47:28 INFO mapred.Task: Task attempt_local391964061_0002_r_000000_0 is allowed to commit now\n17/08/07 14:47:28 INFO output.FileOutputCommitter: Saved output of task 'attempt_local391964061_0002_r_000000_0' to hdfs://localhost:9000/output/_temporary/0/task_local391964061_0002_r_000000\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: reduce > reduce\n17/08/07 14:47:28 INFO mapred.Task: Task 'attempt_local391964061_0002_r_000000_0' done.\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: Finishing task: attempt_local391964061_0002_r_000000_0\n17/08/07 14:47:28 INFO mapred.LocalJobRunner: reduce task executor complete.\n17/08/07 14:47:29 INFO mapreduce.Job: Job job_local391964061_0002 running in uber mode : false\n17/08/07 14:47:29 INFO mapreduce.Job:  map 100% reduce 100%\n17/08/07 14:47:29 INFO mapreduce.Job: Job job_local391964061_0002 completed successfully\n17/08/07 14:47:29 INFO mapreduce.Job: Counters: 35\nFILE: Number of bytes read=1330778\nFILE: Number of bytes written=2508916\nHDFS: Number of bytes read=163894\nHDFS: Number of bytes written=1396\nHDFS: Number of read operations=151\nMap input records=15\nMap output bytes=358\nMap output materialized bytes=394\nReduce shuffle bytes=394\nReduce input records=15\nTotal committed heap usage (bytes)=1063256064\ndrwxr-xr-x   - hadoop supergroup          0 2017-08-07 14:47 /output\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -ls /output\n-rw-r--r--   1 hadoop supergroup          0 2017-08-07 14:47 /output/_SUCCESS\n-rw-r--r--   1 hadoop supergroup        268 2017-08-07 14:47 /output/part-r-00000\n[hadoop@much hadoop-2.8.1]$ bin/hdfs dfs -cat /output/part-r-00000\n可见脱机调用 hadoop 小任务也可以对 hdfs 进行正常读写\n[hadoop@much hadoop-2.8.1]$ ps faux | grep java\nhadoop   10873  0.0  0.0 112648   964 pts/0    S+   15:16   0:00                  \__ grep --color=auto java\nhadoop    8201  0.5  8.2 2884040 333712 ?      Sl   14:11   0:21 /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.141-1.b16.el7_3.x86_64/bin/java -Dproc_namenode -Xmx1000m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.8.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.8.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop-2.8.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.8.1/logs -Dhadoop.log.file=hadoop-hadoop-namenode-much.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.8.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/home/hadoop/hadoop-2.8.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.NameNode\nhadoop    8338  0.4  5.0 2859052 203272 ?      Sl   14:11   0:15 /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.141-1.b16.el7_3.x86_64/bin/java -Dproc_datanode -Xmx1000m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.8.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.8.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop-2.8.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.8.1/logs -Dhadoop.log.file=hadoop-hadoop-datanode-much.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.8.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/home/hadoop/hadoop-2.8.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -server -Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=ERROR,RFAS -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.datanode.DataNode\nhadoop    8511  0.2  6.5 2828548 263600 ?      Sl   14:11   0:08 /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.141-1.b16.el7_3.x86_64/bin/java -Dproc_secondarynamenode -Xmx1000m -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.8.1/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.8.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,console -Djava.library.path=/home/hadoop/hadoop-2.8.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/home/hadoop/hadoop-2.8.1/logs -Dhadoop.log.file=hadoop-hadoop-secondarynamenode-much.log -Dhadoop.home.dir=/home/hadoop/hadoop-2.8.1 -Dhadoop.id.str=hadoop -Dhadoop.root.logger=INFO,RFA -Djava.library.path=/home/hadoop/hadoop-2.8.1/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode\n[hadoop@much hadoop-2.8.1]$ sbin/stop-dfs.sh\nhadoop   11260  0.0  0.0 112648   960 pts/0    S+   15:17   0:00                  \__ grep --color=auto java\nbin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar wordcount ./21centry ./test_output\nhead -n 20 test_output/part-r-00000\nll hdfs/ -d\nfirewall-cmd --add-port 50070/tcp\nbin/hdfs dfs -put etc/hadoop/ /input\nbin/hdfs dfs -ls /input\nbin/hdfs dfs -ls /input/hadoop\nbin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8.1.jar grep /input/hadoop /output 'dfs[a-z.]+'\nbin/hdfs dfs -ls /output\nbin/hdfs dfs -cat /output/part-r-00000\nps faux | grep java


VIN: 3VWDB7AJ8HM396390 Stock: 350380\nJetta 1.4T SE 1.4L TSI Black Uni VW Certified, Purchased Brand New at Eich, EXCEPTIONAL LOCAL TRADE-IN, Power Sunroof/Moonroof, Rear-View Back-Up Camera, Alloy Wheels, Heated Leatherette Seating, SiriusXM & Bluetooth, Blind Spot Sensors, 4 Speakers, ABS brakes, Air Conditioning, CD player, Cruise Control, Illuminated entry, Outside temperature display, Radio: Composition Media w/6.3" Touchscreen, Rear window defroster, Split folding rear seat, Steering wheel mounted audio controls, Telescoping steering wheel, Tilt steering wheel, Variably intermittent wipers. CARFAX One-Owner. Clean CARFAX. Odometer is 6012 miles below market average! 28/38 City/Highway MPG


Watch an incredible Y: The Last Man fan film | CBR\nMore than five years after New Line Cinema acquired the film rights to Y: The Last Man, the acclaimed comic by Brian K. Vaughan and Pia Guerra, we seem little closer to seeing Yorick Brown and Ampersand on the big screen than we were in 2007. But likely for fans of the Eisner Award-winning series, Christian Cardona has taken an adaptation into his own hands with a stellar short film called Y: The Last Man Rising that's debuted at IGN.com.\nTags: vertigo, brian k vaughan, y the last man, pia guerra, fan films


Wool trousers, fuchsia - "NEBBIA" Max Mara\nStraight trousers in double wool crêpe with French pockets at the sides. Fastens with wide belt, covered zip and small hook.\nProduct code: 1136050906003 - NEBBIA


Gasmate Stellar Black Deluxe Patio Heater - PH7056 Price Online from $399 - MyShopping.com.au\nGasmate Stellar Black Deluxe Patio Heater Enjoy being outdoors allyearround thanks to this portable Gasmate Stellar Black Deluxe Patio Heater . It is designed with convenience and a widereaching effect in mind. Keep yourself and your guests warm thanks t More info...\nGasmate Stellar Black Deluxe Patio Heater -...\nGasmate Stellar Black Deluxe Patio Heater Enjoy being outdoors allyearround thanks to this portable Gasmate Stellar... More info...\nGasmate Stellar Black Deluxe Patio Heater ...\nFor anyone who enjoys being outside, there is no more effective way to provide warmth than with the Gasmate Stellar... More info...\nGasmate Stellar Black Deluxe Area Heater -...\nGasmate Stellar Black Deluxe Area Heater If your patio has a lowhanging ceiling, taller patio models might not work... More info...\nGasmate Stellar Black Deluxe Area Heater ...\nA stylish and effective outdoor heater, Gasmate Stellar Black Deluxe Area Heater is the perfect solution for outdoor... More info...\nGasmate Stellar Stainless Steel Deluxe Area Heater...\nGasmate Stellar Stainless Steel Deluxe Area Heater The Gasmate Stainless Steel Deluxe Area Heater is... More info...\nThe Gasmate Solaris Deluxe Ceramic Radiant Heater provides loads of comfortable radiant warmthÂ so you can enjoy the... More info...\nGasmate Deluxe Flame Heater (FH209ODS)\nThe Gasmate Deluxe Flame Heater provides the ultimate combination of warmth outdoors with the natural beauty of a... More info...\nProtecting your patio heater from the harsh weather and keeping it clean, the vinyl patio heater cover will ensure longevity... More info...\nGasmate Patio Heater Cover CPHD\nDescription Protecting your patio heater from the harsh weather and keeping it clean, the vinyl patio heater cover will... More info...\nDevanti 2000w Electric Outdoor Patio Heater -...\nThe perfect heater for any outdoor environment, the Devanti Electric Patio Heater is designed to provide sun-like warmth... More info...\nDevanti Gas Patio Outdoor LPG Heater Stand...\nThe perfect heater for any outdoor environment, the Gas Patio Heater is designed to provide sun-like warmth when you... More info...\nVolkswagen Passat 1998 Auto Parts\nTefal VC1451 Steamer\nCompare Grant 5894 Chrome Horn Button\nToyota Corolla 1994 Auto Body Parts\nBuy BMW E46 316Ti Pair Steering Rack Dust Boots 2000-2004 *Oetiker*\nSpears 839 Series PVC Pipe Fitting, Bushing, Schedule 80, 5.1cm - 1.3cm NPT Male x 5.1cm NPT Female\nPurchase Suction Lifters\nBuy Mitsubishi Heating 11.2KW Ducted System Air Conditioners\nMVP Air Flow Meter For Toyota NCP131R Yaris 1.5ltr 1NZFE 2011-On\n(1, Blue) - Wire Twisting Tools, Wire Stripper and Twister, Wire Terminals Power Tools for Stripping and Twisting Wire Cable (1, Blue)


Interesting Landscape Ultrahd K Nature Live Wallpapers - Nature 4k, Hd Wallpapers & backgrounds Download - Elsetge #580648\nInteresting Landscape Ultrahd K Nature Live Wallpapers - Nature 4k\nName Interesting Landscape Ultrahd K Nature Live Wallpapers - Nature 4k\n4k landscape nature hd nature nature hd 3d\nPrevious Wallpaper - Nature Desktop Backgrounds\nHd Nature Wallpaper Landscape Desktop Images Download - Nature Full Hd 4k\nNature Wallpaper Hd Desktop Free - Nature Background 4k\nWallpaper Lake Zurich, Forest, Sky, Mountains, 4k, - Chrome Backgrounds Landscapes\nBest Nature Wallpapers In 4 K And Full Hd For Desktop - Nature 4k\nLandscapes 4k Gallery - Dual Monitor Wallpaper 4k Nature\nButterfly, Nature, Animal, Forest, Color, Tree, Hdr, - Nature Ultra Hd 4k Hd Wallpapers For Phone\nWallpapers Wallpaper Hd 4k Autmn Landscape 4k Ultra - Beautiful Nature Ultra Hd Wallpapers For Desktop\nCustom Large Wallpapers For Walls 3d Natural Landscape - Tranh Ghép Treo Tường Game\nFull Hd Latest Wallpapers Download High Definiton Wallpapers - Landscape Paintings Canvas Prints Nature Art\nNature Wallpaper For Desktop Full Size Free Download - Great Landscape\nFoto Met Een Meer In De Bergen Met Helder Water - 4k Nature Desktop Backgrounds\nNature Is Beautiful 4k - Nature 4k\nGreen Nature 4k\nScenic View Of Lake During Daytime, 4k Wallpaper, Alps, - Nature\n#landscape, #nature, #4k, #wallpaper, #lake, #ultrahd, - Cool Lake\nHd Nature Wallpaper Fresh Landscape Desktop Images - Canada Forest Lakes\nFantasy Wonderland 3d Stereoscopic European Tv Backdrop - 3d Fantasy Wall Mural\nForest Wallpaper Nature Landscape - Desktop Backgrounds Free Forest\nNature Hd Wallpapers Landscape\nDesktop Snow Wallpaper Hd\nWallpaper Hd Free Download - Ultra Hd Forest 4k\n1920 X - Landscape Wallpaper 4k\nSpring Landscape Wallpapers, Mobile Compatible Spring - Spring Landscape Desktop Backgrounds\nLive Motion Wallpaper For Pc Free Download - Desktop Wallpapers For Windows 7 Free Download\nNature Wallpaper Rocks Sand And Sea Desktop Wallpapers - Nature Wallpaper For Desktop Full Size\nHottest New Design Nature Wallpaper Outside The Window - Nature Wallpapers For Living Room\nInteresting Landscape Ultrahd K Nature Live Wallpapers - Nature 4k is a free hd wallpaper & background picture for desktop or mobile device. Its resolution is 1024*576 and it is classified to nature hd 3d , nature hd for mobile , nature full hd . Explore more free hd wallpapers for desktop and phones on Elsetge.Cat.\nInteresting Landscape Ultrahd K Nature Live Wallpapers - Nature 4k @elsetge.cat\n


Twisted Taboo Tales 2 - Desperate Pleasures DVD Ne Kaufen!\nTwisted Taboo Tales 2 - Desperate Pleasures DVD Ne kaufen\n2 Tage, 15:23:03\nDienstag, 24. März 2020, 13:20:38\nbis Dienstag, 31. März 2020, 14:20:38\nTwisted Taboo Tales 2 - Desperate Pleasures DVD Ne - Artikelbeschreibung


Sniper Ghost Warrior 3 :: Steam Key for free - SteamUnlock.com\nSteamUnlock » Free Steam Keys » Action » Sniper Ghost Warrior 3 free steam key\nSniper Ghost Warrior 3 steam key free\nFree Sniper Ghost Warrior 3 cd key is now available on SteamUnlock.com. Free Steam Keys! FREE STEAM GAMES. Free games to download. Steam Giveaways. Games Key. Sniper Ghost Warrior 3 cd key free\nAbout Sniper Ghost Warrior 3 free steam key\nHow to get Sniper Ghost Warrior 3 key free\n5 - Unlock Sniper Ghost Warrior 3 cd key


ve thermo fans | eBay\nRefine your search for ve thermo fans\n14 results for ve thermo fans\nSave ve thermo fans to get email alerts and updates on your eBay Feed.\nUnfollow ve thermo fans to stop getting updates on your eBay Feed.\nve thermo fans:\nUsed VE Thermo Fans Holden Commodore Ute 3.6 Litre V6 Alloytec 92251624 LFX (Fits: [VE])\nSee more like thisUsed VE Thermo Fans Holden Commodore Ute 3.6 Litre V6 Alloytec 92251624 LFX\nUsed VE WM Thermo Fan 9 Blade Holden Commodore Statesman Caprice V8 K0818001 (Fits: [VE])\nSee more like thisUsed VE WM Thermo Fan 9 Blade Holden Commodore Statesman Caprice V8 K0818001\n2 x 7" 7 Inch 12V Reversible ELECTRIC Thermo COOLING FAN + MOUNTING KITS (Fits: [VE])\n7" 12V Slim Radiator Cooling Thermo Fan & Mounting kit MGA/MGB GT (Fits: [VE])\nUniversal 30 Row Engine Transmission 10AN Oil Cooler + 7 Inch Thermo Fan (Fits: [VE])\nGenuine VE HSV V8 LS2 6.0L Radiator & Thermo Fans Replacment WM V8 ONLY - KLR\nHolden Commodore VE V6 New Radiator Thermo Dual Fan Shroud Assembly\nSee more like thisHolden Commodore VE V6 New Radiator Thermo Dual Fan Shroud Assembly\nHolden Commodore VE V6 New Radiator Thermo Fan Shroud Assembly\nSee more like thisHolden Commodore VE V6 New Radiator Thermo Fan Shroud Assembly\nHOLDEN COMMODORE THERMO FAN New 06 ON, VE, V6, DUAL\nHolden Commodore RH Thermo Fan Cooling Blade VE & VF MYC MER Genuine 92277550\nSee more like thisHolden Commodore RH Thermo Fan Cooling Blade VE & VF MYC MER Genuine 92277550\nGenuine Holden Commodore VE 2012 - VF V6 Towing Pack Large Thermo Fan'S & Shroud\nFULLY ADJUSTABLE THERMO FAN CONTROL UNIT SUIT HOLDEN VB VC VH VK VL VR VE GEN3\nHolden Commodore VY VZ HSV V8 LS1 Calais Thermo / Engine Fans - 5-Pin\nHolden Vy / Vz Thermo fans used\nTHERMO FANS CHROME 16 INCH REVERSIBLE 250 WATT MOTOR SUPER DUTY INC CONTROLLER\nGenuine Holden VY SS & Calais LS1 Gen3 Twin Thermo radiator fans 5.7L V8\nSee more like thisCoolant Cooling Radiator Thermo Fans Assembly Ford EL Falcon Fairmont Fairlane\nTHERMO FANS BLACK 12 INCH REVERSIBLE 160 WATT MOTORS INC THERMO CONTROLLER\nSee more like thisTHERMO FANS BLACK 12 INCH REVERSIBLE 160 WATT MOTORS INC THERMO CONTROLLER\nTHERMO FANS BLACK 10 INCH REVERSIBLE 90 WATT MOTORS\nNissan Xtrail X-Trail Radiator Thermo Cooling Fans T30 2003-2007 *New*\nGenuine Holden WM Statesman & Caprice Twin Thermo radiator fans 6.0L V8\nGenuine VZ HSV Clubsport R8 Senator LS2 Twin Thermo radiator fans 6.0L V8\nDual 10 inch Thermo Fans Low Profile 2500cfm Reversible Flex-a-lite F310\nUsed VY Thermo Fans Holden Commodore Calais 3.8 Litre V6 Ecotec Genuine 92145770\nSee more like thisUsed VY Thermo Fans Holden Commodore Calais 3.8 Litre V6 Ecotec Genuine 92145770\nVx Ls1 Twin Thermo Fans\nTHERMO FANS CHROME 14 INCH REVERSIBLE 350 WATT MOTOR SUPA DUTY\nGenuine Holden WH Statesman & Caprice LS1 Gen3 Twin Thermo radiator fans 5.7L V8\nBf Falcon Thermo Fans\nSee more like thisUsed VY Thermo Fans Holden Commodore Berlina Calais 5.7 Litre V8 Gen 3 92145776\nGenuine Holden Commodore VX SS LS1 Gen3 Twin Thermo radiator fans 5.7L V8\nDAVIES CRAIG TWIN THERMO FANS\nFANS BLACK 7 INCH REVERSIBLE 90 WATT MOTOR INC THERMO CONTROLLER\nNissan Xtrail X-Trail Radiator Thermo Cooling Fans T30 2001-2003 *New*\n. Thermo fans\nTHERMO FANS CHROME 10 INCH REVERSIBLE 90 WATT MOTORS INC THERMO CONTROLLER\nVolkswagen VW Golf Mk4 Radiator Thermo Engine Fans 1998-2004 *New*\nGenuine Holden V6 L67 Ecotec 3.8L Twin Thermo Engine Cooling Fans - VY WK - KLR\nTHERMO FANS BLACK 10 INCH REVERSIBLE 90 WATT MOTOR INC THERMO CONTROLLER\nFANS BLACK 7 INCH REVERSIBLE 90 WATT MOTORS INC THERMO CONTROLLER\nSee more like thisFANS BLACK 7 INCH REVERSIBLE 90 WATT MOTORS INC THERMO CONTROLLER\nChrysler 300C Radiator Twin Thermo Cooling Fans V6 & V8 2005 Onwards *New*\nRadiator Twin Thermo Cooling Fans Assembly Ford BA BF Falcon Fairmont Fairlane


European Girls Adult Film Database - Wikipedy\nDe European Girls Adult Film Database, almeast ôfkoarte ta EGAFD, is in fergees te rieplachtsjen Britske kennisbank (database) op it ynternet, dy't besiket en hâld gegevens by oer alle pornografyske films en pornoaktrises út Jeropa. De namme betsjut: "Pornofilmkennisbank fan Jeropeeske Fammen". Nettsjinsteande dat binne manlike pornoakteurs ek opnommen. De EGAFD waard yn 2000 oprjochte. Yn 2015 omfieme de webside beskriuwings fan mear as 21.000 films en mear as 15.000 aktrises.\nDe EGAFD hâldt sels út dat de webside nea folslein wurde sil, mei't der altyd nije ynformaasje tafoege wurde kin. Nettsjinsteande dat besiket de webside om safolle mooglike gegevens op it mêd fan 'e Jeropeeske pornografyske filmyndustry te sammeljen en yn te dielen en dêrby sa mooglik as oanfolling op 'e IMDb en de IAFD te fungearjen. De gearstallers fan 'e EGAFD jouwe dúdlik de foarkar oan feature-films, d.w.s. films mei in plot, ynstee fan gonzopornografy: in opienfolging fan losse sekssênes. Om't der yn 'e 1970-er jierren mar kwealk ûnderskie makke waard tusken hurde en sêfte pornografy, wêrby't aktrises yn beide sjenres tagelyk wurksum wiene, binne yn 'e EGAFD, alteast út dy tiid, ek softcore-films en -aktrises opnommen.\nDe EGAFD hat foar aktrises sawol in alfabetyske ynhâldsopjefte as in sykfunksje. De ûnderskate lemma's hawwe in foto mei in seksje mei biografyske gegevens (pseudonimen, bertedatum en -jier, nasjonaliteit en eventuële boarstfergruttings en tatoeaazjes), en fierders in filmografy, in list mei wûne prizen, keppelings nei offisjele websiden en/of fansites en in link nei in fotogallery. De lemma's fan manlike akteurs binne beheinder, mei allinnich persoanlike ynformaasje en yn guon gefallen in foto. Foar films is in wiidweidige seksje mei gegevens opnommen, mei û.m. jier fan makkelei, regisseur, filmstudio, akteurs en aktrises en keppelings nei websiden dêr't de film ferkocht wurdt.\n(in) Offisjele webside fan 'e European Girls Adult Film Database\nYnformaasje oer de European Girls Adult Film Database\nYndeks fan 'e European Girls Adult Film Database\nUntfongen fan "https://fy.wikipedia.org/w/index.php?title=European_Girls_Adult_Film_Database&oldid=899397"\nDizze side is it lêst bewurke op 19 okt 2017 om 17.17.


MajorHAWKER, LANOE GEORGE\nSon of Mrs Julia Hawker, of 5, Victoria Terrace, Eastbourne and the late Lieut. Henry Colley Hawker, R.N.\nAn extract from The London Gazette, dated 24th Aug., 1915, records the following\n"For most conspicuous bravery and very great ability on 25th July, 1915. When flying alone he attacked three German aeroplanes in succession. The first managed eventually to escape, the second was driven to ground damaged, and the third, which he attacked at a height of about 10,000 feet, was driven to earth in our lines, the pilot and observer being killed. The personal bravery shown by this Officer was of the very highest order, as the enemy's aircraft were armed with machine guns, and all carried a passenger as well as the pilot."


Play-off:Dijkstra kin meidwaan | Omrop Fryslân (advertinsje)\nPlay-off:Dijkstra kin meidwaan 05 mrt 2013 - 11:05\nIIshockeyer Sander Dijkstra fan Unis Flyers op It Hearrenfean hat in skorsing fan in jier ûnder betingst krigen fanwege doping. Dat meldt foarsitter Henk Hoekstra fan de Flyers. Dêrnjonken hat Dijkstra in proeftiid fan twa jier krigen. Dijkstra waard ferline jier oktober betrape op it brûken fan in ferbean foedingsupplemint, wêrtroch er earder herstelde. It foedingsupplemint is tastien by it trainen, mar net by wedstriden. De dopingsaak fan Dijkstra waard moandeitejûn behannele foar de tuchtkommisje fan it IIshockeybûn.\nNo't Dijkstra in skorsing ûnder betingst krigen hat, kin er kommende freed gewoan meidwaan yn de play-offwedstriid tsjin de Tilburch Trappers.\nKorreksje meldeLês foarTrefwurden: FlyersiishockeyUNIS FlyersSander DijkstraView the discussion thread.Diel dit berjocht op: 05-03Hieren omheech yn Fryslân 05-03Stiensgeaster oppakt om drugs Besjoch ek...\nUNIS Flyers te sterk foar Herentals 15 jan 2017 - 19:49 De iishockeyers fan UNIS Flyers hawwe sneintejûn de kompetysjewedstriid tsjin Herentals wûn mei 5-2. Perioadestannen: 2-1, 1-0 en 2-1. De Flyers... UNIS Flyers yn ferlinging nei winst yn Amsterdam 13 jan 2017 - 23:03 De iishockeyers fan de UNIS Flyers hawwe freedtejûn yn Amsterdam mei 4-3 wûn fan de Amstel Tijgers. Nei de earste perioade stie de ploech fan It... UNIS Flyers wint mei oermacht fan GIJS Grins 07 jan 2017 - 23:37 UNIS Flyers hat sneontejûn mei oermacht wûn fan GIJS út Grins. Op it iis fan Thialf drûgen de iishockeyers fan It Hearrenfean de Grinzers mei 11-1... UNIS Flyers wint fan Nijmegen 06 jan 2017 - 23:11 UNIS Flyers hat har útwedstriid mei 5-1 wûn yn en tsjin Nijmegen. De Flyers kamen op efterstân mar bûgden dat al nei 7 minuten om doe't Kevin... (advertinsje)