Hadoop-2.7.1运行wordcount报错

Question

如题，Hadoop-2.7.1运行wordcount报错，但mapreduce已经执行完成并结果正确

bash：

[wukong@bd01 mapreduce]$ hadoop jar hadoop-mapreduce-examples-2.7.1.jar wordcount /user/wukong/lin /user/wukong/lin/out
15/08/01 18:14:48 INFO client.RMProxy: Connecting to ResourceManager at bd01/192.168.1.21:8032
15/08/01 18:14:51 INFO input.FileInputFormat: Total input paths to process : 2
15/08/01 18:14:52 INFO mapreduce.JobSubmitter: number of splits:2
15/08/01 18:14:54 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1438424028370_0001
15/08/01 18:14:55 INFO impl.YarnClientImpl: Submitted application application_1438424028370_0001
15/08/01 18:14:55 INFO mapreduce.Job: The url to track the job: http://bd01:8088/proxy/application_1438424028370_0001/
15/08/01 18:14:55 INFO mapreduce.Job: Running job: job_1438424028370_0001
15/08/01 18:15:07 INFO mapreduce.Job: Job job_1438424028370_0001 running in uber mode : false
15/08/01 18:15:07 INFO mapreduce.Job:  map 0% reduce 0%
15/08/01 18:15:40 INFO mapreduce.Job:  map 100% reduce 0%
15/08/01 18:15:49 INFO mapreduce.Job:  map 100% reduce 100%
15/08/01 18:16:02 INFO mapreduce.Job:  map 0% reduce 0%
15/08/01 18:16:02 INFO mapreduce.Job: Job job_1438424028370_0001 failed with state FAILED due to: Application application_1438424028370_0001 failed 2 times due to AM Container for appattempt_1438424028370_0001_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://bd01:8088/cluster/app/application_1438424028370_0001Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1438424028370_0001_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
        at org.apache.hadoop.util.Shell.run(Shell.java:456)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
15/08/01 18:16:02 INFO mapreduce.Job: Counters: 0
[wukong@bd01 mapreduce]$ 

application webui 截图

appattempt_1438424028370_0001_000001日志

2015-08-01 18:15:00,097 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1438424028370_0001_000001
2015-08-01 18:15:01,459 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-08-01 18:15:01,624 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-08-01 18:15:01,624 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1438424028370 } attemptId: 1 } keyId: 438995804)
2015-08-01 18:15:02,130 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2015-08-01 18:15:03,697 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null
2015-08-01 18:15:03,777 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: File Output Committer Algorithm version is 1
2015-08-01 18:15:03,780 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2015-08-01 18:15:03,811 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2015-08-01 18:15:03,813 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher
2015-08-01 18:15:03,827 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher
2015-08-01 18:15:03,828 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher
2015-08-01 18:15:03,829 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler
2015-08-01 18:15:03,836 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher
2015-08-01 18:15:03,836 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2015-08-01 18:15:03,848 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter
2015-08-01 18:15:03,906 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:15:03,943 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:15:03,973 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:15:03,987 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
2015-08-01 18:15:04,080 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2015-08-01 18:15:04,518 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-08-01 18:15:04,597 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-08-01 18:15:04,597 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
2015-08-01 18:15:04,607 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1438424028370_0001 to jobTokenSecretManager
2015-08-01 18:15:04,788 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Not uberizing job_1438424028370_0001 because: not enabled;
2015-08-01 18:15:04,809 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1438424028370_0001 = 25. Number of splits = 2
2015-08-01 18:15:04,813 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1438424028370_0001 = 1
2015-08-01 18:15:04,813 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1438424028370_0001Job Transitioned from NEW to INITED
2015-08-01 18:15:04,816 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster launching normal, non-uberized, multi-container job job_1438424028370_0001.
2015-08-01 18:15:04,906 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-08-01 18:15:04,917 INFO [Socket Reader #1 for port 38485] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 38485
2015-08-01 18:15:04,938 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server
2015-08-01 18:15:04,944 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at bd02/192.168.1.22:38485
2015-08-01 18:15:04,941 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-08-01 18:15:04,943 INFO [IPC Server listener on 38485] org.apache.hadoop.ipc.Server: IPC Server listener on 38485: starting
2015-08-01 18:15:05,070 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-08-01 18:15:05,081 INFO [main] org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2015-08-01 18:15:05,109 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined
2015-08-01 18:15:05,137 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter)
2015-08-01 18:15:05,143 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce
2015-08-01 18:15:05,143 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static
2015-08-01 18:15:05,175 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/*
2015-08-01 18:15:05,175 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/*
2015-08-01 18:15:05,195 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 55536
2015-08-01 18:15:05,195 INFO [main] org.mortbay.log: jetty-6.1.26
2015-08-01 18:15:05,266 INFO [main] org.mortbay.log: Extract jar:file:/home/wukong/local/hadoop-2.7.1/share/hadoop/yarn/hadoop-yarn-common-2.7.1.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_55536_mapreduce____.gryqdb/webapp
2015-08-01 18:15:05,666 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:55536
2015-08-01 18:15:05,666 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 55536
2015-08-01 18:15:06,174 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules
2015-08-01 18:15:06,181 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: JOB_CREATE job_1438424028370_0001
2015-08-01 18:15:06,186 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue
2015-08-01 18:15:06,187 INFO [Socket Reader #1 for port 35110] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 35110
2015-08-01 18:15:06,195 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting
2015-08-01 18:15:06,196 INFO [IPC Server listener on 35110] org.apache.hadoop.ipc.Server: IPC Server listener on 35110: starting
2015-08-01 18:15:06,248 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
2015-08-01 18:15:06,248 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
2015-08-01 18:15:06,248 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
2015-08-01 18:15:06,363 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at bd01/192.168.1.21:8030
2015-08-01 18:15:06,716 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: <memory:8192, vCores:32>
2015-08-01 18:15:06,716 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2015-08-01 18:15:06,737 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Upper limit on the thread pool size is 500
2015-08-01 18:15:06,737 INFO [main] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: The thread pool initial size is 10
2015-08-01 18:15:06,741 INFO [main] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: yarn.client.max-cached-nodemanagers-proxies : 0
2015-08-01 18:15:06,752 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1438424028370_0001Job Transitioned from INITED to SETUP
2015-08-01 18:15:06,764 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP
2015-08-01 18:15:07,928 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1438424028370_0001Job Transitioned from SETUP to RUNNING
2015-08-01 18:15:07,961 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd02 to /default-rack
2015-08-01 18:15:07,964 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd03 to /default-rack
2015-08-01 18:15:07,966 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_m_000000 Task Transitioned from NEW to SCHEDULED
2015-08-01 18:15:07,967 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd02 to /default-rack
2015-08-01 18:15:07,967 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd03 to /default-rack
2015-08-01 18:15:07,967 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_m_000001 Task Transitioned from NEW to SCHEDULED
2015-08-01 18:15:07,967 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_r_000000 Task Transitioned from NEW to SCHEDULED
2015-08-01 18:15:07,968 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2015-08-01 18:15:07,968 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000001_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2015-08-01 18:15:07,968 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_r_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED
2015-08-01 18:15:07,970 INFO [Thread-50] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: mapResourceRequest:<memory:1024, vCores:1>
2015-08-01 18:15:07,975 INFO [Thread-50] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: reduceResourceRequest:<memory:1024, vCores:1>
2015-08-01 18:15:08,224 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1438424028370_0001, File: hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job_1438424028370_0001_1.jhist
2015-08-01 18:15:08,820 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:2 ScheduledReds:0 AssignedMaps:0 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:0 ContRel:0 HostLocal:0 RackLocal:0
2015-08-01 18:15:08,831 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1438424028370_0001: ask=4 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:14336, vCores:1> knownNMs=2
2015-08-01 18:15:08,834 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:14336, vCores:1>
2015-08-01 18:15:08,834 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
2015-08-01 18:15:10,169 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 2
2015-08-01 18:15:10,170 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1438424028370_0001_01_000002 to attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:10,173 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1438424028370_0001_01_000003 to attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:10,173 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:12288, vCores:1>
2015-08-01 18:15:10,173 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold not met. completedMapsForReduceSlowstart 1
2015-08-01 18:15:10,173 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:0 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:2 RackLocal:0
2015-08-01 18:15:10,251 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd03 to /default-rack
2015-08-01 18:15:10,277 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job.jar
2015-08-01 18:15:10,284 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job.xml
2015-08-01 18:15:10,286 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container
2015-08-01 18:15:10,286 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1
2015-08-01 18:15:10,286 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData
2015-08-01 18:15:10,317 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2015-08-01 18:15:10,320 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd03 to /default-rack
2015-08-01 18:15:10,320 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000001_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2015-08-01 18:15:10,324 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1438424028370_0001_01_000002 taskAttempt attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:10,332 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:10,335 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1438424028370_0001_01_000003 taskAttempt attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:10,336 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:10,334 INFO [ContainerLauncher #0] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : bd03:60090
2015-08-01 18:15:10,361 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : bd03:60090
2015-08-01 18:15:11,228 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1438424028370_0001: ask=4 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:12288, vCores:1> knownNMs=2
2015-08-01 18:15:11,476 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1438424028370_0001_m_000001_0 : 13562
2015-08-01 18:15:11,478 INFO [ContainerLauncher #0] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1438424028370_0001_m_000000_0 : 13562
2015-08-01 18:15:11,481 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1438424028370_0001_m_000001_0] using containerId: [container_1438424028370_0001_01_000003 on NM: [bd03:60090]
2015-08-01 18:15:11,486 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000001_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2015-08-01 18:15:11,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1438424028370_0001_m_000000_0] using containerId: [container_1438424028370_0001_01_000002 on NM: [bd03:60090]
2015-08-01 18:15:11,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2015-08-01 18:15:11,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1438424028370_0001_m_000001
2015-08-01 18:15:11,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_m_000001 Task Transitioned from SCHEDULED to RUNNING
2015-08-01 18:15:11,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1438424028370_0001_m_000000
2015-08-01 18:15:11,487 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_m_000000 Task Transitioned from SCHEDULED to RUNNING
2015-08-01 18:15:19,978 INFO [Socket Reader #1 for port 35110] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1438424028370_0001 (auth:SIMPLE)
2015-08-01 18:15:20,118 INFO [IPC Server handler 25 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1438424028370_0001_m_000003 asked for a task
2015-08-01 18:15:20,118 INFO [IPC Server handler 25 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1438424028370_0001_m_000003 given task: attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:20,190 INFO [Socket Reader #1 for port 35110] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1438424028370_0001 (auth:SIMPLE)
2015-08-01 18:15:20,335 INFO [IPC Server handler 25 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1438424028370_0001_m_000002 asked for a task
2015-08-01 18:15:20,335 INFO [IPC Server handler 25 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1438424028370_0001_m_000002 given task: attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:34,227 INFO [Socket Reader #1 for port 35110] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1438424028370_0001 (auth:SIMPLE)
2015-08-01 18:15:34,228 INFO [Socket Reader #1 for port 35110] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1438424028370_0001 (auth:SIMPLE)
2015-08-01 18:15:36,447 INFO [IPC Server handler 28 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_m_000001_0 is : 0.0
2015-08-01 18:15:36,480 INFO [IPC Server handler 27 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_m_000000_0 is : 0.0
2015-08-01 18:15:39,143 INFO [IPC Server handler 23 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_m_000000_0 is : 1.0
2015-08-01 18:15:39,151 INFO [IPC Server handler 22 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_m_000001_0 is : 1.0
2015-08-01 18:15:39,157 INFO [IPC Server handler 21 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:39,158 INFO [IPC Server handler 21 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:39,160 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000000_0 TaskAttempt Transitioned from RUNNING to SUCCESS_CONTAINER_CLEANUP
2015-08-01 18:15:39,161 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000001_0 TaskAttempt Transitioned from RUNNING to SUCCESS_CONTAINER_CLEANUP
2015-08-01 18:15:39,162 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1438424028370_0001_01_000002 taskAttempt attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:39,162 INFO [ContainerLauncher #2] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:39,163 INFO [ContainerLauncher #2] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : bd03:60090
2015-08-01 18:15:39,170 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1438424028370_0001_01_000003 taskAttempt attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:39,171 INFO [ContainerLauncher #3] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:39,171 INFO [ContainerLauncher #3] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : bd03:60090
2015-08-01 18:15:39,428 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-08-01 18:15:39,450 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1438424028370_0001_m_000000_0
2015-08-01 18:15:39,452 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_m_000000 Task Transitioned from RUNNING to SUCCEEDED
2015-08-01 18:15:39,455 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2015-08-01 18:15:39,465 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Before Scheduling: PendingReds:1 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:2 AssignedReds:0 CompletedMaps:1 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:2 RackLocal:0
2015-08-01 18:15:39,467 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_m_000001_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-08-01 18:15:39,467 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1438424028370_0001_m_000001_0
2015-08-01 18:15:39,468 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_m_000001 Task Transitioned from RUNNING to SUCCEEDED
2015-08-01 18:15:39,468 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 2
2015-08-01 18:15:39,469 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Recalculating schedule, headroom=<memory:12288, vCores:1>
2015-08-01 18:15:39,469 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Reduce slow start threshold reached. Scheduling reduces.
2015-08-01 18:15:39,469 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: All maps assigned. Ramping up all remaining reduces:1
2015-08-01 18:15:39,470 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:1 AssignedMaps:2 AssignedReds:0 CompletedMaps:2 CompletedReds:0 ContAlloc:2 ContRel:0 HostLocal:2 RackLocal:0
2015-08-01 18:15:40,477 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1438424028370_0001: ask=1 release= 0 newContainers=0 finishedContainers=0 resourcelimit=<memory:12288, vCores:1> knownNMs=2
2015-08-01 18:15:41,517 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Got allocated containers 1
2015-08-01 18:15:41,517 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned to reduce
2015-08-01 18:15:41,517 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Assigned container container_1438424028370_0001_01_000004 to attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:41,517 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:2 AssignedReds:1 CompletedMaps:2 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
2015-08-01 18:15:41,525 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved bd02 to /default-rack
2015-08-01 18:15:41,526 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_r_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED
2015-08-01 18:15:41,529 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1438424028370_0001_01_000004 taskAttempt attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:41,529 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Launching attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:41,529 INFO [ContainerLauncher #4] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : bd02:54522
2015-08-01 18:15:41,547 INFO [ContainerLauncher #4] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Shuffle port returned by ContainerManager for attempt_1438424028370_0001_r_000000_0 : 13562
2015-08-01 18:15:41,548 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1438424028370_0001_r_000000_0] using containerId: [container_1438424028370_0001_01_000004 on NM: [bd02:54522]
2015-08-01 18:15:41,548 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_r_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING
2015-08-01 18:15:41,548 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator: ATTEMPT_START task_1438424028370_0001_r_000000
2015-08-01 18:15:41,549 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_r_000000 Task Transitioned from SCHEDULED to RUNNING
2015-08-01 18:15:42,534 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: getResources() for application_1438424028370_0001: ask=1 release= 0 newContainers=0 finishedContainers=2 resourcelimit=<memory:13312, vCores:1> knownNMs=2
2015-08-01 18:15:42,534 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1438424028370_0001_01_000002
2015-08-01 18:15:42,535 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Received completed container container_1438424028370_0001_01_000003
2015-08-01 18:15:42,535 INFO [RMCommunicator Allocator] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: After Scheduling: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
2015-08-01 18:15:42,535 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1438424028370_0001_m_000000_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-08-01 18:15:42,536 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1438424028370_0001_m_000001_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2015-08-01 18:15:44,450 INFO [Socket Reader #1 for port 35110] SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for job_1438424028370_0001 (auth:SIMPLE)
2015-08-01 18:15:44,481 INFO [IPC Server handler 27 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID : jvm_1438424028370_0001_r_000004 asked for a task
2015-08-01 18:15:44,481 INFO [IPC Server handler 27 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: JVM with ID: jvm_1438424028370_0001_r_000004 given task: attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:46,756 INFO [IPC Server handler 26 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1438424028370_0001_r_000000_0. startIndex 0 maxEvents 10000
2015-08-01 18:15:47,768 INFO [IPC Server handler 23 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: MapCompletionEvents request from attempt_1438424028370_0001_r_000000_0. startIndex 2 maxEvents 10000
2015-08-01 18:15:47,960 INFO [IPC Server handler 22 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_r_000000_0 is : 0.0
2015-08-01 18:15:48,006 INFO [IPC Server handler 21 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_r_000000_0 is : 0.0
2015-08-01 18:15:48,722 INFO [IPC Server handler 26 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit-pending state update from attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:48,723 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_r_000000_0 TaskAttempt Transitioned from RUNNING to COMMIT_PENDING
2015-08-01 18:15:48,723 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: attempt_1438424028370_0001_r_000000_0 given a go for committing the task output.
2015-08-01 18:15:48,736 INFO [IPC Server handler 23 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Commit go/no-go request from attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:48,737 INFO [IPC Server handler 23 on 35110] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Result of canCommit for attempt_1438424028370_0001_r_000000_0:true
2015-08-01 18:15:48,825 INFO [IPC Server handler 22 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1438424028370_0001_r_000000_0 is : 1.0
2015-08-01 18:15:48,840 INFO [IPC Server handler 21 on 35110] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Done acknowledgement from attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:48,842 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_r_000000_0 TaskAttempt Transitioned from COMMIT_PENDING to SUCCESS_CONTAINER_CLEANUP
2015-08-01 18:15:48,854 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1438424028370_0001_01_000004 taskAttempt attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:48,854 INFO [ContainerLauncher #5] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:48,854 INFO [ContainerLauncher #5] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : bd02:54522
2015-08-01 18:15:48,912 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1438424028370_0001_r_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2015-08-01 18:15:48,912 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1438424028370_0001_r_000000_0
2015-08-01 18:15:48,912 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1438424028370_0001_r_000000 Task Transitioned from RUNNING to SUCCEEDED
2015-08-01 18:15:48,913 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 3
2015-08-01 18:15:48,913 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1438424028370_0001Job Transitioned from RUNNING to COMMITTING
2015-08-01 18:15:48,950 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
2015-08-01 18:15:49,152 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Calling handler for JobFinishedEvent 
2015-08-01 18:15:49,153 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1438424028370_0001Job Transitioned from COMMITTING to SUCCEEDED
2015-08-01 18:15:49,165 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry
2015-08-01 18:15:49,165 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true
2015-08-01 18:15:49,165 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: RMCommunicator notified that shouldUnregistered is: true
2015-08-01 18:15:49,165 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true
2015-08-01 18:15:49,165 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true
2015-08-01 18:15:49,165 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services
2015-08-01 18:15:49,166 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
2015-08-01 18:15:49,280 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job_1438424028370_0001_1.jhist to hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001-1438424094960-wukong-word+count-1438424149149-2-1-SUCCEEDED-default-1438424106747.jhist_tmp
2015-08-01 18:15:49,355 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001-1438424094960-wukong-word+count-1438424149149-2-1-SUCCEEDED-default-1438424106747.jhist_tmp
2015-08-01 18:15:49,367 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job_1438424028370_0001_1_conf.xml to hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001_conf.xml_tmp
2015-08-01 18:15:49,427 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001_conf.xml_tmp
2015-08-01 18:15:49,448 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001.summary_tmp to hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001.summary
2015-08-01 18:15:49,457 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001_conf.xml_tmp to hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001_conf.xml
2015-08-01 18:15:49,467 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001-1438424094960-wukong-word+count-1438424149149-2-1-SUCCEEDED-default-1438424106747.jhist_tmp to hdfs://bd01:9000/tmp/hadoop-yarn/staging/history/done_intermediate/wukong/job_1438424028370_0001-1438424094960-wukong-word+count-1438424149149-2-1-SUCCEEDED-default-1438424106747.jhist
2015-08-01 18:15:49,468 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop()
2015-08-01 18:15:49,470 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Setting job diagnostics to 
2015-08-01 18:15:49,471 ERROR [Thread-74] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: Exception while unregistering 
java.util.NoSuchElementException
    at com.google.common.base.AbstractIterator.next(AbstractIterator.java:75)
    at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithoutScheme(MRWebAppUtil.java:130)
    at org.apache.hadoop.mapreduce.v2.util.MRWebAppUtil.getApplicationWebURLOnJHSWithScheme(MRWebAppUtil.java:155)
    at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.doUnregistration(RMCommunicator.java:218)
    at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.unregister(RMCommunicator.java:188)
    at org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator.serviceStop(RMCommunicator.java:268)
    at org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.serviceStop(RMContainerAllocator.java:288)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter.serviceStop(MRAppMaster.java:846)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
    at org.apache.hadoop.service.ServiceOperations.stop(ServiceOperations.java:52)
    at org.apache.hadoop.service.ServiceOperations.stopQuietly(ServiceOperations.java:80)
    at org.apache.hadoop.service.CompositeService.stop(CompositeService.java:157)
    at org.apache.hadoop.service.CompositeService.serviceStop(CompositeService.java:131)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStop(MRAppMaster.java:1626)
    at org.apache.hadoop.service.AbstractService.stop(AbstractService.java:221)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.stop(MRAppMaster.java:1126)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.shutDownJob(MRAppMaster.java:561)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler$1.run(MRAppMaster.java:609)
2015-08-01 18:15:49,472 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Final Stats: PendingReds:0 ScheduledMaps:0 ScheduledReds:0 AssignedMaps:0 AssignedReds:1 CompletedMaps:2 CompletedReds:0 ContAlloc:3 ContRel:0 HostLocal:2 RackLocal:0
2015-08-01 18:15:49,472 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Skipping cleaning up the staging dir. assuming AM will be retried.
2015-08-01 18:15:49,472 INFO [Thread-74] org.apache.hadoop.ipc.Server: Stopping server on 35110
2015-08-01 18:15:49,475 INFO [IPC Server listener on 35110] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 35110
2015-08-01 18:15:49,476 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder
2015-08-01 18:15:49,476 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler 

appattempt_1438424028370_0001_000002日志

2015-08-01 18:15:56,905 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1438424028370_0001_000002
2015-08-01 18:15:57,940 WARN [main] org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-08-01 18:15:58,070 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2015-08-01 18:15:58,070 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 1 cluster_timestamp: 1438424028370 } attemptId: 2 } keyId: 438995804)
2015-08-01 18:15:58,446 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2015-08-01 18:15:59,756 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Attempt num: 2 is last retry: true because a commit was started.
2015-08-01 18:15:59,759 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$NoopEventHandler
2015-08-01 18:15:59,786 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler
2015-08-01 18:15:59,790 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter
2015-08-01 18:15:59,899 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:15:59,938 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:15:59,969 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:15:59,986 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Emitting job history data to the timeline server is not enabled
2015-08-01 18:15:59,987 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Will not try to recover. recoveryEnabled: true recoverySupportedByCommitter: false numReduceTasks: 1 shuffleKeyValidForRecovery: true ApplicationAttemptID: 2
2015-08-01 18:16:00,015 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:16:00,022 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Previous history file is at hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job_1438424028370_0001_1.jhist
2015-08-01 18:16:00,712 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler
2015-08-01 18:16:00,769 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-08-01 18:16:00,883 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-08-01 18:16:00,883 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started
2015-08-01 18:16:00,908 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: nodeBlacklistingEnabled:true
2015-08-01 18:16:00,908 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: maxTaskFailuresPerNode is 3
2015-08-01 18:16:00,908 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerRequestor: blacklistDisablePercent is 33
2015-08-01 18:16:00,969 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at bd01/192.168.1.21:8030
2015-08-01 18:16:01,065 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: maxContainerCapability: <memory:8192, vCores:32>
2015-08-01 18:16:01,065 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMCommunicator: queue: default
2015-08-01 18:16:01,116 INFO [main] org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils: Default file system [hdfs://bd01:9000]
2015-08-01 18:16:01,122 INFO [main] org.apache.hadoop.mapreduce.jobhistory.JobHistoryCopyService: History file is at hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job_1438424028370_0001_1.jhist
2015-08-01 18:16:01,366 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1438424028370_0001, File: hdfs://bd01:9000/tmp/hadoop-yarn/staging/wukong/.staging/job_1438424028370_0001/job_1438424028370_0001_2.jhist
2015-08-01 18:16:01,674 WARN [main] org.apache.hadoop.hdfs.DFSClient: DFSInputStream has been closed already
2015-08-01 18:16:01,676 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.io.IOException: Was asked to shut down.
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1521)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
2015-08-01 18:16:01,679 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1

Answer 1

mapred-site.xml写错了：

mapreduce.jobhistory.webapp.address
bd01.19888

Answer 2

解决了么，哥们