Created
September 25, 2014 09:26
-
-
Save AndreasHoermandinger/a89ec7df4334fa2c98e0 to your computer and use it in GitHub Desktop.
(Crash)Logs of hadoop(2.5.1) mapreduce and pig with elasticsearch-hadoop running in uber mode
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2014-09-25 17:01:22,666 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1411539203871_0014_000001 | |
| 2014-09-25 17:01:23,137 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 17:01:23,157 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 17:01:23,304 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: | |
| 2014-09-25 17:01:23,304 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@4888b7ec) | |
| 2014-09-25 17:01:23,352 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2 for application: 14. Attempt num: 1 is last retry: false | |
| 2014-09-25 17:01:23,358 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter. | |
| 2014-09-25 17:01:23,640 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 17:01:23,667 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 17:01:24,491 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null | |
| 2014-09-25 17:01:24,564 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter | |
| 2014-09-25 17:01:24,590 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler | |
| 2014-09-25 17:01:24,591 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher | |
| 2014-09-25 17:01:24,592 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher | |
| 2014-09-25 17:01:24,593 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher | |
| 2014-09-25 17:01:24,594 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler | |
| 2014-09-25 17:01:24,601 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher | |
| 2014-09-25 17:01:24,602 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter | |
| 2014-09-25 17:01:24,603 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter | |
| 2014-09-25 17:01:24,672 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler | |
| 2014-09-25 17:01:25,006 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties | |
| 2014-09-25 17:01:25,097 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). | |
| 2014-09-25 17:01:25,097 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started | |
| 2014-09-25 17:01:25,111 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1411539203871_0014 to jobTokenSecretManager | |
| 2014-09-25 17:01:25,289 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Uberizing job job_1411539203871_0014: 5m+0r tasks (5 input bytes) will run sequentially on single node. | |
| 2014-09-25 17:01:25,318 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1411539203871_0014 = 5. Number of splits = 5 | |
| 2014-09-25 17:01:25,318 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1411539203871_0014 = 0 | |
| 2014-09-25 17:01:25,318 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0014Job Transitioned from NEW to INITED | |
| 2014-09-25 17:01:25,319 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster uberizing job job_1411539203871_0014 in local container ("uber-AM") on node dev-el-hd-perf010.ncl.someserver.com:41686. | |
| 2014-09-25 17:01:25,394 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2014-09-25 17:01:25,407 INFO [Socket Reader #1 for port 50032] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 50032 | |
| 2014-09-25 17:01:25,431 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server | |
| 2014-09-25 17:01:25,432 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2014-09-25 17:01:25,433 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at dev-el-hd-perf010.ncl.someserver.com/someip:50032 | |
| 2014-09-25 17:01:25,434 INFO [IPC Server listener on 50032] org.apache.hadoop.ipc.Server: IPC Server listener on 50032: starting | |
| 2014-09-25 17:01:25,518 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | |
| 2014-09-25 17:01:25,524 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined | |
| 2014-09-25 17:01:25,543 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) | |
| 2014-09-25 17:01:25,558 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce | |
| 2014-09-25 17:01:25,559 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static | |
| 2014-09-25 17:01:25,568 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/localhost | |
| 2014-09-25 17:01:25,569 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/localhost | |
| 2014-09-25 17:01:25,583 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 36393 | |
| 2014-09-25 17:01:25,584 INFO [main] org.mortbay.log: jetty-6.1.26 | |
| 2014-09-25 17:01:25,624 INFO [main] org.mortbay.log: Extract jar:file:/home/hadoop/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.5.1.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_36393_mapreduce____h1xqjz/webapp | |
| 2014-09-25 17:01:25,964 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:36393 | |
| 2014-09-25 17:01:25,964 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 36393 | |
| 2014-09-25 17:01:26,487 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules | |
| 2014-09-25 17:01:26,493 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2014-09-25 17:01:26,494 INFO [Socket Reader #1 for port 34697] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 34697 | |
| 2014-09-25 17:01:26,502 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2014-09-25 17:01:26,503 INFO [IPC Server listener on 34697] org.apache.hadoop.ipc.Server: IPC Server listener on 34697: starting | |
| 2014-09-25 17:01:26,606 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 17:01:26,615 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 17:01:26,621 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /someip:8030 | |
| 2014-09-25 17:01:26,702 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: 8192 | |
| 2014-09-25 17:01:26,702 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: queue: default | |
| 2014-09-25 17:01:26,816 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0014Job Transitioned from INITED to SETUP | |
| 2014-09-25 17:01:26,823 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP | |
| 2014-09-25 17:01:26,857 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0014Job Transitioned from SETUP to RUNNING | |
| 2014-09-25 17:01:26,932 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf004.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:26,940 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000000 Task Transitioned from NEW to SCHEDULED | |
| 2014-09-25 17:01:26,940 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:26,941 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000001 Task Transitioned from NEW to SCHEDULED | |
| 2014-09-25 17:01:26,956 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf003.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:26,956 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000002 Task Transitioned from NEW to SCHEDULED | |
| 2014-09-25 17:01:26,957 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf008.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:26,957 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000003 Task Transitioned from NEW to SCHEDULED | |
| 2014-09-25 17:01:26,958 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf002.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:26,958 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000004 Task Transitioned from NEW to SCHEDULED | |
| 2014-09-25 17:01:26,976 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED | |
| 2014-09-25 17:01:26,977 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000001_0 TaskAttempt Transitioned from NEW to UNASSIGNED | |
| 2014-09-25 17:01:26,977 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000002_0 TaskAttempt Transitioned from NEW to UNASSIGNED | |
| 2014-09-25 17:01:26,977 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000003_0 TaskAttempt Transitioned from NEW to UNASSIGNED | |
| 2014-09-25 17:01:26,977 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000004_0 TaskAttempt Transitioned from NEW to UNASSIGNED | |
| 2014-09-25 17:01:26,977 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.local.LocalContainerAllocator: Processing the event EventType: CONTAINER_REQ | |
| 2014-09-25 17:01:27,032 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.local.LocalContainerAllocator: Processing the event EventType: CONTAINER_REQ | |
| 2014-09-25 17:01:27,032 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.local.LocalContainerAllocator: Processing the event EventType: CONTAINER_REQ | |
| 2014-09-25 17:01:27,040 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.local.LocalContainerAllocator: Processing the event EventType: CONTAINER_REQ | |
| 2014-09-25 17:01:27,047 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.local.LocalContainerAllocator: Processing the event EventType: CONTAINER_REQ | |
| 2014-09-25 17:01:27,211 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1411539203871_0014, File: hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0014/job_1411539203871_0014_1.jhist | |
| 2014-09-25 17:01:27,298 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:27,351 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0014/job.jar | |
| 2014-09-25 17:01:27,361 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /mapred/hadoop/.staging/job_1411539203871_0014/job.xml | |
| 2014-09-25 17:01:27,370 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #0 tokens and #1 secret keys for NM use for launching container | |
| 2014-09-25 17:01:27,370 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 1 | |
| 2014-09-25 17:01:27,370 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData | |
| 2014-09-25 17:01:27,442 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED | |
| 2014-09-25 17:01:27,451 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:27,452 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000001_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED | |
| 2014-09-25 17:01:27,453 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:27,454 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000002_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED | |
| 2014-09-25 17:01:27,461 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:27,461 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000003_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED | |
| 2014-09-25 17:01:27,462 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 17:01:27,462 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000004_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED | |
| 2014-09-25 17:01:27,463 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000000_0 | |
| 2014-09-25 17:01:27,478 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000001_0 | |
| 2014-09-25 17:01:27,479 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000002_0 | |
| 2014-09-25 17:01:27,479 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000003_0 | |
| 2014-09-25 17:01:27,479 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000004_0 | |
| 2014-09-25 17:01:27,486 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1411539203871_0014_m_000000_0] using containerId: [container_1411539203871_0014_01_000001 on NM: [dev-el-hd-perf010.ncl.someserver.com:41686] | |
| 2014-09-25 17:01:27,488 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: mapreduce.cluster.local.dir for uber task: /home/hadoop/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1411539203871_0014 | |
| 2014-09-25 17:01:27,494 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING | |
| 2014-09-25 17:01:27,494 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000000 Task Transitioned from SCHEDULED to RUNNING | |
| 2014-09-25 17:01:27,563 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] | |
| 2014-09-25 17:01:27,724 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.MapTask: Processing split: ShardInputSplit [node=[MC84epeQS9W0DNX8-EFYtw/dev-el-hd-perf004|someip:9200],shard=4] | |
| 2014-09-25 17:01:27,839 INFO [uber-SubtaskRunner] org.apache.hadoop.conf.Configuration.deprecation: mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class | |
| 2014-09-25 17:01:27,976 WARN [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: Exception running local (uberized) 'child' : java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0014_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$WritableShardRecordReader.init(EsInputFormat.java:367) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:27,977 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1411539203871_0014_m_000000_0 is : 0.0 | |
| 2014-09-25 17:01:27,983 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.Task: Runnning cleanup for the task | |
| 2014-09-25 17:01:27,995 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1411539203871_0014_m_000000_0: java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0014_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$WritableShardRecordReader.init(EsInputFormat.java:367) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:27,998 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: removed attempt attempt_1411539203871_0014_m_000000_0 from the futures to keep track of | |
| 2014-09-25 17:01:27,999 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1411539203871_0014_m_000000_0: java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0014_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$WritableShardRecordReader.init(EsInputFormat.java:367) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:28,001 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: mapreduce.cluster.local.dir for uber task: /home/hadoop/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1411539203871_0014 | |
| 2014-09-25 17:01:28,004 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP | |
| 2014-09-25 17:01:28,005 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] | |
| 2014-09-25 17:01:28,006 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1411539203871_0014_m_000001_0] using containerId: [container_1411539203871_0014_01_000001 on NM: [dev-el-hd-perf010.ncl.someserver.com:41686] | |
| 2014-09-25 17:01:28,006 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000001_0 TaskAttempt Transitioned from ASSIGNED to RUNNING | |
| 2014-09-25 17:01:28,006 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000000_0 | |
| 2014-09-25 17:01:28,007 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000001 Task Transitioned from SCHEDULED to RUNNING | |
| 2014-09-25 17:01:28,008 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000000_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP | |
| 2014-09-25 17:01:28,022 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT | |
| 2014-09-25 17:01:28,025 WARN [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://someip:9000/user/hadoop/output1/_temporary/1/_temporary/attempt_1411539203871_0014_m_000000_0 | |
| 2014-09-25 17:01:28,027 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000000_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED | |
| 2014-09-25 17:01:28,048 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000000 Task Transitioned from RUNNING to FAILED | |
| 2014-09-25 17:01:28,058 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 | |
| 2014-09-25 17:01:28,058 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks failed. failedMaps:1 failedReduces:0 | |
| 2014-09-25 17:01:28,066 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.MapTask: Processing split: ShardInputSplit [node=[XaQYbKnQSVyE0-favX8bXw/dev-el-hd-perf010|someip:9200],shard=2] | |
| 2014-09-25 17:01:28,067 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0014Job Transitioned from RUNNING to FAIL_WAIT | |
| 2014-09-25 17:01:28,068 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000001 Task Transitioned from RUNNING to KILL_WAIT | |
| 2014-09-25 17:01:28,068 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000002 Task Transitioned from SCHEDULED to KILL_WAIT | |
| 2014-09-25 17:01:28,068 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000003 Task Transitioned from SCHEDULED to KILL_WAIT | |
| 2014-09-25 17:01:28,068 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000004 Task Transitioned from SCHEDULED to KILL_WAIT | |
| 2014-09-25 17:01:28,068 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000001_0 TaskAttempt Transitioned from RUNNING to KILL_CONTAINER_CLEANUP | |
| 2014-09-25 17:01:28,069 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000002_0 TaskAttempt Transitioned from ASSIGNED to KILL_CONTAINER_CLEANUP | |
| 2014-09-25 17:01:28,069 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000003_0 TaskAttempt Transitioned from ASSIGNED to KILL_CONTAINER_CLEANUP | |
| 2014-09-25 17:01:28,069 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000004_0 TaskAttempt Transitioned from ASSIGNED to KILL_CONTAINER_CLEANUP | |
| 2014-09-25 17:01:28,069 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000001_0 | |
| 2014-09-25 17:01:28,069 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: canceling the task attempt attempt_1411539203871_0014_m_000001_0 | |
| 2014-09-25 17:01:28,070 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000002_0 | |
| 2014-09-25 17:01:28,070 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: canceling the task attempt attempt_1411539203871_0014_m_000002_0 | |
| 2014-09-25 17:01:28,070 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000003_0 | |
| 2014-09-25 17:01:28,070 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: canceling the task attempt attempt_1411539203871_0014_m_000003_0 | |
| 2014-09-25 17:01:28,070 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1411539203871_0014_01_000001 taskAttempt attempt_1411539203871_0014_m_000004_0 | |
| 2014-09-25 17:01:28,071 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: canceling the task attempt attempt_1411539203871_0014_m_000004_0 | |
| 2014-09-25 17:01:28,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000001_0 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP | |
| 2014-09-25 17:01:28,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000002_0 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP | |
| 2014-09-25 17:01:28,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000003_0 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP | |
| 2014-09-25 17:01:28,071 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000004_0 TaskAttempt Transitioned from KILL_CONTAINER_CLEANUP to KILL_TASK_CLEANUP | |
| 2014-09-25 17:01:28,072 INFO [CommitterEvent Processor #3] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT | |
| 2014-09-25 17:01:28,074 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT | |
| 2014-09-25 17:01:28,075 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT | |
| 2014-09-25 17:01:28,076 INFO [CommitterEvent Processor #4] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT | |
| 2014-09-25 17:01:28,077 WARN [CommitterEvent Processor #3] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://someip:9000/user/hadoop/output1/_temporary/1/_temporary/attempt_1411539203871_0014_m_000002_0 | |
| 2014-09-25 17:01:28,077 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000002_0 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED | |
| 2014-09-25 17:01:28,078 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000002 Task Transitioned from KILL_WAIT to KILLED | |
| 2014-09-25 17:01:28,126 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000001_0 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED | |
| 2014-09-25 17:01:28,127 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000001 Task Transitioned from KILL_WAIT to KILLED | |
| 2014-09-25 17:01:28,136 WARN [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://someip:9000/user/hadoop/output1/_temporary/1/_temporary/attempt_1411539203871_0014_m_000004_0 | |
| 2014-09-25 17:01:28,136 WARN [CommitterEvent Processor #4] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://someip:9000/user/hadoop/output1/_temporary/1/_temporary/attempt_1411539203871_0014_m_000003_0 | |
| 2014-09-25 17:01:28,136 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000004_0 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED | |
| 2014-09-25 17:01:28,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0014_m_000003_0 TaskAttempt Transitioned from KILL_TASK_CLEANUP to KILLED | |
| 2014-09-25 17:01:28,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000004 Task Transitioned from KILL_WAIT to KILLED | |
| 2014-09-25 17:01:28,137 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0014_m_000003 Task Transitioned from KILL_WAIT to KILLED | |
| 2014-09-25 17:01:28,138 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0014Job Transitioned from FAIL_WAIT to FAIL_ABORT | |
| 2014-09-25 17:01:28,138 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT | |
| 2014-09-25 17:01:28,167 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0014Job Transitioned from FAIL_ABORT to FAILED | |
| 2014-09-25 17:01:28,169 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.MapTask: Ignoring exception during close for org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector@7ea026e2 | |
| java.io.IOException: Failed to shutdown streamer | |
| at org.apache.hadoop.hdfs.DFSOutputStream.closeThreads(DFSOutputStream.java:2079) | |
| at org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:2118) | |
| at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) | |
| at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106) | |
| at org.apache.hadoop.mapreduce.lib.output.TextOutputFormat$LineRecordWriter.close(TextOutputFormat.java:111) | |
| at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.close(MapTask.java:647) | |
| at org.apache.hadoop.mapred.MapTask.closeQuietly(MapTask.java:1990) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:774) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:28,174 WARN [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: Exception running local (uberized) 'child' : java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0014_m_000001_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$WritableShardRecordReader.init(EsInputFormat.java:367) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:28,174 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1411539203871_0014_m_000001_0 is : 0.0 | |
| 2014-09-25 17:01:28,175 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.Task: Runnning cleanup for the task | |
| 2014-09-25 17:01:28,180 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry | |
| 2014-09-25 17:01:28,180 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true | |
| 2014-09-25 17:01:28,180 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true | |
| 2014-09-25 17:01:28,180 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true | |
| 2014-09-25 17:01:28,180 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true | |
| 2014-09-25 17:01:28,180 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services | |
| 2014-09-25 17:01:28,181 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 5 | |
| 2014-09-25 17:01:28,183 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event MAP_ATTEMPT_KILLED | |
| 2014-09-25 17:01:28,188 WARN [uber-SubtaskRunner] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://someip:9000/user/hadoop/output1/_temporary/1/_temporary/attempt_1411539203871_0014_m_000001_0 | |
| 2014-09-25 17:01:28,188 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_FAILED | |
| 2014-09-25 17:01:28,189 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1411539203871_0014_m_000001_0: java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0014_m_000001_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$WritableShardRecordReader.init(EsInputFormat.java:367) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:28,190 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1411539203871_0014_m_000001_0: java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0014_m_000001_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$WritableShardRecordReader.init(EsInputFormat.java:367) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 17:01:28,191 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_FAILED | |
| 2014-09-25 17:01:28,193 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event TASK_FAILED | |
| 2014-09-25 17:01:28,195 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event JOB_FAILED | |
| 2014-09-25 17:01:28,271 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0014/job_1411539203871_0014_1.jhist to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014-1411632080674-hadoop-Get+information+from+elasticsearch.-1411632088058-0-0-FAILED-default-1411632086810.jhist_tmp | |
| 2014-09-25 17:01:28,320 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014-1411632080674-hadoop-Get+information+from+elasticsearch.-1411632088058-0-0-FAILED-default-1411632086810.jhist_tmp | |
| 2014-09-25 17:01:28,323 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0014/job_1411539203871_0014_1_conf.xml to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014_conf.xml_tmp | |
| 2014-09-25 17:01:28,367 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014_conf.xml_tmp | |
| 2014-09-25 17:01:28,382 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014.summary_tmp to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014.summary | |
| 2014-09-25 17:01:28,384 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014_conf.xml_tmp to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014_conf.xml | |
| 2014-09-25 17:01:28,388 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014-1411632080674-hadoop-Get+information+from+elasticsearch.-1411632088058-0-0-FAILED-default-1411632086810.jhist_tmp to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0014-1411632080674-hadoop-Get+information+from+elasticsearch.-1411632088058-0-0-FAILED-default-1411632086810.jhist | |
| 2014-09-25 17:01:28,388 INFO [Thread-63] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() | |
| 2014-09-25 17:01:28,389 ERROR [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Returning, interrupted : java.lang.InterruptedException | |
| 2014-09-25 17:01:28,391 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to Task failed task_1411539203871_0014_m_000000 | |
| Job failed as tasks failed. failedMaps:1 failedReduces:0 | |
| 2014-09-25 17:01:28,392 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is http://dev-el-hd-perf002.ncl.someserver.com:19888/jobhistory/job/job_1411539203871_0014 | |
| 2014-09-25 17:01:28,399 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for application to be successfully unregistered. | |
| 2014-09-25 17:01:29,402 INFO [Thread-63] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://someip:9000 /mapred/hadoop/.staging/job_1411539203871_0014 | |
| 2014-09-25 17:01:29,406 INFO [Thread-63] org.apache.hadoop.ipc.Server: Stopping server on 34697 | |
| 2014-09-25 17:01:29,410 INFO [IPC Server listener on 34697] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 34697 | |
| 2014-09-25 17:01:29,411 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder | |
| 2014-09-25 17:01:29,411 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2014-09-25 16:57:29,536 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1411539203871_0013_000001 | |
| 2014-09-25 16:57:29,992 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 16:57:30,017 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 16:57:30,174 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: | |
| 2014-09-25 16:57:30,174 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@31125c11) | |
| 2014-09-25 16:57:30,226 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2 for application: 13. Attempt num: 1 is last retry: false | |
| 2014-09-25 16:57:30,233 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter. | |
| 2014-09-25 16:57:30,410 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 16:57:30,428 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 16:57:31,382 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config null | |
| 2014-09-25 16:57:31,675 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator | |
| 2014-09-25 16:57:31,699 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter is org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputCommitter | |
| 2014-09-25 16:57:31,726 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.jobhistory.EventType for class org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler | |
| 2014-09-25 16:57:31,727 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobEventDispatcher | |
| 2014-09-25 16:57:31,728 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskEventDispatcher | |
| 2014-09-25 16:57:31,730 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.TaskAttemptEventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$TaskAttemptEventDispatcher | |
| 2014-09-25 16:57:31,730 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventType for class org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler | |
| 2014-09-25 16:57:31,737 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.speculate.Speculator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$SpeculatorEventDispatcher | |
| 2014-09-25 16:57:31,738 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.rm.ContainerAllocator$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerAllocatorRouter | |
| 2014-09-25 16:57:31,739 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncher$EventType for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$ContainerLauncherRouter | |
| 2014-09-25 16:57:31,814 INFO [main] org.apache.hadoop.yarn.event.AsyncDispatcher: Registering class org.apache.hadoop.mapreduce.v2.app.job.event.JobFinishEvent$Type for class org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler | |
| 2014-09-25 16:57:32,157 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties | |
| 2014-09-25 16:57:32,237 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). | |
| 2014-09-25 16:57:32,237 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MRAppMaster metrics system started | |
| 2014-09-25 16:57:32,248 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Adding job token for job_1411539203871_0013 to jobTokenSecretManager | |
| 2014-09-25 16:57:32,455 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Uberizing job job_1411539203871_0013: 1m+0r tasks (5 input bytes) will run sequentially on single node. | |
| 2014-09-25 16:57:32,482 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Input size for job job_1411539203871_0013 = 5. Number of splits = 1 | |
| 2014-09-25 16:57:32,482 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Number of reduces for job job_1411539203871_0013 = 0 | |
| 2014-09-25 16:57:32,482 INFO [main] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0013Job Transitioned from NEW to INITED | |
| 2014-09-25 16:57:32,483 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: MRAppMaster uberizing job job_1411539203871_0013 in local container ("uber-AM") on node dev-el-hd-perf010.ncl.someserver.com:41686. | |
| 2014-09-25 16:57:32,522 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2014-09-25 16:57:32,536 INFO [Socket Reader #1 for port 40739] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 40739 | |
| 2014-09-25 16:57:32,564 INFO [main] org.apache.hadoop.yarn.factories.impl.pb.RpcServerFactoryPBImpl: Adding protocol org.apache.hadoop.mapreduce.v2.api.MRClientProtocolPB to the server | |
| 2014-09-25 16:57:32,565 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2014-09-25 16:57:32,566 INFO [IPC Server listener on 40739] org.apache.hadoop.ipc.Server: IPC Server listener on 40739: starting | |
| 2014-09-25 16:57:32,567 INFO [main] org.apache.hadoop.mapreduce.v2.app.client.MRClientService: Instantiated MRClientService at dev-el-hd-perf010.ncl.someserver.com/someip:40739 | |
| 2014-09-25 16:57:32,662 INFO [main] org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog | |
| 2014-09-25 16:57:32,668 INFO [main] org.apache.hadoop.http.HttpRequestLog: Http request log for http.requests.mapreduce is not defined | |
| 2014-09-25 16:57:32,691 INFO [main] org.apache.hadoop.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer2$QuotingInputFilter) | |
| 2014-09-25 16:57:32,696 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context mapreduce | |
| 2014-09-25 16:57:32,696 INFO [main] org.apache.hadoop.http.HttpServer2: Added filter AM_PROXY_FILTER (class=org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter) to context static | |
| 2014-09-25 16:57:32,701 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /mapreduce/* | |
| 2014-09-25 16:57:32,701 INFO [main] org.apache.hadoop.http.HttpServer2: adding path spec: /ws/* | |
| 2014-09-25 16:57:32,715 INFO [main] org.apache.hadoop.http.HttpServer2: Jetty bound to port 52576 | |
| 2014-09-25 16:57:32,715 INFO [main] org.mortbay.log: jetty-6.1.26 | |
| 2014-09-25 16:57:32,751 INFO [main] org.mortbay.log: Extract jar:file:/home/hadoop/hadoop/share/hadoop/yarn/hadoop-yarn-common-2.5.1.jar!/webapps/mapreduce to /tmp/Jetty_0_0_0_0_52576_mapreduce____ft35z6/webapp | |
| 2014-09-25 16:57:33,085 INFO [main] org.mortbay.log: Started HttpServer2$SelectChannelConnectorWithSafeStartup@0.0.0.0:52576 | |
| 2014-09-25 16:57:33,086 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Web app /mapreduce started at 52576 | |
| 2014-09-25 16:57:33,567 INFO [main] org.apache.hadoop.yarn.webapp.WebApps: Registered webapp guice modules | |
| 2014-09-25 16:57:33,573 INFO [main] org.apache.hadoop.ipc.CallQueueManager: Using callQueue class java.util.concurrent.LinkedBlockingQueue | |
| 2014-09-25 16:57:33,574 INFO [Socket Reader #1 for port 60591] org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 60591 | |
| 2014-09-25 16:57:33,581 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: IPC Server Responder: starting | |
| 2014-09-25 16:57:33,584 INFO [IPC Server listener on 60591] org.apache.hadoop.ipc.Server: IPC Server listener on 60591: starting | |
| 2014-09-25 16:57:33,675 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 16:57:33,684 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 16:57:33,689 INFO [main] org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at /someip:8030 | |
| 2014-09-25 16:57:33,782 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: maxContainerCapability: 8192 | |
| 2014-09-25 16:57:33,782 INFO [main] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: queue: default | |
| 2014-09-25 16:57:33,882 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0013Job Transitioned from INITED to SETUP | |
| 2014-09-25 16:57:33,890 INFO [CommitterEvent Processor #0] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_SETUP | |
| 2014-09-25 16:57:33,922 INFO [CommitterEvent Processor #0] org.apache.hadoop.conf.Configuration.deprecation: mapred.textoutputformat.separator is deprecated. Instead, use mapreduce.output.textoutputformat.separator | |
| 2014-09-25 16:57:33,956 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0013Job Transitioned from SETUP to RUNNING | |
| 2014-09-25 16:57:34,047 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf005.ncl.someserver.com to /default-rack | |
| 2014-09-25 16:57:34,048 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf007.ncl.someserver.com to /default-rack | |
| 2014-09-25 16:57:34,048 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf009.ncl.someserver.com to /default-rack | |
| 2014-09-25 16:57:34,048 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf001.ncl.someserver.com to /default-rack | |
| 2014-09-25 16:57:34,048 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf006.ncl.someserver.com to /default-rack | |
| 2014-09-25 16:57:34,059 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0013_m_000000 Task Transitioned from NEW to SCHEDULED | |
| 2014-09-25 16:57:34,069 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0013_m_000000_0 TaskAttempt Transitioned from NEW to UNASSIGNED | |
| 2014-09-25 16:57:34,069 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.local.LocalContainerAllocator: Processing the event EventType: CONTAINER_REQ | |
| 2014-09-25 16:57:34,206 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Event Writer setup for JobId: job_1411539203871_0013, File: hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0013/job_1411539203871_0013_1.jhist | |
| 2014-09-25 16:57:34,336 INFO [AsyncDispatcher event handler] org.apache.hadoop.yarn.util.RackResolver: Resolved dev-el-hd-perf010.ncl.someserver.com to /default-rack | |
| 2014-09-25 16:57:34,373 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-jar file on the remote FS is hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0013/job.jar | |
| 2014-09-25 16:57:34,382 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: The job-conf file on the remote FS is /mapred/hadoop/.staging/job_1411539203871_0013/job.xml | |
| 2014-09-25 16:57:34,386 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Adding #1 tokens and #1 secret keys for NM use for launching container | |
| 2014-09-25 16:57:34,386 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Size of containertokens_dob is 2 | |
| 2014-09-25 16:57:34,386 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Putting shuffle token in serviceData | |
| 2014-09-25 16:57:34,448 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0013_m_000000_0 TaskAttempt Transitioned from UNASSIGNED to ASSIGNED | |
| 2014-09-25 16:57:34,454 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_LAUNCH for container container_1411539203871_0013_01_000001 taskAttempt attempt_1411539203871_0013_m_000000_0 | |
| 2014-09-25 16:57:34,467 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt: [attempt_1411539203871_0013_m_000000_0] using containerId: [container_1411539203871_0013_01_000001 on NM: [dev-el-hd-perf010.ncl.someserver.com:41686] | |
| 2014-09-25 16:57:34,466 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: mapreduce.cluster.local.dir for uber task: /home/hadoop/hadoop/tmp/nm-local-dir/usercache/hadoop/appcache/application_1411539203871_0013 | |
| 2014-09-25 16:57:34,474 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0013_m_000000_0 TaskAttempt Transitioned from ASSIGNED to RUNNING | |
| 2014-09-25 16:57:34,474 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0013_m_000000 Task Transitioned from SCHEDULED to RUNNING | |
| 2014-09-25 16:57:34,636 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.Task: Using ResourceCalculatorProcessTree : [ ] | |
| 2014-09-25 16:57:34,890 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.MapTask: Processing split: Number of splits :5 | |
| Total Length = 5 | |
| Input split[0]: | |
| Length = 1 | |
| Locations: | |
| someip | |
| ----------------------- | |
| Input split[1]: | |
| Length = 1 | |
| Locations: | |
| someip | |
| ----------------------- | |
| Input split[2]: | |
| Length = 1 | |
| Locations: | |
| someip | |
| ----------------------- | |
| Input split[3]: | |
| Length = 1 | |
| Locations: | |
| someip | |
| ----------------------- | |
| Input split[4]: | |
| Length = 1 | |
| Locations: | |
| someip | |
| ----------------------- | |
| 2014-09-25 16:57:35,064 INFO [uber-SubtaskRunner] org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader: Current split being processed ShardInputSplit [node=[Bc4nGBAHTCCpzs4SqgZPew/dev-el-hd-perf005|someip:9200],shard=4] | |
| 2014-09-25 16:57:35,260 INFO [uber-SubtaskRunner] org.apache.hadoop.conf.Configuration.deprecation: fs.default.name is deprecated. Instead, use fs.defaultFS | |
| 2014-09-25 16:57:35,260 INFO [uber-SubtaskRunner] org.apache.hadoop.conf.Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address | |
| 2014-09-25 16:57:35,263 INFO [uber-SubtaskRunner] org.apache.hadoop.conf.Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar | |
| 2014-09-25 16:57:35,263 INFO [uber-SubtaskRunner] org.apache.hadoop.conf.Configuration.deprecation: mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent | |
| 2014-09-25 16:57:35,282 WARN [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: Exception running local (uberized) 'child' : java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0013_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initialize(PigRecordReader.java:178) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 16:57:35,285 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1411539203871_0013_m_000000_0 is : 0.0 | |
| 2014-09-25 16:57:35,290 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.Task: Runnning cleanup for the task | |
| 2014-09-25 16:57:35,303 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1411539203871_0013_m_000000_0: java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0013_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initialize(PigRecordReader.java:178) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 16:57:35,305 INFO [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: removed attempt attempt_1411539203871_0013_m_000000_0 from the futures to keep track of | |
| 2014-09-25 16:57:35,305 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1411539203871_0013_m_000000_0: java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0013_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.HeartBeat.<init>(HeartBeat.java:51) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.init(EsInputFormat.java:226) | |
| at org.elasticsearch.hadoop.mr.EsInputFormat$ShardRecordReader.initialize(EsInputFormat.java:191) | |
| at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.initialize(PigRecordReader.java:178) | |
| at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:525) | |
| at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763) | |
| at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:370) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:295) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:181) | |
| at org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:224) | |
| at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) | |
| at java.util.concurrent.FutureTask.run(FutureTask.java:262) | |
| at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) | |
| at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) | |
| at java.lang.Thread.run(Thread.java:745) | |
| 2014-09-25 16:57:35,306 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0013_m_000000_0 TaskAttempt Transitioned from RUNNING to FAIL_CONTAINER_CLEANUP | |
| 2014-09-25 16:57:35,306 INFO [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_1411539203871_0013_01_000001 taskAttempt attempt_1411539203871_0013_m_000000_0 | |
| 2014-09-25 16:57:35,308 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0013_m_000000_0 TaskAttempt Transitioned from FAIL_CONTAINER_CLEANUP to FAIL_TASK_CLEANUP | |
| 2014-09-25 16:57:35,308 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: TASK_ABORT | |
| 2014-09-25 16:57:35,328 WARN [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Could not delete hdfs://someip:9000/user/hadoop/output_pig2/_temporary/1/_temporary/attempt_1411539203871_0013_m_000000_0 | |
| 2014-09-25 16:57:35,330 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1411539203871_0013_m_000000_0 TaskAttempt Transitioned from FAIL_TASK_CLEANUP to FAILED | |
| 2014-09-25 16:57:35,343 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1411539203871_0013_m_000000 Task Transitioned from RUNNING to FAILED | |
| 2014-09-25 16:57:35,345 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1 | |
| 2014-09-25 16:57:35,345 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Job failed as tasks failed. failedMaps:1 failedReduces:0 | |
| 2014-09-25 16:57:35,346 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0013Job Transitioned from RUNNING to FAIL_ABORT | |
| 2014-09-25 16:57:35,347 INFO [CommitterEvent Processor #2] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_ABORT | |
| 2014-09-25 16:57:35,380 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1411539203871_0013Job Transitioned from FAIL_ABORT to FAILED | |
| 2014-09-25 16:57:35,381 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: We are finishing cleanly so this is the last retry | |
| 2014-09-25 16:57:35,381 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify RMCommunicator isAMLastRetry: true | |
| 2014-09-25 16:57:35,381 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: RMCommunicator notified that shouldUnregistered is: true | |
| 2014-09-25 16:57:35,381 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Notify JHEH isAMLastRetry: true | |
| 2014-09-25 16:57:35,382 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: JobHistoryEventHandler notified that forceJobCompletion is true | |
| 2014-09-25 16:57:35,382 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling stop for all the services | |
| 2014-09-25 16:57:35,382 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopping JobHistoryEventHandler. Size of the outstanding queue size is 1 | |
| 2014-09-25 16:57:35,386 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: In stop, writing event JOB_FAILED | |
| 2014-09-25 16:57:35,446 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0013/job_1411539203871_0013_1.jhist to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013-1411631847622-hadoop-PigLatin%3Aelastic.pig-1411631855345-0-0-FAILED-default-1411631853876.jhist_tmp | |
| 2014-09-25 16:57:35,482 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013-1411631847622-hadoop-PigLatin%3Aelastic.pig-1411631855345-0-0-FAILED-default-1411631853876.jhist_tmp | |
| 2014-09-25 16:57:35,486 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copying hdfs://someip:9000/mapred/hadoop/.staging/job_1411539203871_0013/job_1411539203871_0013_1_conf.xml to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013_conf.xml_tmp | |
| 2014-09-25 16:57:35,542 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to done location: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013_conf.xml_tmp | |
| 2014-09-25 16:57:35,553 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013.summary_tmp to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013.summary | |
| 2014-09-25 16:57:35,559 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013_conf.xml_tmp to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013_conf.xml | |
| 2014-09-25 16:57:35,562 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to done: hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013-1411631847622-hadoop-PigLatin%3Aelastic.pig-1411631855345-0-0-FAILED-default-1411631853876.jhist_tmp to hdfs://someip:9000/mapred/history/done_intermediate/hadoop/job_1411539203871_0013-1411631847622-hadoop-PigLatin%3Aelastic.pig-1411631855345-0-0-FAILED-default-1411631853876.jhist | |
| 2014-09-25 16:57:35,562 INFO [Thread-62] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped JobHistoryEventHandler. super.stop() | |
| 2014-09-25 16:57:35,563 ERROR [uber-EventHandler] org.apache.hadoop.mapred.LocalContainerLauncher: Returning, interrupted : java.lang.InterruptedException | |
| 2014-09-25 16:57:35,565 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job diagnostics to Task failed task_1411539203871_0013_m_000000 | |
| Job failed as tasks failed. failedMaps:1 failedReduces:0 | |
| 2014-09-25 16:57:35,566 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: History url is http://dev-el-hd-perf002.ncl.someserver.com:19888/jobhistory/job/job_1411539203871_0013 | |
| 2014-09-25 16:57:35,573 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Waiting for application to be successfully unregistered. | |
| 2014-09-25 16:57:36,576 INFO [Thread-62] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Deleting staging directory hdfs://someip:9000 /mapred/hadoop/.staging/job_1411539203871_0013 | |
| 2014-09-25 16:57:36,581 INFO [Thread-62] org.apache.hadoop.ipc.Server: Stopping server on 60591 | |
| 2014-09-25 16:57:36,585 INFO [IPC Server listener on 60591] org.apache.hadoop.ipc.Server: Stopping IPC Server listener on 60591 | |
| 2014-09-25 16:57:36,587 INFO [IPC Server Responder] org.apache.hadoop.ipc.Server: Stopping IPC Server Responder | |
| 2014-09-25 16:57:36,587 INFO [TaskHeartbeatHandler PingChecker] org.apache.hadoop.mapreduce.v2.app.TaskHeartbeatHandler: TaskHeartbeatHandler thread interrupted |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment