Skip to content

Instantly share code, notes, and snippets.

@maiha
Created April 9, 2012 01:02
Show Gist options
  • Save maiha/2340635 to your computer and use it in GitHub Desktop.
Save maiha/2340635 to your computer and use it in GitHub Desktop.
Child Error Task process exit with nonzero status of 1
% hadoop jar /usr/lib/hadoop-0.20/hadoop-examples.jar grep songs.csv output '20'
12/04/09 09:28:04 WARN snappy.LoadSnappy: Snappy native library is available
12/04/09 09:28:04 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/04/09 09:28:04 INFO snappy.LoadSnappy: Snappy native library loaded
12/04/09 09:28:04 INFO mapred.FileInputFormat: Total input paths to process : 1
12/04/09 09:28:05 INFO mapred.JobClient: Running job: job_201204031541_0033
12/04/09 09:28:06 INFO mapred.JobClient: map 0% reduce 0%
12/04/09 09:28:09 INFO mapred.JobClient: Task Id : attempt_201204031541_0033_m_000003_0, Status : FAILED
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:242)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:229)
12/04/09 09:28:09 WARN mapred.JobClient: Error reading task outputhttp:...
* log directory problem
http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-user/201107.mbox/%3CCABTmYdbAhzvF8DgJKxHFfobirdQRR-jBgTKMryg4VxxM+aHr=Q@mail.gmail.com%3E
* userlogs problem
https://issues.apache.org/jira/browse/MAPREDUCE-2592
* inode limit 32000 in ext3
http://stackoverflow.com/questions/2091287/error-in-hadoop-mapreduce
* cleaning up tasklogs has been improved in 0.22.0
https://issues.apache.org/jira/browse/MAPREDUCE-927
@mrflip
Copy link

mrflip commented Jan 12, 2013

I had this happen because the JVM stack size was too small (according to oracle java, but not the prior sun java).

This wasn't appearing in the jobtracker's log view. Look in var/log/hadoop/userlogs (or whereever) to see if the JVM has bothered to leave an epitaph behind. Note that that directory is read-protected, so you will have to sudo to see it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment