Skip to content

Instantly share code, notes, and snippets.

@qiaohaijun

qiaohaijun/streaming error 143.md

Created December 28, 2015 09:06
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save qiaohaijun/c035814dc3085af5f56b to your computer and use it in GitHub Desktop.
Save qiaohaijun/c035814dc3085af5f56b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
streaming error 143.md 
Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): 
subprocess failed with code 2 at 
org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:326) 
at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:592) 
at org.apache.hadoop.streaming.PipeMapper.mapRedFinished(PipeMapper.java:162) 
at org.apache.hadoop.streaming.PipeMapper.close(PipeMapper.java:132) 
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61) 
at org.apache.hadoop.streaming.PipeMapRunner.run(PipeMapRunner.java:34) 
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450) 
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343) 
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) 
at java.security.AccessController.doPrivileged(Native Method) 
at javax.security.auth.Subject.doAs(Subject.java:415) 
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1892) 
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) 
Container killed by the ApplicationMaster. 
Container killed on request. Exit code is 143 Container exited with a non-zero exit code 143
@qiaohaijun
Copy link
Author

http://stackoverflow.com/questions/4460522/hadoop-streaming-job-failed-error-in-python
这个是正解

@qiaohaijun
Copy link
Author

-maper 和-reducer需要传递的是可执行的代码。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment