AndreasHoermandinger
AndreasHoermandinger
/ gist:5a55f356a1c8480fb6e6
Created
September 26, 2014 07:18
Stack-trace writing to elasticsearch with es-hadoop and pig
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2014-09-26 15:46:50,630 WARN [uber-SubtaskRunner] org.apache.hadoop.mapred.LocalContainerLauncher: Exception running local (uberized) 'child' : java.lang.IllegalArgumentException: TaskId string : attempt_1411539203871_0035_m_000000_0 is not properly formed | |
| at org.apache.hadoop.mapreduce.TaskID.forName(TaskID.java:233) | |
| at org.apache.hadoop.mapred.TaskID.forName(TaskID.java:195) | |
| at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.detectCurrentInstance(EsOutputFormat.java:264) | |
| at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.init(EsOutputFormat.java:166) | |
| at org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write(EsOutputFormat.java:159) | |
| at org.elasticsearch.hadoop.pig.EsStorage.putNext(EsStorage.java:196) | |
| at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:143) | |
| at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWr |
AndreasHoermandinger
/ Mapreduce log
Created
September 25, 2014 09:26
(Crash)Logs of hadoop(2.5.1) mapreduce and pig with elasticsearch-hadoop running in uber mode
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2014-09-25 17:01:22,666 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1411539203871_0014_000001 | |
| 2014-09-25 17:01:23,137 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. | |
| 2014-09-25 17:01:23,157 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. | |
| 2014-09-25 17:01:23,304 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: | |
| 2014-09-25 17:01:23,304 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Kind: YARN_AM_RM_TOKEN, Service: , Ident: (org.apache.hadoop.yarn.security.AMRMTokenIdentifier@4888b7ec) | |
| 2014-09-25 17:01:23,352 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: The specific max attempts: 2 for application: 14. Attempt num: 1 is last retry: false | |
| 2014-09-25 17:01:23,358 INFO [main] org |