Skip to content

Instantly share code, notes, and snippets.

@rjurney
Created January 21, 2012 04:56
Show Gist options
  • Star 1 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rjurney/1651347 to your computer and use it in GitHub Desktop.
Save rjurney/1651347 to your computer and use it in GitHub Desktop.
order error message for pig
2012-01-20 20:55:19,089 [Thread-71] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
2012-01-20 20:55:19,094 [Thread-71] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local_0004
java.lang.RuntimeException: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/Users/rjurney/Collecting-Data/pigsample_1901945818_1327121718252
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.setConf(WeightedRangePartitioner.java:156)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:527)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:613)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/Users/rjurney/Collecting-Data/pigsample_1901945818_1327121718252
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:224)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigFileInputFormat.listStatus(PigFileInputFormat.java:37)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
at org.apache.pig.impl.io.ReadToEndLoader.init(ReadToEndLoader.java:154)
at org.apache.pig.impl.io.ReadToEndLoader.<init>(ReadToEndLoader.java:116)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.partitioners.WeightedRangePartitioner.setConf(WeightedRangePartitioner.java:129)
... 6 more
2012-01-20 20:55:19,350 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_local_0004
2012-01-20 20:55:23,855 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - job job_local_0004 has failed! Stop running all dependent jobs
2012-01-20 20:55:23,855 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
2012-01-20 20:55:23,855 [main] ERROR org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
2012-01-20 20:55:23,858 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
HadoopVersion PigVersion UserId StartedAt FinishedAt Features
0.20.2 0.9.3-SNAPSHOT rjurney 2012-01-20 20:54:40 2012-01-20 20:55:23 HASH_JOIN,GROUP_BY,ORDER_BY,FILTER
Some jobs have failed! Stop running all dependent jobs
Job Stats (time in seconds):
JobId Maps Reduces MaxMapTime MinMapTIme AvgMapTime MaxReduceTime MinReduceTime AvgReduceTime Alias Feature Outputs
job_local_0001 4 1 n/a n/a n/a n/a n/a n/a ccs,me,messages,pair_count,pairs,three_count,three_pairs,total_pairs,with_cc,with_ccs MULTI_QUERY,COMBINER
job_local_0002 2 1 n/a n/a n/a n/a n/a n/a email_conditionals,email_fractions HASH_JOIN
job_local_0003 1 1 n/a n/a n/a n/a n/a n/a failure SAMPLER
Failed Jobs:
JobId Alias Feature Message Outputs
job_local_0004 failure ORDER_BY Message: Job failed! /tmp/failure,
Input(s):
Successfully read 0 records from: "/tmp/10000_emails.avro"
Output(s):
Failed to produce result in "/tmp/failure"
Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0
Job DAG:
job_local_0001 -> job_local_0002,
job_local_0002 -> job_local_0003,
job_local_0003 -> job_local_0004,
job_local_0004
2012-01-20 20:55:23,859 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Some jobs have failed! Stop running all dependent jobs
2012-01-20 20:55:23,859 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment