Skip to content

Instantly share code, notes, and snippets.

@Denis1990
Created September 18, 2016 17:44
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save Denis1990/9f42f73ae126ea47008ee907da64ac6a to your computer and use it in GitHub Desktop.
2016-09-18 20:29:58 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2016-09-18 20:31:34 INFO deprecation:1173 - session.id is deprecated. Instead, use dfs.metrics.session-id
2016-09-18 20:31:34 INFO JvmMetrics:76 - Initializing JVM Metrics with processName=JobTracker, sessionId=
2016-09-18 20:31:35 WARN JobResourceUploader:171 - No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2016-09-18 20:31:35 INFO FileInputFormat:283 - Total input paths to process : 0
2016-09-18 20:31:35 INFO JobSubmitter:198 - number of splits:0
2016-09-18 20:31:35 INFO JobSubmitter:287 - Submitting tokens for job: job_local1137380161_0001
2016-09-18 20:31:36 INFO Job:1294 - The url to track the job: http://localhost:8080/
2016-09-18 20:31:36 INFO Job:1339 - Running job: job_local1137380161_0001
2016-09-18 20:31:36 INFO LocalJobRunner:471 - OutputCommitter set in config null
2016-09-18 20:31:36 INFO FileOutputCommitter:100 - File Output Committer Algorithm version is 1
2016-09-18 20:31:36 INFO LocalJobRunner:489 - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2016-09-18 20:31:36 INFO LocalJobRunner:448 - Waiting for map tasks
2016-09-18 20:31:36 INFO LocalJobRunner:456 - map task executor complete.
2016-09-18 20:31:36 INFO LocalJobRunner:448 - Waiting for reduce tasks
2016-09-18 20:31:36 INFO LocalJobRunner:302 - Starting task: attempt_local1137380161_0001_r_000000_0
2016-09-18 20:31:36 INFO FileOutputCommitter:100 - File Output Committer Algorithm version is 1
2016-09-18 20:31:36 INFO Task:612 - Using ResourceCalculatorProcessTree : [ ]
2016-09-18 20:31:36 INFO ReduceTask:362 - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@275c0c87
2016-09-18 20:31:36 INFO MergeManagerImpl:196 - MergerManager: memoryLimit=942460096, maxSingleShuffleLimit=235615024, mergeThreshold=622023680, ioSortFactor=10, memToMemMergeOutputsThreshold=10
2016-09-18 20:31:36 INFO EventFetcher:61 - attempt_local1137380161_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events
2016-09-18 20:31:36 INFO EventFetcher:76 - EventFetcher is interrupted.. Returning
2016-09-18 20:31:36 INFO LocalJobRunner:591 -
2016-09-18 20:31:36 INFO MergeManagerImpl:674 - finalMerge called with 0 in-memory map-outputs and 0 on-disk map-outputs
2016-09-18 20:31:36 INFO MergeManagerImpl:781 - Merging 0 files, 0 bytes from disk
2016-09-18 20:31:36 INFO MergeManagerImpl:796 - Merging 0 segments, 0 bytes from memory into reduce
2016-09-18 20:31:36 INFO Merger:606 - Merging 0 sorted segments
2016-09-18 20:31:36 INFO Merger:705 - Down to the last merge-pass, with 0 segments left of total size: 0 bytes
2016-09-18 20:31:36 INFO LocalJobRunner:591 -
2016-09-18 20:31:36 INFO deprecation:1173 - mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords
2016-09-18 20:31:36 INFO Task:1038 - Task:attempt_local1137380161_0001_r_000000_0 is done. And is in the process of committing
2016-09-18 20:31:36 INFO LocalJobRunner:591 -
2016-09-18 20:31:36 INFO Task:1199 - Task attempt_local1137380161_0001_r_000000_0 is allowed to commit now
2016-09-18 20:31:36 INFO FileOutputCommitter:482 - Saved output of task 'attempt_local1137380161_0001_r_000000_0' to file:/home/denis/output/_temporary/0/task_local1137380161_0001_r_000000
2016-09-18 20:31:36 INFO LocalJobRunner:591 - reduce > reduce
2016-09-18 20:31:36 INFO Task:1158 - Task 'attempt_local1137380161_0001_r_000000_0' done.
2016-09-18 20:31:36 INFO LocalJobRunner:325 - Finishing task: attempt_local1137380161_0001_r_000000_0
2016-09-18 20:31:36 INFO LocalJobRunner:456 - reduce task executor complete.
2016-09-18 20:31:37 INFO Job:1360 - Job job_local1137380161_0001 running in uber mode : false
2016-09-18 20:31:37 INFO Job:1367 - map 0% reduce 100%
2016-09-18 20:31:37 INFO Job:1378 - Job job_local1137380161_0001 completed successfully
2016-09-18 20:31:37 INFO Job:1385 - Counters: 24
File System Counters
FILE: Number of bytes read=22
FILE: Number of bytes written=276109
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Combine input records=0
Combine output records=0
Reduce input groups=0
Reduce shuffle bytes=0
Reduce input records=0
Reduce output records=0
Spilled Records=0
Shuffled Maps =0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=13
Total committed heap usage (bytes)=119537664
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Output Format Counters
Bytes Written=8
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment