Created
September 18, 2016 17:44
Star
You must be signed in to star a gist
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2016-09-18 20:29:58 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
2016-09-18 20:31:34 INFO deprecation:1173 - session.id is deprecated. Instead, use dfs.metrics.session-id | |
2016-09-18 20:31:34 INFO JvmMetrics:76 - Initializing JVM Metrics with processName=JobTracker, sessionId= | |
2016-09-18 20:31:35 WARN JobResourceUploader:171 - No job jar file set. User classes may not be found. See Job or Job#setJar(String). | |
2016-09-18 20:31:35 INFO FileInputFormat:283 - Total input paths to process : 0 | |
2016-09-18 20:31:35 INFO JobSubmitter:198 - number of splits:0 | |
2016-09-18 20:31:35 INFO JobSubmitter:287 - Submitting tokens for job: job_local1137380161_0001 | |
2016-09-18 20:31:36 INFO Job:1294 - The url to track the job: http://localhost:8080/ | |
2016-09-18 20:31:36 INFO Job:1339 - Running job: job_local1137380161_0001 | |
2016-09-18 20:31:36 INFO LocalJobRunner:471 - OutputCommitter set in config null | |
2016-09-18 20:31:36 INFO FileOutputCommitter:100 - File Output Committer Algorithm version is 1 | |
2016-09-18 20:31:36 INFO LocalJobRunner:489 - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter | |
2016-09-18 20:31:36 INFO LocalJobRunner:448 - Waiting for map tasks | |
2016-09-18 20:31:36 INFO LocalJobRunner:456 - map task executor complete. | |
2016-09-18 20:31:36 INFO LocalJobRunner:448 - Waiting for reduce tasks | |
2016-09-18 20:31:36 INFO LocalJobRunner:302 - Starting task: attempt_local1137380161_0001_r_000000_0 | |
2016-09-18 20:31:36 INFO FileOutputCommitter:100 - File Output Committer Algorithm version is 1 | |
2016-09-18 20:31:36 INFO Task:612 - Using ResourceCalculatorProcessTree : [ ] | |
2016-09-18 20:31:36 INFO ReduceTask:362 - Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@275c0c87 | |
2016-09-18 20:31:36 INFO MergeManagerImpl:196 - MergerManager: memoryLimit=942460096, maxSingleShuffleLimit=235615024, mergeThreshold=622023680, ioSortFactor=10, memToMemMergeOutputsThreshold=10 | |
2016-09-18 20:31:36 INFO EventFetcher:61 - attempt_local1137380161_0001_r_000000_0 Thread started: EventFetcher for fetching Map Completion Events | |
2016-09-18 20:31:36 INFO EventFetcher:76 - EventFetcher is interrupted.. Returning | |
2016-09-18 20:31:36 INFO LocalJobRunner:591 - | |
2016-09-18 20:31:36 INFO MergeManagerImpl:674 - finalMerge called with 0 in-memory map-outputs and 0 on-disk map-outputs | |
2016-09-18 20:31:36 INFO MergeManagerImpl:781 - Merging 0 files, 0 bytes from disk | |
2016-09-18 20:31:36 INFO MergeManagerImpl:796 - Merging 0 segments, 0 bytes from memory into reduce | |
2016-09-18 20:31:36 INFO Merger:606 - Merging 0 sorted segments | |
2016-09-18 20:31:36 INFO Merger:705 - Down to the last merge-pass, with 0 segments left of total size: 0 bytes | |
2016-09-18 20:31:36 INFO LocalJobRunner:591 - | |
2016-09-18 20:31:36 INFO deprecation:1173 - mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords | |
2016-09-18 20:31:36 INFO Task:1038 - Task:attempt_local1137380161_0001_r_000000_0 is done. And is in the process of committing | |
2016-09-18 20:31:36 INFO LocalJobRunner:591 - | |
2016-09-18 20:31:36 INFO Task:1199 - Task attempt_local1137380161_0001_r_000000_0 is allowed to commit now | |
2016-09-18 20:31:36 INFO FileOutputCommitter:482 - Saved output of task 'attempt_local1137380161_0001_r_000000_0' to file:/home/denis/output/_temporary/0/task_local1137380161_0001_r_000000 | |
2016-09-18 20:31:36 INFO LocalJobRunner:591 - reduce > reduce | |
2016-09-18 20:31:36 INFO Task:1158 - Task 'attempt_local1137380161_0001_r_000000_0' done. | |
2016-09-18 20:31:36 INFO LocalJobRunner:325 - Finishing task: attempt_local1137380161_0001_r_000000_0 | |
2016-09-18 20:31:36 INFO LocalJobRunner:456 - reduce task executor complete. | |
2016-09-18 20:31:37 INFO Job:1360 - Job job_local1137380161_0001 running in uber mode : false | |
2016-09-18 20:31:37 INFO Job:1367 - map 0% reduce 100% | |
2016-09-18 20:31:37 INFO Job:1378 - Job job_local1137380161_0001 completed successfully | |
2016-09-18 20:31:37 INFO Job:1385 - Counters: 24 | |
File System Counters | |
FILE: Number of bytes read=22 | |
FILE: Number of bytes written=276109 | |
FILE: Number of read operations=0 | |
FILE: Number of large read operations=0 | |
FILE: Number of write operations=0 | |
Map-Reduce Framework | |
Combine input records=0 | |
Combine output records=0 | |
Reduce input groups=0 | |
Reduce shuffle bytes=0 | |
Reduce input records=0 | |
Reduce output records=0 | |
Spilled Records=0 | |
Shuffled Maps =0 | |
Failed Shuffles=0 | |
Merged Map outputs=0 | |
GC time elapsed (ms)=13 | |
Total committed heap usage (bytes)=119537664 | |
Shuffle Errors | |
BAD_ID=0 | |
CONNECTION=0 | |
IO_ERROR=0 | |
WRONG_LENGTH=0 | |
WRONG_MAP=0 | |
WRONG_REDUCE=0 | |
File Output Format Counters | |
Bytes Written=8 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment