Created
February 20, 2016 02:01
-
-
Save justizin/524359df94b2fe31d906 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| zk01:~$ HADOOP_USER_NAME=hdfs hdfs balancer | |
| 16/02/19 17:59:44 INFO balancer.Balancer: namenodes = [hdfs://zk01.aur.test.ziprealty.com] | |
| 16/02/19 17:59:44 INFO balancer.Balancer: p = Balancer.Parameters[BalancingPolicy.Node, threshold=10.0, number of datanodes=0, exclude=true] | |
| Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.248:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.245:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.250:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.241:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.242:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.243:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.247:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.249:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.246:50010 | |
| 16/02/19 17:59:44 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.244:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: 2 over-utilized: [Source[10.100.6.243:50010, utilization=30.13183802935085], Source[10.100.6.244:50010, utilization=31.40537066937403]] | |
| 16/02/19 17:59:44 INFO balancer.Balancer: 0 underutilized: [] | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Need to move 1.34 GB to make the cluster balanced. | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 933.20 MB bytes from 10.100.6.243:50010 to 10.100.6.248:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 116.75 MB bytes from 10.100.6.243:50010 to 10.100.6.245:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 449.05 MB bytes from 10.100.6.243:50010 to 10.100.6.250:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 173.18 MB bytes from 10.100.6.244:50010 to 10.100.6.250:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 649.71 MB bytes from 10.100.6.244:50010 to 10.100.6.241:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 640.23 MB bytes from 10.100.6.244:50010 to 10.100.6.242:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Decided to move 35.88 MB bytes from 10.100.6.244:50010 to 10.100.6.247:50010 | |
| 16/02/19 17:59:44 INFO balancer.Balancer: Will move 2.93 GB in this iteration | |
| Feb 19, 2016 5:59:44 PM 0 0 B 1.34 GB 2.93 GB | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741980_1156 with size=46000000 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.245:50010: block move is failed: Not able to receive block 1073741980 from /10.100.6.251:47227 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741969_1145 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.247:50010: block move is failed: Not able to receive block 1073741969 from /10.100.6.251:47181 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741975_1151 with size=45967184 from 10.100.6.244:50010 to 10.100.6.241:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741975 from /10.100.6.251:39982 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741978_1154 with size=46000000 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741978 from /10.100.6.251:47229 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741970_1146 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.247:50010: block move is failed: Not able to receive block 1073741970 from /10.100.6.251:47180 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741974_1150 with size=45967182 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741974 from /10.100.6.251:47231 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741976_1152 with size=46000000 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741976 from /10.100.6.251:47230 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741981_1157 with size=46000000 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741981 from /10.100.6.251:47228 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741965_1141 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741965 from /10.100.6.251:47182 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741972_1148 with size=45032818 from 10.100.6.244:50010 to 10.100.6.241:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741972 from /10.100.6.251:39983 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741971_1147 with size=45000000 from 10.100.6.244:50010 to 10.100.6.241:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741971 from /10.100.6.251:39984 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741964_1140 with size=45000000 from 10.100.6.244:50010 to 10.100.6.241:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741964 from /10.100.6.251:39986 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741966_1142 with size=45000000 from 10.100.6.244:50010 to 10.100.6.241:50010 through 10.100.6.248:50010: block move is failed: Not able to receive block 1073741966 from /10.100.6.251:39985 because threads quota is exceeded. | |
| 16/02/19 17:59:44 WARN balancer.Balancer: Failed to move blk_1073741959_1135 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.246:50010: block move is failed: Not able to receive block 1073741959 from /10.100.6.251:47183 because threads quota is exceeded. | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.246:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.248:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.247:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.245:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.250:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.243:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.244:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.242:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.249:50010 | |
| 16/02/19 17:59:54 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.241:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: 2 over-utilized: [Source[10.100.6.243:50010, utilization=30.13183802935085], Source[10.100.6.244:50010, utilization=31.40537066937403]] | |
| 16/02/19 17:59:54 INFO balancer.Balancer: 0 underutilized: [] | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Need to move 1.34 GB to make the cluster balanced. | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 185.59 MB bytes from 10.100.6.243:50010 to 10.100.6.246:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 933.20 MB bytes from 10.100.6.243:50010 to 10.100.6.248:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 380.21 MB bytes from 10.100.6.243:50010 to 10.100.6.247:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 618.89 MB bytes from 10.100.6.244:50010 to 10.100.6.247:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 116.75 MB bytes from 10.100.6.244:50010 to 10.100.6.245:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 622.23 MB bytes from 10.100.6.244:50010 to 10.100.6.250:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Decided to move 141.13 MB bytes from 10.100.6.244:50010 to 10.100.6.242:50010 | |
| 16/02/19 17:59:54 INFO balancer.Balancer: Will move 2.93 GB in this iteration | |
| Feb 19, 2016 5:59:54 PM 1 0 B 1.34 GB 2.93 GB | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741943_1119 with size=45000000 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741943 from /10.100.6.251:44275 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741940_1116 with size=45000000 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741940 from /10.100.6.251:44277 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741934_1110 with size=43777770 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741934 from /10.100.6.251:44276 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741925_1101 with size=46000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.250:50010: block move is failed: Not able to receive block 1073741925 from /10.100.6.251:48715 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741918_1094 with size=46000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.250:50010: block move is failed: Not able to receive block 1073741918 from /10.100.6.251:45332 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741920_1096 with size=46000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.250:50010: block move is failed: Not able to receive block 1073741920 from /10.100.6.251:45331 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741938_1114 with size=44993014 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741938 from /10.100.6.251:44281 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741933_1109 with size=17865496 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.244:50010: block move is failed: opReplaceBlock BP-960830245-10.100.6.251-1455343048711:blk_1073741933_1109 received exception java.io.IOException: Copy block BP-960830245-10.100.6.251-1455343048711:blk_1073741933_1109 from /10.100.6.244:50010 failed | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741932_1108 with size=17865452 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741932 from /10.100.6.251:44280 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741917_1093 with size=46000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.241:50010: block move is failed: Not able to receive block 1073741917 from /10.100.6.251:45333 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741922_1098 with size=46000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.249:50010: block move is failed: opReplaceBlock BP-960830245-10.100.6.251-1455343048711:blk_1073741922_1098 received exception java.io.IOException: Copy block BP-960830245-10.100.6.251-1455343048711:blk_1073741922_1098 from /10.100.6.249:50010 failed | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741926_1102 with size=46000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.249:50010: block move is failed: opReplaceBlock BP-960830245-10.100.6.251-1455343048711:blk_1073741926_1102 received exception java.io.IOException: Copy block BP-960830245-10.100.6.251-1455343048711:blk_1073741926_1102 from /10.100.6.249:50010 failed | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741937_1113 with size=44006984 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.243:50010: block move is failed: opReplaceBlock BP-960830245-10.100.6.251-1455343048711:blk_1073741937_1113 received exception java.io.IOException: Copy block BP-960830245-10.100.6.251-1455343048711:blk_1073741937_1113 from /10.100.6.243:50010 failed | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741916_1092 with size=46000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.245:50010: block move is failed: Not able to receive block 1073741916 from /10.100.6.251:45334 because threads quota is exceeded. | |
| 16/02/19 17:59:54 WARN balancer.Balancer: Failed to move blk_1073741915_1091 with size=46000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.249:50010: block move is failed: Not able to receive block 1073741915 from /10.100.6.251:45335 because threads quota is exceeded. | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.245:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.249:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.241:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.248:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.247:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.250:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.244:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.243:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.242:50010 | |
| 16/02/19 18:00:05 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.246:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: 2 over-utilized: [Source[10.100.6.244:50010, utilization=31.40537066937403], Source[10.100.6.243:50010, utilization=30.13183802935085]] | |
| 16/02/19 18:00:05 INFO balancer.Balancer: 0 underutilized: [] | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Need to move 1.34 GB to make the cluster balanced. | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 116.75 MB bytes from 10.100.6.244:50010 to 10.100.6.245:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 220.75 MB bytes from 10.100.6.244:50010 to 10.100.6.249:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 649.71 MB bytes from 10.100.6.244:50010 to 10.100.6.241:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 511.79 MB bytes from 10.100.6.244:50010 to 10.100.6.248:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 421.41 MB bytes from 10.100.6.243:50010 to 10.100.6.248:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 999.10 MB bytes from 10.100.6.243:50010 to 10.100.6.247:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Decided to move 78.49 MB bytes from 10.100.6.243:50010 to 10.100.6.250:50010 | |
| 16/02/19 18:00:05 INFO balancer.Balancer: Will move 2.93 GB in this iteration | |
| Feb 19, 2016 6:00:05 PM 2 0 B 1.34 GB 2.93 GB | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741968_1144 with size=45000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741968 from /10.100.6.251:48735 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741967_1143 with size=45000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741967 from /10.100.6.251:48746 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741973_1149 with size=45032816 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741973 from /10.100.6.251:45347 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741956_1132 with size=45000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741956 from /10.100.6.251:45350 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741962_1138 with size=45000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.241:50010: block move is failed: Not able to receive block 1073741962 from /10.100.6.251:45351 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741958_1134 with size=45000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.246:50010: block move is failed: Not able to receive block 1073741958 from /10.100.6.251:45353 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741964_1140 with size=45000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741964 from /10.100.6.251:48744 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741971_1147 with size=45000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.243:50010: block move is failed: opReplaceBlock BP-960830245-10.100.6.251-1455343048711:blk_1073741971_1147 received exception java.io.IOException: Copy block BP-960830245-10.100.6.251-1455343048711:blk_1073741971_1147 from /10.100.6.243:50010 failed | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741960_1136 with size=45000000 from 10.100.6.243:50010 to 10.100.6.247:50010 through 10.100.6.249:50010: block move is failed: Not able to receive block 1073741960 from /10.100.6.251:45352 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741965_1141 with size=45000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.244:50010: block move is failed: opReplaceBlock BP-960830245-10.100.6.251-1455343048711:blk_1073741965_1141 received exception java.io.IOException: Copy block BP-960830245-10.100.6.251-1455343048711:blk_1073741965_1141 from /10.100.6.244:50010 failed | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741957_1133 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.246:50010: block move is failed: Not able to receive block 1073741957 from /10.100.6.251:47285 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741949_1125 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.245:50010: block move is failed: Not able to receive block 1073741949 from /10.100.6.251:47288 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741950_1126 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.246:50010: block move is failed: Not able to receive block 1073741950 from /10.100.6.251:47286 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741955_1131 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.249:50010: block move is failed: Not able to receive block 1073741955 from /10.100.6.251:47290 because threads quota is exceeded. | |
| 16/02/19 18:00:05 WARN balancer.Balancer: Failed to move blk_1073741951_1127 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741951 from /10.100.6.251:47287 because threads quota is exceeded. | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.248:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.245:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.246:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.244:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.243:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.250:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.242:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.249:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.241:50010 | |
| 16/02/19 18:00:16 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.247:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: 2 over-utilized: [Source[10.100.6.244:50010, utilization=31.40537066937403], Source[10.100.6.243:50010, utilization=30.13183802935085]] | |
| 16/02/19 18:00:16 INFO balancer.Balancer: 0 underutilized: [] | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Need to move 1.34 GB to make the cluster balanced. | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 933.20 MB bytes from 10.100.6.244:50010 to 10.100.6.248:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 116.75 MB bytes from 10.100.6.244:50010 to 10.100.6.245:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 185.59 MB bytes from 10.100.6.244:50010 to 10.100.6.246:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 263.46 MB bytes from 10.100.6.244:50010 to 10.100.6.250:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 358.77 MB bytes from 10.100.6.243:50010 to 10.100.6.250:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 640.23 MB bytes from 10.100.6.243:50010 to 10.100.6.242:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 220.75 MB bytes from 10.100.6.243:50010 to 10.100.6.249:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Decided to move 279.25 MB bytes from 10.100.6.243:50010 to 10.100.6.241:50010 | |
| 16/02/19 18:00:16 INFO balancer.Balancer: Will move 2.93 GB in this iteration | |
| Feb 19, 2016 6:00:16 PM 3 0 B 1.34 GB 2.93 GB | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741991_1167 with size=45000000 from 10.100.6.243:50010 to 10.100.6.242:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741991 from /10.100.6.251:47251 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741985_1161 with size=43777780 from 10.100.6.243:50010 to 10.100.6.242:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741985 from /10.100.6.251:47252 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741990_1166 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.249:50010: block move is failed: Not able to receive block 1073741990 from /10.100.6.251:47304 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741995_1171 with size=45000000 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741995 from /10.100.6.251:47303 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741986_1162 with size=44009161 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741986 from /10.100.6.251:47307 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741987_1163 with size=44009162 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741987 from /10.100.6.251:47305 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741989_1165 with size=44990839 from 10.100.6.243:50010 to 10.100.6.250:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741989 from /10.100.6.251:47306 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741977_1153 with size=46000000 from 10.100.6.243:50010 to 10.100.6.242:50010 through 10.100.6.243:50010: block move is failed: Not able to receive block 1073741977 from /10.100.6.251:47253 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741960_1136 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.6.248:50010: block move is failed: Not able to receive block 1073741960 from /10.100.6.251:40062 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741958_1134 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.6.246:50010: block move is failed: Not able to receive block 1073741958 from /10.100.6.251:40065 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741957_1133 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.6.246:50010: block move is failed: Not able to receive block 1073741957 from /10.100.6.251:40068 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741973_1149 with size=45032816 from 10.100.6.243:50010 to 10.100.6.242:50010 through 10.100.6.245:50010: block move is failed: Not able to receive block 1073741973 from /10.100.6.251:47262 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741976_1152 with size=46000000 from 10.100.6.243:50010 to 10.100.6.242:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741976 from /10.100.6.251:47257 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741967_1143 with size=45000000 from 10.100.6.243:50010 to 10.100.6.241:50010 through 10.100.6.245:50010: block move is failed: Not able to receive block 1073741967 from /10.100.6.251:40070 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741962_1138 with size=45000000 from 10.100.6.243:50010 to 10.100.6.249:50010 through 10.100.6.241:50010: block move is failed: Not able to receive block 1073741962 from /10.100.6.251:57470 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741974_1150 with size=45967182 from 10.100.6.243:50010 to 10.100.6.249:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741974 from /10.100.6.251:57473 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741964_1140 with size=45000000 from 10.100.6.243:50010 to 10.100.6.249:50010 through 10.100.6.247:50010: block move is failed: Not able to receive block 1073741964 from /10.100.6.251:57476 because threads quota is exceeded. | |
| 16/02/19 18:00:16 WARN balancer.Balancer: Failed to move blk_1073741971_1147 with size=45000000 from 10.100.6.243:50010 to 10.100.6.249:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741971 from /10.100.6.251:57477 because threads quota is exceeded. | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.246:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.248:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.250:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.247:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.243:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.249:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.244:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.242:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.241:50010 | |
| 16/02/19 18:00:27 INFO net.NetworkTopology: Adding a new node: /default-rack/10.100.6.245:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: 2 over-utilized: [Source[10.100.6.243:50010, utilization=30.13183802935085], Source[10.100.6.244:50010, utilization=31.40537066937403]] | |
| 16/02/19 18:00:27 INFO balancer.Balancer: 0 underutilized: [] | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Need to move 1.34 GB to make the cluster balanced. | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 185.59 MB bytes from 10.100.6.243:50010 to 10.100.6.246:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 933.20 MB bytes from 10.100.6.243:50010 to 10.100.6.248:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 380.21 MB bytes from 10.100.6.243:50010 to 10.100.6.250:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 242.02 MB bytes from 10.100.6.244:50010 to 10.100.6.250:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 999.10 MB bytes from 10.100.6.244:50010 to 10.100.6.247:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 220.75 MB bytes from 10.100.6.244:50010 to 10.100.6.249:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Decided to move 37.12 MB bytes from 10.100.6.244:50010 to 10.100.6.242:50010 | |
| 16/02/19 18:00:27 INFO balancer.Balancer: Will move 2.93 GB in this iteration | |
| Feb 19, 2016 6:00:27 PM 4 0 B 1.34 GB 2.93 GB | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741982_1158 with size=40951868 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: block move is failed: Not able to receive block 1073741982 from /10.100.6.251:47336 because threads quota is exceeded. | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741969_1145 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.241:50010: block move is failed: Not able to receive block 1073741969 from /10.100.6.251:47289 because threads quota is exceeded. | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741966_1142 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.248:50010: block move is failed: Not able to receive block 1073741966 from /10.100.6.251:47290 because threads quota is exceeded. | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741980_1156 with size=46000000 from 10.100.6.244:50010 to 10.100.6.247:50010 through 10.100.6.245:50010: block move is failed: Not able to receive block 1073741980 from /10.100.6.251:45420 because threads quota is exceeded. | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741985_1161 with size=43777780 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.241:50010: block move is failed: Not able to receive block 1073741985 from /10.100.6.251:44378 because threads quota is exceeded. | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741977_1153 with size=46000000 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.248:50010: block move is failed: Not able to receive block 1073741977 from /10.100.6.251:44377 because threads quota is exceeded. | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741978_1154 with size=46000000 from 10.100.6.244:50010 to 10.100.6.247:50010 through 10.100.6.248:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741975_1151 with size=45967184 from 10.100.6.244:50010 to 10.100.6.249:50010 through 10.100.6.246:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741959_1135 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.246:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741967_1143 with size=45000000 from 10.100.6.243:50010 to 10.100.6.248:50010 through 10.100.6.245:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741965_1141 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.243:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741976_1152 with size=46000000 from 10.100.6.244:50010 to 10.100.6.247:50010 through 10.100.6.249:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741989_1165 with size=44990839 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.243:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741972_1148 with size=45032818 from 10.100.6.244:50010 to 10.100.6.249:50010 through 10.100.6.248:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741974_1150 with size=45967182 from 10.100.6.244:50010 to 10.100.6.247:50010 through 10.100.6.243:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741970_1146 with size=45000000 from 10.100.6.244:50010 to 10.100.6.249:50010 through 10.100.6.241:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741987_1163 with size=44009162 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741984_1160 with size=43777785 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741988_1164 with size=44990839 from 10.100.6.244:50010 to 10.100.6.250:50010 through 10.100.6.244:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741964_1140 with size=45000000 from 10.100.6.244:50010 to 10.100.6.242:50010 through 10.100.6.243:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741971_1147 with size=45000000 from 10.100.6.244:50010 to 10.100.6.249:50010 through 10.100.6.243:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741973_1149 with size=45032816 from 10.100.6.243:50010 to 10.100.6.246:50010 through 10.100.6.245:50010: Message missing required fields: status | |
| 16/02/19 18:00:27 WARN balancer.Balancer: Failed to move blk_1073741981_1157 with size=46000000 from 10.100.6.244:50010 to 10.100.6.247:50010 through 10.100.6.244:50010: Message missing required fields: status | |
| No block has been moved for 5 iterations. Exiting... | |
| Balancing took 1.2343666666666666 minutes |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment