Last active
August 29, 2015 13:56
-
-
Save ottomata/9139443 to your computer and use it in GitHub Desktop.
Broker re-election, can't connect to zookeeper
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [2014-02-21 05:36:33,613] 119762261 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,2] on broker 21: Shrinking ISR for partition [webrequest_bits,2] from 21,22 to 21 | |
| [2014-02-21 05:36:33,932] 119762580 [main-SendThread(analytics1024.eqiad.wmnet:2181)] INFO org.apache.zookeeper.ClientCnxn - Client session timed out, have not heard from server in 13515ms for sessionid 0x425d903a351257, closing socket connection and attempting reconnect | |
| [2014-02-21 05:36:34,057] 119762705 [kafka-logcleaner-1] INFO kafka.log.Log - [Kafka Log on Broker 21], Deleting log segment 2359785906 from webrequest_mobile-6 | |
| [2014-02-21 05:36:34,070] 119762718 [main-EventThread] INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (Disconnected) | |
| [2014-02-21 05:36:34,593] 119763241 [kafka-logcleaner-1] INFO kafka.log.OffsetIndex - Deleting index /var/spool/kafka/d/data/webrequest_mobile-6/00000000002359785906.index | |
| [2014-02-21 05:36:34,594] 119763242 [kafka-logcleaner-1] INFO kafka.log.Log - [Kafka Log on Broker 21], Deleting log segment 4745075575 from webrequest_bits-6 | |
| [2014-02-21 05:36:34,604] 119763252 [main-SendThread(analytics1024.eqiad.wmnet:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server analytics1025.eqiad.wmnet/10.64.36.125:2181 | |
| [2014-02-21 05:36:34,623] 119763271 [main-SendThread(analytics1025.eqiad.wmnet:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to analytics1025.eqiad.wmnet/10.64.36.125:2181, initiating session | |
| [2014-02-21 05:36:34,627] 119763275 [main-EventThread] INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (Expired) | |
| [2014-02-21 05:36:34,627] 119763275 [main-SendThread(analytics1025.eqiad.wmnet:2181)] INFO org.apache.zookeeper.ClientCnxn - Unable to reconnect to ZooKeeper service, session 0x425d903a351257 has expired, closing socket connection | |
| [2014-02-21 05:36:34,627] 119763275 [main-EventThread] INFO org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@34b172ef | |
| [2014-02-21 05:36:34,647] 119763295 [main-SendThread()] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server analytics1024.eqiad.wmnet/10.64.36.124:2181 | |
| [2014-02-21 05:36:34,649] 119763297 [main-EventThread] INFO org.apache.zookeeper.ClientCnxn - EventThread shut down | |
| [2014-02-21 05:36:34,649] 119763297 [main-SendThread(analytics1024.eqiad.wmnet:2181)] INFO org.apache.zookeeper.ClientCnxn - Socket connection established to analytics1024.eqiad.wmnet/10.64.36.124:2181, initiating session | |
| [2014-02-21 05:36:34,671] 119763319 [main-SendThread(analytics1024.eqiad.wmnet:2181)] INFO org.apache.zookeeper.ClientCnxn - Session establishment complete on server analytics1024.eqiad.wmnet/10.64.36.124:2181, sessionid = 0x425d903a351334, negotiated timeout = 6000 | |
| [2014-02-21 05:36:34,671] 119763319 [main-EventThread] INFO org.I0Itec.zkclient.ZkClient - zookeeper state changed (SyncConnected) | |
| [2014-02-21 05:36:34,673] 119763321 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.server.KafkaZooKeeper - re-registering broker info in ZK for broker 21 | |
| [2014-02-21 05:36:34,681] 119763329 [isr-expiration-thread-1] ERROR kafka.utils.ZkUtils$ - Conditional update of path /brokers/topics/webrequest_bits/partitions/2/state with data { "controller_epoch":18, "isr":[ 21 ], "leader":21, "leader_epoch":11, "version":1 } and expected version 381 failed due to org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /brokers/topics/webrequest_bits/partitions/2/state | |
| [2014-02-21 05:36:34,682] 119763330 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,2] on broker 21: Cached zkVersion [381] not equal to that in zookeeper, skip updating ISR | |
| [2014-02-21 05:36:34,682] 119763330 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,0] on broker 21: Shrinking ISR for partition [webrequest_bits,0] from 21,22 to 21 | |
| [2014-02-21 05:36:34,687] 119763335 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.utils.ZkUtils$ - Registered broker 21 at path /brokers/ids/21 with address analytics1021.eqiad.wmnet:9092. | |
| [2014-02-21 05:36:34,695] 119763343 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.server.KafkaZooKeeper - done re-registering broker | |
| [2014-02-21 05:36:34,696] 119763344 [isr-expiration-thread-1] ERROR kafka.utils.ZkUtils$ - Conditional update of path /brokers/topics/webrequest_bits/partitions/0/state with data { "controller_epoch":18, "isr":[ 21 ], "leader":21, "leader_epoch":11, "version":1 } and expected version 317 failed due to org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /brokers/topics/webrequest_bits/partitions/0/state | |
| [2014-02-21 05:36:34,696] 119763344 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,0] on broker 21: Cached zkVersion [317] not equal to that in zookeeper, skip updating ISR | |
| [2014-02-21 05:36:34,696] 119763344 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,4] on broker 21: Shrinking ISR for partition [webrequest_bits,4] from 21,22 to 21 | |
| [2014-02-21 05:36:34,696] 119763344 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.server.KafkaZooKeeper - Subscribing to /brokers/topics path to watch for new topics | |
| [2014-02-21 05:36:34,700] 119763348 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.RequestSendThread - [Controller-21-to-broker-21-send-thread], Shutting down | |
| [2014-02-21 05:36:34,700] 119763348 [kafka-processor-9092-0] INFO kafka.network.Processor - Closing socket connection to /10.64.5.14. | |
| [2014-02-21 05:36:34,700] 119763348 [Controller-21-to-broker-21-send-thread] INFO kafka.controller.RequestSendThread - [Controller-21-to-broker-21-send-thread], Stopped | |
| [2014-02-21 05:36:34,700] 119763348 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.RequestSendThread - [Controller-21-to-broker-21-send-thread], Shutdown completed | |
| [2014-02-21 05:36:34,701] 119763349 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.RequestSendThread - [Controller-21-to-broker-22-send-thread], Shutting down | |
| [2014-02-21 05:36:34,701] 119763349 [Controller-21-to-broker-22-send-thread] INFO kafka.controller.RequestSendThread - [Controller-21-to-broker-22-send-thread], Stopped | |
| [2014-02-21 05:36:34,701] 119763349 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.RequestSendThread - [Controller-21-to-broker-22-send-thread], Shutdown completed | |
| [2014-02-21 05:36:34,704] 119763352 [isr-expiration-thread-1] ERROR kafka.utils.ZkUtils$ - Conditional update of path /brokers/topics/webrequest_bits/partitions/4/state with data { "controller_epoch":18, "isr":[ 21 ], "leader":21, "leader_epoch":11, "version":1 } and expected version 437 failed due to org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /brokers/topics/webrequest_bits/partitions/4/state | |
| [2014-02-21 05:36:34,704] 119763352 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,4] on broker 21: Cached zkVersion [437] not equal to that in zookeeper, skip updating ISR | |
| [2014-02-21 05:36:34,705] 119763353 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,4] on broker 21: Shrinking ISR for partition [webrequest_bits,4] from 21,22 to 21 | |
| [2014-02-21 05:36:34,711] 119763359 [kafka-processor-9092-0] INFO kafka.network.Processor - Closing socket connection to /10.64.36.122. | |
| [2014-02-21 05:36:34,720] 119763368 [isr-expiration-thread-1] ERROR kafka.utils.ZkUtils$ - Conditional update of path /brokers/topics/webrequest_bits/partitions/4/state with data { "controller_epoch":18, "isr":[ 21 ], "leader":21, "leader_epoch":11, "version":1 } and expected version 437 failed due to org.apache.zookeeper.KeeperException$BadVersionException: KeeperErrorCode = BadVersion for /brokers/topics/webrequest_bits/partitions/4/state | |
| [2014-02-21 05:36:34,721] 119763369 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,4] on broker 21: Cached zkVersion [437] not equal to that in zookeeper, skip updating ISR | |
| [2014-02-21 05:36:34,721] 119763369 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.utils.ZkUtils$ - conflict in /controller data: { "brokerid":21, "timestamp":"1392960994701", "version":1 } stored data: { "brokerid":22, "timestamp":"1392960988174", "version":1 } | |
| [2014-02-21 05:36:34,727] 119763375 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine$BrokerChangeListener - [BrokerChangeListener on Controller 21]: Broker change listener fired for path /brokers/ids with children 21,22 | |
| [2014-02-21 05:36:34,731] 119763379 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine$AddPartitionsListener - [AddPartitionsListener on 21]: Add Partition triggered { "partitions":{ "0":[ 21, 22 ], "1":[ 22, 21 ], "2":[ 21, 22 ], "3":[ 22, 21 ], "4":[ 21, 22 ], "5":[ 22, 21 ], "6":[ 21, 22 ], "7":[ 22, 21 ], "8":[ 21, 22 ], "9":[ 22, 21 ] }, "version":1 } for path /brokers/topics/webrequest_mobile | |
| [2014-02-21 05:36:34,744] 119763392 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine$AddPartitionsListener - [AddPartitionsListener on 21]: New partitions to be added [Map()] | |
| [2014-02-21 05:36:34,750] 119763398 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 21]: New partition creation callback for | |
| [2014-02-21 05:36:34,750] 119763398 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 21]: Invoking state change to NewPartition for partitions | |
| [2014-02-21 05:36:34,752] 119763400 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 21]: Invoking state change to NewReplica for replicas | |
| [2014-02-21 05:36:34,752] 119763400 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 21]: Invoking state change to OnlinePartition for partitions | |
| [2014-02-21 05:36:34,752] 119763400 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 21]: Invoking state change to OnlineReplica for replicas | |
| [2014-02-21 05:36:34,755] 119763403 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine$AddPartitionsListener - [AddPartitionsListener on 21]: Add Partition triggered { "partitions":{ "0":[ 21, 22 ], "1":[ 22, 21 ], "2":[ 21, 22 ], "3":[ 22, 21 ], "4":[ 21, 22 ], "5":[ 22, 21 ], "6":[ 21, 22 ], "7":[ 22, 21 ], "8":[ 21, 22 ], "9":[ 22, 21 ] }, "version":1 } for path /brokers/topics/test | |
| [2014-02-21 05:36:34,767] 119763415 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine$AddPartitionsListener - [AddPartitionsListener on 21]: New partitions to be added [Map()] | |
| [2014-02-21 05:36:34,767] 119763415 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 21]: New partition creation callback for | |
| [2014-02-21 05:36:34,768] 119763416 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 21]: Invoking state change to NewPartition for partitions | |
| [2014-02-21 05:36:34,768] 119763416 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 21]: Invoking state change to NewReplica for replicas | |
| [2014-02-21 05:36:34,768] 119763416 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 21]: Invoking state change to OnlinePartition for partitions | |
| [2014-02-21 05:36:34,768] 119763416 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 21]: Invoking state change to OnlineReplica for replicas | |
| [2014-02-21 05:36:34,773] 119763421 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ControllerEpochListener - [ControllerEpochListener on 21]: Initialized controller epoch to 20 and zk version 19 | |
| [2014-02-21 05:36:34,776] 119763424 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.server.ZookeeperLeaderElector$LeaderChangeListener - New leader is 22 | |
| [2014-02-21 05:36:34,784] 119763432 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine$AddPartitionsListener - [AddPartitionsListener on 21]: Add Partition triggered { "partitions":{ "0":[ 21, 22 ], "1":[ 22, 21 ], "2":[ 21, 22 ], "3":[ 22, 21 ], "4":[ 21, 22 ], "5":[ 22, 21 ], "6":[ 21, 22 ], "7":[ 22, 21 ], "8":[ 21, 22 ], "9":[ 22, 21 ] }, "version":1 } for path /brokers/topics/webrequest_bits | |
| [2014-02-21 05:36:34,797] 119763445 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine$AddPartitionsListener - [AddPartitionsListener on 21]: New partitions to be added [Map()] | |
| [2014-02-21 05:36:34,797] 119763445 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 21]: New partition creation callback for | |
| [2014-02-21 05:36:34,797] 119763445 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 21]: Invoking state change to NewPartition for partitions | |
| [2014-02-21 05:36:34,798] 119763446 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 21]: Invoking state change to NewReplica for replicas | |
| [2014-02-21 05:36:34,798] 119763446 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 21]: Invoking state change to OnlinePartition for partitions | |
| [2014-02-21 05:36:34,798] 119763446 [ZkClient-EventThread-33-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 21]: Invoking state change to OnlineReplica for replicas | |
| [2014-02-21 05:36:34,829] 119763477 [kafka-request-handler-0] INFO kafka.server.ReplicaManager - [Replica Manager on Broker 21]: Handling LeaderAndIsr request Name:LeaderAndIsrRequest;Version:0;Controller:22;ControllerEpoch:20;CorrelationId:5;ClientId:id_22-host_null-port_9092;PartitionState:(webrequest_bits,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22);Leaders:id:22,host:analytics1022.eqiad.wmnet,port:9092 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [2014-02-21 05:35:57,746] 117368110 [ReplicaFetcherThread-0-21] INFO kafka.log.Log - [Kafka Log on Broker 22], Rolling log 'webrequest_bits-6' to /var/spool/kafka/l/data/webrequest_bits-6/00000000006744506560.log and /var/spool/kafka/l/data/webrequest_bits-6/00000000006744506560.index | |
| [2014-02-21 05:36:28,182] 117398546 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.server.ZookeeperLeaderElector - 22 successfully elected as leader | |
| [2014-02-21 05:36:28,187] 117398551 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Broker 22 starting become controller state transition | |
| [2014-02-21 05:36:28,200] 117398564 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Controller 22 incremented epoch to 20 | |
| [2014-02-21 05:36:28,697] 117399061 [Controller-22-to-broker-22-send-thread] INFO kafka.controller.RequestSendThread - [Controller-22-to-broker-22-send-thread], Starting | |
| [2014-02-21 05:36:28,700] 117399064 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Currently active brokers in the cluster: Set(22) | |
| [2014-02-21 05:36:28,701] 117399065 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Currently shutting brokers in the cluster: Set() | |
| [2014-02-21 05:36:28,702] 117399066 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Current list of topics in the cluster: Set(webrequest_bits, test, webrequest_mobile) | |
| [2014-02-21 05:36:28,728] 117399092 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 22]: Invoking state change to OnlineReplica for replicas PartitionAndReplica(webrequest_mobile,5,22),PartitionAndReplica(webrequest_bits,5,22),PartitionAndReplica(test,0,22),PartitionAndReplica(webrequest_mobile,1,22),PartitionAndReplica(webrequest_bits,9,22),PartitionAndReplica(webrequest_mobile,9,22),PartitionAndReplica(webrequest_bits,1,22),PartitionAndReplica(webrequest_bits,0,22),PartitionAndReplica(test,1,22),PartitionAndReplica(test,8,22),PartitionAndReplica(webrequest_bits,3,22),PartitionAndReplica(webrequest_mobile,6,22),PartitionAndReplica(webrequest_bits,6,22),PartitionAndReplica(webrequest_bits,8,22),PartitionAndReplica(test,6,22),PartitionAndReplica(test,7,22),PartitionAndReplica(webrequest_bits,7,22),PartitionAndReplica(webrequest_mobile,8,22),PartitionAndReplica(test,2,22),PartitionAndReplica(webrequest_mobile,7,22),PartitionAndReplica(webrequest_mobile,0,22),PartitionAndReplica(test,3,22),PartitionAndReplica(test,4,22),PartitionAndReplica(webrequest_bits,4,22),PartitionAndReplica(webrequest_bits,2,22),PartitionAndReplica(webrequest_mobile,4,22),PartitionAndReplica(webrequest_mobile,2,22),PartitionAndReplica(test,9,22),PartitionAndReplica(webrequest_mobile,3,22),PartitionAndReplica(test,5,22) | |
| [2014-02-21 05:36:28,764] 117399128 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 22]: Started replica state machine with initial state -> Map((test,0,21) -> OfflineReplica, (test,4,21) -> OfflineReplica, (webrequest_bits,4,22) -> OnlineReplica, (test,8,22) -> OnlineReplica, (webrequest_bits,1,22) -> OnlineReplica, (test,8,21) -> OfflineReplica, (test,6,22) -> OnlineReplica, (webrequest_mobile,4,22) -> OnlineReplica, (webrequest_mobile,5,21) -> OfflineReplica, (webrequest_mobile,5,22) -> OnlineReplica, (webrequest_bits,6,21) -> OfflineReplica, (webrequest_bits,8,21) -> OfflineReplica, (webrequest_bits,9,21) -> OfflineReplica, (webrequest_mobile,7,21) -> OfflineReplica, (webrequest_mobile,9,22) -> OnlineReplica, (test,7,22) -> OnlineReplica, (webrequest_bits,9,22) -> OnlineReplica, (webrequest_mobile,3,22) -> OnlineReplica, (webrequest_bits,2,21) -> OfflineReplica, (test,6,21) -> OfflineReplica, (webrequest_mobile,6,21) -> OfflineReplica, (webrequest_bits,3,22) -> OnlineReplica, (webrequest_mobile,6,22) -> OnlineReplica, (webrequest_bits,4,21) -> OfflineReplica, (test,0,22) -> OnlineReplica, (test,1,21) -> OfflineReplica, (webrequest_mobile,0,21) -> OfflineReplica, (test,7,21) -> OfflineReplica, (test,9,22) -> OnlineReplica, (test,5,22) -> OnlineReplica, (webrequest_bits,7,21) -> OfflineReplica, (webrequest_bits,7,22) -> OnlineReplica, (webrequest_bits,0,22) -> OnlineReplica, (webrequest_mobile,1,22) -> OnlineReplica, (webrequest_bits,3,21) -> OfflineReplica, (webrequest_bits,6,22) -> OnlineReplica, (webrequest_mobile,3,21) -> OfflineReplica, (test,3,21) -> OfflineReplica, (test,9,21) -> OfflineReplica, (test,1,22) -> OnlineReplica, (test,2,22) -> OnlineReplica, (webrequest_bits,5,21) -> OfflineReplica, (webrequest_bits,5,22) -> OnlineReplica, (webrequest_bits,0,21) -> OfflineReplica, (webrequest_mobile,8,22) -> OnlineReplica, (webrequest_mobile,8,21) -> OfflineReplica, (webrequest_mobile,1,21) -> OfflineReplica, (test,3,22) -> OnlineReplica, (webrequest_mobile,2,22) -> OnlineReplica, (webrequest_mobile,0,22) -> OnlineReplica, (webrequest_bits,8,22) -> OnlineReplica, (test,2,21) -> OfflineReplica, (webrequest_bits,2,22) -> OnlineReplica, (webrequest_mobile,7,22) -> OnlineReplica, (test,4,22) -> OnlineReplica, (webrequest_mobile,2,21) -> OfflineReplica, (test,5,21) -> OfflineReplica, (webrequest_bits,1,21) -> OfflineReplica, (webrequest_mobile,4,21) -> OfflineReplica, (webrequest_mobile,9,21) -> OfflineReplica) | |
| [2014-02-21 05:36:28,770] 117399134 [kafka-request-handler-1] INFO kafka.server.ReplicaManager - [Replica Manager on Broker 22]: Handling LeaderAndIsr request Name:LeaderAndIsrRequest;Version:0;Controller:22;ControllerEpoch:20;CorrelationId:0;ClientId:id_22-host_null-port_9092;PartitionState:(webrequest_bits,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,2) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,8) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,8) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,4) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,4) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,2) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,2) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,6) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,6) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,8) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,6) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,0) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,4) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,0) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,0) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22);Leaders:id:22,host:analytics1022.eqiad.wmnet,port:9092 | |
| [2014-02-21 05:36:28,782] 117399146 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"16" } for offline partition [test,0] | |
| [2014-02-21 05:36:28,785] 117399149 [kafka-request-handler-1] INFO kafka.server.ReplicaManager - [Replica Manager on Broker 22]: Handled leader and isr request Name:LeaderAndIsrRequest;Version:0;Controller:22;ControllerEpoch:20;CorrelationId:0;ClientId:id_22-host_null-port_9092;PartitionState:(webrequest_bits,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,2) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,8) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,8) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,4) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,4) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,2) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,2) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,6) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,6) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,8) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,6) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,0) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,3) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_bits,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,4) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,1) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,7) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,0) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:11,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22),(test,5) -> (LeaderAndIsrInfo:(Leader:22,ISR:21,22,LeaderEpoch:10,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(webrequest_mobile,9) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,21,LeaderEpoch:6,ControllerEpoch:19),ReplicationFactor:2),AllReplicas:22,21),(test,0) -> (LeaderAndIsrInfo:(Leader:21,ISR:21,22,LeaderEpoch:15,ControllerEpoch:18),ReplicationFactor:2),AllReplicas:21,22);Leaders:id:22,host:analytics1022.eqiad.wmnet,port:9092 | |
| [2014-02-21 05:36:28,811] 117399175 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_bits,4] | |
| [2014-02-21 05:36:28,827] 117399191 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_bits,6] | |
| [2014-02-21 05:36:28,844] 117399208 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_mobile,2] | |
| [2014-02-21 05:36:28,860] 117399224 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_bits,2] | |
| [2014-02-21 05:36:28,877] 117399241 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"16" } for offline partition [test,8] | |
| [2014-02-21 05:36:28,894] 117399258 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_mobile,0] | |
| [2014-02-21 05:36:28,911] 117399275 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"16" } for offline partition [test,4] | |
| [2014-02-21 05:36:28,928] 117399292 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_mobile,8] | |
| [2014-02-21 05:36:28,944] 117399308 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"16" } for offline partition [test,6] | |
| [2014-02-21 05:36:28,960] 117399324 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_bits,8] | |
| [2014-02-21 05:36:28,977] 117399341 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_mobile,4] | |
| [2014-02-21 05:36:28,994] 117399358 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_mobile,6] | |
| [2014-02-21 05:36:29,010] 117399374 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"16" } for offline partition [test,2] | |
| [2014-02-21 05:36:29,027] 117399391 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.OfflinePartitionLeaderSelector - [OfflinePartitionLeaderSelector]: Selected new leader and ISR { "ISR":"22", "leader":"22", "leaderEpoch":"12" } for offline partition [webrequest_bits,0] | |
| [2014-02-21 05:36:29,043] 117399407 [kafka-request-handler-0] INFO kafka.server.ReplicaManager - [Replica Manager on Broker 22]: Handling LeaderAndIsr request Name:LeaderAndIsrRequest;Version:0;Controller:22;ControllerEpoch:20;CorrelationId:1;ClientId:id_22-host_null-port_9092;PartitionState:(test,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22);Leaders:id:22,host:analytics1022.eqiad.wmnet,port:9092 | |
| [2014-02-21 05:36:29,044] 117399408 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [test,2] | |
| [2014-02-21 05:36:29,045] 117399409 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_mobile,8] | |
| [2014-02-21 05:36:29,046] 117399410 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 22]: Started partition state machine with initial state -> Map([test,0] -> OnlinePartition, [webrequest_bits,4] -> OnlinePartition, [webrequest_bits,6] -> OnlinePartition, [webrequest_mobile,3] -> OnlinePartition, [webrequest_mobile,2] -> OnlinePartition, [test,9] -> OnlinePartition, [test,7] -> OnlinePartition, [webrequest_bits,7] -> OnlinePartition, [webrequest_bits,2] -> OnlinePartition, [webrequest_mobile,9] -> OnlinePartition, [webrequest_mobile,5] -> OnlinePartition, [webrequest_bits,5] -> OnlinePartition, [test,8] -> OnlinePartition, [webrequest_mobile,0] -> OnlinePartition, [test,4] -> OnlinePartition, [test,3] -> OnlinePartition, [webrequest_mobile,8] -> OnlinePartition, [webrequest_mobile,7] -> OnlinePartition, [test,6] -> OnlinePartition, [webrequest_bits,9] -> OnlinePartition, [webrequest_mobile,1] -> OnlinePartition, [webrequest_bits,8] -> OnlinePartition, [webrequest_bits,1] -> OnlinePartition, [test,1] -> OnlinePartition, [webrequest_bits,3] -> OnlinePartition, [webrequest_mobile,4] -> OnlinePartition, [webrequest_mobile,6] -> OnlinePartition, [test,2] -> OnlinePartition, [test,5] -> OnlinePartition, [webrequest_bits,0] -> OnlinePartition) | |
| [2014-02-21 05:36:29,046] 117399410 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [test,8] | |
| [2014-02-21 05:36:29,047] 117399411 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [test,4] | |
| [2014-02-21 05:36:29,047] 117399411 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_bits,4] | |
| [2014-02-21 05:36:29,048] 117399412 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_mobile,2] | |
| [2014-02-21 05:36:29,048] 117399412 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_bits,2] | |
| [2014-02-21 05:36:29,048] 117399412 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [test,6] | |
| [2014-02-21 05:36:29,049] 117399413 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_mobile,6] | |
| [2014-02-21 05:36:29,049] 117399413 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_bits,8] | |
| [2014-02-21 05:36:29,050] 117399414 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_bits,6] | |
| [2014-02-21 05:36:29,050] 117399414 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_bits,0] | |
| [2014-02-21 05:36:29,051] 117399415 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_mobile,4] | |
| [2014-02-21 05:36:29,051] 117399415 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [webrequest_mobile,0] | |
| [2014-02-21 05:36:29,052] 117399416 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherManager - [ReplicaFetcherManager on broker 22] Removing fetcher for partition [test,0] | |
| [2014-02-21 05:36:29,053] 117399417 [kafka-request-handler-0] INFO kafka.server.ReplicaManager - [Replica Manager on Broker 22]: Handled leader and isr request Name:LeaderAndIsrRequest;Version:0;Controller:22;ControllerEpoch:20;CorrelationId:1;ClientId:id_22-host_null-port_9092;PartitionState:(test,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,2) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,8) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,6) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_bits,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,4) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(webrequest_mobile,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:12,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22),(test,0) -> (LeaderAndIsrInfo:(Leader:22,ISR:22,LeaderEpoch:16,ControllerEpoch:20),ReplicationFactor:2),AllReplicas:21,22);Leaders:id:22,host:analytics1022.eqiad.wmnet,port:9092 | |
| [2014-02-21 05:36:29,053] 117399417 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherThread - [ReplicaFetcherThread-0-21], Shutting down | |
| [2014-02-21 05:36:29,056] 117399420 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Broker 22 is ready to serve as the new controller with epoch 20 | |
| [2014-02-21 05:36:29,060] 117399424 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Partitions being reassigned: Map() | |
| [2014-02-21 05:36:29,061] 117399425 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Partitions already reassigned: List() | |
| [2014-02-21 05:36:29,062] 117399426 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Resuming reassignment of partitions: Map() | |
| [2014-02-21 05:36:29,066] 117399430 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Partitions undergoing preferred replica election: | |
| [2014-02-21 05:36:29,066] 117399430 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Partitions that completed preferred replica election: | |
| [2014-02-21 05:36:29,067] 117399431 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Resuming preferred replica election for partitions: | |
| [2014-02-21 05:36:29,068] 117399432 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: Starting preferred replica leader election for partitions | |
| [2014-02-21 05:36:29,069] 117399433 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.PartitionStateMachine - [Partition state machine on Controller 22]: Invoking state change to OnlinePartition for partitions | |
| [2014-02-21 05:36:29,103] 117399467 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.server.ZookeeperLeaderElector$LeaderChangeListener - New leader is 22 | |
| [2014-02-21 05:36:29,107] 117399471 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ControllerEpochListener - [ControllerEpochListener on 22]: Initialized controller epoch to 20 and zk version 19 | |
| [2014-02-21 05:36:29,431] 117399795 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,1] on broker 22: Shrinking ISR for partition [webrequest_bits,1] from 22,21 to 22 | |
| [2014-02-21 05:36:29,450] 117399814 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,7] on broker 22: Shrinking ISR for partition [webrequest_bits,7] from 22,21 to 22 | |
| [2014-02-21 05:36:29,458] 117399822 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,5] on broker 22: Shrinking ISR for partition [webrequest_bits,5] from 22,21 to 22 | |
| [2014-02-21 05:36:29,467] 117399831 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,3] on broker 22: Shrinking ISR for partition [webrequest_bits,3] from 22,21 to 22 | |
| [2014-02-21 05:36:29,475] 117399839 [isr-expiration-thread-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,9] on broker 22: Shrinking ISR for partition [webrequest_bits,9] from 22,21 to 22 | |
| [2014-02-21 05:36:34,702] 117405066 [kafka-processor-9092-1] INFO kafka.network.Processor - Closing socket connection to /10.64.5.14. | |
| [2014-02-21 05:36:34,707] 117405071 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine$BrokerChangeListener - [BrokerChangeListener on Controller 22]: Broker change listener fired for path /brokers/ids with children 21,22 | |
| [2014-02-21 05:36:34,711] 117405075 [ReplicaFetcherThread-0-21] INFO kafka.server.ReplicaFetcherThread - [ReplicaFetcherThread-0-21], Stopped | |
| [2014-02-21 05:36:34,711] 117405075 [kafka-request-handler-0] INFO kafka.server.ReplicaFetcherThread - [ReplicaFetcherThread-0-21], Shutdown completed | |
| [2014-02-21 05:36:34,742] 117405106 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine$BrokerChangeListener - [BrokerChangeListener on Controller 22]: Newly added brokers: 21, deleted brokers: , all live brokers: 21,22 | |
| [2014-02-21 05:36:34,747] 117405111 [Controller-22-to-broker-21-send-thread] INFO kafka.controller.RequestSendThread - [Controller-22-to-broker-21-send-thread], Starting | |
| [2014-02-21 05:36:34,750] 117405114 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.KafkaController - [Controller 22]: New broker startup callback for 21 | |
| [2014-02-21 05:36:34,810] 117405174 [ZkClient-EventThread-32-analytics1023.eqiad.wmnet,analytics1024.eqiad.wmnet,analytics1025.eqiad.wmnet/kafka/eqiad] INFO kafka.controller.ReplicaStateMachine - [Replica state machine on controller 22]: Invoking state change to OnlineReplica for replicas PartitionAndReplica(webrequest_mobile,4,21),PartitionAndReplica(webrequest_bits,2,21),PartitionAndReplica(webrequest_bits,0,21),PartitionAndReplica(test,4,21),PartitionAndReplica(test,8,21),PartitionAndReplica(webrequest_mobile,5,21),PartitionAndReplica(webrequest_bits,9,21),PartitionAndReplica(webrequest_bits,4,21),PartitionAndReplica(test,7,21),PartitionAndReplica(webrequest_mobile,0,21),PartitionAndReplica(webrequest_bits,6,21),PartitionAndReplica(test,5,21),PartitionAndReplica(webrequest_bits,3,21),PartitionAndReplica(webrequest_mobile,6,21),PartitionAndReplica(webrequest_mobile,8,21),PartitionAndReplica(test,3,21),PartitionAndReplica(test,6,21),PartitionAndReplica(test,2,21),PartitionAndReplica(webrequest_mobile,3,21),PartitionAndReplica(webrequest_mobile,2,21),PartitionAndReplica(webrequest_bits,7,21),PartitionAndReplica(test,1,21),PartitionAndReplica(test,0,21),PartitionAndReplica(webrequest_bits,5,21),PartitionAndReplica(webrequest_bits,8,21),PartitionAndReplica(webrequest_mobile,9,21),PartitionAndReplica(webrequest_bits,1,21),PartitionAndReplica(test,9,21),PartitionAndReplica(webrequest_mobile,1,21),PartitionAndReplica(webrequest_mobile,7,21) | |
| [2014-02-21 05:36:35,053] 117405417 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [test,2] on broker 22: Expanding ISR for partition [test,2] from 22 to 22,21 | |
| [2014-02-21 05:36:35,576] 117405940 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_mobile,8] on broker 22: Expanding ISR for partition [webrequest_mobile,8] from 22 to 22,21 | |
| [2014-02-21 05:36:35,597] 117405961 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [test,8] on broker 22: Expanding ISR for partition [test,8] from 22 to 22,21 | |
| [2014-02-21 05:36:35,605] 117405969 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [test,4] on broker 22: Expanding ISR for partition [test,4] from 22 to 22,21 | |
| [2014-02-21 05:36:35,614] 117405978 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_bits,4] on broker 22: Expanding ISR for partition [webrequest_bits,4] from 22 to 22,21 | |
| [2014-02-21 05:36:35,622] 117405986 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_mobile,2] on broker 22: Expanding ISR for partition [webrequest_mobile,2] from 22 to 22,21 | |
| [2014-02-21 05:36:35,630] 117405994 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_bits,2] on broker 22: Expanding ISR for partition [webrequest_bits,2] from 22 to 22,21 | |
| [2014-02-21 05:36:35,641] 117406005 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [test,6] on broker 22: Expanding ISR for partition [test,6] from 22 to 22,21 | |
| [2014-02-21 05:36:35,650] 117406014 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_mobile,6] on broker 22: Expanding ISR for partition [webrequest_mobile,6] from 22 to 22,21 | |
| [2014-02-21 05:36:35,663] 117406027 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_bits,8] on broker 22: Expanding ISR for partition [webrequest_bits,8] from 22 to 22,21 | |
| [2014-02-21 05:36:35,675] 117406039 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_bits,6] on broker 22: Expanding ISR for partition [webrequest_bits,6] from 22 to 22,21 | |
| [2014-02-21 05:36:35,683] 117406047 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_bits,0] on broker 22: Expanding ISR for partition [webrequest_bits,0] from 22 to 22,21 | |
| [2014-02-21 05:36:35,691] 117406055 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_mobile,4] on broker 22: Expanding ISR for partition [webrequest_mobile,4] from 22 to 22,21 | |
| [2014-02-21 05:36:35,700] 117406064 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [webrequest_mobile,0] on broker 22: Expanding ISR for partition [webrequest_mobile,0] from 22 to 22,21 | |
| [2014-02-21 05:36:35,708] 117406072 [kafka-request-handler-0] INFO kafka.cluster.Partition - Partition [test,0] on broker 22: Expanding ISR for partition [test,0] from 22 to 22,21 | |
| [2014-02-21 05:36:37,080] 117407444 [kafka-request-handler-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,9] on broker 22: Expanding ISR for partition [webrequest_bits,9] from 22 to 22,21 | |
| [2014-02-21 05:36:37,121] 117407485 [kafka-request-handler-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,1] on broker 22: Expanding ISR for partition [webrequest_bits,1] from 22 to 22,21 | |
| [2014-02-21 05:36:37,145] 117407509 [kafka-request-handler-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,5] on broker 22: Expanding ISR for partition [webrequest_bits,5] from 22 to 22,21 | |
| [2014-02-21 05:36:37,155] 117407519 [kafka-request-handler-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,3] on broker 22: Expanding ISR for partition [webrequest_bits,3] from 22 to 22,21 | |
| [2014-02-21 05:36:37,163] 117407527 [kafka-request-handler-1] INFO kafka.cluster.Partition - Partition [webrequest_bits,7] on broker 22: Expanding ISR for partition [webrequest_bits,7] from 22 to 22,21 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # grep kafka | grep -v consumer | |
| 2014-02-21 05:36:29,079 - INFO [ProcessThread:-1:PrepRequestProcessor@419] - Got user-level KeeperException when processing sessionid:0x425d903a35125e type:delete cxid:0x8da95 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/kafka/eqiad/admin/preferred_replica_election Error:KeeperErrorCode = NoNode for /kafka/eqiad/admin/preferred_replica_election | |
| 2014-02-21 05:36:34,673 - INFO [ProcessThread:-1:PrepRequestProcessor@419] - Got user-level KeeperException when processing sessionid:0x425d903a351334 type:setData cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/kafka/eqiad/brokers/topics/webrequest_bits/partitions/2/state Error:KeeperErrorCode = BadVersion for /kafka/eqiad/brokers/topics/webrequest_bits/partitions/2/state | |
| 2014-02-21 05:36:34,683 - INFO [ProcessThread:-1:PrepRequestProcessor@419] - Got user-level KeeperException when processing sessionid:0x425d903a351334 type:setData cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/kafka/eqiad/brokers/topics/webrequest_bits/partitions/0/state Error:KeeperErrorCode = BadVersion for /kafka/eqiad/brokers/topics/webrequest_bits/partitions/0/state | |
| 2014-02-21 05:36:34,697 - INFO [ProcessThread:-1:PrepRequestProcessor@419] - Got user-level KeeperException when processing sessionid:0x425d903a351334 type:setData cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/kafka/eqiad/brokers/topics/webrequest_bits/partitions/4/state Error:KeeperErrorCode = BadVersion for /kafka/eqiad/brokers/topics/webrequest_bits/partitions/4/state | |
| 2014-02-21 05:36:34,702 - INFO [ProcessThread:-1:PrepRequestProcessor@419] - Got user-level KeeperException when processing sessionid:0x425d903a351334 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/kafka/eqiad/controller Error:KeeperErrorCode = NodeExists for /kafka/eqiad/controller | |
| 2014-02-21 05:36:34,706 - INFO [ProcessThread:-1:PrepRequestProcessor@419] - Got user-level KeeperException when processing sessionid:0x425d903a351334 type:setData cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/kafka/eqiad/brokers/topics/webrequest_bits/partitions/4/state Error:KeeperErrorCode = BadVersion for /kafka/eqiad/brokers/topics/webrequest_bits/partitions/4/state |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment