Skip to content

Instantly share code, notes, and snippets.

@tcrayford
Created July 19, 2016 14:15
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tcrayford/cbf3d5aa1c46194eb7a98786d83b0eab to your computer and use it in GitHub Desktop.
Save tcrayford/cbf3d5aa1c46194eb7a98786d83b0eab to your computer and use it in GitHub Desktop.
[0000] 18 Jul 19:13:23.329 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4001ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect
[0000] 18 Jul 19:13:23.429 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:13:23.564 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:13:23.565 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:13:26.449 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000
[0000] 18 Jul 19:13:26.450 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:21:15.667 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect
[0000] 18 Jul 19:21:15.767 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:21:16.691 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:21:17.466 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:21:17.468 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000
[0000] 18 Jul 19:21:17.468 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:21:29.688 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4000ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect
[0000] 18 Jul 19:21:29.789 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:21:30.522 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:21:30.523 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:21:30.525 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000
[0000] 18 Jul 19:21:30.525 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:27.401 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:27.502 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:27.521 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:28.344 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230000, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:28.445 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:28.698 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:29.18 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:37:29.18 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:37:29.20 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000
[0000] 18 Jul 19:37:29.20 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230000, negotiated timeout = 6000
[0000] 18 Jul 19:37:29.21 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:29.21 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:33.24 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230000, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:33.25 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4003ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:33.125 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:33.125 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:33.205 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:33.206 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:37:33.822 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:33.823 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230000, negotiated timeout = 6000
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:43:05.859 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x155e49f2b230000, likely server has closed socket, closing socket connection and attempting reconnect
[0000] 18 Jul 19:43:05.861 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x155e49f2b230001, likely server has closed socket, closing socket connection and attempting reconnect
[0000] 18 Jul 19:43:05.960 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:43:05.961 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:43:05.961 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkClient Waiting for keeper state SyncConnected
[0000] 18 Jul 19:43:05.985 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.44 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.556 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:43:06.556 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired)
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x155e49f2b230001 has expired, closing socket connection
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@79e2c065
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x155e49f2b230000 has expired, closing socket connection
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired)
[0000] 18 Jul 19:43:06.558 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@4d14b6c2
[0000] 18 Jul 19:43:06.558 * app=kafka broker=0 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down
[0000] 18 Jul 19:43:06.559 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.559 * app=kafka broker=0 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down
[0000] 18 Jul 19:43:06.572 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:43:06.572 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.573 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:43:06.580 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230004, negotiated timeout = 6000
[0000] 18 Jul 19:43:06.580 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:43:06.582 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x55e49f2b1d52eb, negotiated timeout = 6000
[0000] 18 Jul 19:43:06.582 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:43:06.583 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Creating /controller (is it secure? false)
[0000] 18 Jul 19:43:06.585 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Result of znode creation is: OK
[0000] 18 Jul 19:43:06.586 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector 0 successfully elected as leader
[0000] 18 Jul 19:43:06.586 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Broker 0 starting become controller state transition
[0000] 18 Jul 19:43:06.588 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Initialized controller epoch to 2 and zk version 1
[0000] 18 Jul 19:43:06.590 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Controller 0 incremented epoch to 3
[0000] 18 Jul 19:43:06.795 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions undergoing preferred replica election:
[0000] 18 Jul 19:43:06.796 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions that completed preferred replica election:
[0000] 18 Jul 19:43:06.796 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Resuming preferred replica election for partitions:
[0000] 18 Jul 19:43:06.798 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions being reassigned: Map()
[0000] 18 Jul 19:43:06.798 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions already reassigned: List()
[0000] 18 Jul 19:43:06.798 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Resuming reassignment of partitions: Map()
[0000] 18 Jul 19:43:06.801 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: List of topics to be deleted:
[0000] 18 Jul 19:43:06.802 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: List of topics ineligible for deletion: __consumer_offsets,REDACTED_TOPIC
[0000] 18 Jul 19:43:06.804 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Currently active brokers in the cluster: Set()
[0000] 18 Jul 19:43:06.804 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Currently shutting brokers in the cluster: Set()
[0000] 18 Jul 19:43:06.804 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Current list of topics in the cluster: Set(REDACTED_TOPIC, __consumer_offsets)
[0000] 18 Jul 19:43:06.812 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 0]: Started replica state machine with initial state -> Map([Topic=__consumer_offsets,Partition=48,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=39,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=6,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=21,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=17,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=30,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=33,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=22,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=11,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=10,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=18,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=5,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=27,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=21,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=11,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=17,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=12,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=9,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=28,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=6,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=20,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=3,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=19,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=49,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=20,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=45,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=22,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=14,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=18,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=13,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=10,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=5,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=27,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=34,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=32,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=14,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=26,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=44,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=11,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=3,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=10,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=42,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=38,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=43,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=48,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=30,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=46,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=24,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=8,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=12,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=16,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=33,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=28,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=47,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=16,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=37,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=2,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=36,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=29,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=40,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=16,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=4,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=0,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=7,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=21,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=15,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=3,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=42,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=23,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=1,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=13,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=46,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=28,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=32,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=23,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=44,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=2,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=43,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=19,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=11,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=23,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=29,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=7,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=4,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=4,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=40,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=15,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=29,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=28,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=25,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=22,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=12,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=15,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=27,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=3,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=7,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=17,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=38,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=16,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=26,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=8,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=36,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=30,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=17,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=8,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=34,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=37,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=49,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=29,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=23,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=45,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=31,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=0,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=26,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=5,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=27,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=41,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=18,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=10,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=2,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=7,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=24,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=30,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=31,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=1,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=31,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=1,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=21,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=0,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=6,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=35,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=24,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=0,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=41,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=19,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=25,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=20,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=19,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=20,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=22,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=9,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=9,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=14,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=5,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=31,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=14,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=4,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=1,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=8,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=26,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=25,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=13,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=24,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=2,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=6,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=18,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=15,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=25,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=12,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=47,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=35,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=13,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=9,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=39,Replica=1] -> ReplicaDeletionIneligible)
[0000] 18 Jul 19:43:06.821 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,19] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,19] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.824 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,7] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,7] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.828 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,30] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,30] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.832 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,47] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,47] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.835 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,23] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,23] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.839 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,29] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,29] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.845 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,41] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,41] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.848 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,16] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,16] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.851 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,13] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,13] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.855 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,39] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,39] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.859 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,17] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,17] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.862 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,10] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,10] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.866 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,14] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,14] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.869 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,40] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,40] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.873 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,17] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,17] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.878 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,18] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,18] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.882 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,26] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,26] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.885 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,0] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,0] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.889 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,27] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,27] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.893 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,24] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,24] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.898 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,11] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,11] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.901 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,5] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,5] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.905 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,33] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,33] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.908 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,26] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,26] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.911 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,22] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,22] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.914 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,31] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,31] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.917 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,20] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,20] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.926 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,3] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,3] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.931 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,21] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,21] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.934 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,5] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,5] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.938 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,22] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,22] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.941 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,1] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,1] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.944 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,25] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,25] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.947 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,9] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,9] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.950 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,14] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,14] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.956 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,18] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,18] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.960 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,21] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,21] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.963 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,12] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,12] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.966 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,8] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,8] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.970 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,23] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,23] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.973 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,15] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,15] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.977 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,48] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,48] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.980 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,20] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,20] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.984 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,11] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,11] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.987 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,8] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,8] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.991 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,13] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,13] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.994 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,2] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,2] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.997 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,30] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,30] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.0 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,0] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,0] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.3 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,49] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,49] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.7 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,6] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,6] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.10 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,4] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,4] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.13 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,28] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,28] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.16 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,37] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,37] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.19 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,31] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,31] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.22 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,44] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,44] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.25 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,42] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,42] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.29 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,34] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,34] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.32 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,46] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,46] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.36 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,10] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,10] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.40 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,29] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,29] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.43 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,24] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,24] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.46 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,25] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,25] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.49 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,15] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,15] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.52 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,6] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,6] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.55 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,45] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,45] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.58 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,27] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,27] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.61 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,32] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,32] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.64 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,43] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,43] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.67 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,19] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,19] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.70 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,36] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,36] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:07.73 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,35] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,35] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:09.447 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,7] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,7] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:09.450 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,9] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,9] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:09.455 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,28] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,28] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:09.459 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,4] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,4] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:09.476 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,38] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,38] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:09.489 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,3] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,3] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:10.706 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,12] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,12] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:10.710 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,1] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,1] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:10.713 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,16] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,16] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:10.716 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,2] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,2] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)]
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75)
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345)
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120)
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117)
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777)
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117)
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70)
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332)
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163)
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:10.719 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 0]: Started partition state machine with initial state -> Map([__consumer_offsets,19] -> OfflinePartition, [REDACTED_TOPIC,7] -> OfflinePartition, [__consumer_offsets,30] -> OfflinePartition, [__consumer_offsets,47] -> OfflinePartition, [REDACTED_TOPIC,23] -> OfflinePartition, [__consumer_offsets,29] -> OfflinePartition, [__consumer_offsets,41] -> OfflinePartition, [REDACTED_TOPIC,16] -> OfflinePartition, [REDACTED_TOPIC,13] -> OfflinePartition, [__consumer_offsets,39] -> OfflinePartition, [__consumer_offsets,17] -> OfflinePartition, [__consumer_offsets,10] -> OfflinePartition, [__consumer_offsets,14] -> OfflinePartition, [__consumer_offsets,40] -> OfflinePartition, [REDACTED_TOPIC,17] -> OfflinePartition, [__consumer_offsets,18] -> OfflinePartition, [__consumer_offsets,26] -> OfflinePartition, [__consumer_offsets,0] -> OfflinePartition, [REDACTED_TOPIC,27] -> OfflinePartition, [__consumer_offsets,24] -> OfflinePartition, [REDACTED_TOPIC,11] -> OfflinePartition, [REDACTED_TOPIC,5] -> OfflinePartition, [__consumer_offsets,33] -> OfflinePartition, [REDACTED_TOPIC,26] -> OfflinePartition, [REDACTED_TOPIC,22] -> OfflinePartition, [REDACTED_TOPIC,31] -> OfflinePartition, [__consumer_offsets,20] -> OfflinePartition, [__consumer_offsets,3] -> OfflinePartition, [__consumer_offsets,21] -> OfflinePartition, [__consumer_offsets,5] -> OfflinePartition, [__consumer_offsets,22] -> OfflinePartition, [REDACTED_TOPIC,1] -> OfflinePartition, [REDACTED_TOPIC,25] -> OfflinePartition, [REDACTED_TOPIC,9] -> OfflinePartition, [REDACTED_TOPIC,14] -> OfflinePartition, [REDACTED_TOPIC,18] -> OfflinePartition, [REDACTED_TOPIC,21] -> OfflinePartition, [__consumer_offsets,12] -> OfflinePartition, [__consumer_offsets,8] -> OfflinePartition, [__consumer_offsets,23] -> OfflinePartition, [__consumer_offsets,15] -> OfflinePartition, [__consumer_offsets,48] -> OfflinePartition, [REDACTED_TOPIC,20] -> OfflinePartition, [__consumer_offsets,11] -> OfflinePartition, [REDACTED_TOPIC,8] -> OfflinePartition, [__consumer_offsets,13] -> OfflinePartition, [REDACTED_TOPIC,2] -> OfflinePartition, [REDACTED_TOPIC,30] -> OfflinePartition, [REDACTED_TOPIC,0] -> OfflinePartition, [__consumer_offsets,49] -> OfflinePartition, [__consumer_offsets,6] -> OfflinePartition, [__consumer_offsets,4] -> OfflinePartition, [__consumer_offsets,28] -> OfflinePartition, [__consumer_offsets,37] -> OfflinePartition, [__consumer_offsets,31] -> OfflinePartition, [__consumer_offsets,44] -> OfflinePartition, [__consumer_offsets,42] -> OfflinePartition, [__consumer_offsets,34] -> OfflinePartition, [__consumer_offsets,46] -> OfflinePartition, [REDACTED_TOPIC,10] -> OfflinePartition, [REDACTED_TOPIC,29] -> OfflinePartition, [REDACTED_TOPIC,24] -> OfflinePartition, [__consumer_offsets,25] -> OfflinePartition, [REDACTED_TOPIC,15] -> OfflinePartition, [REDACTED_TOPIC,6] -> OfflinePartition, [__consumer_offsets,45] -> OfflinePartition, [__consumer_offsets,27] -> OfflinePartition, [__consumer_offsets,32] -> OfflinePartition, [__consumer_offsets,43] -> OfflinePartition, [REDACTED_TOPIC,19] -> OfflinePartition, [__consumer_offsets,36] -> OfflinePartition, [__consumer_offsets,35] -> OfflinePartition, [__consumer_offsets,7] -> OfflinePartition, [__consumer_offsets,9] -> OfflinePartition, [REDACTED_TOPIC,28] -> OfflinePartition, [REDACTED_TOPIC,4] -> OfflinePartition, [__consumer_offsets,38] -> OfflinePartition, [REDACTED_TOPIC,3] -> OfflinePartition, [REDACTED_TOPIC,12] -> OfflinePartition, [__consumer_offsets,1] -> OfflinePartition, [__consumer_offsets,16] -> OfflinePartition, [__consumer_offsets,2] -> OfflinePartition)
[0000] 18 Jul 19:43:10.721 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Broker 0 is ready to serve as the new controller with epoch 3
[0000] 18 Jul 19:43:10.722 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Starting preferred replica leader election for partitions
[0000] 18 Jul 19:43:10.723 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions
[0000] 18 Jul 19:43:10.728 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: starting the partition rebalance scheduler
[0000] 18 Jul 19:43:10.729 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController$SessionExpirationListener [SessionExpirationListener on 0], ZK expired; shut down all controller components and try to re-elect
[0000] 18 Jul 19:43:10.733 * app=kafka broker=0 pri=INFO t=delete-topics-thread-0 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Starting
[0000] 18 Jul 19:43:10.734 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Shutting down
[0000] 18 Jul 19:43:10.734 * app=kafka broker=0 pri=INFO t=delete-topics-thread-0 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Stopped
[0000] 18 Jul 19:43:10.734 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Shutdown completed
[0000] 18 Jul 19:43:10.736 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 0]: Stopped partition state machine
[0000] 18 Jul 19:43:10.736 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 0]: Stopped replica state machine
[0000] 18 Jul 19:43:10.736 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Broker 0 resigned as the controller
[0000] 18 Jul 19:43:10.738 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck re-registering broker info in ZK for broker 0
[0000] 18 Jul 19:43:10.738 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Creating /brokers/ids/0 (is it secure? false)
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Result of znode creation is: OK
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkUtils Registered broker 0 at path /brokers/ids/0 with addresses: SSL -> EndPoint(REDACTED_HOST,9096,SSL)
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck done re-registering broker
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck Subscribing to /brokers/topics path to watch for new topics
[0000] 18 Jul 19:43:10.744 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0
[0000] 18 Jul 19:43:10.745 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0
[0000] 18 Jul 19:43:10.749 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine$BrokerChangeListener [BrokerChangeListener on Controller 0]: Broker change listener fired for path /brokers/ids with children 0,1
[0000] 18 Jul 19:43:14.751 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230004, closing socket connection and attempting reconnect
[0000] 18 Jul 19:43:14.852 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:43:15.437 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:15.438 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:43:17.332 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230004, negotiated timeout = 6000
[0000] 18 Jul 19:43:17.332 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:21:15.638 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect
[0000] 18 Jul 19:21:15.738 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:21:16.321 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:21:16.322 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:21:16.323 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000
[0000] 18 Jul 19:21:16.324 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:22:56.390 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4000ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect
[0000] 18 Jul 19:22:56.491 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:22:57.30 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:22:57.31 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:22:57.33 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000
[0000] 18 Jul 19:22:57.33 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:27.799 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4001ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:27.900 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:28.177 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:28.351 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x55e49f2b1d0000, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:28.452 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:29.19 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:37:29.23 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000
[0000] 18 Jul 19:37:29.23 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:29.418 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:29.419 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:37:29.420 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x55e49f2b1d0000, negotiated timeout = 6000
[0000] 18 Jul 19:37:29.420 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:33.26 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:33.126 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:33.374 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:33.375 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:37:33.423 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x55e49f2b1d0000, closing socket connection and attempting reconnect
[0000] 18 Jul 19:37:33.524 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:37:33.656 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:37:33.657 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x55e49f2b1d0000, negotiated timeout = 6000
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:43:05.861 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x155e49f2b230002, likely server has closed socket, closing socket connection and attempting reconnect
[0000] 18 Jul 19:43:05.862 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x55e49f2b1d0000, likely server has closed socket, closing socket connection and attempting reconnect
[0000] 18 Jul 19:43:05.962 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:43:05.962 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkClient Waiting for keeper state SyncConnected
[0000] 18 Jul 19:43:05.962 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:43:06.278 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.352 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.557 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:43:06.557 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x55e49f2b1d0000 has expired, closing socket connection
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired)
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired)
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@79e2c065
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@7ce69770
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x155e49f2b230002 has expired, closing socket connection
[0000] 18 Jul 19:43:06.559 * app=kafka broker=1 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down
[0000] 18 Jul 19:43:06.559 * app=kafka broker=1 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down
[0000] 18 Jul 19:43:06.564 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.564 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:06.565 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session
[0000] 18 Jul 19:43:06.565 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:43:06.567 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230003, negotiated timeout = 6000
[0000] 18 Jul 19:43:06.568 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:43:06.568 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x55e49f2b1d52ea, negotiated timeout = 6000
[0000] 18 Jul 19:43:06.568 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
[0000] 18 Jul 19:43:06.659 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkClient Waiting for keeper state SyncConnected
[0000] 18 Jul 19:43:06.661 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0
[0000] 18 Jul 19:43:06.661 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-1], Shutting down
[0000] 18 Jul 19:43:06.661 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-1], Shutdown completed
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=INFO t=delete-topics-thread-1 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-1], Stopped
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 1]: Stopped partition state machine
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 1]: Stopped replica state machine
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=WARN t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=SslTransportLayer Failed to send SSL Close message java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.kafka.common.network.SslTransportLayer.flush(SslTransportLayer.java:194)
at org.apache.kafka.common.network.SslTransportLayer.close(SslTransportLayer.java:161)
at org.apache.kafka.common.network.KafkaChannel.close(KafkaChannel.java:45)
at org.apache.kafka.common.network.Selector.close(Selector.java:442)
at org.apache.kafka.common.network.Selector.close(Selector.java:434)
at org.apache.kafka.common.network.Selector.close(Selector.java:194)
at org.apache.kafka.clients.NetworkClient.close(NetworkClient.java:336)
at kafka.controller.ControllerChannelManager.kafka$controller$ControllerChannelManager$$removeExistingBroker(ControllerChannelManager.scala:126)
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53)
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53)
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108)
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap$$anon$2.foreach(HashMap.scala:108)
at kafka.controller.ControllerChannelManager.shutdown(ControllerChannelManager.scala:53)
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply$mcV$sp(KafkaController.scala:381)
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372)
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.controller.KafkaController.onControllerResignation(KafkaController.scala:372)
at kafka.controller.KafkaController$$anonfun$2.apply$mcV$sp(KafkaController.scala:164)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply$mcV$sp(ZookeeperLeaderElector.scala:130)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataChange(ZookeeperLeaderElector.scala:124)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:821)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-1-send-thread], Shutting down
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=INFO t=Controller-1-to-broker-1-send-thread at=RequestSendThread [Controller-1-to-broker-1-send-thread], Stopped
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-1-send-thread], Shutdown completed
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=WARN t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=SslTransportLayer Failed to send SSL Close message java.io.IOException: Broken pipe
at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93)
at sun.nio.ch.IOUtil.write(IOUtil.java:65)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471)
at org.apache.kafka.common.network.SslTransportLayer.flush(SslTransportLayer.java:194)
at org.apache.kafka.common.network.SslTransportLayer.close(SslTransportLayer.java:161)
at org.apache.kafka.common.network.KafkaChannel.close(KafkaChannel.java:45)
at org.apache.kafka.common.network.Selector.close(Selector.java:442)
at org.apache.kafka.common.network.Selector.close(Selector.java:434)
at org.apache.kafka.common.network.Selector.close(Selector.java:194)
at org.apache.kafka.clients.NetworkClient.close(NetworkClient.java:336)
at kafka.controller.ControllerChannelManager.kafka$controller$ControllerChannelManager$$removeExistingBroker(ControllerChannelManager.scala:126)
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53)
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53)
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108)
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap$$anon$2.foreach(HashMap.scala:108)
at kafka.controller.ControllerChannelManager.shutdown(ControllerChannelManager.scala:53)
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply$mcV$sp(KafkaController.scala:381)
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372)
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.controller.KafkaController.onControllerResignation(KafkaController.scala:372)
at kafka.controller.KafkaController$$anonfun$2.apply$mcV$sp(KafkaController.scala:164)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply$mcV$sp(ZookeeperLeaderElector.scala:130)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataChange(ZookeeperLeaderElector.scala:124)
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:821)
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71)
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-0-send-thread], Shutting down
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=Controller-1-to-broker-0-send-thread at=RequestSendThread [Controller-1-to-broker-0-send-thread], Stopped
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-0-send-thread], Shutdown completed
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 1]: Broker 1 resigned as the controller
[0000] 18 Jul 19:43:06.669 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine$BrokerChangeListener [BrokerChangeListener on Controller 1]: Broker change listener fired for path /brokers/ids with children
[0000] 18 Jul 19:43:06.669 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController$SessionExpirationListener [SessionExpirationListener on 1], ZK expired; shut down all controller components and try to re-elect
[0000] 18 Jul 19:43:06.669 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 1]: Stopped partition state machine
[0000] 18 Jul 19:43:06.670 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 1]: Stopped replica state machine
[0000] 18 Jul 19:43:06.670 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 1]: Broker 1 resigned as the controller
[0000] 18 Jul 19:43:06.673 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck re-registering broker info in ZK for broker 1
[0000] 18 Jul 19:43:06.674 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Creating /brokers/ids/1 (is it secure? false)
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Result of znode creation is: OK
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkUtils Registered broker 1 at path /brokers/ids/1 with addresses: SSL -> EndPoint(REDACTED_HOST_2,9096,SSL)
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck done re-registering broker
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck Subscribing to /brokers/topics path to watch for new topics
[0000] 18 Jul 19:43:06.680 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine$BrokerChangeListener [BrokerChangeListener on Controller 1]: Broker change listener fired for path /brokers/ids with children 1
[0000] 18 Jul 19:43:06.687 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0
[0000] 18 Jul 19:43:06.691 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine$AddPartitionsListener [AddPartitionsListener on 1]: Add Partition triggered {"version":1,"partitions":{"12":[1,0],"8":[1,0],"19":[0,1],"23":[0,1],"4":[1,0],"15":[0,1],"11":[0,1],"9":[0,1],"22":[1,0],"26":[1,0],"13":[0,1],"24":[1,0],"16":[1,0],"5":[0,1],"10":[1,0],"21":[0,1],"6":[1,0],"1":[0,1],"17":[0,1],"25":[0,1],"14":[1,0],"31":[0,1],"0":[1,0],"20":[1,0],"27":[0,1],"2":[1,0],"18":[1,0],"30":[1,0],"7":[0,1],"29":[0,1],"3":[0,1],"28":[1,0]}} for path /brokers/topics/REDACTED_TOPIC
[0000] 18 Jul 19:43:06.699 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine$AddPartitionsListener [AddPartitionsListener on 1]: Add Partition triggered {"version":1,"partitions":{"45":[1,0],"34":[0,1],"12":[0,1],"8":[0,1],"19":[1,0],"23":[1,0],"4":[0,1],"40":[0,1],"15":[1,0],"11":[1,0],"9":[1,0],"44":[0,1],"33":[1,0],"22":[0,1],"26":[0,1],"37":[1,0],"13":[1,0],"46":[0,1],"24":[0,1],"35":[1,0],"16":[0,1],"5":[1,0],"10":[0,1],"48":[0,1],"21":[1,0],"43":[1,0],"32":[0,1],"49":[1,0],"6":[0,1],"36":[0,1],"1":[1,0],"39":[1,0],"17":[1,0],"25":[1,0],"14":[0,1],"47":[1,0],"31":[1,0],"42":[0,1],"0":[0,1],"20":[0,1],"27":[1,0],"2":[0,1],"38":[0,1],"18":[0,1],"30":[0,1],"7":[1,0],"29":[1,0],"41":[1,0],"3":[1,0],"28":[0,1]}} for path /brokers/topics/__consumer_offsets
[0000] 18 Jul 19:43:14.705 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4000ms for sessionid 0x155e49f2b230003, closing socket connection and attempting reconnect
[0000] 18 Jul 19:43:14.806 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected)
[0000] 18 Jul 19:43:15.355 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error)
[0000] 18 Jul 19:43:15.356 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session
[0000] 18 Jul 19:43:17.333 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230003, negotiated timeout = 6000
[0000] 18 Jul 19:43:17.333 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment