-
-
Save tcrayford/cbf3d5aa1c46194eb7a98786d83b0eab to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
[0000] 18 Jul 19:13:23.329 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4001ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:13:23.429 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:13:23.564 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:13:23.565 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:13:26.449 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000 | |
[0000] 18 Jul 19:13:26.450 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:21:15.667 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:21:15.767 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:21:16.691 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:21:17.466 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:21:17.468 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000 | |
[0000] 18 Jul 19:21:17.468 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:21:29.688 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4000ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:21:29.789 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:21:30.522 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:21:30.523 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:21:30.525 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000 | |
[0000] 18 Jul 19:21:30.525 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:27.401 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:27.502 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:27.521 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:28.344 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230000, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:28.445 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:28.698 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:29.18 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:37:29.18 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:37:29.20 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:29.20 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230000, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:29.21 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:29.21 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:33.24 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230000, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:33.25 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4003ms for sessionid 0x155e49f2b230001, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:33.125 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:33.125 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:33.205 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:33.206 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:37:33.822 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:33.823 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230001, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230000, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:43:05.859 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x155e49f2b230000, likely server has closed socket, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:43:05.861 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x155e49f2b230001, likely server has closed socket, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:43:05.960 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:43:05.961 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:43:05.961 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkClient Waiting for keeper state SyncConnected | |
[0000] 18 Jul 19:43:05.985 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.44 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.556 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:43:06.556 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired) | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x155e49f2b230001 has expired, closing socket connection | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@79e2c065 | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x155e49f2b230000 has expired, closing socket connection | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired) | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@4d14b6c2 | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=0 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down | |
[0000] 18 Jul 19:43:06.559 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.559 * app=kafka broker=0 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down | |
[0000] 18 Jul 19:43:06.572 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:43:06.572 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.573 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:43:06.580 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230004, negotiated timeout = 6000 | |
[0000] 18 Jul 19:43:06.580 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:43:06.582 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x55e49f2b1d52eb, negotiated timeout = 6000 | |
[0000] 18 Jul 19:43:06.582 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:43:06.583 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Creating /controller (is it secure? false) | |
[0000] 18 Jul 19:43:06.585 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Result of znode creation is: OK | |
[0000] 18 Jul 19:43:06.586 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector 0 successfully elected as leader | |
[0000] 18 Jul 19:43:06.586 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Broker 0 starting become controller state transition | |
[0000] 18 Jul 19:43:06.588 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Initialized controller epoch to 2 and zk version 1 | |
[0000] 18 Jul 19:43:06.590 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Controller 0 incremented epoch to 3 | |
[0000] 18 Jul 19:43:06.795 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions undergoing preferred replica election: | |
[0000] 18 Jul 19:43:06.796 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions that completed preferred replica election: | |
[0000] 18 Jul 19:43:06.796 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Resuming preferred replica election for partitions: | |
[0000] 18 Jul 19:43:06.798 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions being reassigned: Map() | |
[0000] 18 Jul 19:43:06.798 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Partitions already reassigned: List() | |
[0000] 18 Jul 19:43:06.798 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Resuming reassignment of partitions: Map() | |
[0000] 18 Jul 19:43:06.801 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: List of topics to be deleted: | |
[0000] 18 Jul 19:43:06.802 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: List of topics ineligible for deletion: __consumer_offsets,REDACTED_TOPIC | |
[0000] 18 Jul 19:43:06.804 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Currently active brokers in the cluster: Set() | |
[0000] 18 Jul 19:43:06.804 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Currently shutting brokers in the cluster: Set() | |
[0000] 18 Jul 19:43:06.804 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Current list of topics in the cluster: Set(REDACTED_TOPIC, __consumer_offsets) | |
[0000] 18 Jul 19:43:06.812 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 0]: Started replica state machine with initial state -> Map([Topic=__consumer_offsets,Partition=48,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=39,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=6,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=21,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=17,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=30,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=33,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=22,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=11,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=10,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=18,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=5,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=27,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=21,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=11,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=17,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=12,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=9,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=28,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=6,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=20,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=3,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=19,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=49,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=20,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=45,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=22,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=14,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=18,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=13,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=10,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=5,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=27,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=34,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=32,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=14,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=26,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=44,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=11,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=3,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=10,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=42,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=38,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=43,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=48,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=30,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=46,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=24,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=8,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=12,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=16,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=33,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=28,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=47,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=16,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=37,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=2,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=36,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=29,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=40,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=16,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=4,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=0,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=7,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=21,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=15,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=3,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=42,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=23,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=1,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=13,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=46,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=28,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=32,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=23,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=44,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=2,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=43,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=19,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=11,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=23,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=29,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=7,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=4,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=4,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=40,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=15,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=29,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=28,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=25,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=22,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=12,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=15,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=27,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=3,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=7,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=17,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=38,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=16,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=26,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=8,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=36,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=30,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=17,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=8,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=34,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=37,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=49,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=29,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=23,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=45,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=31,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=0,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=26,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=5,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=27,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=41,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=18,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=10,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=2,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=7,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=24,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=30,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=31,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=1,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=31,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=1,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=21,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=0,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=6,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=35,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=24,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=0,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=41,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=19,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=25,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=20,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=19,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=20,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=22,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=9,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=9,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=14,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=5,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=31,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=14,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=4,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=1,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=8,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=26,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=25,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=13,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=24,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=2,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=6,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=18,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=15,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=25,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=12,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=47,Replica=0] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=35,Replica=0] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=13,Replica=1] -> ReplicaDeletionIneligible, [Topic=REDACTED_TOPIC,Partition=9,Replica=1] -> ReplicaDeletionIneligible, [Topic=__consumer_offsets,Partition=39,Replica=1] -> ReplicaDeletionIneligible) | |
[0000] 18 Jul 19:43:06.821 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,19] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,19] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.824 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,7] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,7] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.828 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,30] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,30] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.832 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,47] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,47] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.835 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,23] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,23] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.839 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,29] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,29] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.845 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,41] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,41] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.848 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,16] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,16] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.851 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,13] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,13] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.855 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,39] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,39] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.859 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,17] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,17] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.862 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,10] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,10] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.866 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,14] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,14] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.869 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,40] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,40] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.873 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,17] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,17] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.878 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,18] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,18] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.882 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,26] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,26] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.885 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,0] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,0] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.889 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,27] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,27] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.893 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,24] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,24] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.898 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,11] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,11] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.901 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,5] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,5] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.905 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,33] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,33] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.908 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,26] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,26] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.911 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,22] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,22] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.914 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,31] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,31] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.917 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,20] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,20] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.926 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,3] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,3] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.931 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,21] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,21] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.934 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,5] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,5] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.938 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,22] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,22] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.941 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,1] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,1] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.944 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,25] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,25] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.947 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,9] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,9] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.950 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,14] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,14] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.956 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,18] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,18] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.960 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,21] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,21] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.963 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,12] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,12] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.966 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,8] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,8] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.970 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,23] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,23] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.973 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,15] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,15] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.977 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,48] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,48] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.980 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,20] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,20] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.984 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,11] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,11] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.987 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,8] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,8] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.991 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,13] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,13] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.994 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,2] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,2] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.997 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,30] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,30] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.0 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,0] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,0] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.3 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,49] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,49] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.7 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,6] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,6] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.10 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,4] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,4] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.13 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,28] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,28] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.16 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,37] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,37] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.19 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,31] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,31] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.22 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,44] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,44] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.25 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,42] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,42] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.29 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,34] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,34] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.32 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,46] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,46] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.36 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,10] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,10] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.40 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,29] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,29] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.43 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,24] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,24] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.46 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,25] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,25] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.49 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,15] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,15] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.52 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,6] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,6] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.55 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,45] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,45] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.58 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,27] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,27] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.61 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,32] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,32] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.64 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,43] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,43] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.67 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,19] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,19] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.70 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,36] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,36] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:07.73 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,35] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,35] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:09.447 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,7] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,7] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:09.450 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,9] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,9] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:09.455 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,28] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,28] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:09.459 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,4] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,4] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:09.476 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,38] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,38] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:09.489 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,3] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,3] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:10.706 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [REDACTED_TOPIC,12] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [REDACTED_TOPIC,12] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:10.710 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,1] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,1] is alive. Live brokers are: [Set()], Assigned replicas are: [List(1, 0)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:10.713 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,16] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,16] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:10.716 * app=kafka broker=0 pri=ERROR t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=logger Controller 0 epoch 3 initiated state change for partition [__consumer_offsets,2] from OfflinePartition to OnlinePartition failed kafka.common.NoReplicaOnlineException: No replica for partition [__consumer_offsets,2] is alive. Live brokers are: [Set()], Assigned replicas are: [List(0, 1)] | |
at kafka.controller.OfflinePartitionLeaderSelector.selectLeader(PartitionLeaderSelector.scala:75) | |
at kafka.controller.PartitionStateMachine.electLeaderForPartition(PartitionStateMachine.scala:345) | |
at kafka.controller.PartitionStateMachine.kafka$controller$PartitionStateMachine$$handleStateChange(PartitionStateMachine.scala:205) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:120) | |
at kafka.controller.PartitionStateMachine$$anonfun$triggerOnlinePartitionStateChange$3.apply(PartitionStateMachine.scala:117) | |
at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:778) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99) | |
at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:777) | |
at kafka.controller.PartitionStateMachine.triggerOnlinePartitionStateChange(PartitionStateMachine.scala:117) | |
at kafka.controller.PartitionStateMachine.startup(PartitionStateMachine.scala:70) | |
at kafka.controller.KafkaController.onControllerFailover(KafkaController.scala:332) | |
at kafka.controller.KafkaController$$anonfun$1.apply$mcV$sp(KafkaController.scala:163) | |
at kafka.server.ZookeeperLeaderElector.elect(ZookeeperLeaderElector.scala:84) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply$mcZ$sp(ZookeeperLeaderElector.scala:146) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataDeleted$1.apply(ZookeeperLeaderElector.scala:141) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataDeleted(ZookeeperLeaderElector.scala:141) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:823) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:10.719 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 0]: Started partition state machine with initial state -> Map([__consumer_offsets,19] -> OfflinePartition, [REDACTED_TOPIC,7] -> OfflinePartition, [__consumer_offsets,30] -> OfflinePartition, [__consumer_offsets,47] -> OfflinePartition, [REDACTED_TOPIC,23] -> OfflinePartition, [__consumer_offsets,29] -> OfflinePartition, [__consumer_offsets,41] -> OfflinePartition, [REDACTED_TOPIC,16] -> OfflinePartition, [REDACTED_TOPIC,13] -> OfflinePartition, [__consumer_offsets,39] -> OfflinePartition, [__consumer_offsets,17] -> OfflinePartition, [__consumer_offsets,10] -> OfflinePartition, [__consumer_offsets,14] -> OfflinePartition, [__consumer_offsets,40] -> OfflinePartition, [REDACTED_TOPIC,17] -> OfflinePartition, [__consumer_offsets,18] -> OfflinePartition, [__consumer_offsets,26] -> OfflinePartition, [__consumer_offsets,0] -> OfflinePartition, [REDACTED_TOPIC,27] -> OfflinePartition, [__consumer_offsets,24] -> OfflinePartition, [REDACTED_TOPIC,11] -> OfflinePartition, [REDACTED_TOPIC,5] -> OfflinePartition, [__consumer_offsets,33] -> OfflinePartition, [REDACTED_TOPIC,26] -> OfflinePartition, [REDACTED_TOPIC,22] -> OfflinePartition, [REDACTED_TOPIC,31] -> OfflinePartition, [__consumer_offsets,20] -> OfflinePartition, [__consumer_offsets,3] -> OfflinePartition, [__consumer_offsets,21] -> OfflinePartition, [__consumer_offsets,5] -> OfflinePartition, [__consumer_offsets,22] -> OfflinePartition, [REDACTED_TOPIC,1] -> OfflinePartition, [REDACTED_TOPIC,25] -> OfflinePartition, [REDACTED_TOPIC,9] -> OfflinePartition, [REDACTED_TOPIC,14] -> OfflinePartition, [REDACTED_TOPIC,18] -> OfflinePartition, [REDACTED_TOPIC,21] -> OfflinePartition, [__consumer_offsets,12] -> OfflinePartition, [__consumer_offsets,8] -> OfflinePartition, [__consumer_offsets,23] -> OfflinePartition, [__consumer_offsets,15] -> OfflinePartition, [__consumer_offsets,48] -> OfflinePartition, [REDACTED_TOPIC,20] -> OfflinePartition, [__consumer_offsets,11] -> OfflinePartition, [REDACTED_TOPIC,8] -> OfflinePartition, [__consumer_offsets,13] -> OfflinePartition, [REDACTED_TOPIC,2] -> OfflinePartition, [REDACTED_TOPIC,30] -> OfflinePartition, [REDACTED_TOPIC,0] -> OfflinePartition, [__consumer_offsets,49] -> OfflinePartition, [__consumer_offsets,6] -> OfflinePartition, [__consumer_offsets,4] -> OfflinePartition, [__consumer_offsets,28] -> OfflinePartition, [__consumer_offsets,37] -> OfflinePartition, [__consumer_offsets,31] -> OfflinePartition, [__consumer_offsets,44] -> OfflinePartition, [__consumer_offsets,42] -> OfflinePartition, [__consumer_offsets,34] -> OfflinePartition, [__consumer_offsets,46] -> OfflinePartition, [REDACTED_TOPIC,10] -> OfflinePartition, [REDACTED_TOPIC,29] -> OfflinePartition, [REDACTED_TOPIC,24] -> OfflinePartition, [__consumer_offsets,25] -> OfflinePartition, [REDACTED_TOPIC,15] -> OfflinePartition, [REDACTED_TOPIC,6] -> OfflinePartition, [__consumer_offsets,45] -> OfflinePartition, [__consumer_offsets,27] -> OfflinePartition, [__consumer_offsets,32] -> OfflinePartition, [__consumer_offsets,43] -> OfflinePartition, [REDACTED_TOPIC,19] -> OfflinePartition, [__consumer_offsets,36] -> OfflinePartition, [__consumer_offsets,35] -> OfflinePartition, [__consumer_offsets,7] -> OfflinePartition, [__consumer_offsets,9] -> OfflinePartition, [REDACTED_TOPIC,28] -> OfflinePartition, [REDACTED_TOPIC,4] -> OfflinePartition, [__consumer_offsets,38] -> OfflinePartition, [REDACTED_TOPIC,3] -> OfflinePartition, [REDACTED_TOPIC,12] -> OfflinePartition, [__consumer_offsets,1] -> OfflinePartition, [__consumer_offsets,16] -> OfflinePartition, [__consumer_offsets,2] -> OfflinePartition) | |
[0000] 18 Jul 19:43:10.721 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Broker 0 is ready to serve as the new controller with epoch 3 | |
[0000] 18 Jul 19:43:10.722 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Starting preferred replica leader election for partitions | |
[0000] 18 Jul 19:43:10.723 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions | |
[0000] 18 Jul 19:43:10.728 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: starting the partition rebalance scheduler | |
[0000] 18 Jul 19:43:10.729 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController$SessionExpirationListener [SessionExpirationListener on 0], ZK expired; shut down all controller components and try to re-elect | |
[0000] 18 Jul 19:43:10.733 * app=kafka broker=0 pri=INFO t=delete-topics-thread-0 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Starting | |
[0000] 18 Jul 19:43:10.734 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Shutting down | |
[0000] 18 Jul 19:43:10.734 * app=kafka broker=0 pri=INFO t=delete-topics-thread-0 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Stopped | |
[0000] 18 Jul 19:43:10.734 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-0], Shutdown completed | |
[0000] 18 Jul 19:43:10.736 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 0]: Stopped partition state machine | |
[0000] 18 Jul 19:43:10.736 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 0]: Stopped replica state machine | |
[0000] 18 Jul 19:43:10.736 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 0]: Broker 0 resigned as the controller | |
[0000] 18 Jul 19:43:10.738 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck re-registering broker info in ZK for broker 0 | |
[0000] 18 Jul 19:43:10.738 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Creating /brokers/ids/0 (is it secure? false) | |
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Result of znode creation is: OK | |
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkUtils Registered broker 0 at path /brokers/ids/0 with addresses: SSL -> EndPoint(REDACTED_HOST,9096,SSL) | |
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck done re-registering broker | |
[0000] 18 Jul 19:43:10.741 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck Subscribing to /brokers/topics path to watch for new topics | |
[0000] 18 Jul 19:43:10.744 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0 | |
[0000] 18 Jul 19:43:10.745 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0 | |
[0000] 18 Jul 19:43:10.749 * app=kafka broker=0 pri=INFO t=ZkClient-EventThread-22-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine$BrokerChangeListener [BrokerChangeListener on Controller 0]: Broker change listener fired for path /brokers/ids with children 0,1 | |
[0000] 18 Jul 19:43:14.751 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230004, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:43:14.852 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:43:15.437 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:15.438 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:43:17.332 * app=kafka broker=0 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230004, negotiated timeout = 6000 | |
[0000] 18 Jul 19:43:17.332 * app=kafka broker=0 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
[0000] 18 Jul 19:21:15.638 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:21:15.738 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:21:16.321 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:21:16.322 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:21:16.323 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000 | |
[0000] 18 Jul 19:21:16.324 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:22:56.390 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4000ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:22:56.491 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:22:57.30 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:22:57.31 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:22:57.33 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000 | |
[0000] 18 Jul 19:22:57.33 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:27.799 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4001ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:27.900 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:28.177 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:28.351 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x55e49f2b1d0000, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:28.452 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:29.19 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:37:29.23 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:29.23 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:29.418 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:29.419 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:37:29.420 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x55e49f2b1d0000, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:29.420 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:33.26 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x155e49f2b230002, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:33.126 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:33.374 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:33.375 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:37:33.423 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4002ms for sessionid 0x55e49f2b1d0000, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:37:33.524 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:37:33.656 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:37:33.657 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x55e49f2b1d0000, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230002, negotiated timeout = 6000 | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:37:34.376 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:43:05.861 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x155e49f2b230002, likely server has closed socket, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:43:05.862 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Unable to read additional data from server sessionid 0x55e49f2b1d0000, likely server has closed socket, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:43:05.962 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:43:05.962 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkClient Waiting for keeper state SyncConnected | |
[0000] 18 Jul 19:43:05.962 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:43:06.278 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.352 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:43:06.557 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x55e49f2b1d0000 has expired, closing socket connection | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired) | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Expired) | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@79e2c065 | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZooKeeper Initiating client connection, connectString=REDACTED_IP_1:2181,REDACTED_IP_2:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@7ce69770 | |
[0000] 18 Jul 19:43:06.558 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Unable to reconnect to ZooKeeper service, session 0x155e49f2b230002 has expired, closing socket connection | |
[0000] 18 Jul 19:43:06.559 * app=kafka broker=1 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down | |
[0000] 18 Jul 19:43:06.559 * app=kafka broker=1 pri=INFO t=main-EventThread at=ClientCnxn EventThread shut down | |
[0000] 18 Jul 19:43:06.564 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_1/REDACTED_IP_1:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.564 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:06.565 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Socket connection established to REDACTED_IP_1/REDACTED_IP_1:2181, initiating session | |
[0000] 18 Jul 19:43:06.565 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:43:06.567 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_1/REDACTED_IP_1:2181, sessionid = 0x155e49f2b230003, negotiated timeout = 6000 | |
[0000] 18 Jul 19:43:06.568 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:43:06.568 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x55e49f2b1d52ea, negotiated timeout = 6000 | |
[0000] 18 Jul 19:43:06.568 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) | |
[0000] 18 Jul 19:43:06.659 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkClient Waiting for keeper state SyncConnected | |
[0000] 18 Jul 19:43:06.661 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0 | |
[0000] 18 Jul 19:43:06.661 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-1], Shutting down | |
[0000] 18 Jul 19:43:06.661 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-1], Shutdown completed | |
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=INFO t=delete-topics-thread-1 at=TopicDeletionManager$DeleteTopicsThread [delete-topics-thread-1], Stopped | |
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 1]: Stopped partition state machine | |
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 1]: Stopped replica state machine | |
[0000] 18 Jul 19:43:06.662 * app=kafka broker=1 pri=WARN t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=SslTransportLayer Failed to send SSL Close message java.io.IOException: Broken pipe | |
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) | |
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) | |
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) | |
at sun.nio.ch.IOUtil.write(IOUtil.java:65) | |
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) | |
at org.apache.kafka.common.network.SslTransportLayer.flush(SslTransportLayer.java:194) | |
at org.apache.kafka.common.network.SslTransportLayer.close(SslTransportLayer.java:161) | |
at org.apache.kafka.common.network.KafkaChannel.close(KafkaChannel.java:45) | |
at org.apache.kafka.common.network.Selector.close(Selector.java:442) | |
at org.apache.kafka.common.network.Selector.close(Selector.java:434) | |
at org.apache.kafka.common.network.Selector.close(Selector.java:194) | |
at org.apache.kafka.clients.NetworkClient.close(NetworkClient.java:336) | |
at kafka.controller.ControllerChannelManager.kafka$controller$ControllerChannelManager$$removeExistingBroker(ControllerChannelManager.scala:126) | |
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53) | |
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53) | |
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108) | |
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap$$anon$2.foreach(HashMap.scala:108) | |
at kafka.controller.ControllerChannelManager.shutdown(ControllerChannelManager.scala:53) | |
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply$mcV$sp(KafkaController.scala:381) | |
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372) | |
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.controller.KafkaController.onControllerResignation(KafkaController.scala:372) | |
at kafka.controller.KafkaController$$anonfun$2.apply$mcV$sp(KafkaController.scala:164) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply$mcV$sp(ZookeeperLeaderElector.scala:130) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataChange(ZookeeperLeaderElector.scala:124) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:821) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-1-send-thread], Shutting down | |
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=INFO t=Controller-1-to-broker-1-send-thread at=RequestSendThread [Controller-1-to-broker-1-send-thread], Stopped | |
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-1-send-thread], Shutdown completed | |
[0000] 18 Jul 19:43:06.666 * app=kafka broker=1 pri=WARN t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=SslTransportLayer Failed to send SSL Close message java.io.IOException: Broken pipe | |
at sun.nio.ch.FileDispatcherImpl.write0(Native Method) | |
at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) | |
at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) | |
at sun.nio.ch.IOUtil.write(IOUtil.java:65) | |
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) | |
at org.apache.kafka.common.network.SslTransportLayer.flush(SslTransportLayer.java:194) | |
at org.apache.kafka.common.network.SslTransportLayer.close(SslTransportLayer.java:161) | |
at org.apache.kafka.common.network.KafkaChannel.close(KafkaChannel.java:45) | |
at org.apache.kafka.common.network.Selector.close(Selector.java:442) | |
at org.apache.kafka.common.network.Selector.close(Selector.java:434) | |
at org.apache.kafka.common.network.Selector.close(Selector.java:194) | |
at org.apache.kafka.clients.NetworkClient.close(NetworkClient.java:336) | |
at kafka.controller.ControllerChannelManager.kafka$controller$ControllerChannelManager$$removeExistingBroker(ControllerChannelManager.scala:126) | |
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53) | |
at kafka.controller.ControllerChannelManager$$anonfun$shutdown$1.apply(ControllerChannelManager.scala:53) | |
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108) | |
at scala.collection.mutable.HashMap$$anon$2$$anonfun$foreach$3.apply(HashMap.scala:108) | |
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230) | |
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40) | |
at scala.collection.mutable.HashMap$$anon$2.foreach(HashMap.scala:108) | |
at kafka.controller.ControllerChannelManager.shutdown(ControllerChannelManager.scala:53) | |
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply$mcV$sp(KafkaController.scala:381) | |
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372) | |
at kafka.controller.KafkaController$$anonfun$onControllerResignation$1.apply(KafkaController.scala:372) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.controller.KafkaController.onControllerResignation(KafkaController.scala:372) | |
at kafka.controller.KafkaController$$anonfun$2.apply$mcV$sp(KafkaController.scala:164) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply$mcV$sp(ZookeeperLeaderElector.scala:130) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener$$anonfun$handleDataChange$1.apply(ZookeeperLeaderElector.scala:124) | |
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262) | |
at kafka.server.ZookeeperLeaderElector$LeaderChangeListener.handleDataChange(ZookeeperLeaderElector.scala:124) | |
at org.I0Itec.zkclient.ZkClient$9.run(ZkClient.java:821) | |
at org.I0Itec.zkclient.ZkEventThread.run(ZkEventThread.java:71) | |
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-0-send-thread], Shutting down | |
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=Controller-1-to-broker-0-send-thread at=RequestSendThread [Controller-1-to-broker-0-send-thread], Stopped | |
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=RequestSendThread [Controller-1-to-broker-0-send-thread], Shutdown completed | |
[0000] 18 Jul 19:43:06.668 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 1]: Broker 1 resigned as the controller | |
[0000] 18 Jul 19:43:06.669 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine$BrokerChangeListener [BrokerChangeListener on Controller 1]: Broker change listener fired for path /brokers/ids with children | |
[0000] 18 Jul 19:43:06.669 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController$SessionExpirationListener [SessionExpirationListener on 1], ZK expired; shut down all controller components and try to re-elect | |
[0000] 18 Jul 19:43:06.669 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine [Partition state machine on Controller 1]: Stopped partition state machine | |
[0000] 18 Jul 19:43:06.670 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine [Replica state machine on controller 1]: Stopped replica state machine | |
[0000] 18 Jul 19:43:06.670 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaController [Controller 1]: Broker 1 resigned as the controller | |
[0000] 18 Jul 19:43:06.673 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck re-registering broker info in ZK for broker 1 | |
[0000] 18 Jul 19:43:06.674 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Creating /brokers/ids/1 (is it secure? false) | |
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZKCheckedEphemeral Result of znode creation is: OK | |
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZkUtils Registered broker 1 at path /brokers/ids/1 with addresses: SSL -> EndPoint(REDACTED_HOST_2,9096,SSL) | |
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck done re-registering broker | |
[0000] 18 Jul 19:43:06.677 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=KafkaHealthcheck Subscribing to /brokers/topics path to watch for new topics | |
[0000] 18 Jul 19:43:06.680 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ReplicaStateMachine$BrokerChangeListener [BrokerChangeListener on Controller 1]: Broker change listener fired for path /brokers/ids with children 1 | |
[0000] 18 Jul 19:43:06.687 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=ZookeeperLeaderElector$LeaderChangeListener New leader is 0 | |
[0000] 18 Jul 19:43:06.691 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine$AddPartitionsListener [AddPartitionsListener on 1]: Add Partition triggered {"version":1,"partitions":{"12":[1,0],"8":[1,0],"19":[0,1],"23":[0,1],"4":[1,0],"15":[0,1],"11":[0,1],"9":[0,1],"22":[1,0],"26":[1,0],"13":[0,1],"24":[1,0],"16":[1,0],"5":[0,1],"10":[1,0],"21":[0,1],"6":[1,0],"1":[0,1],"17":[0,1],"25":[0,1],"14":[1,0],"31":[0,1],"0":[1,0],"20":[1,0],"27":[0,1],"2":[1,0],"18":[1,0],"30":[1,0],"7":[0,1],"29":[0,1],"3":[0,1],"28":[1,0]}} for path /brokers/topics/REDACTED_TOPIC | |
[0000] 18 Jul 19:43:06.699 * app=kafka broker=1 pri=INFO t=ZkClient-EventThread-21-REDACTED_IP_1:2181,REDACTED_IP_2:2181 at=PartitionStateMachine$AddPartitionsListener [AddPartitionsListener on 1]: Add Partition triggered {"version":1,"partitions":{"45":[1,0],"34":[0,1],"12":[0,1],"8":[0,1],"19":[1,0],"23":[1,0],"4":[0,1],"40":[0,1],"15":[1,0],"11":[1,0],"9":[1,0],"44":[0,1],"33":[1,0],"22":[0,1],"26":[0,1],"37":[1,0],"13":[1,0],"46":[0,1],"24":[0,1],"35":[1,0],"16":[0,1],"5":[1,0],"10":[0,1],"48":[0,1],"21":[1,0],"43":[1,0],"32":[0,1],"49":[1,0],"6":[0,1],"36":[0,1],"1":[1,0],"39":[1,0],"17":[1,0],"25":[1,0],"14":[0,1],"47":[1,0],"31":[1,0],"42":[0,1],"0":[0,1],"20":[0,1],"27":[1,0],"2":[0,1],"38":[0,1],"18":[0,1],"30":[0,1],"7":[1,0],"29":[1,0],"41":[1,0],"3":[1,0],"28":[0,1]}} for path /brokers/topics/__consumer_offsets | |
[0000] 18 Jul 19:43:14.705 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_1:2181) at=ClientCnxn Client session timed out, have not heard from server in 4000ms for sessionid 0x155e49f2b230003, closing socket connection and attempting reconnect | |
[0000] 18 Jul 19:43:14.806 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (Disconnected) | |
[0000] 18 Jul 19:43:15.355 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Opening socket connection to server REDACTED_IP_2/REDACTED_IP_2:2181. Will not attempt to authenticate using SASL (unknown error) | |
[0000] 18 Jul 19:43:15.356 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Socket connection established to REDACTED_IP_2/REDACTED_IP_2:2181, initiating session | |
[0000] 18 Jul 19:43:17.333 * app=kafka broker=1 pri=INFO t=main-SendThread(REDACTED_IP_2:2181) at=ClientCnxn Session establishment complete on server REDACTED_IP_2/REDACTED_IP_2:2181, sessionid = 0x155e49f2b230003, negotiated timeout = 6000 | |
[0000] 18 Jul 19:43:17.333 * app=kafka broker=1 pri=INFO t=main-EventThread at=ZkClient zookeeper state changed (SyncConnected) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment