Skip to content

Instantly share code, notes, and snippets.

@stanislavkozlovski

stanislavkozlovski/gist:39d39438fb8859ec915bf5fee5b3b8d7

Created December 19, 2023 13:42
Show Gist options
  • Save stanislavkozlovski/39d39438fb8859ec915bf5fee5b3b8d7 to your computer and use it in GitHub Desktop.
Save stanislavkozlovski/39d39438fb8859ec915bf5fee5b3b8d7 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
metaPropertiesEnsemble=MetaPropertiesEnsemble(metadataLogDir=Optional.empty, dirs={/tmp/kafka-11154148799385091495: EMPTY})
[2023-12-06 05:14:49,465] WARN [QuorumController id=1000] Performing controller activation. The metadata log appears to be empty. Appending 1 bootstrap record(s) in metadata transaction at metadata.version 3.7-IV3 from bootstrap source 'test harness'. Setting the ZK migration state to NONE since this is a de-novo KRaft cluster. (org.apache.kafka.controller.QuorumController:108)
[2023-12-06 05:14:53,973] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:14:59,814] ERROR Unexpected error handling org.apache.kafka.server.AssignmentsManager$DispatchEvent@17fa1fff (org.apache.kafka.server.AssignmentsManager:117)
java.lang.IllegalStateException: Cannot enqueue a request if the request thread is not running
at kafka.server.NodeToControllerRequestThread.enqueue(NodeToControllerChannelManager.scala:309)
at kafka.server.NodeToControllerChannelManagerImpl.sendRequest(NodeToControllerChannelManager.scala:239)
at org.apache.kafka.server.AssignmentsManager$DispatchEvent.run(AssignmentsManager.java:210)
at org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127)
at org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210)
at org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181)
at java.base/java.lang.Thread.run(Thread.java:833)
[2023-12-06 05:14:59,815] ERROR Unexpected error handling org.apache.kafka.server.AssignmentsManager$DispatchEvent@3a38a903 (org.apache.kafka.server.AssignmentsManager:117)
java.lang.IllegalStateException: Cannot enqueue a request if the request thread is not running
at kafka.server.NodeToControllerRequestThread.enqueue(NodeToControllerChannelManager.scala:309)
at kafka.server.NodeToControllerChannelManagerImpl.sendRequest(NodeToControllerChannelManager.scala:239)
at org.apache.kafka.server.AssignmentsManager$DispatchEvent.run(AssignmentsManager.java:210)
at org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127)
at org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210)
at org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181)
at java.base/java.lang.Thread.run(Thread.java:833)
[2023-12-06 05:14:59,814] ERROR Unexpected error handling org.apache.kafka.server.AssignmentsManager$DispatchEvent@61b1d757 (org.apache.kafka.server.AssignmentsManager:117)
java.lang.IllegalStateException: Cannot enqueue a request if the request thread is not running
at kafka.server.NodeToControllerRequestThread.enqueue(NodeToControllerChannelManager.scala:309)
at kafka.server.NodeToControllerChannelManagerImpl.sendRequest(NodeToControllerChannelManager.scala:239)
at org.apache.kafka.server.AssignmentsManager$DispatchEvent.run(AssignmentsManager.java:210)
at org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127)
at org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210)
at org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181)
at java.base/java.lang.Thread.run(Thread.java:833)
[2023-12-06 05:15:16,069] WARN The broker generated an error for the get telemetry network API request (org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter:520)
org.apache.kafka.common.errors.UnsupportedVersionException: The node does not support GET_TELEMETRY_SUBSCRIPTIONS
[2023-12-06 05:15:19,319] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:15:20,617] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:15:21,521] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:15:21,919] WARN [QuorumController id=1000] Renouncing the leadership due to a metadata log event. We were the leader at epoch 103, but in the new epoch 104, the leader is (none). Reverting to last stable offset 3855. (org.apache.kafka.controller.QuorumController:1166)
[2023-12-06 05:15:27,369] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:15:29,419] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:15:32,217] WARN The broker generated an error for the get telemetry network API request (org.apache.kafka.common.telemetry.internals.ClientTelemetryReporter:520)
org.apache.kafka.common.errors.UnsupportedVersionException: The node does not support GET_TELEMETRY_SUBSCRIPTIONS
[2023-12-06 05:15:41,618] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:16:27,325] WARN [ReplicaFetcher replicaId=2, leaderId=1, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=2, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=273458141, epoch=89), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.io.IOException: Connection to 1 was disconnected before the response was read
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:100)
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:113)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:16:27,326] WARN [ReplicaFetcher replicaId=0, leaderId=1, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=2024768054, epoch=89), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.io.IOException: Connection to 1 was disconnected before the response was read
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:100)
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:113)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:16:27,326] WARN [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=1936477459, epoch=92), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.io.IOException: Connection to 2 was disconnected before the response was read
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:100)
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:113)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:16:27,325] WARN [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=1, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=518869023, epoch=91), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.io.IOException: Connection to 2 was disconnected before the response was read
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:100)
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:113)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:16:27,720] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:31,890] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:32,967] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:33,563] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:35,570] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:16:36,427] WARN [QuorumController id=1000] Renouncing the leadership due to a metadata log event. We were the leader at epoch 106, but in the new epoch 107, the leader is (none). Reverting to last stable offset 3855. (org.apache.kafka.controller.QuorumController:1166)
[2023-12-06 05:16:36,617] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 1. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,767] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 2. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 1. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 2. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 1. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 2. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,769] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 2. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,770] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 1. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,770] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 2. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,770] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 1. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:36,770] ERROR [QuorumController id=1000] processExpiredBrokerHeartbeat: controller event queue overloaded. Timed out heartbeat from broker 0. (org.apache.kafka.controller.ReplicationControlManager:1515)
[2023-12-06 05:16:41,120] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:16:47,713] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:16:56,670] WARN [BrokerLifecycleManager id=2] Broker 2 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:16:56,670] WARN [BrokerLifecycleManager id=1] Broker 1 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:16:58,524] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:02,221] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:04,965] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:05,011] WARN [BrokerLifecycleManager id=2] Broker 2 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:17:05,013] WARN [BrokerLifecycleManager id=1] Broker 1 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:17:11,071] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:14,766] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:30,725] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:33,912] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:39,167] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:41,661] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:45,361] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:48,422] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:51,517] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:54,563] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:17:57,565] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:00,511] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:02,861] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:05,518] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:12,213] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:14,362] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:15,164] WARN [BrokerLifecycleManager id=1] Broker 1 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:18:15,164] WARN [BrokerLifecycleManager id=2] Broker 2 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:18:15,164] WARN [BrokerLifecycleManager id=0] Broker 0 sent a heartbeat request but received error REQUEST_TIMED_OUT. (kafka.server.BrokerLifecycleManager:70)
[2023-12-06 05:18:29,618] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:18:55,820] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 05:19:20,062] WARN [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=1, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=342264766, epoch=150), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.io.IOException: Connection to 2 was disconnected before the response was read
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:100)
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:113)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:19:20,062] WARN [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=2073681467, epoch=149), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.io.IOException: Connection to 2 was disconnected before the response was read
at org.apache.kafka.clients.NetworkClientUtils.sendAndReceive(NetworkClientUtils.java:100)
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:113)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:30:28,206] WARN [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=1, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={__consumer_offsets-0=PartitionData(topicId=eTNKJQSZTtaw9q-H58prfw, fetchOffset=0, logStartOffset=0, maxBytes=1048576, currentLeaderEpoch=Optional[2], lastFetchedEpoch=Optional.empty), e2etopic-0=PartitionData(topicId=N4l2zPHaTkGGAYE7Q_JoTQ, fetchOffset=1, logStartOffset=0, maxBytes=1048576, currentLeaderEpoch=Optional[3], lastFetchedEpoch=Optional[0])}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=342264766, epoch=INITIAL), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.net.SocketTimeoutException: Failed to connect within 1500 ms
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:109)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 05:21:07,675] WARN [QuorumController id=1000] Performing controller activation. Loaded ZK migration state of NONE. (org.apache.kafka.controller.QuorumController:204)
[2023-12-06 06:51:50,713] WARN [ReplicaFetcher replicaId=0, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=0, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={__consumer_offsets-0=PartitionData(topicId=eTNKJQSZTtaw9q-H58prfw, fetchOffset=0, logStartOffset=0, maxBytes=1048576, currentLeaderEpoch=Optional[2], lastFetchedEpoch=Optional.empty)}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=2073681467, epoch=INITIAL), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.net.SocketTimeoutException: Failed to connect within 1500 ms
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:109)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 06:51:50,877] WARN [NodeToControllerChannelManager id=2 name=heartbeat] Connection to node 1000 (localhost/127.0.0.1:37801) could not be established. Node may not be available. (org.apache.kafka.clients.NetworkClient:830)
[2023-12-06 06:51:50,877] WARN [NodeToControllerChannelManager id=1 name=heartbeat] Connection to node 1000 (localhost/127.0.0.1:37801) could not be established. Node may not be available. (org.apache.kafka.clients.NetworkClient:830)
[2023-12-06 06:51:50,877] WARN [RaftManager id=2] Connection to node 1000 (localhost/127.0.0.1:37801) could not be established. Node may not be available. (org.apache.kafka.clients.NetworkClient:830)
[2023-12-06 06:51:51,048] WARN [ReplicaFetcher replicaId=1, leaderId=2, fetcherId=0] Error in response for fetch request (type=FetchRequest, replicaId=1, maxWait=500, minBytes=1, maxBytes=10485760, fetchData={__consumer_offsets-0=PartitionData(topicId=eTNKJQSZTtaw9q-H58prfw, fetchOffset=0, logStartOffset=0, maxBytes=1048576, currentLeaderEpoch=Optional[2], lastFetchedEpoch=Optional.empty)}, isolationLevel=READ_UNCOMMITTED, removed=, replaced=, metadata=(sessionId=342264766, epoch=INITIAL), rackId=) (kafka.server.ReplicaFetcherThread:72)
java.net.SocketTimeoutException: Failed to connect within 1500 ms
at kafka.server.BrokerBlockingSender.sendRequest(BrokerBlockingSender.scala:109)
at kafka.server.RemoteLeaderEndPoint.fetch(RemoteLeaderEndPoint.scala:79)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:317)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3(AbstractFetcherThread.scala:131)
at kafka.server.AbstractFetcherThread.$anonfun$maybeFetch$3$adapted(AbstractFetcherThread.scala:130)
at scala.Option.foreach(Option.scala:437)
at kafka.server.AbstractFetcherThread.maybeFetch(AbstractFetcherThread.scala:130)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:113)
at kafka.server.ReplicaFetcherThread.doWork(ReplicaFetcherThread.scala:98)
at org.apache.kafka.server.util.ShutdownableThread.run(ShutdownableThread.java:131)
[2023-12-06 06:51:51,049] WARN [QuorumController id=1000] Renouncing the leadership due to a metadata log event. We were the leader at epoch 13, but in the new epoch 14, the leader is (none). Reverting to last stable offset 194. (org.apache.kafka.controller.QuorumController:1166)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment