Skip to content

Instantly share code, notes, and snippets.

@theduderog
Created August 2, 2016 16:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save theduderog/f9ab4767cd3b098d404f5513a7e1c27e to your computer and use it in GitHub Desktop.
Save theduderog/f9ab4767cd3b098d404f5513a7e1c27e to your computer and use it in GitHub Desktop.
[2016-08-02 16:26:08,183] INFO Starting stream thread [StreamThread-1] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,183] INFO Starting stream thread [StreamThread-2] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,184] INFO Starting stream thread [StreamThread-3] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,184] INFO Starting stream thread [StreamThread-4] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,184] INFO Starting stream thread [StreamThread-5] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,184] INFO Starting stream thread [StreamThread-6] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,184] INFO Starting stream thread [StreamThread-7] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,184] INFO Started Kafka Stream process (org.apache.kafka.streams.KafkaStreams:172)
[2016-08-02 16:26:08,184] INFO Starting stream thread [StreamThread-8] (org.apache.kafka.streams.processor.internals.StreamThread:215)
[2016-08-02 16:26:08,395] INFO Logging initialized @2815ms (org.eclipse.jetty.util.log:186)
[2016-08-02 16:26:08,411] WARN DEPRECATION warning: `listeners` configuration is not configured. Falling back to the deprecated `port` configuration. (io.confluent.rest.Application:250)
[2016-08-02 16:26:08,411] INFO Adding listener: http://0.0.0.0:9021 (io.confluent.rest.Application:138)
[2016-08-02 16:26:08,433] WARN failed to connect to kafka-connect javax.ws.rs.ProcessingException: java.net.ConnectException: Connection refused (io.confluent.controlcenter.connect.ConnectService:66)
[2016-08-02 16:26:08,464] INFO jetty-9.2.12.v20150709 (org.eclipse.jetty.server.Server:327)
[2016-08-02 16:26:08,820] INFO HV000001: Hibernate Validator 5.1.2.Final (org.hibernate.validator.internal.util.Version:27)
[2016-08-02 16:26:08,937] INFO Started o.e.j.s.ServletContextHandler@45bf6f39{/,null,AVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:744)
[2016-08-02 16:26:08,942] INFO Started NetworkTrafficServerConnector@5e671e20{HTTP/1.1}{0.0.0.0:9021} (org.eclipse.jetty.server.NetworkTrafficServerConnector:266)
[2016-08-02 16:26:08,944] INFO Started @3363ms (org.eclipse.jetty.server.Server:379)
[2016-08-02 16:27:12,321] INFO 50.174.16.88 - - [02/Aug/2016:16:27:12 +0000] "GET /1.0/status/streams HTTP/1.1" 200 3746 95 (io.confluent.rest-utils.requests:77)
[2016-08-02 16:27:12,953] INFO 50.174.16.88 - - [02/Aug/2016:16:27:12 +0000] "GET /favicon.ico HTTP/1.1" 200 311 6 (io.confluent.rest-utils.requests:77)
[2016-08-02 16:28:30,185] INFO 50.174.16.88 - - [02/Aug/2016:16:28:30 +0000] "GET /1.0/status/streams HTTP/1.1" 200 3746 3 (io.confluent.rest-utils.requests:77)
[2016-08-02 16:28:30,694] INFO 50.174.16.88 - - [02/Aug/2016:16:28:30 +0000] "GET /favicon.ico HTTP/1.1" 200 311 1 (io.confluent.rest-utils.requests:77)
[2016-08-02 16:29:55,216] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:29:55,218] INFO Assigning tasks to clients: {358a8a86-ed62-4593-894b-16ff3e96450a=[activeTasks: ([]) assignedTasks: ([]) prevActiveTasks: ([]) prevAssignedTasks: ([1_0, 1_1, 3_0, 1_2, 4_0, 1_3, 2_3, 4_1, 3_3, 4_2, 7_0, 5_2, 7_1, 6_2, 6_3]) capacity: 8.0 cost: 0.0]}, prevAssignmentBalanced: false, prevClientsUnchangeed: false, tasks: [0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 0_3, 1_2, 2_1, 3_0, 1_3, 2_2, 3_1, 4_0, 2_3, 3_2, 4_1, 5_0, 3_3, 4_2, 5_1, 6_0, 4_3, 5_2, 6_1, 7_0, 5_3, 6_2, 7_1, 6_3, 7_2, 7_3], replicas: 0 (org.apache.kafka.streams.processor.internals.assignment.TaskAssignor:43)
[2016-08-02 16:29:55,224] INFO Assigned with: {358a8a86-ed62-4593-894b-16ff3e96450a=[activeTasks: ([0_0, 0_1, 1_0, 1_1, 0_2, 2_0, 0_3, 1_2, 3_0, 2_1, 4_0, 1_3, 2_2, 3_1, 5_0, 4_1, 3_2, 2_3, 3_3, 4_2, 6_0, 5_1, 5_2, 7_0, 4_3, 6_1, 6_2, 5_3, 7_1, 7_2, 6_3, 7_3]) assignedTasks: ([0_0, 0_1, 1_0, 1_1, 0_2, 2_0, 0_3, 1_2, 3_0, 2_1, 4_0, 1_3, 2_2, 3_1, 5_0, 4_1, 3_2, 2_3, 3_3, 4_2, 6_0, 5_1, 5_2, 7_0, 4_3, 6_1, 6_2, 5_3, 7_1, 7_2, 6_3, 7_3]) prevActiveTasks: ([]) prevAssignedTasks: ([]) capacity: 8.0 cost: 11.499999999999996]} (org.apache.kafka.streams.processor.internals.assignment.TaskAssignor:52)
[2016-08-02 16:29:55,226] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:29:55,297] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:29:55,301] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:29:55,302] INFO Assigning tasks to clients: {358a8a86-ed62-4593-894b-16ff3e96450a=[activeTasks: ([]) assignedTasks: ([]) prevActiveTasks: ([]) prevAssignedTasks: ([1_0, 1_1, 3_0, 1_2, 4_0, 1_3, 2_3, 4_1, 3_3, 4_2, 7_0, 5_2, 7_1, 6_2, 6_3]) capacity: 8.0 cost: 0.0]}, prevAssignmentBalanced: false, prevClientsUnchangeed: false, tasks: [0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 0_3, 1_2, 2_1, 3_0, 1_3, 2_2, 3_1, 4_0, 2_3, 3_2, 4_1, 5_0, 3_3, 4_2, 5_1, 6_0, 4_3, 5_2, 6_1, 7_0, 5_3, 6_2, 7_1, 6_3, 7_2, 7_3], replicas: 0 (org.apache.kafka.streams.processor.internals.assignment.TaskAssignor:43)
[2016-08-02 16:29:55,304] INFO Assigned with: {358a8a86-ed62-4593-894b-16ff3e96450a=[activeTasks: ([0_0, 0_1, 1_0, 1_1, 0_2, 2_0, 0_3, 1_2, 3_0, 2_1, 4_0, 1_3, 2_2, 3_1, 5_0, 4_1, 3_2, 2_3, 3_3, 4_2, 6_0, 5_1, 5_2, 7_0, 4_3, 6_1, 6_2, 5_3, 7_1, 7_2, 6_3, 7_3]) assignedTasks: ([0_0, 0_1, 1_0, 1_1, 0_2, 2_0, 0_3, 1_2, 3_0, 2_1, 4_0, 1_3, 2_2, 3_1, 5_0, 4_1, 3_2, 2_3, 3_3, 4_2, 6_0, 5_1, 5_2, 7_0, 4_3, 6_1, 6_2, 5_3, 7_1, 7_2, 6_3, 7_3]) prevActiveTasks: ([]) prevAssignedTasks: ([]) capacity: 8.0 cost: 11.499999999999996]} (org.apache.kafka.streams.processor.internals.assignment.TaskAssignor:52)
[2016-08-02 16:29:55,304] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:29:55,354] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #0_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #1_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #0_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #1_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #0_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #0_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #2_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,375] INFO Creating restoration consumer client for stream task #1_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,383] INFO Creating restoration consumer client for stream task #2_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,387] INFO Creating restoration consumer client for stream task #5_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,387] INFO Creating restoration consumer client for stream task #2_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,390] INFO Creating restoration consumer client for stream task #3_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,779] INFO Creating restoration consumer client for stream task #1_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,890] INFO Creating restoration consumer client for stream task #4_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:55,899] INFO Creating restoration consumer client for stream task #4_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:56,079] INFO Creating restoration consumer client for stream task #4_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:29:56,334] INFO Creating restoration consumer client for stream task #3_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:30:33,733] INFO Creating restoration consumer client for stream task #4_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:04,975] INFO Creating restoration consumer client for stream task #7_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:11,216] INFO Creating restoration consumer client for stream task #5_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:26,762] INFO Creating restoration consumer client for stream task #3_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:35,831] INFO Creating restoration consumer client for stream task #2_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:40,155] INFO Creating restoration consumer client for stream task #3_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:41,066] INFO Creating restoration consumer client for stream task #6_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:32:57,216] INFO Creating restoration consumer client for stream task #6_0 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:33:10,523] INFO Creating restoration consumer client for stream task #5_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:33:26,191] INFO Creating restoration consumer client for stream task #6_1 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:34:40,782] INFO Creating restoration consumer client for stream task #7_3 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:35:58,529] WARN Failed to commit StreamTask #1_0 in thread [StreamThread-2]: (org.apache.kafka.streams.processor.internals.StreamThread:449)
org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:588)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:529)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:414)
at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1059)
at org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:266)
at org.apache.kafka.streams.processor.internals.StreamThread.commitOne(StreamThread.java:446)
at org.apache.kafka.streams.processor.internals.StreamThread.commitAll(StreamThread.java:434)
at org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsRevoked(StreamThread.java:135)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
[2016-08-02 16:35:58,955] WARN Failed to commit StreamTask #4_0 in thread [StreamThread-2]: (org.apache.kafka.streams.processor.internals.StreamThread:449)
org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:588)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:529)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:414)
at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1059)
at org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:266)
at org.apache.kafka.streams.processor.internals.StreamThread.commitOne(StreamThread.java:446)
at org.apache.kafka.streams.processor.internals.StreamThread.commitAll(StreamThread.java:434)
at org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsRevoked(StreamThread.java:135)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
[2016-08-02 16:35:58,992] WARN Failed to commit StreamTask #3_3 in thread [StreamThread-2]: (org.apache.kafka.streams.processor.internals.StreamThread:449)
org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:588)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:529)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:414)
at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1059)
at org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:266)
at org.apache.kafka.streams.processor.internals.StreamThread.commitOne(StreamThread.java:446)
at org.apache.kafka.streams.processor.internals.StreamThread.commitAll(StreamThread.java:434)
at org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsRevoked(StreamThread.java:135)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
[2016-08-02 16:35:59,044] WARN Failed to commit StreamTask #6_2 in thread [StreamThread-2]: (org.apache.kafka.streams.processor.internals.StreamThread:449)
org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed since the group has already rebalanced and assigned the partitions to another member. This means that the time between subsequent calls to poll() was longer than the configured session.timeout.ms, which typically implies that the poll loop is spending too much time message processing. You can address this either by increasing the session timeout or by reducing the maximum size of batches returned in poll() with max.poll.records.
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:588)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator$OffsetCommitResponseHandler.handle(ConsumerCoordinator.java:529)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:414)
at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1059)
at org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:266)
at org.apache.kafka.streams.processor.internals.StreamThread.commitOne(StreamThread.java:446)
at org.apache.kafka.streams.processor.internals.StreamThread.commitAll(StreamThread.java:434)
at org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsRevoked(StreamThread.java:135)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinPrepare(ConsumerCoordinator.java:283)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:212)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
[2016-08-02 16:35:59,045] INFO Removing a task 1_0 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:35:59,045] INFO closing store=MonitoringVerifierStore (io.confluent.controlcenter.streams.verify.VerifyTransformerSupplier:356)
[2016-08-02 16:35:59,063] INFO Removing a task 4_0 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:35:59,063] INFO closing store=aggregate-topic-partition (io.confluent.controlcenter.streams.verify.ThroughTopicVerifierTransformerSupplier$ThroughTopicVerifierTransformer:99)
[2016-08-02 16:35:59,068] INFO Removing a task 3_3 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:35:59,077] INFO Removing a task 6_2 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:35:59,077] INFO closing store=group-aggregate-topic-ONE_HOUR (io.confluent.controlcenter.streams.verify.ThroughTopicVerifierTransformerSupplier$ThroughTopicVerifierTransformer:99)
[2016-08-02 16:35:59,084] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:35:59,085] INFO Assigning tasks to clients: {358a8a86-ed62-4593-894b-16ff3e96450a=[activeTasks: ([]) assignedTasks: ([]) prevActiveTasks: ([1_0, 4_0, 3_3, 6_2]) prevAssignedTasks: ([1_0, 4_0, 3_3, 5_2, 6_2, 7_1, 6_3]) capacity: 1.0 cost: 0.0]}, prevAssignmentBalanced: false, prevClientsUnchangeed: false, tasks: [0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 0_3, 1_2, 2_1, 3_0, 1_3, 2_2, 3_1, 4_0, 2_3, 3_2, 4_1, 5_0, 3_3, 4_2, 5_1, 6_0, 4_3, 5_2, 6_1, 7_0, 5_3, 6_2, 7_1, 6_3, 7_2, 7_3], replicas: 0 (org.apache.kafka.streams.processor.internals.assignment.TaskAssignor:43)
[2016-08-02 16:35:59,091] INFO Assigned with: {358a8a86-ed62-4593-894b-16ff3e96450a=[activeTasks: ([0_0, 0_1, 1_0, 1_1, 0_2, 2_0, 0_3, 1_2, 3_0, 2_1, 4_0, 1_3, 2_2, 3_1, 5_0, 4_1, 3_2, 2_3, 3_3, 4_2, 6_0, 5_1, 5_2, 7_0, 4_3, 6_1, 6_2, 5_3, 7_1, 7_2, 6_3, 7_3]) assignedTasks: ([0_0, 0_1, 1_0, 1_1, 0_2, 2_0, 0_3, 1_2, 3_0, 2_1, 4_0, 1_3, 2_2, 3_1, 5_0, 4_1, 3_2, 2_3, 3_3, 4_2, 6_0, 5_1, 5_2, 7_0, 4_3, 6_1, 6_2, 5_3, 7_1, 7_2, 6_3, 7_3]) prevActiveTasks: ([]) prevAssignedTasks: ([]) capacity: 1.0 cost: 13.499999999999998]} (org.apache.kafka.streams.processor.internals.assignment.TaskAssignor:52)
[2016-08-02 16:35:59,091] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:35:59,303] INFO Completed validating internal topics in partition assignor. (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:199)
[2016-08-02 16:36:00,313] ERROR Failed to create an active task #0_0 in thread [StreamThread-2]: (org.apache.kafka.streams.processor.internals.StreamThread:583)
org.apache.kafka.streams.errors.ProcessorStateException: Error while creating the state manager
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:71)
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:86)
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:550)
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:577)
at org.apache.kafka.streams.processor.internals.StreamThread.access$000(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:123)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
Caused by: java.io.IOException: Failed to lock the state directory: /data/control-center/1/kafka-streams/_confluent-controlcenter-1/0_0
at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:95)
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:69)
... 32 more
[2016-08-02 16:36:00,319] ERROR User provided listener org.apache.kafka.streams.processor.internals.StreamThread$1 for group _confluent-controlcenter-1 failed on partition assignment (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:226)
org.apache.kafka.streams.errors.ProcessorStateException: Error while creating the state manager
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:71)
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:86)
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:550)
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:577)
at org.apache.kafka.streams.processor.internals.StreamThread.access$000(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:123)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
Caused by: java.io.IOException: Failed to lock the state directory: /data/control-center/1/kafka-streams/_confluent-controlcenter-1/0_0
at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:95)
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:69)
... 32 more
[2016-08-02 16:36:00,319] ERROR User provided listener org.apache.kafka.streams.processor.internals.StreamThread$1 for group _confluent-controlcenter-1 failed on partition assignment (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:226)
org.apache.kafka.streams.errors.ProcessorStateException: Error while creating the state manager
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:71)
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:86)
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:550)
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:577)
at org.apache.kafka.streams.processor.internals.StreamThread.access$000(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:123)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
Caused by: java.io.IOException: Failed to lock the state directory: /data/control-center/1/kafka-streams/_confluent-controlcenter-1/0_0
at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:95)
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:69)
... 32 more
[2016-08-02 16:36:00,335] INFO Shutting down stream thread [StreamThread-2] (org.apache.kafka.streams.processor.internals.StreamThread:244)
[2016-08-02 16:36:00,393] INFO Stream thread shutdown complete [StreamThread-2] (org.apache.kafka.streams.processor.internals.StreamThread:278)
[2016-08-02 16:36:00,393] ERROR streams exception (io.confluent.controlcenter.streams.KafkaStreamsManager:36)
org.apache.kafka.streams.errors.StreamsException: Failed to rebalance
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:299)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:218)
Caused by: org.apache.kafka.streams.errors.ProcessorStateException: Error while creating the state manager
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:71)
at org.apache.kafka.streams.processor.internals.StreamTask.<init>(StreamTask.java:86)
at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:550)
at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:577)
at org.apache.kafka.streams.processor.internals.StreamThread.access$000(StreamThread.java:68)
at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:123)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:222)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:232)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$1.onSuccess(AbstractCoordinator.java:227)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.RequestFuture$2.onSuccess(RequestFuture.java:182)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:436)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$SyncGroupResponseHandler.handle(AbstractCoordinator.java:422)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:679)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$CoordinatorResponseHandler.onSuccess(AbstractCoordinator.java:658)
at org.apache.kafka.clients.consumer.internals.RequestFuture$1.onSuccess(RequestFuture.java:167)
at org.apache.kafka.clients.consumer.internals.RequestFuture.fireSuccess(RequestFuture.java:133)
at org.apache.kafka.clients.consumer.internals.RequestFuture.complete(RequestFuture.java:107)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler.onComplete(ConsumerNetworkClient.java:426)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:278)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.clientPoll(ConsumerNetworkClient.java:360)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:224)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:192)
at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:163)
at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:243)
at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.ensurePartitionAssignment(ConsumerCoordinator.java:354)
at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:978)
at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:938)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:295)
... 1 more
Caused by: java.io.IOException: Failed to lock the state directory: /data/control-center/1/kafka-streams/_confluent-controlcenter-1/0_0
at org.apache.kafka.streams.processor.internals.ProcessorStateManager.<init>(ProcessorStateManager.java:95)
at org.apache.kafka.streams.processor.internals.AbstractTask.<init>(AbstractTask.java:69)
... 32 more
[2016-08-02 16:36:30,403] ERROR Failed to restart Kafka Streams after failure (io.confluent.controlcenter.streams.KafkaStreamsManager:40)
java.util.concurrent.TimeoutException
at java.util.concurrent.FutureTask.get(FutureTask.java:205)
at io.confluent.controlcenter.streams.KafkaStreamsManager.start(KafkaStreamsManager.java:74)
at io.confluent.controlcenter.streams.KafkaStreamsManager$KafkaStreamsUncaughtExceptionHandler.uncaughtException(KafkaStreamsManager.java:38)
at java.lang.Thread.dispatchUncaughtException(Thread.java:1952)
[2016-08-02 16:37:00,275] INFO Shutting down stream thread [StreamThread-5] (org.apache.kafka.streams.processor.internals.StreamThread:244)
[2016-08-02 16:37:00,282] INFO Removing a task 0_0 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:37:00,282] INFO Removing a task 3_0 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:37:00,291] INFO Removing a task 3_2 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:37:00,295] INFO Removing a task 4_3 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:37:00,295] INFO closing store=aggregate-topic-partition (io.confluent.controlcenter.streams.verify.ThroughTopicVerifierTransformerSupplier$ThroughTopicVerifierTransformer:99)
[2016-08-02 16:37:00,319] INFO Stream thread shutdown complete [StreamThread-5] (org.apache.kafka.streams.processor.internals.StreamThread:278)
[2016-08-02 16:38:26,720] INFO Shutting down stream thread [StreamThread-6] (org.apache.kafka.streams.processor.internals.StreamThread:244)
[2016-08-02 16:38:26,730] INFO Removing a task 1_1 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:38:26,730] INFO closing store=MonitoringVerifierStore (io.confluent.controlcenter.streams.verify.VerifyTransformerSupplier:356)
[2016-08-02 16:38:26,734] INFO Removing a task 1_3 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:38:26,734] INFO closing store=MonitoringVerifierStore (io.confluent.controlcenter.streams.verify.VerifyTransformerSupplier:356)
[2016-08-02 16:38:26,737] INFO Removing a task 4_2 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:38:26,737] INFO closing store=aggregate-topic-partition (io.confluent.controlcenter.streams.verify.ThroughTopicVerifierTransformerSupplier$ThroughTopicVerifierTransformer:99)
[2016-08-02 16:38:26,741] INFO Removing a task 5_3 (org.apache.kafka.streams.processor.internals.StreamThread:606)
[2016-08-02 16:38:26,741] INFO closing store=group-aggregate-topic-FIFTEEN_SECONDS (io.confluent.controlcenter.streams.verify.ThroughTopicVerifierTransformerSupplier$ThroughTopicVerifierTransformer:99)
[2016-08-02 16:38:26,744] INFO Stream thread shutdown complete [StreamThread-6] (org.apache.kafka.streams.processor.internals.StreamThread:278)
[2016-08-02 16:39:18,216] INFO Creating restoration consumer client for stream task #7_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
[2016-08-02 16:39:41,331] INFO Creating restoration consumer client for stream task #5_2 (org.apache.kafka.streams.processor.internals.StreamTask:109)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment