Skip to content

Instantly share code, notes, and snippets.

@srijiths
Created August 6, 2016 15:07
Show Gist options
  • Save srijiths/459725df0137c881090f7a03565f784f to your computer and use it in GitHub Desktop.
Save srijiths/459725df0137c881090f7a03565f784f to your computer and use it in GitHub Desktop.
[2016-08-06 15:00:17,968] INFO Successfully joined group connect-elasticsearch-sink with generation 1 (org.apache.kafka.clients.consumer.internals.AbstractCoordinator:434)
[2016-08-06 15:00:17,968] INFO Setting newly assigned partitions [sensor-output-4, sensor-output-3, sensor-output-2, sensor-output-1, sensor-output-0] for group connect-elasticsearch-sink (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:219)
[2016-08-06 15:00:19,505] WARN Failed to execute bulk request java.util.ConcurrentModificationException. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:19,518] WARN Failed to execute bulk request java.util.ConcurrentModificationException. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:20,205] WARN Failed to execute bulk request java.util.ConcurrentModificationException. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
Exception in thread "I/O dispatcher 8" [2016-08-06 15:00:33,651] ERROR Unexpected exception in KafkaBasedLog's work thread (org.apache.kafka.connect.util.KafkaBasedLog:351)
java.lang.OutOfMemoryError: Java heap space
Exception in thread "I/O dispatcher 7" java.lang.OutOfMemoryError: Java heap space
at java.util.HashMap$KeySet.iterator(HashMap.java:916)
at java.util.HashSet.iterator(HashSet.java:172)
at java.util.Collections$UnmodifiableCollection$1.<init>(Collections.java:1039)
at java.util.Collections$UnmodifiableCollection.iterator(Collections.java:1038)
at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:214)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:282)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:33,651] ERROR Unexpected exception in KafkaBasedLog's work thread (org.apache.kafka.connect.util.KafkaBasedLog:?)
java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
[2016-08-06 15:00:33,651] ERROR Uncaught exception in herder work thread, exiting: (org.apache.kafka.connect.runtime.distributed.DistributedHerder:183)
java.lang.OutOfMemoryError: Java heap space
[2016-08-06 15:00:36,937] WARN Failed to execute bulk request java.lang.OutOfMemoryError: Java heap space. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:36,936] ERROR Exception occurred during async execution. (io.searchbox.client.http.JestHttpClient:185)
org.apache.http.ConnectionClosedException: Connection closed unexpectedly
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.closed(HttpAsyncRequestExecutor.java:139)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:71)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.disconnected(AbstractIODispatch.java:102)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionClosed(BaseIOReactor.java:281)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processClosedSessions(AbstractIOReactor.java:442)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.hardShutdown(AbstractIOReactor.java:578)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:307)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:36,938] INFO Kafka Connect stopping (org.apache.kafka.connect.runtime.Connect:68)
[2016-08-06 15:00:36,938] INFO Stopping REST server (org.apache.kafka.connect.runtime.rest.RestServer:154)
[2016-08-06 15:00:36,938] ERROR Failed to execute the batch (io.confluent.connect.elasticsearch.internals.BulkProcessor:147)
org.apache.http.ConnectionClosedException: Connection closed unexpectedly
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.closed(HttpAsyncRequestExecutor.java:139)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:71)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.disconnected(AbstractIODispatch.java:102)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionClosed(BaseIOReactor.java:281)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processClosedSessions(AbstractIOReactor.java:442)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.hardShutdown(AbstractIOReactor.java:578)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:307)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:36,938] ERROR Failed to execute the batch, retry or fail (io.confluent.connect.elasticsearch.internals.BulkProcessor:186)
org.apache.http.ConnectionClosedException: Connection closed unexpectedly
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.closed(HttpAsyncRequestExecutor.java:139)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:71)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.disconnected(AbstractIODispatch.java:102)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionClosed(BaseIOReactor.java:281)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processClosedSessions(AbstractIOReactor.java:442)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.hardShutdown(AbstractIOReactor.java:578)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:307)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:36,937] ERROR Exception occurred during async execution. (io.searchbox.client.http.JestHttpClient:185)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:36,954] ERROR Failed to execute the batch (io.confluent.connect.elasticsearch.internals.BulkProcessor:147)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,251] ERROR Failed to execute the batch, retry or fail (io.confluent.connect.elasticsearch.internals.BulkProcessor:186)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Exception in thread "pool-7-thread-1" java.lang.OutOfMemoryError: Java heap space
[2016-08-06 15:00:36,940] ERROR Exception occurred during async execution. (io.searchbox.client.http.JestHttpClient:185)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,547] ERROR Failed to execute the batch (io.confluent.connect.elasticsearch.internals.BulkProcessor:147)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,547] ERROR Failed to execute the batch, retry or fail (io.confluent.connect.elasticsearch.internals.BulkProcessor:186)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:36,937] ERROR Exception occurred during async execution. (io.searchbox.client.http.JestHttpClient:185)
org.apache.http.ConnectionClosedException: Connection closed unexpectedly
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.closed(HttpAsyncRequestExecutor.java:139)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:71)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.disconnected(AbstractIODispatch.java:102)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionClosed(BaseIOReactor.java:281)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processClosedSessions(AbstractIOReactor.java:442)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.hardShutdown(AbstractIOReactor.java:578)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:307)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,548] ERROR Failed to execute the batch (io.confluent.connect.elasticsearch.internals.BulkProcessor:147)
org.apache.http.ConnectionClosedException: Connection closed unexpectedly
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.closed(HttpAsyncRequestExecutor.java:139)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:71)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.disconnected(AbstractIODispatch.java:102)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionClosed(BaseIOReactor.java:281)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processClosedSessions(AbstractIOReactor.java:442)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.hardShutdown(AbstractIOReactor.java:578)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:307)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,548] ERROR Failed to execute the batch, retry or fail (io.confluent.connect.elasticsearch.internals.BulkProcessor:186)
org.apache.http.ConnectionClosedException: Connection closed unexpectedly
at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.closed(HttpAsyncRequestExecutor.java:139)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:71)
at org.apache.http.impl.nio.client.InternalIODispatch.onClosed(InternalIODispatch.java:39)
at org.apache.http.impl.nio.reactor.AbstractIODispatch.disconnected(AbstractIODispatch.java:102)
at org.apache.http.impl.nio.reactor.BaseIOReactor.sessionClosed(BaseIOReactor.java:281)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.processClosedSessions(AbstractIOReactor.java:442)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.hardShutdown(AbstractIOReactor.java:578)
at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:307)
at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,547] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:37,547] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:37,847] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:37,848] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:37,546] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:37,249] ERROR Exception occurred during async execution. (io.searchbox.client.http.JestHttpClient:185)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,851] ERROR Failed to execute the batch (io.confluent.connect.elasticsearch.internals.BulkProcessor:147)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,851] ERROR Failed to execute the batch, retry or fail (io.confluent.connect.elasticsearch.internals.BulkProcessor:186)
java.lang.IllegalStateException: I/O reactor has been shut down
at org.apache.http.util.Asserts.check(Asserts.java:34)
at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.connect(DefaultConnectingIOReactor.java:226)
at org.apache.http.nio.pool.AbstractNIOConnPool.processPendingRequest(AbstractNIOConnPool.java:433)
at org.apache.http.nio.pool.AbstractNIOConnPool.lease(AbstractNIOConnPool.java:275)
at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.requestConnection(PoolingNHttpClientConnectionManager.java:265)
at org.apache.http.impl.nio.client.AbstractClientExchangeHandler.requestConnection(AbstractClientExchangeHandler.java:363)
at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.start(DefaultClientExchangeHandlerImpl.java:125)
at org.apache.http.impl.nio.client.InternalHttpAsyncClient.execute(InternalHttpAsyncClient.java:141)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:74)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:107)
at org.apache.http.impl.nio.client.CloseableHttpAsyncClient.execute(CloseableHttpAsyncClient.java:91)
at io.searchbox.client.http.JestHttpClient.executeAsync(JestHttpClient.java:62)
at io.confluent.connect.elasticsearch.internals.HttpClient.execute(HttpClient.java:47)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.execute(BulkProcessor.java:157)
at io.confluent.connect.elasticsearch.internals.BulkProcessor.access$700(BulkProcessor.java:30)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:307)
at io.confluent.connect.elasticsearch.internals.BulkProcessor$BulkTask.call(BulkProcessor.java:295)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[2016-08-06 15:00:37,871] INFO Stopped ServerConnector@37bd68c3{HTTP/1.1}{0.0.0.0:8083} (org.eclipse.jetty.server.ServerConnector:306)
[2016-08-06 15:00:38,162] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:38,166] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:38,493] WARN Failed to execute bulk request java.lang.IllegalStateException: Request cannot be executed; I/O reactor status: STOPPED. (io.confluent.connect.elasticsearch.internals.BulkProcessor:159)
[2016-08-06 15:00:38,498] INFO Stopped o.e.j.s.ServletContextHandler@36546a22{/,null,UNAVAILABLE} (org.eclipse.jetty.server.handler.ContextHandler:865)
[2016-08-06 15:00:38,503] INFO REST server stopped (org.apache.kafka.connect.runtime.rest.RestServer:165)
[2016-08-06 15:00:38,503] INFO Herder stopping (org.apache.kafka.connect.runtime.distributed.DistributedHerder:362)
[2016-08-06 15:00:38,503] INFO Herder stopped (org.apache.kafka.connect.runtime.distributed.DistributedHerder:382)
[2016-08-06 15:00:38,503] INFO Kafka Connect stopped (org.apache.kafka.connect.runtime.Connect:73)
@skilledmonster
Copy link

Is this resolved? How ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment