Created
March 18, 2016 16:42
-
-
Save maxd/cd5073b8b635d2ab149e to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2016-03-18 16:24:12,525 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable | |
2016-03-18 16:24:12,621 INFO org.apache.flink.runtime.taskmanager.TaskManager - -------------------------------------------------------------------------------- | |
2016-03-18 16:24:12,621 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager (Version: 1.0.0, Rev:94cd554, Date:03.03.2016 @ 08:34:27 UTC) | |
2016-03-18 16:24:12,621 INFO org.apache.flink.runtime.taskmanager.TaskManager - Current user: root | |
2016-03-18 16:24:12,621 INFO org.apache.flink.runtime.taskmanager.TaskManager - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.71-b15 | |
2016-03-18 16:24:12,621 INFO org.apache.flink.runtime.taskmanager.TaskManager - Maximum heap size: 1963 MiBytes | |
2016-03-18 16:24:12,621 INFO org.apache.flink.runtime.taskmanager.TaskManager - JAVA_HOME: (not set) | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - Hadoop version: 2.7.2 | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - JVM Options: | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -Xms2048M | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -Xmx2048M | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -XX:MaxDirectMemorySize=8388607T | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -Dlog.file=/flink/log/flink--taskmanager-0-app-2.stag.local.log | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -Dlog4j.configuration=file:/flink/conf/log4j.properties | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -Dlogback.configurationFile=file:/flink/conf/logback.xml | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - -Djava.net.preferIPv4Stack=true | |
2016-03-18 16:24:12,624 INFO org.apache.flink.runtime.taskmanager.TaskManager - Program Arguments: | |
2016-03-18 16:24:12,625 INFO org.apache.flink.runtime.taskmanager.TaskManager - --configDir | |
2016-03-18 16:24:12,625 INFO org.apache.flink.runtime.taskmanager.TaskManager - /flink/conf | |
2016-03-18 16:24:12,625 INFO org.apache.flink.runtime.taskmanager.TaskManager - Classpath: /flink/lib/flink-dist_2.11-1.0.0.jar:/flink/lib/flink-python_2.11-1.0.0.jar:/flink/lib/log4j-1.2.17.jar:/flink/lib/slf4j-log4j12-1.7.7.jar::: | |
2016-03-18 16:24:12,625 INFO org.apache.flink.runtime.taskmanager.TaskManager - -------------------------------------------------------------------------------- | |
2016-03-18 16:24:12,625 INFO org.apache.flink.runtime.taskmanager.TaskManager - Registered UNIX signal handlers for [TERM, HUP, INT] | |
2016-03-18 16:24:12,628 INFO org.apache.flink.runtime.taskmanager.TaskManager - Maximum number of open file descriptors is 1048576 | |
2016-03-18 16:24:12,648 INFO org.apache.flink.runtime.taskmanager.TaskManager - Loading configuration from /flink/conf | |
2016-03-18 16:24:12,687 INFO org.apache.flink.runtime.taskmanager.TaskManager - Security is not enabled. Starting non-authenticated TaskManager. | |
2016-03-18 16:24:12,712 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - Trying to select the network interface and address to use by connecting to the leading JobManager. | |
2016-03-18 16:24:12,712 INFO org.apache.flink.runtime.util.LeaderRetrievalUtils - TaskManager will try to connect for 10000 milliseconds before falling back to heuristics | |
2016-03-18 16:24:12,715 INFO org.apache.flink.runtime.net.ConnectionUtils - Retrieved new target address /192.168.38.93:6123. | |
2016-03-18 16:24:12,726 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager will use hostname/address 'app-2.stag.local' (192.168.38.98) for communication. | |
2016-03-18 16:24:12,727 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager | |
2016-03-18 16:24:12,728 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager actor system at 192.168.38.98:0 | |
2016-03-18 16:24:13,087 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started | |
2016-03-18 16:24:13,139 INFO Remoting - Starting remoting | |
2016-03-18 16:24:13,433 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://flink@192.168.38.98:59815] | |
2016-03-18 16:24:13,438 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager actor | |
2016-03-18 16:24:13,447 INFO org.apache.flink.runtime.io.network.netty.NettyConfig - NettyConfig [server address: app-2.stag.local/192.168.38.98, server port: 35806, memory segment size (bytes): 32768, transport type: NIO, number of server threads: 4 (manual), number of client threads: 4 (manual), server connect backlog: 0 (use Netty's default), client connect timeout (sec): 120, send/receive buffer size (bytes): 0 (use Netty's default)] | |
2016-03-18 16:24:13,450 INFO org.apache.flink.runtime.taskmanager.TaskManager - Messages between TaskManager and JobManager have a max timeout of 10000 milliseconds | |
2016-03-18 16:24:13,454 INFO org.apache.flink.runtime.taskmanager.TaskManager - Temporary file directory '/tmp': total 5 GB, usable 3 GB (60.00% usable) | |
2016-03-18 16:24:13,501 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). | |
2016-03-18 16:24:13,639 INFO org.apache.flink.runtime.taskmanager.TaskManager - Limiting managed memory to 0.7 of the currently free heap space (1318 MB), memory will be allocated lazily. | |
2016-03-18 16:24:13,652 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses directory /tmp/flink-io-601aff21-70e5-45c1-b7b2-85d92632de36 for spill files. | |
2016-03-18 16:24:13,661 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-cfb9cc2c-8890-4bda-bb0d-f33ce3347d2f | |
2016-03-18 16:24:13,907 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager actor at akka://flink/user/taskmanager#-1472896074. | |
2016-03-18 16:24:13,907 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager data connection information: app-2.stag.local (dataPort=35806) | |
2016-03-18 16:24:13,908 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager has 4 task slot(s). | |
2016-03-18 16:24:13,910 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP: 131/1963/1963 MB, NON HEAP: 32/32/-1 MB (used/committed/max)] | |
2016-03-18 16:24:13,916 INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to register at JobManager akka.tcp://flink@192.168.38.93:6123/user/jobmanager (attempt 1, timeout: 500 milliseconds) | |
2016-03-18 16:24:14,140 INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful registration at JobManager (akka.tcp://flink@192.168.38.93:6123/user/jobmanager), starting network stack and library cache. | |
2016-03-18 16:24:14,308 INFO org.apache.flink.runtime.io.network.netty.NettyClient - Successful initialization (took 33 ms). | |
2016-03-18 16:24:14,347 INFO org.apache.flink.runtime.io.network.netty.NettyServer - Successful initialization (took 39 ms). Listening on SocketAddress /192.168.38.98:35806. | |
2016-03-18 16:24:14,347 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server address to be /192.168.38.93:6130. Starting BLOB cache. | |
2016-03-18 16:24:14,350 INFO org.apache.flink.runtime.blob.BlobCache - Created BLOB cache storage directory /tmp/blobStore-f2a25e17-aa2d-4d99-82b0-4e14fd110d79 | |
2016-03-18 16:24:46,340 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) | |
2016-03-18 16:24:46,341 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) | |
2016-03-18 16:24:46,341 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) | |
2016-03-18 16:24:46,346 INFO org.apache.flink.runtime.blob.BlobCache - Downloading e082fedf20e9b9e8c868bd49ce455e0b826362c0 from /192.168.38.93:6130 | |
2016-03-18 16:24:46,349 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) | |
2016-03-18 16:24:46,349 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) | |
2016-03-18 16:24:46,351 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) | |
2016-03-18 16:24:46,350 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) | |
2016-03-18 16:24:46,354 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) | |
2016-03-18 16:24:46,355 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Calculate total traffic and duration (1/8) | |
2016-03-18 16:24:46,355 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Calculate total traffic and duration (2/8) | |
2016-03-18 16:24:46,355 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Calculate total traffic and duration (1/8) | |
2016-03-18 16:24:46,356 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Calculate total traffic and duration (2/8) | |
2016-03-18 16:24:46,356 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Calculate total traffic and duration (3/8) | |
2016-03-18 16:24:46,364 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Calculate total traffic and duration (3/8) | |
2016-03-18 16:24:46,364 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Calculate total traffic and duration (4/8) | |
2016-03-18 16:24:46,365 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:24:46,366 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Calculate total traffic and duration (4/8) | |
2016-03-18 16:24:46,366 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:24:46,443 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) [DEPLOYING] | |
2016-03-18 16:24:46,443 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) [DEPLOYING] | |
2016-03-18 16:24:46,443 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Sink: Log total traffic and duration (1/1) [DEPLOYING] | |
2016-03-18 16:24:46,444 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) [DEPLOYING] | |
2016-03-18 16:24:46,445 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Calculate total traffic and duration (1/8) [DEPLOYING] | |
2016-03-18 16:24:46,445 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Calculate total traffic and duration (2/8) [DEPLOYING] | |
2016-03-18 16:24:46,447 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) [DEPLOYING] | |
2016-03-18 16:24:46,447 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Calculate total traffic and duration (3/8) [DEPLOYING] | |
2016-03-18 16:24:46,447 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Calculate total traffic and duration (4/8) [DEPLOYING] | |
2016-03-18 16:24:46,450 INFO org.apache.flink.runtime.taskmanager.Task - Sink: Log total traffic and duration (1/1) switched to RUNNING | |
2016-03-18 16:24:46,460 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) switched to RUNNING | |
2016-03-18 16:24:46,461 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) switched to RUNNING | |
2016-03-18 16:24:46,461 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (4/8) switched to RUNNING | |
2016-03-18 16:24:46,461 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (3/8) switched to RUNNING | |
2016-03-18 16:24:46,462 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (2/8) switched to RUNNING | |
2016-03-18 16:24:46,463 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (1/8) switched to RUNNING | |
2016-03-18 16:24:46,463 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) switched to RUNNING | |
2016-03-18 16:24:46,468 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) switched to RUNNING | |
2016-03-18 16:24:46,587 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,637 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,636 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,640 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,648 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,701 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,703 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,703 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,702 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,705 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,703 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,709 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,711 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,881 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,899 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,900 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:24:46,902 INFO org.apache.flink.streaming.runtime.tasks.StreamTask - Using user-defined state backend: MemoryStateBackend (data in heap memory / checkpoints to JobManager) | |
2016-03-18 16:26:46,804 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:83) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,815 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) | |
2016-03-18 16:26:46,816 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:83) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,805 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Sink: Log total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:83) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,805 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,824 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) | |
2016-03-18 16:26:46,804 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,826 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) | |
2016-03-18 16:26:46,826 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,804 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Sink: Log total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,829 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:46,829 INFO org.apache.flink.runtime.taskmanager.Task - Sink: Log total traffic and duration (1/1) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,804 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Sink: Log total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,833 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:46,833 INFO org.apache.flink.runtime.taskmanager.Task - Task Sink: Log total traffic and duration (1/1) is already in state FAILED | |
2016-03-18 16:26:46,804 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Sink: Log total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,835 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:46,835 INFO org.apache.flink.runtime.taskmanager.Task - Task Sink: Log total traffic and duration (1/1) is already in state FAILED | |
2016-03-18 16:26:46,834 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,997 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) | |
2016-03-18 16:26:46,997 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,833 INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) (348a284b52ef1591c3033bf19d184f5d). | |
2016-03-18 16:26:46,833 INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Sink: Log total traffic and duration (1/1) (855f7e7b2c28255a3ee657cb907df0a0). | |
2016-03-18 16:26:46,832 INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) (8fb7211fe0393868ca4cd9d6972b671c). | |
2016-03-18 16:26:46,824 INFO org.apache.flink.runtime.taskmanager.Task - Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,005 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Calculate total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,019 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,019 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (1/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:46,823 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:47,020 INFO org.apache.flink.runtime.taskmanager.Task - Task Sink: Log total traffic and duration (1/1) is already in state FAILED | |
2016-03-18 16:26:47,016 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (3/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.requestPartitions(SingleInputGate.java:388) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.getNextBufferOrEvent(SingleInputGate.java:411) | |
at org.apache.flink.streaming.runtime.io.BarrierTracker.getNextNonBlocked(BarrierTracker.java:75) | |
at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:175) | |
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:65) | |
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224) | |
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
... 1 more | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,021 INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Calculate total traffic and duration (1/8) (ed4ca815aa9e0cf5706a2a5a65838c41). | |
2016-03-18 16:26:47,022 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Calculate total traffic and duration (3/8) | |
2016-03-18 16:26:47,016 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) | |
2016-03-18 16:26:47,024 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) is already in state FAILED | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) is already in state FAILED | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) is already in state FAILED | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) is already in state FAILED | |
2016-03-18 16:26:47,025 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (1/8) is already in state FAILED | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (2/8) | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (2/8) is already in state FAILED | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (3/8) | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (3/8) is already in state FAILED | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (4/8) | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (4/8) is already in state FAILED | |
2016-03-18 16:26:47,026 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Task Sink: Log total traffic and duration (1/1) is already in state FAILED | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) is already in state FAILED | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) is already in state FAILED | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) is already in state FAILED | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) is already in state FAILED | |
2016-03-18 16:26:47,027 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (1/8) is already in state FAILED | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (2/8) | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (2/8) is already in state FAILED | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (3/8) | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (3/8) is already in state FAILED | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Calculate total traffic and duration (4/8) | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (4/8) is already in state FAILED | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:47,028 INFO org.apache.flink.runtime.taskmanager.Task - Task Sink: Log total traffic and duration (1/1) is already in state FAILED | |
2016-03-18 16:26:47,014 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Sink: Log total traffic and duration (1/1) | |
2016-03-18 16:26:47,014 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (2/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.requestPartitions(SingleInputGate.java:388) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.getNextBufferOrEvent(SingleInputGate.java:411) | |
at org.apache.flink.streaming.runtime.io.BarrierTracker.getNextNonBlocked(BarrierTracker.java:75) | |
at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:175) | |
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:65) | |
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224) | |
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
... 1 more | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,036 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Calculate total traffic and duration (2/8) | |
2016-03-18 16:26:47,013 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Calculate total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,037 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,037 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (1/8) is already in state FAILED | |
2016-03-18 16:26:47,006 INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) (e18a70bea2a7ae9a54c4658aa11f0e17). | |
2016-03-18 16:26:47,001 INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) (41241db5819cb0d7a8dc29548c043fc1). | |
2016-03-18 16:26:46,995 INFO org.apache.flink.runtime.taskmanager.Task - Calculate total traffic and duration (4/8) switched to FAILED with exception. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:83) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.requestPartitions(SingleInputGate.java:388) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.getNextBufferOrEvent(SingleInputGate.java:411) | |
at org.apache.flink.streaming.runtime.io.BarrierTracker.getNextNonBlocked(BarrierTracker.java:75) | |
at org.apache.flink.streaming.runtime.io.StreamInputProcessor.processInput(StreamInputProcessor.java:175) | |
at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask.run(OneInputStreamTask.java:65) | |
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224) | |
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
... 1 more | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,041 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Calculate total traffic and duration (4/8) | |
2016-03-18 16:26:46,994 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Calculate total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,042 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,043 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (1/8) is already in state FAILED | |
2016-03-18 16:26:46,994 ERROR org.apache.flink.runtime.taskmanager.TaskManager - Could not update input data location for task Calculate total traffic and duration. Trying to fail task. | |
java.io.IOException: Connecting the channel failed: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.waitForChannel(PartitionRequestClientFactory.java:196) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.access$000(PartitionRequestClientFactory.java:131) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory.createPartitionRequestClient(PartitionRequestClientFactory.java:67) | |
at org.apache.flink.runtime.io.network.netty.NettyConnectionManager.createPartitionRequestClient(NettyConnectionManager.java:60) | |
at org.apache.flink.runtime.io.network.partition.consumer.RemoteInputChannel.requestSubpartition(RemoteInputChannel.java:114) | |
at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.updateInputChannel(SingleInputGate.java:284) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply$mcV$sp(TaskManager.scala:1076) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at org.apache.flink.runtime.taskmanager.TaskManager$$anonfun$3$$anonfun$apply$1.apply(TaskManager.scala:1075) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) | |
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) | |
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:41) | |
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:401) | |
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) | |
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) | |
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) | |
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) | |
Caused by: org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Connecting to remote task manager + 'app-1.stag.local/192.168.38.93:44582' has failed. This might indicate that the remote task manager has been lost. | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:215) | |
at org.apache.flink.runtime.io.network.netty.PartitionRequestClientFactory$ConnectingChannel.operationComplete(PartitionRequestClientFactory.java:131) | |
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) | |
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) | |
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:214) | |
at io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38) | |
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120) | |
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) | |
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) | |
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) | |
at java.lang.Thread.run(Thread.java:745) | |
Caused by: io.netty.channel.ConnectTimeoutException: connection timed out: app-1.stag.local/192.168.38.93:44582 | |
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe$1.run(AbstractNioChannel.java:212) | |
... 6 more | |
2016-03-18 16:26:47,060 INFO org.apache.flink.runtime.taskmanager.Task - Attempting to fail task externally Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,060 INFO org.apache.flink.runtime.taskmanager.Task - Task Calculate total traffic and duration (1/8) is already in state FAILED | |
2016-03-18 16:26:47,068 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Calculate total traffic and duration (1/8) | |
2016-03-18 16:26:47,071 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (6/8) | |
2016-03-18 16:26:47,071 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (7/8) | |
2016-03-18 16:26:47,071 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (5/8) | |
2016-03-18 16:26:47,071 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8/8) | |
2016-03-18 16:26:47,074 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Calculate total traffic and duration (68224de9ef7b195adcf98233d5daf7e0) | |
2016-03-18 16:26:47,078 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Calculate total traffic and duration (ed4ca815aa9e0cf5706a2a5a65838c41) | |
2016-03-18 16:26:47,078 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Calculate total traffic and duration (c0de9b9d8389b55828050cb38bc2d8d6) | |
2016-03-18 16:26:47,079 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Calculate total traffic and duration (3fa3a1e80d8f4f169072aac2ab51326b) | |
2016-03-18 16:26:47,080 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Sink: Log total traffic and duration (855f7e7b2c28255a3ee657cb907df0a0) | |
2016-03-18 16:26:47,081 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (41241db5819cb0d7a8dc29548c043fc1) | |
2016-03-18 16:26:47,082 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (e18a70bea2a7ae9a54c4658aa11f0e17) | |
2016-03-18 16:26:47,084 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (348a284b52ef1591c3033bf19d184f5d) | |
2016-03-18 16:26:47,087 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FAILED to JobManager for task Extract content from RSyslog item -> Extract LogItem from RSyslog Content -> Extract timestamp (8fb7211fe0393868ca4cd9d6972b671c) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment