Created
June 23, 2017 16:51
-
-
Save cresny/8d0d24b1bd72031a515bd9a3822da189 to your computer and use it in GitHub Desktop.
cp1-cp3 (success), cancel -> resume cp3, cp4 (hang...)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2017-06-23 16:43:44.907 [ip-10-150-96-68] INFO org.apache.flink.runtime.blob.BlobClient - Blob client connecting to akka://flink/user/jobmanager | |
| 2017-06-23 16:43:45.235 [ip-10-150-96-68] INFO org.apache.flink.runtime.client.JobClient - Checking and uploading JAR files | |
| 2017-06-23 16:43:45.235 [ip-10-150-96-68] INFO org.apache.flink.runtime.blob.BlobClient - Blob client connecting to akka://flink/user/jobmanager | |
| 2017-06-23 16:43:45.570 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via failover strategy: full graph restart | |
| 2017-06-23 16:43:45.573 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Persisting periodic checkpoints externally at s3://mm-flink-checkpoints//cliff. | |
| 2017-06-23 16:43:45.573 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Persisting periodic checkpoints externally at s3://mm-flink-checkpoints//cliff. | |
| 2017-06-23 16:43:45.574 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job Report Pipeline (41989860902b258a85ab86a901effc19) switched from state CREATED to RUNNING. | |
| 2017-06-23 16:43:45.574 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.574 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.574 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.575 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.575 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.575 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.575 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.575 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:43:45.576 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.576 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: null source -> Sink: Redshift Transmitter (1/1) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.576 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.576 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: S3 File Watcher (1/1) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.577 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.577 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.578 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.579 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.579 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.579 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Aggregate Metrics -> Extract Value (1/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.581 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.581 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Aggregate Metrics -> Extract Value (2/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.581 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.581 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying To Tsv -> Sink: pulse-streaming-report (1/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.582 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:43:45.582 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying To Tsv -> Sink: pulse-streaming-report (2/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:43:45.583 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.584 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) [DEPLOYING] | |
| 2017-06-23 16:43:45.586 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) [DEPLOYING]. | |
| 2017-06-23 16:43:45.589 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.601 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) [DEPLOYING] | |
| 2017-06-23 16:43:45.608 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.620 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.601 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) [DEPLOYING]. | |
| 2017-06-23 16:43:45.608 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) [DEPLOYING] | |
| 2017-06-23 16:43:45.620 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) [DEPLOYING] | |
| 2017-06-23 16:43:45.620 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) [DEPLOYING]. | |
| 2017-06-23 16:43:45.608 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) [DEPLOYING]. | |
| 2017-06-23 16:43:45.626 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) [DEPLOYING]. | |
| 2017-06-23 16:43:45.626 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) [DEPLOYING]. | |
| 2017-06-23 16:43:45.624 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.627 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) [DEPLOYING]. | |
| 2017-06-23 16:43:45.628 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) [DEPLOYING]. | |
| 2017-06-23 16:43:45.634 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.635 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) [DEPLOYING] | |
| 2017-06-23 16:43:45.634 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) [DEPLOYING] | |
| 2017-06-23 16:43:45.635 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) [DEPLOYING]. | |
| 2017-06-23 16:43:45.634 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) [DEPLOYING]. | |
| 2017-06-23 16:43:45.635 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) [DEPLOYING]. | |
| 2017-06-23 16:43:45.635 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) [DEPLOYING]. | |
| 2017-06-23 16:43:45.637 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.640 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) [DEPLOYING] | |
| 2017-06-23 16:43:45.640 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:43:45.641 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.644 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.647 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) [DEPLOYING]. | |
| 2017-06-23 16:43:45.644 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.643 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) [DEPLOYING] | |
| 2017-06-23 16:43:45.649 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) [DEPLOYING]. | |
| 2017-06-23 16:43:45.649 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.650 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) [DEPLOYING]. | |
| 2017-06-23 16:43:45.650 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) [DEPLOYING]. | |
| 2017-06-23 16:43:45.652 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.659 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.654 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.657 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.661 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.659 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.665 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.665 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.665 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.666 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.666 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:45.670 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:43:46.111 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.111 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.112 [ip-10-150-96-244] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot. | |
| 2017-06-23 16:43:46.116 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: null. | |
| 2017-06-23 16:43:46.137 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.137 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.150 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.150 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.158 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.158 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.196 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.196 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.220 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.220 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.260 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.262 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.260 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.262 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.278 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.278 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.302 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.302 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.304 [ip-10-150-96-244] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot. | |
| 2017-06-23 16:43:46.304 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: null. | |
| 2017-06-23 16:43:46.308 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.308 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.363 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.363 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.397 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.397 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.459 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.459 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.468 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.468 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.505 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.505 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.864 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.864 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.920 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:46.920 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:47.882 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:43:47.882 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:15.578 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 1 @ 1498236255574 | |
| 2017-06-23 16:44:15.578 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 1 @ 1498236255574 | |
| 2017-06-23 16:44:15.612 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 6bf672b9300af1eab82babefe7dcc545 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:15.612 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 6bf672b9300af1eab82babefe7dcc545 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:19.513 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0 | |
| 2017-06-23 16:44:19.539 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 40 ms. | |
| 2017-06-23 16:44:19.539 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 40 ms. | |
| 2017-06-23 16:44:19.560 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task bad0818e3423781ea51f8203f9895fa6 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:19.560 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task bad0818e3423781ea51f8203f9895fa6 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:19.560 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 10a96ac8496f62c2d9928576eef0e7e7 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:19.560 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 10a96ac8496f62c2d9928576eef0e7e7 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:19.553 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 1 | |
| 2017-06-23 16:44:19.637 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 63 ms. | |
| 2017-06-23 16:44:19.637 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 63 ms. | |
| 2017-06-23 16:44:19.644 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 75 ms. | |
| 2017-06-23 16:44:19.644 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 75 ms. | |
| 2017-06-23 16:44:20.117 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-19-thread-1,5,Flink Task Threads] took 569 ms. | |
| 2017-06-23 16:44:20.117 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-19-thread-1,5,Flink Task Threads] took 569 ms. | |
| 2017-06-23 16:44:20.133 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task b7b6935101ec0da3c0161d7215524426 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:20.133 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task b7b6935101ec0da3c0161d7215524426 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:20.886 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 1246 ms. | |
| 2017-06-23 16:44:20.886 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 1246 ms. | |
| 2017-06-23 16:44:20.897 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 1250 ms. | |
| 2017-06-23 16:44:20.897 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 1250 ms. | |
| 2017-06-23 16:44:21.393 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:44:21.393 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000011.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:44:21.404 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/0f9df366-a710-4280-af81-570f39d4bb3b'} | |
| 2017-06-23 16:44:21.424 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:44:21.424 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000011.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:44:21.424 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5201886f-b22c-49e5-b6e6-1982b402b544'} | |
| 2017-06-23 16:44:21.469 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 583 ms. | |
| 2017-06-23 16:44:21.469 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 583 ms. | |
| 2017-06-23 16:44:21.662 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 761 ms. | |
| 2017-06-23 16:44:21.662 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 761 ms. | |
| 2017-06-23 16:44:21.672 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5078338e-c95d-4e9d-a099-e801a491d5d8 [8290 bytes] | |
| 2017-06-23 16:44:21.673 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/0370d350-5ef5-4793-9990-83ee41668af9'} | |
| 2017-06-23 16:44:21.694 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 6a248760de347710abda246b4f06207e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:21.694 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 6a248760de347710abda246b4f06207e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:21.833 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/b1fc9b41-2782-431e-b2cd-adde198a5156 [8290 bytes] | |
| 2017-06-23 16:44:21.836 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/0e013932-25ed-4b11-9d42-1ae561f24a04'} | |
| 2017-06-23 16:44:21.847 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 2dae2f0e6a64c18829b80cf415b1ed17 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:21.847 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task 2dae2f0e6a64c18829b80cf415b1ed17 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:22.393 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 923 ms. | |
| 2017-06-23 16:44:22.393 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 923 ms. | |
| 2017-06-23 16:44:22.399 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 736 ms. | |
| 2017-06-23 16:44:22.399 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 736 ms. | |
| 2017-06-23 16:44:22.406 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task b2f108d3ee9ad91c0605cfbf06cbe0b1 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:22.406 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task b2f108d3ee9ad91c0605cfbf06cbe0b1 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:22.414 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task ba72be9256db823bf66ced2ffc18c77e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:22.414 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 1 from task ba72be9256db823bf66ced2ffc18c77e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:22.414 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {} | |
| 2017-06-23 16:44:22.414 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {} | |
| 2017-06-23 16:44:22.414 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:44:22.414 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:44:22.415 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1} | |
| 2017-06-23 16:44:22.415 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1} | |
| 2017-06-23 16:44:22.416 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:44:22.416 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:44:22.416 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1} | |
| 2017-06-23 16:44:22.416 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1} | |
| 2017-06-23 16:44:22.416 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}} | |
| 2017-06-23 16:44:22.416 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}} | |
| 2017-06-23 16:44:23.642 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 1 (26624344 bytes in 8067 ms). | |
| 2017-06-23 16:44:23.642 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 1 (26624344 bytes in 8067 ms). | |
| 2017-06-23 16:44:23.642 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Checkpoint state: OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 12477447), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 6108926), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 8034109), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0) | |
| 2017-06-23 16:44:23.642 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Checkpoint state: OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 12477447), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 6108926), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 8034109), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0) | |
| 2017-06-23 16:44:47.641 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 2 @ 1498236287641 | |
| 2017-06-23 16:44:47.641 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 2 @ 1498236287641 | |
| 2017-06-23 16:44:47.647 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 6bf672b9300af1eab82babefe7dcc545 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:47.647 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 6bf672b9300af1eab82babefe7dcc545 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:54.620 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 1 ms. | |
| 2017-06-23 16:44:54.620 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 1 ms. | |
| 2017-06-23 16:44:54.620 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 1 | |
| 2017-06-23 16:44:54.653 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task bad0818e3423781ea51f8203f9895fa6 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:54.653 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task bad0818e3423781ea51f8203f9895fa6 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:54.654 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 10a96ac8496f62c2d9928576eef0e7e7 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:54.654 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 10a96ac8496f62c2d9928576eef0e7e7 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:54.651 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0 | |
| 2017-06-23 16:44:54.671 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 44 ms. | |
| 2017-06-23 16:44:54.671 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 44 ms. | |
| 2017-06-23 16:44:54.705 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 40 ms. | |
| 2017-06-23 16:44:54.705 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 40 ms. | |
| 2017-06-23 16:44:55.090 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-19-thread-1,5,Flink Task Threads] took 470 ms. | |
| 2017-06-23 16:44:55.090 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-19-thread-1,5,Flink Task Threads] took 470 ms. | |
| 2017-06-23 16:44:55.095 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task b7b6935101ec0da3c0161d7215524426 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:55.095 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task b7b6935101ec0da3c0161d7215524426 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:56.002 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 1292 ms. | |
| 2017-06-23 16:44:56.002 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 1292 ms. | |
| 2017-06-23 16:44:56.010 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 1334 ms. | |
| 2017-06-23 16:44:56.010 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 1334 ms. | |
| 2017-06-23 16:44:56.172 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:44:56.172 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000012.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:44:56.173 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:44:56.173 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/ff99f421-4a24-4a41-ba42-30e2fdeacba3'} | |
| 2017-06-23 16:44:56.508 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/3bc7b30a-b724-4c9d-87c2-639121fa8c14 [8290 bytes] | |
| 2017-06-23 16:44:56.509 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/1ef80a27-6eca-447b-ad31-2f19263641da'} | |
| 2017-06-23 16:44:56.517 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 6a248760de347710abda246b4f06207e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:56.517 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 6a248760de347710abda246b4f06207e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:56.606 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 603 ms. | |
| 2017-06-23 16:44:56.606 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 603 ms. | |
| 2017-06-23 16:44:57.265 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 1255 ms. | |
| 2017-06-23 16:44:57.266 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:44:57.265 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 1255 ms. | |
| 2017-06-23 16:44:57.266 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000012.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:44:57.266 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:44:57.266 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/0e4bc81a-c25a-4870-bb61-8ccecaa02a8c'} | |
| 2017-06-23 16:44:57.553 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/a9182932-cea0-4551-921b-688b11b65695 [8290 bytes] | |
| 2017-06-23 16:44:57.593 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/3ae8d8e9-c17a-4a7b-ba0c-0a4383e01c9f'} | |
| 2017-06-23 16:44:57.605 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 2dae2f0e6a64c18829b80cf415b1ed17 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:57.605 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task 2dae2f0e6a64c18829b80cf415b1ed17 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:58.149 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 1542 ms. | |
| 2017-06-23 16:44:58.149 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 1542 ms. | |
| 2017-06-23 16:44:58.157 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task ba72be9256db823bf66ced2ffc18c77e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:58.157 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task ba72be9256db823bf66ced2ffc18c77e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:58.369 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 1103 ms. | |
| 2017-06-23 16:44:58.369 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 1103 ms. | |
| 2017-06-23 16:44:58.377 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task b2f108d3ee9ad91c0605cfbf06cbe0b1 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:58.377 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 2 from task b2f108d3ee9ad91c0605cfbf06cbe0b1 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:44:58.377 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}} | |
| 2017-06-23 16:44:58.377 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}} | |
| 2017-06-23 16:44:58.378 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@1abc3e5c | |
| 2017-06-23 16:44:58.378 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@1abc3e5c | |
| 2017-06-23 16:44:58.378 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2} | |
| 2017-06-23 16:44:58.378 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2} | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1} | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1} | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@1e83b9d3 | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@1e83b9d3 | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2} | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2} | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:44:58.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:44:58.380 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1} | |
| 2017-06-23 16:44:58.380 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1} | |
| 2017-06-23 16:44:58.380 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2}} | |
| 2017-06-23 16:44:58.380 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2}} | |
| 2017-06-23 16:44:58.622 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 2 (55456594 bytes in 10981 ms). | |
| 2017-06-23 16:44:58.622 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 2 (55456594 bytes in 10981 ms). | |
| 2017-06-23 16:44:58.622 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Checkpoint state: OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 31160438), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 17974046), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 6318248), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0) | |
| 2017-06-23 16:44:58.622 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Checkpoint state: OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 31160438), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 17974046), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 6318248), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0) | |
| 2017-06-23 16:45:22.622 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 3 @ 1498236322621 | |
| 2017-06-23 16:45:22.622 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 3 @ 1498236322621 | |
| 2017-06-23 16:45:22.626 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 6bf672b9300af1eab82babefe7dcc545 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:22.626 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 6bf672b9300af1eab82babefe7dcc545 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:25.849 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 0 ms. | |
| 2017-06-23 16:45:25.849 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 0 ms. | |
| 2017-06-23 16:45:25.857 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0 | |
| 2017-06-23 16:45:25.884 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 10a96ac8496f62c2d9928576eef0e7e7 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:25.884 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 10a96ac8496f62c2d9928576eef0e7e7 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:25.894 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task bad0818e3423781ea51f8203f9895fa6 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:25.894 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task bad0818e3423781ea51f8203f9895fa6 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:25.881 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 1 | |
| 2017-06-23 16:45:25.948 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 62 ms. | |
| 2017-06-23 16:45:25.948 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 62 ms. | |
| 2017-06-23 16:45:25.963 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 63 ms. | |
| 2017-06-23 16:45:25.963 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 63 ms. | |
| 2017-06-23 16:45:26.787 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-19-thread-1,5,Flink Task Threads] took 937 ms. | |
| 2017-06-23 16:45:26.787 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-19-thread-1,5,Flink Task Threads] took 937 ms. | |
| 2017-06-23 16:45:26.792 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task b7b6935101ec0da3c0161d7215524426 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:26.792 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task b7b6935101ec0da3c0161d7215524426 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:27.538 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 1586 ms. | |
| 2017-06-23 16:45:27.538 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 1586 ms. | |
| 2017-06-23 16:45:27.548 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 1581 ms. | |
| 2017-06-23 16:45:27.548 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 1581 ms. | |
| 2017-06-23 16:45:28.117 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:45:28.117 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000013.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:45:28.117 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000012.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:45:28.118 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:45:28.118 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/fa2ef73f-99d6-484c-ab0e-c255facd7c02'} | |
| 2017-06-23 16:45:28.141 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 603 ms. | |
| 2017-06-23 16:45:28.141 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 603 ms. | |
| 2017-06-23 16:45:28.282 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 734 ms. | |
| 2017-06-23 16:45:28.282 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 734 ms. | |
| 2017-06-23 16:45:28.297 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:45:28.297 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000013.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:45:28.297 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000012.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:45:28.297 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:45:28.298 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/8125db1c-84e8-4391-ba85-d117e2713731'} | |
| 2017-06-23 16:45:28.437 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/2309437c-c66a-4bfe-b391-57ad8e4fd119 [8290 bytes] | |
| 2017-06-23 16:45:28.437 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/efc916c2-2f9e-440c-8fba-f2a88f1df0a8'} | |
| 2017-06-23 16:45:28.443 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 6a248760de347710abda246b4f06207e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:28.443 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 6a248760de347710abda246b4f06207e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:28.658 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/308474b5-352b-40eb-8120-11049d7712e1 [8290 bytes] | |
| 2017-06-23 16:45:28.659 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/0bd2eeed-f91a-4d18-8c67-019a6f857974'} | |
| 2017-06-23 16:45:28.666 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 2dae2f0e6a64c18829b80cf415b1ed17 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:28.666 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task 2dae2f0e6a64c18829b80cf415b1ed17 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:29.468 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 1326 ms. | |
| 2017-06-23 16:45:29.468 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-14-thread-1,5,Flink Task Threads] took 1326 ms. | |
| 2017-06-23 16:45:29.479 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task ba72be9256db823bf66ced2ffc18c77e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:29.479 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task ba72be9256db823bf66ced2ffc18c77e of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:29.811 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 1528 ms. | |
| 2017-06-23 16:45:29.811 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19, asynchronous part) in thread Thread[pool-15-thread-1,5,Flink Task Threads] took 1528 ms. | |
| 2017-06-23 16:45:29.822 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task b2f108d3ee9ad91c0605cfbf06cbe0b1 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:29.822 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 3 from task b2f108d3ee9ad91c0605cfbf06cbe0b1 of job 41989860902b258a85ab86a901effc19. | |
| 2017-06-23 16:45:29.823 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2}} | |
| 2017-06-23 16:45:29.823 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2}} | |
| 2017-06-23 16:45:29.823 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@4e3f3470 | |
| 2017-06-23 16:45:29.823 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@4e3f3470 | |
| 2017-06-23 16:45:29.823 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=3} | |
| 2017-06-23 16:45:29.823 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=3} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@4a00b96f | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@4a00b96f | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=2} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=2} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@f023e4b | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@f023e4b | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=3} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=3} | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@96c7d9e | |
| 2017-06-23 16:45:29.824 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@96c7d9e | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=2} | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=2} | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1} | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1} | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=3}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=2}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=2}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=3}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1}} | |
| 2017-06-23 16:45:29.825 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=3}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=2}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=2}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=3}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1}} | |
| 2017-06-23 16:45:31.626 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to UNregister for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst | |
| 2017-06-23 16:45:31.626 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to UNregister for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst | |
| 2017-06-23 16:45:31.627 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - UNRegistration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result: Result{reference=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2} | |
| 2017-06-23 16:45:31.627 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - UNRegistration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result: Result{reference=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=2} | |
| 2017-06-23 16:45:32.590 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to UNregister for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst | |
| 2017-06-23 16:45:32.590 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to UNregister for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst | |
| 2017-06-23 16:45:32.591 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - UNRegistration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result: Result{reference=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2} | |
| 2017-06-23 16:45:32.591 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - UNRegistration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result: Result{reference=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=2} | |
| 2017-06-23 16:45:33.778 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 3 (72367708 bytes in 7502 ms). | |
| 2017-06-23 16:45:33.778 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Completed checkpoint 3 (72367708 bytes in 7502 ms). | |
| 2017-06-23 16:45:33.778 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Checkpoint state: OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 45501811), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 16237763), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 10624272), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0) | |
| 2017-06-23 16:45:33.778 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Checkpoint state: OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 45501811), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 16237763), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 10624272), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 2, maxParallelism: 128, sub task states: 2, total size (bytes): 0) | |
| 2017-06-23 16:45:47.415 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job Report Pipeline (41989860902b258a85ab86a901effc19) switched from state RUNNING to CANCELLING. | |
| 2017-06-23 16:45:47.415 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.415 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.415 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.416 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.416 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.416 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.416 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.416 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.417 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545). | |
| 2017-06-23 16:45:47.418 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.418 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545). | |
| 2017-06-23 16:45:47.419 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426). | |
| 2017-06-23 16:45:47.419 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.419 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426). | |
| 2017-06-23 16:45:47.420 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e). | |
| 2017-06-23 16:45:47.420 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.420 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e). | |
| 2017-06-23 16:45:47.420 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1). | |
| 2017-06-23 16:45:47.421 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.421 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1). | |
| 2017-06-23 16:45:47.421 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17). | |
| 2017-06-23 16:45:47.421 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.422 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17). | |
| 2017-06-23 16:45:47.422 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e). | |
| 2017-06-23 16:45:47.422 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.422 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e). | |
| 2017-06-23 16:45:47.423 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7). | |
| 2017-06-23 16:45:47.423 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.423 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7). | |
| 2017-06-23 16:45:47.424 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Attempting to cancel task To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6). | |
| 2017-06-23 16:45:47.424 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from RUNNING to CANCELING. | |
| 2017-06-23 16:45:47.425 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Triggering cancellation of task code To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6). | |
| 2017-06-23 16:45:47.433 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.433 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545). | |
| 2017-06-23 16:45:47.434 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) [CANCELED] | |
| 2017-06-23 16:45:47.440 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.440 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.440 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7). | |
| 2017-06-23 16:45:47.440 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6). | |
| 2017-06-23 16:45:47.440 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) [CANCELED] | |
| 2017-06-23 16:45:47.440 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) [CANCELED] | |
| 2017-06-23 16:45:47.454 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (6bf672b9300af1eab82babefe7dcc545) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.454 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (bad0818e3423781ea51f8203f9895fa6) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.454 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (10a96ac8496f62c2d9928576eef0e7e7) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.461 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.461 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e). | |
| 2017-06-23 16:45:47.461 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) [CANCELED] | |
| 2017-06-23 16:45:47.466 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (ba72be9256db823bf66ced2ffc18c77e) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.464 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.464 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1). | |
| 2017-06-23 16:45:47.464 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) [CANCELED] | |
| 2017-06-23 16:45:47.471 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (b2f108d3ee9ad91c0605cfbf06cbe0b1) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.509 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - deleting instance base path /media/flink/tmp0/flink-io-86192fda-0f81-4bae-a452-a60cf622a3e9/job-41989860902b258a85ab86a901effc19_op-WindowOperator_26_1_uuid-4c2f1364-c556-4067-80bb-d77a9676ccfe | |
| 2017-06-23 16:45:47.512 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.512 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e). | |
| 2017-06-23 16:45:47.512 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) [CANCELED] | |
| 2017-06-23 16:45:47.517 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (6a248760de347710abda246b4f06207e) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.570 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - deleting instance base path /media/flink/tmp0/flink-io-86192fda-0f81-4bae-a452-a60cf622a3e9/job-41989860902b258a85ab86a901effc19_op-WindowOperator_26_0_uuid-4a6784e9-4ec0-4739-b3b2-f45a303686e4 | |
| 2017-06-23 16:45:47.573 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:47.573 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17). | |
| 2017-06-23 16:45:47.573 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) [CANCELED] | |
| 2017-06-23 16:45:47.578 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (2dae2f0e6a64c18829b80cf415b1ed17) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:53.586 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:53.586 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426). | |
| 2017-06-23 16:45:53.588 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) [CANCELED] | |
| 2017-06-23 16:45:53.593 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (b7b6935101ec0da3c0161d7215524426) switched from CANCELING to CANCELED. | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job Report Pipeline (41989860902b258a85ab86a901effc19) switched from state CANCELLING to CANCELED. | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 41989860902b258a85ab86a901effc19 | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 41989860902b258a85ab86a901effc19 | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO o.a.f.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO o.a.f.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CompletedCheckpoint - Persistent checkpoint with ID 2 at 's3://mm-flink-checkpoints/cliff/checkpoint_metadata-b00a29203a00' not discarded. | |
| 2017-06-23 16:45:53.594 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CompletedCheckpoint - Persistent checkpoint with ID 2 at 's3://mm-flink-checkpoints/cliff/checkpoint_metadata-b00a29203a00' not discarded. | |
| 2017-06-23 16:45:53.595 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CompletedCheckpoint - Persistent checkpoint with ID 3 at 's3://mm-flink-checkpoints/cliff/checkpoint_metadata-140341570010' not discarded. | |
| 2017-06-23 16:45:53.595 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CompletedCheckpoint - Persistent checkpoint with ID 3 at 's3://mm-flink-checkpoints/cliff/checkpoint_metadata-140341570010' not discarded. | |
| 2017-06-23 16:46:18.859 [ip-10-150-96-68] INFO org.apache.flink.runtime.blob.BlobClient - Blob client connecting to akka://flink/user/jobmanager | |
| 2017-06-23 16:46:19.172 [ip-10-150-96-68] INFO org.apache.flink.runtime.client.JobClient - Checking and uploading JAR files | |
| 2017-06-23 16:46:19.173 [ip-10-150-96-68] INFO org.apache.flink.runtime.blob.BlobClient - Blob client connecting to akka://flink/user/jobmanager | |
| 2017-06-23 16:46:19.500 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via failover strategy: full graph restart | |
| 2017-06-23 16:46:19.502 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Persisting periodic checkpoints externally at s3://mm-flink-checkpoints//cliff. | |
| 2017-06-23 16:46:19.502 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Persisting periodic checkpoints externally at s3://mm-flink-checkpoints//cliff. | |
| 2017-06-23 16:46:19.503 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Starting job from savepoint s3://mm-flink-checkpoints/cliff/checkpoint_metadata-140341570010 () | |
| 2017-06-23 16:46:19.503 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Starting job from savepoint s3://mm-flink-checkpoints/cliff/checkpoint_metadata-140341570010 () | |
| 2017-06-23 16:46:19.504 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.savepoint.SavepointStore - Loading savepoint from s3://mm-flink-checkpoints/cliff/checkpoint_metadata-140341570010 | |
| 2017-06-23 16:46:19.504 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.savepoint.SavepointStore - Loading savepoint from s3://mm-flink-checkpoints/cliff/checkpoint_metadata-140341570010 | |
| 2017-06-23 16:46:19.672 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {} | |
| 2017-06-23 16:46:19.672 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {} | |
| 2017-06-23 16:46:19.672 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:46:19.672 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.673 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst the state handle File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Registration for key WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst has result entry: SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1}} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry AFTER registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1}} | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Reset the checkpoint ID to 4. | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Reset the checkpoint ID to 4. | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Restoring from latest valid checkpoint: Checkpoint 3 @ 0 for eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:19.674 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Restoring from latest valid checkpoint: Checkpoint 3 @ 0 for eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:19.677 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - No master state to restore | |
| 2017-06-23 16:46:19.677 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - No master state to restore | |
| 2017-06-23 16:46:19.678 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job Report Pipeline (eeb654ff4e8c36bf36e5ffb5aff4192c) switched from state CREATED to RUNNING. | |
| 2017-06-23 16:46:19.678 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.678 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) switched from CREATED to SCHEDULED. | |
| 2017-06-23 16:46:19.679 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.680 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: null source -> Sink: Redshift Transmitter (1/1) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.680 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.681 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: S3 File Watcher (1/1) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.681 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.681 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.682 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.682 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.682 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.683 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Aggregate Metrics -> Extract Value (1/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.683 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.683 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Aggregate Metrics -> Extract Value (2/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.683 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.684 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying To Tsv -> Sink: pulse-streaming-report (1/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.684 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) switched from SCHEDULED to DEPLOYING. | |
| 2017-06-23 16:46:19.684 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying To Tsv -> Sink: pulse-streaming-report (2/2) (attempt #0) to ip-10-150-96-244 | |
| 2017-06-23 16:46:19.683 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.684 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) [DEPLOYING] | |
| 2017-06-23 16:46:19.688 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) [DEPLOYING]. | |
| 2017-06-23 16:46:19.690 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.700 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) [DEPLOYING] | |
| 2017-06-23 16:46:19.704 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) [DEPLOYING]. | |
| 2017-06-23 16:46:19.700 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) [DEPLOYING]. | |
| 2017-06-23 16:46:19.711 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.734 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: null source -> Sink: Redshift Transmitter (1/1) (0224611061a7d7cd2756a658afab3f05) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.724 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.726 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) [DEPLOYING]. | |
| 2017-06-23 16:46:19.731 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) [DEPLOYING] | |
| 2017-06-23 16:46:19.732 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.731 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) [DEPLOYING]. | |
| 2017-06-23 16:46:19.731 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) [DEPLOYING]. | |
| 2017-06-23 16:46:19.734 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.736 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) [DEPLOYING] | |
| 2017-06-23 16:46:19.737 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) [DEPLOYING]. | |
| 2017-06-23 16:46:19.737 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) [DEPLOYING]. | |
| 2017-06-23 16:46:19.738 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.753 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.754 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) [DEPLOYING] | |
| 2017-06-23 16:46:19.760 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.761 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.767 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.764 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) [DEPLOYING]. | |
| 2017-06-23 16:46:19.762 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) [DEPLOYING] | |
| 2017-06-23 16:46:19.765 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) [DEPLOYING]. | |
| 2017-06-23 16:46:19.762 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) [DEPLOYING]. | |
| 2017-06-23 16:46:19.762 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) [DEPLOYING]. | |
| 2017-06-23 16:46:19.767 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) [DEPLOYING] | |
| 2017-06-23 16:46:19.777 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) [DEPLOYING]. | |
| 2017-06-23 16:46:19.777 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) [DEPLOYING]. | |
| 2017-06-23 16:46:19.781 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.781 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.786 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: S3 File Watcher (1/1) (fb2e29fad3bc031dfe04d0d00defbedf) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.787 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2) (d6f0636c301395fa6a3dbc0071611534) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.787 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2) (5d8942f2cc485b821b090147f79eb96a) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.783 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) switched from CREATED to DEPLOYING. | |
| 2017-06-23 16:46:19.788 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (1/2) (5fd6d403f7fd08e559f7dc877c94ed1d) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.788 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (1/2) (5f68e7bbea001a0c7733c034d995d3d2) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.785 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.785 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) [DEPLOYING] | |
| 2017-06-23 16:46:19.786 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) [DEPLOYING]. | |
| 2017-06-23 16:46:19.786 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) [DEPLOYING]. | |
| 2017-06-23 16:46:19.800 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Aggregate Metrics -> Extract Value (2/2) (7b3e50770840ebe9515d78a19b304e9c) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.807 [ip-10-150-96-244] INFO org.apache.flink.runtime.taskmanager.Task - To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:19.811 [ip-10-150-96-68] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - To Tsv -> Sink: pulse-streaming-report (2/2) (70d60908714ae9699f944c03f9013b67) switched from DEPLOYING to RUNNING. | |
| 2017-06-23 16:46:20.086 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.086 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.093 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.093 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.115 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.115 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.160 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.160 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.165 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.165 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.197 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.197 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.198 [ip-10-150-96-244] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot. | |
| 2017-06-23 16:46:20.198 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: [org.apache.flink.runtime.state.IncrementalKeyedStateHandle@8b23b6c1]. | |
| 2017-06-23 16:46:20.199 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.199 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.203 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - restoring instance org.apache.flink.runtime.state.IncrementalKeyedStateHandle@8b23b6c1, hasExtrayKeys: false | |
| 2017-06-23 16:46:20.212 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading 000011.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes] | |
| 2017-06-23 16:46:20.223 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.223 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.228 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.228 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.265 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.265 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.298 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.298 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:20.298 [ip-10-150-96-244] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot. | |
| 2017-06-23 16:46:20.298 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: [org.apache.flink.runtime.state.IncrementalKeyedStateHandle@f9e7c019]. | |
| 2017-06-23 16:46:20.299 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - restoring instance org.apache.flink.runtime.state.IncrementalKeyedStateHandle@f9e7c019, hasExtrayKeys: false | |
| 2017-06-23 16:46:20.299 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading 000011.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes] | |
| 2017-06-23 16:46:20.378 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading 000012.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes] | |
| 2017-06-23 16:46:20.508 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading 000012.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes] | |
| 2017-06-23 16:46:20.663 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading 000013.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes] | |
| 2017-06-23 16:46:20.721 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading 000013.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes] | |
| 2017-06-23 16:46:20.752 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading MANIFEST-000006 -> ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/8125db1c-84e8-4391-ba85-d117e2713731'} | |
| 2017-06-23 16:46:20.753 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading OPTIONS-000010 -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/308474b5-352b-40eb-8120-11049d7712e1 [8290 bytes] | |
| 2017-06-23 16:46:20.794 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading CURRENT -> ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/0bd2eeed-f91a-4d18-8c67-019a6f857974'} | |
| 2017-06-23 16:46:20.852 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading MANIFEST-000006 -> ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/fa2ef73f-99d6-484c-ab0e-c255facd7c02'} | |
| 2017-06-23 16:46:20.863 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading OPTIONS-000010 -> File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/2309437c-c66a-4bfe-b391-57ad8e4fd119 [8290 bytes] | |
| 2017-06-23 16:46:20.936 [ip-10-150-96-244] TRACE o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - reading CURRENT -> ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/efc916c2-2f9e-440c-8fba-f2a88f1df0a8'} | |
| 2017-06-23 16:46:21.052 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.052 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.055 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.055 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.094 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.094 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.114 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.114 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.142 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.142 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.296 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.296 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.362 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.362 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.773 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:21.773 [ip-10-150-96-244] DEBUG o.a.flink.runtime.state.filesystem.FsCheckpointStreamFactory - Initialed file stream factory to URI s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:49.678 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 4 @ 1498236409678 | |
| 2017-06-23 16:46:49.678 [ip-10-150-96-68] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Triggering checkpoint 4 @ 1498236409678 | |
| 2017-06-23 16:46:49.686 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 0224611061a7d7cd2756a658afab3f05 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:49.686 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 0224611061a7d7cd2756a658afab3f05 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:57.343 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 1 ms. | |
| 2017-06-23 16:46:57.343 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[Async calls on Source: S3 File Watcher (1/1),5,Flink Task Threads] took 1 ms. | |
| 2017-06-23 16:46:57.350 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 1 | |
| 2017-06-23 16:46:57.372 [ip-10-150-96-244] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0 | |
| 2017-06-23 16:46:57.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 70d60908714ae9699f944c03f9013b67 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:57.379 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 70d60908714ae9699f944c03f9013b67 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:57.391 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 5f68e7bbea001a0c7733c034d995d3d2 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:57.391 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 5f68e7bbea001a0c7733c034d995d3d2 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:57.430 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 49 ms. | |
| 2017-06-23 16:46:57.430 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 49 ms. | |
| 2017-06-23 16:46:57.437 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 55 ms. | |
| 2017-06-23 16:46:57.437 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 55 ms. | |
| 2017-06-23 16:46:58.698 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-23-thread-1,5,Flink Task Threads] took 1353 ms. | |
| 2017-06-23 16:46:58.698 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-23-thread-1,5,Flink Task Threads] took 1353 ms. | |
| 2017-06-23 16:46:58.703 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task fb2e29fad3bc031dfe04d0d00defbedf of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:58.703 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task fb2e29fad3bc031dfe04d0d00defbedf of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:46:59.647 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 2207 ms. | |
| 2017-06-23 16:46:59.647 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (1/2),5,Flink Task Threads] took 2207 ms. | |
| 2017-06-23 16:46:59.664 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 2230 ms. | |
| 2017-06-23 16:46:59.664 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, synchronous part) in thread Thread[S3 File Reader -> Parser -> Timestamps/Watermarks -> Combiner (2/2),5,Flink Task Threads] took 2230 ms. | |
| 2017-06-23 16:46:59.767 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/2961f50c-1073-4748-9395-9ee0b084c3d7 [2651545 bytes] | |
| 2017-06-23 16:46:59.768 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000018.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/2961f50c-1073-4748-9395-9ee0b084c3d7 [2651545 bytes] | |
| 2017-06-23 16:46:59.768 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000013.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:46:59.768 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000012.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:46:59.768 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:46:59.768 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/d65a965f-2d8f-4b27-a556-6b2d185c7007'} | |
| 2017-06-23 16:46:59.875 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/a18b6a2c-2301-42d4-a665-67dc9fdd6f4d [2642261 bytes] | |
| 2017-06-23 16:46:59.876 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000018.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/a18b6a2c-2301-42d4-a665-67dc9fdd6f4d [2642261 bytes] | |
| 2017-06-23 16:46:59.876 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000013.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:46:59.876 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000012.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:46:59.876 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle | |
| 2017-06-23 16:46:59.876 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/98cb52a2-39a4-43bb-afb4-12f8fb348728'} | |
| 2017-06-23 16:47:00.122 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/9ee8ece0-3edd-46a2-86bd-1cc18dd2ca4e [8290 bytes] | |
| 2017-06-23 16:47:00.123 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/45594d3f-1591-4384-b30d-4fae6713bc3c'} | |
| 2017-06-23 16:47:00.129 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 7b3e50770840ebe9515d78a19b304e9c of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:00.129 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 7b3e50770840ebe9515d78a19b304e9c of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:00.134 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-25-thread-1,5,Flink Task Threads] took 468 ms. | |
| 2017-06-23 16:47:00.134 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-25-thread-1,5,Flink Task Threads] took 468 ms. | |
| 2017-06-23 16:47:00.188 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-24-thread-1,5,Flink Task Threads] took 535 ms. | |
| 2017-06-23 16:47:00.188 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-24-thread-1,5,Flink Task Threads] took 535 ms. | |
| 2017-06-23 16:47:00.437 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/26c2da94-c100-4bbe-8753-3edf8cdaab75 [8290 bytes] | |
| 2017-06-23 16:47:00.438 [ip-10-150-96-244] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c/chk-4/88a5c30d-b674-4cb9-914f-6874d7417788'} | |
| 2017-06-23 16:47:00.446 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 5fd6d403f7fd08e559f7dc877c94ed1d of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:00.446 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 5fd6d403f7fd08e559f7dc877c94ed1d of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:01.998 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-25-thread-1,5,Flink Task Threads] took 1864 ms. | |
| 2017-06-23 16:47:01.998 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-25-thread-1,5,Flink Task Threads] took 1864 ms. | |
| 2017-06-23 16:47:02.008 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 5d8942f2cc485b821b090147f79eb96a of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:02.008 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task 5d8942f2cc485b821b090147f79eb96a of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:03.978 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-24-thread-1,5,Flink Task Threads] took 3789 ms. | |
| 2017-06-23 16:47:03.978 [ip-10-150-96-244] INFO org.apache.flink.runtime.state.DefaultOperatorStateBackend - DefaultOperatorStateBackend snapshot (File Stream Factory @ s3://mm-prod-stats-pulse-streaming/test/state/eeb654ff4e8c36bf36e5ffb5aff4192c, asynchronous part) in thread Thread[pool-24-thread-1,5,Flink Task Threads] took 3789 ms. | |
| 2017-06-23 16:47:03.989 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task d6f0636c301395fa6a3dbc0071611534 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:03.989 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Received acknowledge message for checkpoint 4 from task d6f0636c301395fa6a3dbc0071611534 of job eeb654ff4e8c36bf36e5ffb5aff4192c. | |
| 2017-06-23 16:47:03.989 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1}} | |
| 2017-06-23 16:47:03.989 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - SharedStateRegistry BEFORE registerAll: {WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5cf17b9a-a6df-4fa4-9d2a-76e9a6434231 [1340819 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/ee8bfa52-185c-44a2-943b-c90b1dafe18b [2115876 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/93a8641c-0bc4-4ba0-8936-4d5fdb08342f [3801769 bytes], referenceCount=1}, WindowOperator_26_1-KeyGroupRange{startKeyGroup=64, endKeyGroup=127}-000012.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-2/035c4d41-c5e8-4582-a88b-7da44c3bd3a7 [3799891 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-1/5d34680e-7742-403e-8c96-9b82e17547fb [1345940 bytes], referenceCount=1}, WindowOperator_26_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000013.sst=SharedStateEntry{stateHandle=File State: s3://mm-prod-stats-pulse-streaming/test/state/41989860902b258a85ab86a901effc19/chk-3/60ec043d-7f9a-4cc3-a9ab-43706366a6f7 [2107921 bytes], referenceCount=1}} | |
| 2017-06-23 16:47:03.990 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_44_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@34913597 | |
| 2017-06-23 16:47:03.990 [ip-10-150-96-68] DEBUG org.apache.flink.runtime.state.SharedStateRegistry - Attempt to register for key WindowOperator_44_0-KeyGroupRange{startKeyGroup=0, endKeyGroup=63}-000011.sst the state handle org.apache.flink.runtime.state.PlaceholderStreamStateHandle@34913597 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment