Created
August 19, 2016 11:33
-
-
Save josqu4red/fc1bc11b2822b5050b7d4850c5e18f71 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2016-08-19T11:00:03Z [INFO] Starting Agent: Amazon ECS Agent - v1.12.0 (895f3c1) | |
2016-08-19T11:00:03Z [INFO] Loading configuration | |
2016-08-19T11:00:03Z [DEBUG] Environment variable empty: ECS_CONTAINER_STOP_TIMEOUT | |
2016-08-19T11:00:03Z [DEBUG] Loaded config: Cluster: stock-ecs-stage, Region: eu-west-1, DataDir: /data, Checkpoint: true, AuthType: , UpdatesEnabled: false, DisableMetrics: false, ReservedMem: 0, TaskCleanupWaitDuration: 10m0s, DockerStopTimeout: 30s | |
2016-08-19T11:00:03Z [INFO] Checkpointing is enabled. Attempting to load state | |
2016-08-19T11:00:03Z [INFO] Loading state! module="statemanager" | |
2016-08-19T11:00:03Z [DEBUG] Loaded state! module="statemanager" state="&{Data:map[TaskEngine:0xc82013a7d0 ContainerInstanceArn:0xc82013a7e0 Cluster:0xc82013a7f0 EC2InstanceID:0xc82013a800 ACSSeqNum:0xc82013a820] Version:4}" | |
2016-08-19T11:00:03Z [INFO] Restored cluster 'stock-ecs-stage' | |
2016-08-19T11:00:03Z [INFO] Detected Docker versions [1.17 1.18 1.19 1.20 1.21 1.22] | |
2016-08-19T11:00:03Z [INFO] Restored from checkpoint file. I am running as 'arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d' in cluster 'stock-ecs-stage' | |
2016-08-19T11:00:03Z [INFO] Registered! module="api client" | |
2016-08-19T11:00:03Z [DEBUG] Updating task module="api client" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Earliest status is RUNNING module="api client" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Updating task module="api client" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Already sent container event; no need to re-send module="TaskEngine" task="arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158" container="contrib_app" event="RUNNING" | |
2016-08-19T11:00:03Z [DEBUG] Already sent task event; no need to re-send module="TaskEngine" task="arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158" event="RUNNING" | |
2016-08-19T11:00:03Z [DEBUG] Waiting for any previous stops to complete module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" seqnum="56" | |
2016-08-19T11:00:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Wait over; ready to move towards status: RUNNING module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:00:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [INFO] Saving state! module="statemanager" | |
2016-08-19T11:00:03Z [DEBUG] Updating task module="api client" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Earliest status is RUNNING module="api client" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Updating task module="api client" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Already sent container event; no need to re-send module="TaskEngine" task="arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166" container="contrib_lb" event="RUNNING" | |
2016-08-19T11:00:03Z [DEBUG] Already sent task event; no need to re-send module="TaskEngine" task="arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166" event="RUNNING" | |
2016-08-19T11:00:03Z [DEBUG] Waiting for any previous stops to complete module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" seqnum="2" | |
2016-08-19T11:00:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Wait over; ready to move towards status: RUNNING module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:00:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:00:03Z [INFO] Beginning Polling for updates | |
2016-08-19T11:00:03Z [INFO] Start listening to deregister-container-instance event from ACS client | |
2016-08-19T11:00:03Z [INFO] Initializing stats engine module="stats" | |
2016-08-19T11:00:03Z [DEBUG] Could not map container to task, ignoring module="stats" err="Could not map docker id to task" id="3228854a7aa988580f05644dfd72404c4afa27ddd9b2947a58582ccece4d3c40" | |
2016-08-19T11:00:03Z [DEBUG] Adding container to stats watch list module="stats" id="8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16" task="arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158" | |
2016-08-19T11:00:03Z [DEBUG] Adding container to stats watch list module="stats" id="c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56" task="arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166" | |
2016-08-19T11:00:03Z [DEBUG] Collecting stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 | |
2016-08-19T11:00:03Z [DEBUG] Collecting stats for container c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56 | |
2016-08-19T11:00:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:00:03Z [DEBUG] Connecting to TCS endpoint https://ecs-t-1.eu-west-1.amazonaws.com/ module="tcs handler" | |
2016-08-19T11:00:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:00:03Z [DEBUG] TCS client starting websocket poll loop | |
2016-08-19T11:00:03Z [WARN] Error getting cpu stats module="stats" err="No data in the queue" container="&{DockerID:8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16}" | |
2016-08-19T11:00:03Z [DEBUG] Empty containerMetrics for task, ignoring module="stats" task="arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158" | |
2016-08-19T11:00:03Z [WARN] Error getting cpu stats module="stats" err="No data in the queue" container="&{DockerID:c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56}" | |
2016-08-19T11:00:03Z [DEBUG] Empty containerMetrics for task, ignoring module="stats" task="arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166" | |
2016-08-19T11:00:03Z [WARN] Error getting instance metrics: No task metrics to report | |
2016-08-19T11:00:03Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:00:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"2f782475-be54-4ce7-8051-ea019722c779"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":3.3227956295013428,"min":0.0030817000661045313,"sampleCount":19,"sum":7.631916080368683},"memoryStatsSet":{"max":221,"min":219,"sampleCount":20,"sum":4406}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03289540112018585,"min":0.0009663000237196684,"sampleCount":19,"sum":0.18008199986070395},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604423}} | |
2016-08-19T11:00:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:00:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:00:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:00:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"0a8a6f98-7bee-49cf-8cc2-c3069d22d5f3"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":3.002143144607544,"min":0,"sampleCount":19,"sum":11.201570766046643},"memoryStatsSet":{"max":220,"min":214,"sampleCount":20,"sum":4366}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.029043199494481087,"min":0.0007578000077046454,"sampleCount":19,"sum":0.1893129997770302},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604443}} | |
2016-08-19T11:00:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:00:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:00:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:01:03Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:01:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f5ccd341-87d4-4ca3-a516-f76ef25e055f"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.1085879802703857,"min":0.003253099974244833,"sampleCount":19,"sum":5.089324370026588},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4302}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.023824799805879593,"min":0.0008445000275969505,"sampleCount":19,"sum":0.1884461990557611},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604463}} | |
2016-08-19T11:01:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:01:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:01:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:01:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:01:03Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:01:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"e697a676-e211-4c67-87a7-332f336dc5e4"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.780436635017395,"min":0,"sampleCount":19,"sum":2.8281591285485774},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4313}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02100520022213459,"min":0.0009658000199124217,"sampleCount":19,"sum":0.1695009012473747},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604483}} | |
2016-08-19T11:01:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:01:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:01:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:01:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"ab89e41f-6855-41ab-8e51-5bfeea117b17"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.61064213514328,"min":0,"sampleCount":19,"sum":2.5328541584312916},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4317}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.023384399712085724,"min":0.0008296999731101096,"sampleCount":19,"sum":0.18509229767369106},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604503}} | |
2016-08-19T11:01:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:01:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:01:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:02:03Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:02:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"518c33de-b19c-469e-85ee-87311b171387"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5901123881340027,"min":0,"sampleCount":19,"sum":2.5163038969039917},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4318}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.01914129965007305,"min":0.000882200023625046,"sampleCount":19,"sum":0.1753536998294294},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604523}} | |
2016-08-19T11:02:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:02:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:02:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:02:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:02:03Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:02:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"6cff9da1-a176-4245-8ecc-9716c62c5f6e"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.7263914942741394,"min":0,"sampleCount":19,"sum":2.5831353049725294},"memoryStatsSet":{"max":217,"min":215,"sampleCount":20,"sum":4319}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.024444300681352615,"min":0.000818900007288903,"sampleCount":19,"sum":0.17509179940680042},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604543}} | |
2016-08-19T11:02:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:02:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:02:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:02:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"00e2c737-6d5e-4df2-80db-15116254e1e3"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.6398035883903503,"min":0,"sampleCount":19,"sum":2.5149135917890817},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4330}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.024442600086331367,"min":0.0010100000072270632,"sampleCount":19,"sum":0.20583250024355948},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604563}} | |
2016-08-19T11:02:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:02:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:02:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:03:03Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:03:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"962e2865-787e-47f5-8690-215d67d78df8"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.03287680074572563,"min":0.0010260000126436353,"sampleCount":19,"sum":0.1961709005990997},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.34281620383262634,"min":0,"sampleCount":19,"sum":2.3195918989367783},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4338}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471604583}} | |
2016-08-19T11:03:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:03:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:03:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:03:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:03:03Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:03:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"17997338-c74f-4682-8481-bbe2dff845d3"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5634366869926453,"min":0,"sampleCount":19,"sum":2.4147188114002347},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4341}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02371850050985813,"min":0.0009382999851368368,"sampleCount":19,"sum":0.19371879805112258},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604603}} | |
2016-08-19T11:03:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:03:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:03:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:03:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"fc3fb900-b516-4cc5-82d7-3ee66d862d9e"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.41960668563842773,"min":0,"sampleCount":19,"sum":2.452851009555161},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4350}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.021947599947452545,"min":0.00102680001873523,"sampleCount":19,"sum":0.19088209909386933},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604623}} | |
2016-08-19T11:03:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:03:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:03:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:04:03Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:04:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"863b10bb-5cce-4c14-baf4-c18cf36a6bb4"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3752247095108032,"min":0,"sampleCount":19,"sum":2.3302996968850493},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4353}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02545039914548397,"min":0,"sampleCount":19,"sum":0.16715470020426437},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604643}} | |
2016-08-19T11:04:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:04:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:04:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:04:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:04:03Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:04:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"8674ea33-1d1f-48fe-933c-fd8a51fbf8ec"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.030818000435829163,"min":0.0009530999814160168,"sampleCount":19,"sum":0.18179039924871176},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.5722845792770386,"min":0,"sampleCount":19,"sum":2.415181577205658},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4364}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471604663}} | |
2016-08-19T11:04:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:04:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:04:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:04:36Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:pull Type:image Actor:{ID:amazon/amazon-ecs-agent:v1.12.0 Attributes:map[name:amazon/amazon-ecs-agent]} Status:pull ID:amazon/amazon-ecs-agent:v1.12.0 From: Time:1471604676 TimeNano:1471604676203608202}" | |
2016-08-19T11:04:36Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:pull Type:image Actor:{ID:amazon/amazon-ecs-agent:v1.12.0 Attributes:map[name:amazon/amazon-ecs-agent]} Status:pull ID:amazon/amazon-ecs-agent:v1.12.0 From: Time:1471604676 TimeNano:1471604676203608202}" | |
2016-08-19T11:04:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"c059a0ac-9e04-4f5e-a3a1-e2831674aca9"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5005735754966736,"min":0,"sampleCount":19,"sum":2.2885121600702405},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4372}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.026688499376177788,"min":0.0006243999814614654,"sampleCount":19,"sum":0.17409799859160557},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604683}} | |
2016-08-19T11:04:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:04:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:04:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:05:03Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:05:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"63d38197-b99a-43b7-9f4b-c426c5c45ba3"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.36480221152305603,"min":0,"sampleCount":19,"sum":2.3035829216241837},"memoryStatsSet":{"max":219,"min":219,"sampleCount":20,"sum":4380}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02537750080227852,"min":0.0008704999927431345,"sampleCount":19,"sum":0.16086040035588667},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604703}} | |
2016-08-19T11:05:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:05:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:05:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:05:04Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:05:04Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:05:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"618cdd30-81cf-4583-bd31-7b0c26bec00b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5246469974517822,"min":0,"sampleCount":19,"sum":2.4377889975439757},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4382}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.022370100021362305,"min":0.0008296999731101096,"sampleCount":19,"sum":0.17615480039967224},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604723}} | |
2016-08-19T11:05:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:05:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:05:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:05:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"5ce3be0d-ac7f-446e-9131-bf3d50ae6ace"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.49653109908103943,"min":0,"sampleCount":19,"sum":2.3392939642071724},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4388}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.029592400416731834,"min":0.0009340000106021762,"sampleCount":19,"sum":0.20333569985814393},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604743}} | |
2016-08-19T11:05:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:05:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:05:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:06:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"64efd92b-7b81-4e25-a1c5-ce4b3b2b42d7"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3661949932575226,"min":0,"sampleCount":19,"sum":2.3347218837589025},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4398}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.019735699519515038,"min":0.0007790999952703714,"sampleCount":19,"sum":0.167971899965778},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604763}} | |
2016-08-19T11:06:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:06:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:06:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:06:04Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:06:06Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:06:06Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:06:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f0b3dbf8-30bb-4cf2-80ec-7346b55f7872"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5928778052330017,"min":0,"sampleCount":19,"sum":2.5306188128888607},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4398}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.022340500727295876,"min":0.0008446999709121883,"sampleCount":19,"sum":0.1646261983551085},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604783}} | |
2016-08-19T11:06:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:06:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:06:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:06:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"1431c021-df6d-48bc-a28e-5018b4183311"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.7440967559814453,"min":0,"sampleCount":19,"sum":6.993593063205481},"memoryStatsSet":{"max":221,"min":218,"sampleCount":20,"sum":4385}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.021949799731373787,"min":0.0006305000279098749,"sampleCount":19,"sum":0.16936439997516572},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604803}} | |
2016-08-19T11:06:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:06:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:06:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:07:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"171b7a6c-3922-44c2-b139-1aeab7c5067a"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.8247714042663574,"min":0,"sampleCount":19,"sum":10.318491479381919},"memoryStatsSet":{"max":219,"min":213,"sampleCount":20,"sum":4328}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03527989983558655,"min":0.0009688999853096902,"sampleCount":19,"sum":0.17715389968361706},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604823}} | |
2016-08-19T11:07:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:07:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:07:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:07:06Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:07:08Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:07:08Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:07:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"25c6a16e-7215-4e89-b40d-3aa784ddd982"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":1.3685557842254639,"min":0,"sampleCount":19,"sum":4.063614398241043},"memoryStatsSet":{"max":216,"min":214,"sampleCount":20,"sum":4300}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.021509399637579918,"min":0.0008409000001847744,"sampleCount":19,"sum":0.17190160072641447},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604843}} | |
2016-08-19T11:07:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:07:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:07:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:07:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"d6f02616-6faf-43f2-bdf4-1abe44f8be44"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.49080461263656616,"min":0,"sampleCount":19,"sum":2.4020525133237243},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4312}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.025439100340008736,"min":0.0009347000159323215,"sampleCount":19,"sum":0.17869899841025472},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604863}} | |
2016-08-19T11:07:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:07:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:07:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:08:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"4074d74c-0819-4cdc-b09e-5e0c6f6f7d82"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.34639981389045715,"min":0,"sampleCount":19,"sum":2.3907197564840317},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4316}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02927990071475506,"min":0.0010279000271111727,"sampleCount":19,"sum":0.17004520213231444},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604883}} | |
2016-08-19T11:08:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:08:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:08:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:08:08Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:08:13Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:08:13Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:08:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"2d08fb39-b834-48fc-b3fe-dc610885b446"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.025989200919866562,"min":0.0011527000460773706,"sampleCount":19,"sum":0.17644840327557176},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.5673607587814331,"min":0,"sampleCount":19,"sum":2.4455634700134397},"memoryStatsSet":{"max":216,"min":216,"sampleCount":20,"sum":4320}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471604903}} | |
2016-08-19T11:08:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:08:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:08:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:08:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"64bf509d-df85-4bf1-b7f1-d1ac04e95036"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.41697660088539124,"min":0,"sampleCount":19,"sum":2.296246807090938},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4329}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02676749974489212,"min":0.0009329000022262335,"sampleCount":19,"sum":0.19306379894260317},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604923}} | |
2016-08-19T11:08:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:08:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:08:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:09:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"02007dc1-f085-424a-b4a4-f7da109c5155"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3209088146686554,"min":0,"sampleCount":19,"sum":2.287069038487971},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4338}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02512810006737709,"min":0.0009442999726161361,"sampleCount":19,"sum":0.1668626992031932},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604943}} | |
2016-08-19T11:09:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:09:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:09:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:09:13Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:09:20Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:09:20Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:09:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"dab607e8-62ba-4dc2-8675-3031e3052098"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5729237794876099,"min":0,"sampleCount":19,"sum":2.440196963958442},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4342}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02205280028283596,"min":0.0009142999770119786,"sampleCount":19,"sum":0.16996629885397851},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604963}} | |
2016-08-19T11:09:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:09:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:09:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:09:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"83e6f281-715c-4e08-9a54-7741661babda"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.4116685092449188,"min":0,"sampleCount":19,"sum":2.3096582451835275},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4352}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.028793100267648697,"min":0.000922699982766062,"sampleCount":19,"sum":0.19537840207340196},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471604983}} | |
2016-08-19T11:09:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:09:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:09:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:10:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Checking task to make sure it's still at steadystate module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:10:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Checking task to make sure it's still at steadystate module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:10:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Got container event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Handling container change module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" change="{container:0xc82015a000 event:{Status:3 DockerContainerMetadata:{DockerId:8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 ExitCode:<nil> PortBindings:[{ContainerPort:8088 HostPort:8081 BindIp:0.0.0.0 Protocol:0}] Error:<nil> Volumes:map[]}}}" | |
2016-08-19T11:10:03Z [INFO] Redundant container state change for task contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]: contrib_app(301063766409.dkr.ecr.eu-west-1.amazonaws.com/stock/contributors_app:35101c16a116) (RUNNING->RUNNING) to RUNNING, but already RUNNING | |
2016-08-19T11:10:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:10:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Got container event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] Handling container change module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" change="{container:0xc82015a160 event:{Status:3 DockerContainerMetadata:{DockerId:c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56 ExitCode:<nil> PortBindings:[{ContainerPort:80 HostPort:8080 BindIp:0.0.0.0 Protocol:0}] Error:<nil> Volumes:map[]}}}" | |
2016-08-19T11:10:03Z [INFO] Redundant container state change for task contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]: contrib_lb(301063766409.dkr.ecr.eu-west-1.amazonaws.com/infra/haproxy_stage:c5771e8af3e2) (RUNNING->RUNNING) to RUNNING, but already RUNNING | |
2016-08-19T11:10:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:10:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:10:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"609394ee-5506-45e9-be72-7903124b1576"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.024411499500274658,"min":0.0008908999734558165,"sampleCount":19,"sum":0.1834305981756188},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.35522279143333435,"min":0,"sampleCount":19,"sum":2.3097464304883033},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4358}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605003}} | |
2016-08-19T11:10:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:10:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:10:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:10:19Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:10:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"3ab863b9-7d2d-41e9-9dc3-f35a9ba5b28e"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5869013667106628,"min":0,"sampleCount":19,"sum":2.434703483013436},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4358}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03173670172691345,"min":0,"sampleCount":19,"sum":0.16769320092862472},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605023}} | |
2016-08-19T11:10:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:10:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:10:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:10:29Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:10:29Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:10:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"1fef62cf-393e-4c9f-94da-a108a1ae22fe"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.6034166812896729,"min":0,"sampleCount":19,"sum":2.4706557895988226},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4367}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.027828600257635117,"min":0.0008736000163480639,"sampleCount":19,"sum":0.18736820173216984},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605043}} | |
2016-08-19T11:10:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:10:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:10:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:11:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"0110a4c1-4f38-498c-a887-2aa12311a9ea"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5729994773864746,"min":0,"sampleCount":19,"sum":2.360217875801027},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4378}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.015911199152469635,"min":0.0007510000141337514,"sampleCount":19,"sum":0.16300709830829874},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605063}} | |
2016-08-19T11:11:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:11:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:11:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:11:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"ee4d91ac-3272-4236-8201-cf13e3f8d17c"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.02827960066497326,"min":0.000895800010766834,"sampleCount":19,"sum":0.16232890193350613},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.5889127254486084,"min":0,"sampleCount":19,"sum":2.526432104408741},"memoryStatsSet":{"max":219,"min":219,"sampleCount":20,"sum":4380}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605083}} | |
2016-08-19T11:11:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:11:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:11:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:11:29Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:11:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f6a7417a-3087-48ca-ab28-427e4e64d9e4"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.49449971318244934,"min":0,"sampleCount":19,"sum":2.3132493356242776},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4393}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.027554800733923912,"min":0.0008064999710768461,"sampleCount":19,"sum":0.16767220065230504},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605103}} | |
2016-08-19T11:11:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:11:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:11:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:11:45Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:11:46Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:12:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"4c9ec929-ffc7-4be1-93c1-c98f99b0af5b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.36894410848617554,"min":0,"sampleCount":19,"sum":2.3307211035862565},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4395}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.027195699512958527,"min":0.0009491000091657043,"sampleCount":19,"sum":0.16955359821440652},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605123}} | |
2016-08-19T11:12:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:12:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:12:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:12:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"b7c8dbfd-94ba-4e72-99cf-f62520abe6d6"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.02582780085504055,"min":0.0008014999912120402,"sampleCount":19,"sum":0.16888350155204535},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.5276057124137878,"min":0,"sampleCount":19,"sum":2.6859675077721477},"memoryStatsSet":{"max":221,"min":220,"sampleCount":20,"sum":4401}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605143}} | |
2016-08-19T11:12:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:12:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:12:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:12:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"6b1e3d6d-38fc-428c-8543-f28044f603fb"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.49690142273902893,"min":0,"sampleCount":19,"sum":2.3003859100863338},"memoryStatsSet":{"max":221,"min":220,"sampleCount":20,"sum":4409}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.024843299761414528,"min":0.0008221999742090702,"sampleCount":19,"sum":0.1545122015522793},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605163}} | |
2016-08-19T11:12:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:12:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:12:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:12:45Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:13:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"73a59f7a-7b8d-41e3-9e4f-beb0d5634a8e"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.5381083488464355,"min":0,"sampleCount":19,"sum":7.0764623349532485},"memoryStatsSet":{"max":221,"min":218,"sampleCount":20,"sum":4410}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03111260011792183,"min":0.0008359000203199685,"sampleCount":19,"sum":0.16616860107751563},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605183}} | |
2016-08-19T11:13:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:13:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:13:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:13:07Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:13:07Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:13:22Z [CRITICAL] ====== STACKTRACE ====== | |
2016-08-19 11:13:22.679717887 +0000 UTC | |
goroutine 35 [running]: | |
github.com/aws/amazon-ecs-agent/agent/sighandlers.StartDebugHandler.func1(0xc820051e00) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/sighandlers/debug_handler.go:33 +0xc4 | |
created by github.com/aws/amazon-ecs-agent/agent/sighandlers.StartDebugHandler | |
/go/src/github.com/aws/amazon-ecs-agent/agent/sighandlers/debug_handler.go:38 +0x13f | |
goroutine 1 [select]: | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.startACSSession(0x7fe01f317580, 0xc82000b9b0, 0x7fe01f1813c0, 0xc82009a870, 0x7fe01f181418, 0xc820445500, 0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/acs_handler.go:309 +0xa2d | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.startSessionOnce(0x7fe01f317580, 0xc82000b9b0, 0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, 0xc820444ec0, 0x7fe01f317638, 0xc82000cf00, 0x7fe01f31bc90, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/acs_handler.go:206 +0x506 | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.startSession(0x7fe01f317580, 0xc82000b9b0, 0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, 0xc820444ec0, 0x7fe01f317638, 0xc82000cf00, 0x7fe01f31bc90, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/acs_handler.go:169 +0xd3 | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.StartSession(0x7fe01f317580, 0xc82000b9b0, 0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, 0xc820444ec0, 0x7fe01f317638, 0xc82000cf00, 0x7fe01f31bc90, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/acs_handler.go:155 +0x205 | |
main._main(0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:264 +0x3de6 | |
main.main() | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:55 +0x18 | |
goroutine 5 [semacquire, 13 minutes]: | |
sync.runtime_Syncsemacquire(0xc820013110) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc820013100) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc820050600, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc820050600) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91 | |
goroutine 6 [semacquire, 13 minutes]: | |
sync.runtime_Syncsemacquire(0xc8200132d0) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc8200132c0) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc820050720, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc820050720) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91 | |
goroutine 7 [semacquire, 13 minutes]: | |
sync.runtime_Syncsemacquire(0xc820013990) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc820013980) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc8200508a0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc8200508a0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91 | |
goroutine 8 [semacquire]: | |
sync.runtime_Syncsemacquire(0xc8200a8090) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc8200a8080) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc820050a20, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc820050a20) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91 | |
goroutine 9 [syscall]: | |
os/signal.signal_recv(0x7fe01f311078) | |
/usr/local/go/src/runtime/sigqueue.go:116 +0x132 | |
os/signal.loop() | |
/usr/local/go/src/os/signal/signal_unix.go:22 +0x18 | |
created by os/signal.init.1 | |
/usr/local/go/src/os/signal/signal_unix.go:28 +0x37 | |
goroutine 86 [runnable]: | |
net.runtime_pollWait(0x7fe01f316ec8, 0x72, 0xc8201ea000) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820046d80, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820046d80, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).Read(0xc820046d20, 0xc8201ea000, 0x1000, 0x1000, 0x0, 0x7fe01f311050, 0xc82000a018) | |
/usr/local/go/src/net/fd_unix.go:250 +0x23a | |
net.(*conn).Read(0xc820110010, 0xc8201ea000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/net.go:172 +0xe4 | |
bufio.(*Reader).fill(0xc8202b9140) | |
/usr/local/go/src/bufio/bufio.go:97 +0x1e9 | |
bufio.(*Reader).ReadSlice(0xc8202b9140, 0xc82034b10a, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/bufio/bufio.go:328 +0x21a | |
net/http/internal.readChunkLine(0xc8202b9140, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/internal/chunked.go:110 +0x53 | |
net/http/internal.(*chunkedReader).beginChunk(0xc820452ea0) | |
/usr/local/go/src/net/http/internal/chunked.go:47 +0x39 | |
net/http/internal.(*chunkedReader).Read(0xc820452ea0, 0xc8202f6001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/internal/chunked.go:77 +0xb7 | |
net/http.(*body).readLocked(0xc8203f16c0, 0xc8202f6001, 0x5ff, 0x5ff, 0x199, 0x0, 0x0) | |
/usr/local/go/src/net/http/transfer.go:651 +0xa1 | |
net/http.(*body).Read(0xc8203f16c0, 0xc8202f6001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/transfer.go:643 +0x110 | |
encoding/json.(*Decoder).refill(0xc8200541a0, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:152 +0x287 | |
encoding/json.(*Decoder).readValue(0xc8200541a0, 0x1, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:128 +0x413 | |
encoding/json.(*Decoder).Decode(0xc8200541a0, 0x8a2640, 0xc820428c80, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:57 +0x159 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).eventHijack.func1(0xc820469f80, 0xc82009fc20, 0xc8201a0240, 0xc8201a02a0, 0xc8201446c0, 0xc82048b080) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/event.go:326 +0x197 | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).eventHijack | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/event.go:347 +0x6be | |
goroutine 340 [chan receive, 3 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask.func2(0xc820106ba0, 0xc820276d20) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:134 +0x36 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:136 +0x6b6 | |
goroutine 34 [select, 13 minutes, locked to thread]: | |
runtime.gopark(0xbc9b50, 0xc820021728, 0xa9c1e0, 0x6, 0x100000000000018, 0x2) | |
/usr/local/go/src/runtime/proc.go:262 +0x163 | |
runtime.selectgoImpl(0xc820021728, 0x0, 0x18) | |
/usr/local/go/src/runtime/select.go:392 +0xa67 | |
runtime.selectgo(0xc820021728) | |
/usr/local/go/src/runtime/select.go:215 +0x12 | |
runtime.ensureSigM.func1() | |
/usr/local/go/src/runtime/signal1_unix.go:279 +0x358 | |
runtime.goexit() | |
/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1 | |
goroutine 97 [select]: | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*eventMonitoringState).monitorEvents(0xc820051560, 0xc82009fc20) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/event.go:209 +0x350 | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*eventMonitoringState).enableEventMonitoring | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/event.go:176 +0x158 | |
goroutine 98 [chan receive, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents.func1(0x7fe01f31f060, 0xc820444700, 0x7fe01f3171f0, 0xc82009fc20, 0xc8201a01e0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:562 +0x4a | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:564 +0x2eb | |
goroutine 99 [chan receive, 9 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents.func2(0xc8201a01e0, 0xc8201420e0, 0xc8201a0300) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:569 +0x62 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:650 +0x342 | |
goroutine 89 [select, 3 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).waitEvent(0xc82046b1d0, 0xc820046e70, 0xc82014fb00) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:309 +0x7c2 | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask(0xc82046b1d0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:137 +0x6d1 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*DockerTaskEngine).startTask | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_task_engine.go:304 +0x1ce | |
goroutine 106 [chan receive, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/sighandlers.StartTerminationHandler(0x7fe01f31f000, 0xc82014e960, 0x7fe01f317638, 0xc82000cf00) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/sighandlers/termination_handler.go:41 +0x1b1 | |
created by main._main | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:225 +0x38c1 | |
goroutine 104 [select, 3 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).waitEvent(0xc820434280, 0xc820276d20, 0xc820106ba0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:309 +0x7c2 | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask(0xc820434280) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:137 +0x6d1 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*DockerTaskEngine).startTask | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_task_engine.go:304 +0x1ce | |
goroutine 105 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*DockerTaskEngine).handleDockerEvents(0xc82000cf00, 0x7fe01f31f060, 0xc820444700) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_task_engine.go:361 +0x15f | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*DockerTaskEngine).Init | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_task_engine.go:135 +0x138 | |
goroutine 320 [chan receive, 3 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask.func2(0xc82014fb00, 0xc820046e70) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:134 +0x36 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:136 +0x6b6 | |
goroutine 107 [IO wait, 13 minutes]: | |
net.runtime_pollWait(0x7fe01f316b08, 0x72, 0x0) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820359c60, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820359c60, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).accept(0xc820359c00, 0x0, 0x7fe01f181208, 0xc8204471a0) | |
/usr/local/go/src/net/fd_unix.go:426 +0x27c | |
net.(*TCPListener).AcceptTCP(0xc820022540, 0x5da3b1, 0x0, 0x0) | |
/usr/local/go/src/net/tcpsock_posix.go:254 +0x4d | |
net/http.tcpKeepAliveListener.Accept(0xc820022540, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/server.go:2427 +0x41 | |
net/http.(*Server).Serve(0xc820428680, 0x7fe01f1811d0, 0xc820022540, 0x0, 0x0) | |
/usr/local/go/src/net/http/server.go:2117 +0x129 | |
net/http.(*Server).ListenAndServe(0xc820428680, 0x0, 0x0) | |
/usr/local/go/src/net/http/server.go:2098 +0x136 | |
github.com/aws/amazon-ecs-agent/agent/handlers.ServeHttp.func1(0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/handlers/v1_handlers.go:218 +0x39 | |
github.com/aws/amazon-ecs-agent/agent/utils.RetryWithBackoff(0x7fe01f315f00, 0xc8203bd260, 0xc8201d3ee8, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/utils/utils.go:112 +0x3c | |
github.com/aws/amazon-ecs-agent/agent/handlers.ServeHttp(0xc82013a770, 0x7fe01f317638, 0xc82000cf00, 0xc8200a7440) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/handlers/v1_handlers.go:223 +0x260 | |
created by main._main | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:228 +0x390d | |
goroutine 108 [IO wait, 13 minutes]: | |
net.runtime_pollWait(0x7fe01f316e08, 0x72, 0x0) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820047e90, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820047e90, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).accept(0xc820047e30, 0x0, 0x7fe01f181208, 0xc820457640) | |
/usr/local/go/src/net/fd_unix.go:426 +0x27c | |
net.(*TCPListener).AcceptTCP(0xc820110070, 0x5da3b1, 0x0, 0x0) | |
/usr/local/go/src/net/tcpsock_posix.go:254 +0x4d | |
net/http.tcpKeepAliveListener.Accept(0xc820110070, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/server.go:2427 +0x41 | |
net/http.(*Server).Serve(0xc820104800, 0x7fe01f1811d0, 0xc820110070, 0x0, 0x0) | |
/usr/local/go/src/net/http/server.go:2117 +0x129 | |
net/http.(*Server).ListenAndServe(0xc820104800, 0x0, 0x0) | |
/usr/local/go/src/net/http/server.go:2098 +0x136 | |
github.com/aws/amazon-ecs-agent/agent/handlers/credentials.ServeHttp.func1(0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/handlers/credentials/handler.go:74 +0x33 | |
github.com/aws/amazon-ecs-agent/agent/utils.RetryWithBackoff(0x7fe01f315f00, 0xc8203fe7e0, 0xc820179e80, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/utils/utils.go:112 +0x3c | |
github.com/aws/amazon-ecs-agent/agent/handlers/credentials.ServeHttp(0x7fe01f317548, 0xc8200e3c40, 0xc82014e540, 0x5a, 0xc8200a7440) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/handlers/credentials/handler.go:79 +0x5f2 | |
created by main._main | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:231 +0x3967 | |
goroutine 109 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/eventhandler.HandleEngineEvents(0x7fe01f317638, 0xc82000cf00, 0x7fe01f31bc90, 0xc8201c2200, 0x7fe01f31f000, 0xc82014e960) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/eventhandler/handler.go:35 +0x33e | |
created by main._main | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:234 +0x39f5 | |
goroutine 110 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/acs/event.(*ACSDeregisterInstanceStream).StartListening.func1(0xc820444ec0, 0x7fe01f317580, 0xc82000b9b0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/event/deregister.go:84 +0x29a | |
created by github.com/aws/amazon-ecs-agent/agent/acs/event.(*ACSDeregisterInstanceStream).StartListening | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/event/deregister.go:92 +0x49 | |
goroutine 111 [IO wait]: | |
net.runtime_pollWait(0x7fe01f3168c8, 0x72, 0xc82051d400) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820276f40, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820276f40, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).Read(0xc820276ee0, 0xc82051d400, 0x400, 0x400, 0x0, 0x7fe01f311050, 0xc82000a018) | |
/usr/local/go/src/net/fd_unix.go:250 +0x23a | |
net.(*conn).Read(0xc8200225a0, 0xc82051d400, 0x400, 0x400, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/net.go:172 +0xe4 | |
crypto/tls.(*block).readFromUntil(0xc8203478c0, 0x7fe01f1750a8, 0xc8200225a0, 0x5, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:460 +0xcc | |
crypto/tls.(*Conn).readRecord(0xc82053e000, 0xbc9c17, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:562 +0x2d1 | |
crypto/tls.(*Conn).Read(0xc82053e000, 0xc820540000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:939 +0x167 | |
bufio.(*Reader).fill(0xc820051b60) | |
/usr/local/go/src/bufio/bufio.go:97 +0x1e9 | |
bufio.(*Reader).Read(0xc820051b60, 0xc82000b468, 0x2, 0x8, 0x8cf5a0, 0x0, 0x0) | |
/usr/local/go/src/bufio/bufio.go:207 +0x260 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).readFull(0xc820136f00, 0xc82000b468, 0x2, 0x8, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:524 +0xa9 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).advanceFrame(0xc820136f00, 0xc82000b450, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:548 +0x15c | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).NextReader(0xc820136f00, 0x1, 0x0, 0x0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:688 +0x76 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).ReadMessage(0xc820136f00, 0xc8203d2c00, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:751 +0x55 | |
github.com/aws/amazon-ecs-agent/agent/wsclient.(*ClientServerImpl).ConsumeMessages(0xc820373578, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/wsclient/client.go:220 +0x6b | |
github.com/aws/amazon-ecs-agent/agent/tcs/client.(*clientServer).Serve(0xc820373550, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/client/client.go:83 +0x238 | |
github.com/aws/amazon-ecs-agent/agent/tcs/handler.startSession(0xc8201da840, 0xbb, 0xc8200e1976, 0x9, 0xc820146b40, 0x0, 0x7fe01f31f2f0, 0xc8203870e0, 0x4a817c800, 0xc820444ec0, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/handler/handler.go:121 +0x6c7 | |
github.com/aws/amazon-ecs-agent/agent/tcs/handler.startTelemetrySession(0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, 0xc820444ec0, 0x7fe01f3174c0, 0xc8201420e0, 0x0, 0x7fe01f31bc90, 0xc8201c2200, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/handler/handler.go:94 +0x3d2 | |
github.com/aws/amazon-ecs-agent/agent/tcs/handler.StartSession(0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, 0xc820444ec0, 0x7fe01f3174c0, 0xc8201420e0, 0x0, 0x7fe01f31bc90, 0xc8201c2200, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/handler/handler.go:76 +0x121 | |
github.com/aws/amazon-ecs-agent/agent/tcs/handler.StartMetricsSession(0xc82014e540, 0x5a, 0xc820146b40, 0xc8200a7440, 0xc820444ec0, 0x7fe01f3174c0, 0xc8201420e0, 0x0, 0x7fe01f31bc90, 0xc8201c2200, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/handler/handler.go:59 +0x600 | |
created by main._main | |
/go/src/github.com/aws/amazon-ecs-agent/agent/agent.go:251 +0x3be1 | |
goroutine 96 [semacquire, 13 minutes]: | |
sync.runtime_Syncsemacquire(0xc820393b50) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc820393b40) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processItem(0xc82014e660, 0xc82014e500) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:50 +0xc7 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.(*asyncLoopLogger).processQueue(0xc82014e660) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:63 +0x2a | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog.newAsyncLoopLogger | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/cihub/seelog/behavior_asynclooplogger.go:40 +0x91 | |
goroutine 113 [chan receive, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents.func1(0x7fe01f31f060, 0xc8204453c0, 0x7fe01f3171f0, 0xc82009fc20, 0xc8201069c0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:562 +0x4a | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:564 +0x2eb | |
goroutine 114 [chan receive, 9 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents.func2(0xc8201069c0, 0xc8201420e0, 0xc820106a20) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:569 +0x62 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).ContainerEvents | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:650 +0x342 | |
goroutine 132 [semacquire]: | |
sync.runtime_Syncsemacquire(0xc8200e8f40) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc8200e8f30) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
io.(*pipe).read(0xc8200e8f00, 0xc82056c001, 0x1dff, 0x1dff, 0x0, 0x0, 0x0) | |
/usr/local/go/src/io/pipe.go:52 +0x2d2 | |
io.(*PipeReader).Read(0xc820110078, 0xc82056c001, 0x1dff, 0x1dff, 0xea9, 0x0, 0x0) | |
/usr/local/go/src/io/pipe.go:134 +0x50 | |
encoding/json.(*Decoder).refill(0xc8204ee000, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:152 +0x287 | |
encoding/json.(*Decoder).readValue(0xc8204ee000, 0x1, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:128 +0x413 | |
encoding/json.(*Decoder).Decode(0xc8204ee000, 0x8a4200, 0xc82030b800, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:57 +0x159 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats(0xc82009fc20, 0xc8202fe000, 0x40, 0xc82014ede0, 0x1, 0xc82014ee40, 0x0, 0x0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:989 +0x59a | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats.func1(0x7fe01f3171f0, 0xc82009fc20, 0xc8202fe000, 0x40, 0xc82014ede0, 0xc82000b901, 0xc82014ee40, 0x0, 0x0, 0xc8202fe000, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:724 +0x93 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:729 +0x20c | |
goroutine 166 [select]: | |
github.com/aws/amazon-ecs-agent/agent/tcs/client.(*clientServer).publishMetrics(0xc820373550) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/client/client.go:143 +0x1f2 | |
created by github.com/aws/amazon-ecs-agent/agent/tcs/client.(*clientServer).Serve | |
/go/src/github.com/aws/amazon-ecs-agent/agent/tcs/client/client.go:81 +0x21e | |
goroutine 129 [chan receive]: | |
github.com/aws/amazon-ecs-agent/agent/stats.(*StatsContainer).collectDockerStats(0xc8202fe300, 0x7fe01f181288, 0xc8203ff5c0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/container.go:89 +0x365 | |
github.com/aws/amazon-ecs-agent/agent/stats.(*StatsContainer).collect(0xc8202fe300, 0x8bb2c97000, 0x8bb2c97000) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/container.go:76 +0x228 | |
created by github.com/aws/amazon-ecs-agent/agent/stats.(*StatsContainer).StartStatsCollection | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/container.go:57 +0x113 | |
goroutine 131 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/stats.(*DockerStatsEngine).handleDockerEvents(0xc8203870e0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/engine.go:228 +0x76e | |
created by github.com/aws/amazon-ecs-agent/agent/stats.(*DockerStatsEngine).listContainersAndStartEventHandler | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/engine.go:135 +0x1e1 | |
goroutine 130 [chan receive]: | |
github.com/aws/amazon-ecs-agent/agent/stats.(*StatsContainer).collectDockerStats(0xc8202fe400, 0x7fe01f181288, 0xc8203ff6b0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/container.go:89 +0x365 | |
github.com/aws/amazon-ecs-agent/agent/stats.(*StatsContainer).collect(0xc8202fe400, 0x8bb2c97000, 0x8bb2c97000) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/container.go:76 +0x228 | |
created by github.com/aws/amazon-ecs-agent/agent/stats.(*StatsContainer).StartStatsCollection | |
/go/src/github.com/aws/amazon-ecs-agent/agent/stats/container.go:57 +0x113 | |
goroutine 133 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats.func2(0x7fe01f181288, 0xc8203ff5c0, 0xc82014ee40, 0xc82014eea0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:732 +0x10e | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:737 +0x255 | |
goroutine 134 [semacquire]: | |
sync.runtime_Syncsemacquire(0xc8200e9000) | |
/usr/local/go/src/runtime/sema.go:241 +0x201 | |
sync.(*Cond).Wait(0xc8200e8ff0) | |
/usr/local/go/src/sync/cond.go:63 +0x9b | |
io.(*pipe).read(0xc8200e8fc0, 0xc82056e001, 0x1dff, 0x1dff, 0x0, 0x0, 0x0) | |
/usr/local/go/src/io/pipe.go:52 +0x2d2 | |
io.(*PipeReader).Read(0xc820110088, 0xc82056e001, 0x1dff, 0x1dff, 0xe77, 0x0, 0x0) | |
/usr/local/go/src/io/pipe.go:134 +0x50 | |
encoding/json.(*Decoder).refill(0xc8204ee1a0, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:152 +0x287 | |
encoding/json.(*Decoder).readValue(0xc8204ee1a0, 0x1, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:128 +0x413 | |
encoding/json.(*Decoder).Decode(0xc8204ee1a0, 0x8a4200, 0xc8202e2c00, 0x0, 0x0) | |
/usr/local/go/src/encoding/json/stream.go:57 +0x159 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats(0xc82009fc20, 0xc8202fe100, 0x40, 0xc82014efc0, 0x1, 0xc82014f020, 0x0, 0x0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:989 +0x59a | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats.func1(0x7fe01f3171f0, 0xc82009fc20, 0xc8202fe100, 0x40, 0xc82014efc0, 0xc82000b901, 0xc82014f020, 0x0, 0x0, 0xc8202fe100, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:724 +0x93 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:729 +0x20c | |
goroutine 135 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats.func2(0x7fe01f181288, 0xc8203ff6b0, 0xc82014f020, 0xc82014f080) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:732 +0x10e | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*dockerGoClient).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/docker_container_engine.go:737 +0x255 | |
goroutine 136 [IO wait]: | |
net.runtime_pollWait(0x7fe01f316c88, 0x72, 0xc8204f0000) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820276370, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820276370, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).Read(0xc820276310, 0xc8204f0000, 0x1000, 0x1000, 0x0, 0x7fe01f311050, 0xc82000a018) | |
/usr/local/go/src/net/fd_unix.go:250 +0x23a | |
net.(*conn).Read(0xc8201100a8, 0xc8204f0000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/net.go:172 +0xe4 | |
bufio.(*Reader).fill(0xc82014f3e0) | |
/usr/local/go/src/bufio/bufio.go:97 +0x1e9 | |
bufio.(*Reader).ReadSlice(0xc82014f3e0, 0xc8204f0e0a, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/bufio/bufio.go:328 +0x21a | |
net/http/internal.readChunkLine(0xc82014f3e0, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/internal/chunked.go:110 +0x53 | |
net/http/internal.(*chunkedReader).beginChunk(0xc8203ffe00) | |
/usr/local/go/src/net/http/internal/chunked.go:47 +0x39 | |
net/http/internal.(*chunkedReader).Read(0xc8203ffe00, 0xc8204f4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/internal/chunked.go:77 +0xb7 | |
net/http.(*body).readLocked(0xc8202feac0, 0xc8204f4000, 0x8000, 0x8000, 0xea9, 0x0, 0x0) | |
/usr/local/go/src/net/http/transfer.go:651 +0xa1 | |
net/http.(*body).Read(0xc8202feac0, 0xc8204f4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/transfer.go:643 +0x110 | |
io.copyBuffer(0x7fe01f1812f0, 0xc820110080, 0x7fe01f180fd0, 0xc8202feac0, 0xc8204f4000, 0x8000, 0x8000, 0x2dc132, 0x0, 0x0) | |
/usr/local/go/src/io/io.go:380 +0x247 | |
io.Copy(0x7fe01f1812f0, 0xc820110080, 0x7fe01f180fd0, 0xc8202feac0, 0xc8202feac0, 0x0, 0x0) | |
/usr/local/go/src/io/io.go:350 +0x64 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.handleStreamResponse(0xc8201457a0, 0xc82046b590, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/client.go:564 +0x192 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).stream(0xc82009fc20, 0xa97ad8, 0x3, 0xc82014f320, 0x5e, 0x10100, 0x0, 0x0, 0x0, 0x7fe01f1812f0, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/client.go:541 +0xb8a | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats.func2(0xc82009fc20, 0xc8202fe000, 0x40, 0xc82014ede0, 0xc82014ee01, 0xc82014ee40, 0x0, 0x0, 0xc820110080, 0xc82014f1a0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:953 +0x262 | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:973 +0x2ff | |
goroutine 137 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats.func3(0xc8202fe000, 0x40, 0xc82014ede0, 0xc82014ed01, 0xc82014ee40, 0x0, 0x0, 0xc820110078, 0xc82014f200) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:979 +0xe4 | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:985 +0x3d4 | |
goroutine 138 [IO wait]: | |
net.runtime_pollWait(0x7fe01f316d48, 0x72, 0xc8204f2000) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc8202765a0, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc8202765a0, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).Read(0xc820276540, 0xc8204f2000, 0x1000, 0x1000, 0x0, 0x7fe01f311050, 0xc82000a018) | |
/usr/local/go/src/net/fd_unix.go:250 +0x23a | |
net.(*conn).Read(0xc8201100b0, 0xc8204f2000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/net.go:172 +0xe4 | |
bufio.(*Reader).fill(0xc82014f500) | |
/usr/local/go/src/bufio/bufio.go:97 +0x1e9 | |
bufio.(*Reader).ReadSlice(0xc82014f500, 0xc8204f2e0a, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/bufio/bufio.go:328 +0x21a | |
net/http/internal.readChunkLine(0xc82014f500, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/internal/chunked.go:110 +0x53 | |
net/http/internal.(*chunkedReader).beginChunk(0xc8203bd380) | |
/usr/local/go/src/net/http/internal/chunked.go:47 +0x39 | |
net/http/internal.(*chunkedReader).Read(0xc8203bd380, 0xc820502000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/internal/chunked.go:77 +0xb7 | |
net/http.(*body).readLocked(0xc82034c440, 0xc820502000, 0x8000, 0x8000, 0xe77, 0x0, 0x0) | |
/usr/local/go/src/net/http/transfer.go:651 +0xa1 | |
net/http.(*body).Read(0xc82034c440, 0xc820502000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/http/transfer.go:643 +0x110 | |
io.copyBuffer(0x7fe01f1812f0, 0xc820110090, 0x7fe01f180fd0, 0xc82034c440, 0xc820502000, 0x8000, 0x8000, 0x2d2524, 0x0, 0x0) | |
/usr/local/go/src/io/io.go:380 +0x247 | |
io.Copy(0x7fe01f1812f0, 0xc820110090, 0x7fe01f180fd0, 0xc82034c440, 0xc82034c440, 0x0, 0x0) | |
/usr/local/go/src/io/io.go:350 +0x64 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.handleStreamResponse(0xc820145950, 0xc82046b5e0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/client.go:564 +0x192 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).stream(0xc82009fc20, 0xa97ad8, 0x3, 0xc82014f440, 0x5e, 0x10100, 0x0, 0x0, 0x0, 0x7fe01f1812f0, ...) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/client.go:541 +0xb8a | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats.func2(0xc82009fc20, 0xc8202fe100, 0x40, 0xc82014efc0, 0xc82014f001, 0xc82014f020, 0x0, 0x0, 0xc820110090, 0xc82014f260) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:953 +0x262 | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:973 +0x2ff | |
goroutine 139 [select, 13 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats.func3(0xc8202fe100, 0x40, 0xc82014efc0, 0xc82014ef01, 0xc82014f020, 0x0, 0x0, 0xc820110088, 0xc82014f2c0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:979 +0xe4 | |
created by github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient.(*Client).Stats | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/fsouza/go-dockerclient/container.go:985 +0x3d4 | |
goroutine 398 [IO wait]: | |
net.runtime_pollWait(0x7fe01f316bc8, 0x72, 0xc820025400) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820047410, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820047410, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).Read(0xc8200473b0, 0xc820025400, 0x400, 0x400, 0x0, 0x7fe01f311050, 0xc82000a018) | |
/usr/local/go/src/net/fd_unix.go:250 +0x23a | |
net.(*conn).Read(0xc820022120, 0xc820025400, 0x400, 0x400, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/net.go:172 +0xe4 | |
crypto/tls.(*block).readFromUntil(0xc820420600, 0x7fe01f1750a8, 0xc820022120, 0x5, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:460 +0xcc | |
crypto/tls.(*Conn).readRecord(0xc82022c000, 0xbc9c17, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:562 +0x2d1 | |
crypto/tls.(*Conn).Read(0xc82022c000, 0xc82051a000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:939 +0x167 | |
bufio.(*Reader).fill(0xc820573ec0) | |
/usr/local/go/src/bufio/bufio.go:97 +0x1e9 | |
bufio.(*Reader).Read(0xc820573ec0, 0xc82043c590, 0x2, 0x8, 0xbc7521, 0x0, 0x0) | |
/usr/local/go/src/bufio/bufio.go:207 +0x260 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).readFull(0xc820136960, 0xc82043c590, 0x2, 0x8, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:524 +0xa9 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).advanceFrame(0xc820136960, 0x7fe01f315e01, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:548 +0x15c | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).NextReader(0xc820136960, 0xc820256e18, 0x0, 0x0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:688 +0x76 | |
github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket.(*Conn).ReadMessage(0xc820136960, 0x7fe01f315e88, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/vendor/github.com/gorilla/websocket/conn.go:751 +0x55 | |
github.com/aws/amazon-ecs-agent/agent/wsclient.(*ClientServerImpl).ConsumeMessages(0xc82009a870, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/wsclient/client.go:220 +0x6b | |
github.com/aws/amazon-ecs-agent/agent/acs/client.(*clientServer).Serve(0xc82009a870, 0x0, 0x0) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/client/acs_client.go:59 +0x144 | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.startACSSession.func3(0xc8202b8cc0, 0x7fe01f1813c0, 0xc82009a870) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/acs_handler.go:305 +0x27 | |
created by github.com/aws/amazon-ecs-agent/agent/acs/handler.startACSSession | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/acs_handler.go:306 +0x863 | |
goroutine 377 [select]: | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.(*refreshCredentialsHandler).handleMessages(0xc820358a80) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/refresh_credentials_handler.go:106 +0x123 | |
created by github.com/aws/amazon-ecs-agent/agent/acs/handler.(*refreshCredentialsHandler).start | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/refresh_credentials_handler.go:72 +0x35 | |
goroutine 378 [select]: | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.(*refreshCredentialsHandler).sendAcks(0xc820358a80) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/refresh_credentials_handler.go:85 +0x124 | |
created by github.com/aws/amazon-ecs-agent/agent/acs/handler.(*refreshCredentialsHandler).start | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/refresh_credentials_handler.go:73 +0x57 | |
goroutine 315 [chan receive, 3 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask.func2(0xc82014ea80, 0xc820046620) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:134 +0x36 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:136 +0x6b6 | |
goroutine 379 [select]: | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.(*payloadRequestHandler).handleMessages(0xc820166000) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/payload_handler.go:119 +0x123 | |
created by github.com/aws/amazon-ecs-agent/agent/acs/handler.(*payloadRequestHandler).start | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/payload_handler.go:81 +0x35 | |
goroutine 335 [chan receive, 3 minutes]: | |
github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask.func2(0xc820106120, 0xc820276690) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:134 +0x36 | |
created by github.com/aws/amazon-ecs-agent/agent/engine.(*managedTask).overseeTask | |
/go/src/github.com/aws/amazon-ecs-agent/agent/engine/task_manager.go:136 +0x6b6 | |
goroutine 396 [IO wait]: | |
net.runtime_pollWait(0x7fe01f316a48, 0x72, 0xc820116800) | |
/usr/local/go/src/runtime/netpoll.go:160 +0x60 | |
net.(*pollDesc).Wait(0xc820046840, 0x72, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a | |
net.(*pollDesc).WaitRead(0xc820046840, 0x0, 0x0) | |
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36 | |
net.(*netFD).Read(0xc8200467e0, 0xc820116800, 0x400, 0x400, 0x0, 0x7fe01f311050, 0xc82000a018) | |
/usr/local/go/src/net/fd_unix.go:250 +0x23a | |
net.(*conn).Read(0xc820022040, 0xc820116800, 0x400, 0x400, 0x0, 0x0, 0x0) | |
/usr/local/go/src/net/net.go:172 +0xe4 | |
crypto/tls.(*block).readFromUntil(0xc820453170, 0x7fe01f1750a8, 0xc820022040, 0x5, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:460 +0xcc | |
crypto/tls.(*Conn).readRecord(0xc8205ab200, 0xbc9c17, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:562 +0x2d1 | |
crypto/tls.(*Conn).Read(0xc8205ab200, 0xc8204f1000, 0x1000, 0x1000, 0x0, 0x0, 0x0) | |
/usr/local/go/src/crypto/tls/conn.go:939 +0x167 | |
net/http.noteEOFReader.Read(0x7fe01f180ee0, 0xc8205ab200, 0xc8200fe208, 0xc8204f1000, 0x1000, 0x1000, 0x40b433, 0x0, 0x0) | |
/usr/local/go/src/net/http/transport.go:1690 +0x67 | |
net/http.(*noteEOFReader).Read(0xc820460e80, 0xc8204f1000, 0x1000, 0x1000, 0xc8201d9d0d, 0x0, 0x0) | |
<autogenerated>:284 +0xd0 | |
bufio.(*Reader).fill(0xc820573c20) | |
/usr/local/go/src/bufio/bufio.go:97 +0x1e9 | |
bufio.(*Reader).Peek(0xc820573c20, 0x1, 0x0, 0x0, 0x0, 0x0, 0x0) | |
/usr/local/go/src/bufio/bufio.go:132 +0xcc | |
net/http.(*persistConn).readLoop(0xc8200fe1a0) | |
/usr/local/go/src/net/http/transport.go:1076 +0x177 | |
created by net/http.(*Transport).dialConn | |
/usr/local/go/src/net/http/transport.go:860 +0x10a6 | |
goroutine 397 [select]: | |
net/http.(*persistConn).writeLoop(0xc8200fe1a0) | |
/usr/local/go/src/net/http/transport.go:1280 +0x472 | |
created by net/http.(*Transport).dialConn | |
/usr/local/go/src/net/http/transport.go:861 +0x10cb | |
goroutine 380 [select]: | |
github.com/aws/amazon-ecs-agent/agent/acs/handler.(*payloadRequestHandler).sendAcks(0xc820166000) | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/payload_handler.go:94 +0x13b | |
created by github.com/aws/amazon-ecs-agent/agent/acs/handler.(*payloadRequestHandler).start | |
/go/src/github.com/aws/amazon-ecs-agent/agent/acs/handler/payload_handler.go:82 +0x57 | |
====== /STACKTRACE ====== | |
2016-08-19T11:13:22Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:kill Type:container Actor:{ID:3228854a7aa988580f05644dfd72404c4afa27ddd9b2947a58582ccece4d3c40 Attributes:map[image:amazon/amazon-ecs-agent:v1.12.0 name:amazon-ecs-agent signal:10]} Status:kill ID:3228854a7aa988580f05644dfd72404c4afa27ddd9b2947a58582ccece4d3c40 From:amazon/amazon-ecs-agent:v1.12.0 Time:1471605202 TimeNano:1471605202678915296}" | |
2016-08-19T11:13:22Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:kill Type:container Actor:{ID:3228854a7aa988580f05644dfd72404c4afa27ddd9b2947a58582ccece4d3c40 Attributes:map[image:amazon/amazon-ecs-agent:v1.12.0 name:amazon-ecs-agent signal:10]} Status:kill ID:3228854a7aa988580f05644dfd72404c4afa27ddd9b2947a58582ccece4d3c40 From:amazon/amazon-ecs-agent:v1.12.0 Time:1471605202 TimeNano:1471605202678915296}" | |
2016-08-19T11:13:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"8b1464a2-c3cc-4054-b8fd-f0e0dd5b6b8b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.4337096214294434,"min":0,"sampleCount":19,"sum":8.035410195589066},"memoryStatsSet":{"max":219,"min":215,"sampleCount":20,"sum":4358}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03116999939084053,"min":0.000874800025485456,"sampleCount":19,"sum":0.1657586001092568},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605203}} | |
2016-08-19T11:13:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:13:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:13:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:13:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"26a3c410-4967-4212-9303-72c819d94370"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.7537684440612793,"min":0,"sampleCount":19,"sum":7.59066351223737},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4304}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.029292600229382515,"min":0.0009679999784566462,"sampleCount":19,"sum":0.17652400070801377},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605223}} | |
2016-08-19T11:13:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:13:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:13:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:14:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"1cc5179e-2cb2-4384-b9db-a9ef81795188"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.04297029972076416,"min":0.0006364000146277249,"sampleCount":19,"sum":0.17874949937686324},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.44168028235435486,"min":0,"sampleCount":19,"sum":2.7708545131608844},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4315}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605243}} | |
2016-08-19T11:14:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:14:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:14:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:14:07Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:14:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"be8bb4c4-7672-4a58-a5b5-b02cea9c944a"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.6178700923919678,"min":0,"sampleCount":19,"sum":2.607107578776777},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4324}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02965790033340454,"min":0.000956700008828193,"sampleCount":19,"sum":0.1803254002588801},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605263}} | |
2016-08-19T11:14:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:14:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:14:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:14:42Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:14:42Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:14:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a6cb55da-b114-4ef9-bb45-f405ee8d0aa1"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.028746699914336205,"min":0.0009998000459745526,"sampleCount":19,"sum":0.19842659961432219},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.4850229024887085,"min":0,"sampleCount":19,"sum":2.3321758722886443},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4332}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605283}} | |
2016-08-19T11:14:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:14:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:14:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:15:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f17e22bd-457c-458c-9e08-df7b46c9c7ca"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3677113950252533,"min":0,"sampleCount":19,"sum":2.314927402883768},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4336}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.030783699825406075,"min":0.0010519999777898192,"sampleCount":19,"sum":0.1693494007922709},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605303}} | |
2016-08-19T11:15:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:15:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:15:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:15:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"387087fb-918c-4ea1-bff1-30dbdf1abbfe"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.02650360018014908,"min":0.0009034000104293227,"sampleCount":19,"sum":0.15717000124277547},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.5731006860733032,"min":0,"sampleCount":19,"sum":2.4617995750159025},"memoryStatsSet":{"max":217,"min":217,"sampleCount":20,"sum":4340}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605323}} | |
2016-08-19T11:15:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:15:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:15:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:15:42Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:15:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f8584cfc-3828-480c-8793-8d89def3142d"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.4854833781719208,"min":0,"sampleCount":19,"sum":2.2221464831382036},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4353}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.025203699246048927,"min":0.001018799957819283,"sampleCount":19,"sum":0.16259430011268705},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605343}} | |
2016-08-19T11:15:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:15:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:15:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:16:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"d8120f41-737a-4caa-a949-4cd3157e87e7"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.2968266010284424,"min":0,"sampleCount":19,"sum":2.2720891730859876},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4356}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.026532499119639397,"min":0.0008783999946899712,"sampleCount":19,"sum":0.1645277997595258},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605363}} | |
2016-08-19T11:16:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:16:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:16:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:16:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"87633943-4192-4722-b182-b176d3fa75f5"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5782185196876526,"min":0,"sampleCount":19,"sum":2.469501939602196},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4362}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.027529200538992882,"min":0.0007562999962829053,"sampleCount":19,"sum":0.1704441022593528},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605383}} | |
2016-08-19T11:16:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:16:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:16:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:16:33Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:16:33Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:16:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"5fbcccee-aad6-4d28-8f16-3f81330563a2"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.4870530068874359,"min":0,"sampleCount":19,"sum":2.3427055049687624},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4372}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.028584899380803108,"min":0.000999000039882958,"sampleCount":19,"sum":0.1819025995209813},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605403}} | |
2016-08-19T11:16:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:16:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:16:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:16:52Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:pull Type:image Actor:{ID:amazon/amazon-ecs-agent:v1.12.0 Attributes:map[name:amazon/amazon-ecs-agent]} Status:pull ID:amazon/amazon-ecs-agent:v1.12.0 From: Time:1471605412 TimeNano:1471605412341061285}" | |
2016-08-19T11:16:52Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:pull Type:image Actor:{ID:amazon/amazon-ecs-agent:v1.12.0 Attributes:map[name:amazon/amazon-ecs-agent]} Status:pull ID:amazon/amazon-ecs-agent:v1.12.0 From: Time:1471605412 TimeNano:1471605412341061285}" | |
2016-08-19T11:17:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"1be77afe-e4a7-437b-9c41-22cea3ca5eaa"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.03450069949030876,"min":0.0008004999835975468,"sampleCount":19,"sum":0.15109939820831642},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.30805280804634094,"min":0,"sampleCount":19,"sum":2.321897636167705},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4378}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605423}} | |
2016-08-19T11:17:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:17:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:17:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:17:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"3cf27eff-d1e6-43a6-80b8-eb4c5869ee39"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5869985222816467,"min":0,"sampleCount":19,"sum":2.4956416999921203},"memoryStatsSet":{"max":220,"min":218,"sampleCount":20,"sum":4380}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03891799971461296,"min":0.0007557999924756587,"sampleCount":19,"sum":0.16830149898305535},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605443}} | |
2016-08-19T11:17:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:17:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:17:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:17:25Z [WARN] Error retrieving stats for container c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56: io: read/write on closed pipe | |
2016-08-19T11:17:25Z [DEBUG] Disconnected from docker stats for container c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56 | |
2016-08-19T11:17:25Z [DEBUG] Collecting stats for container c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56 | |
2016-08-19T11:17:32Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:17:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"59e6b16c-84e7-4c02-8962-76a709abb414"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.415449321269989,"min":0,"sampleCount":19,"sum":2.3631212674081326},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4391}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03081499971449375,"min":0.0008135000243782997,"sampleCount":19,"sum":0.1731009004288353},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605463}} | |
2016-08-19T11:17:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:17:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:17:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:17:51Z [WARN] Error retrieving stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16: io: read/write on closed pipe | |
2016-08-19T11:17:51Z [DEBUG] Disconnected from docker stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 | |
2016-08-19T11:17:51Z [DEBUG] Collecting stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 | |
2016-08-19T11:18:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f3e95873-ae0a-4311-9f20-d8fc6ff1979a"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3793434798717499,"min":0,"sampleCount":19,"sum":2.3153098737820983},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4397}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02962449938058853,"min":0.0008585000177845359,"sampleCount":19,"sum":0.17918339918833226},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605483}} | |
2016-08-19T11:18:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:18:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:18:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:18:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"af04bf0a-c473-4bc3-9163-95e5640966e6"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.598012387752533,"min":0,"sampleCount":19,"sum":2.415205870056525},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4398}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.0272367000579834,"min":0.000895200006198138,"sampleCount":19,"sum":0.16886829730356112},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605503}} | |
2016-08-19T11:18:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:18:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:18:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:18:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"bdd3bfe8-1fff-48b5-bbc9-e404971a1d33"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.6479966044425964,"min":0,"sampleCount":19,"sum":2.388266432331875},"memoryStatsSet":{"max":221,"min":220,"sampleCount":20,"sum":4411}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.029789999127388,"min":0.00047080000513233244,"sampleCount":19,"sum":0.17833419764065184},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605523}} | |
2016-08-19T11:18:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:18:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:18:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:18:46Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:18:46Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:19:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"9ceb5d54-cc6b-42b4-bfb7-44820934bff8"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5712071657180786,"min":0,"sampleCount":19,"sum":2.5972857838496566},"memoryStatsSet":{"max":221,"min":220,"sampleCount":20,"sum":4418}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02530430071055889,"min":0.0008095999946817756,"sampleCount":19,"sum":0.18324399960692972},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605543}} | |
2016-08-19T11:19:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:19:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:19:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:19:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"5bce610c-f079-465d-a18f-6bd12b5460bc"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.421912431716919,"min":0,"sampleCount":19,"sum":7.452242218889296},"memoryStatsSet":{"max":221,"min":219,"sampleCount":20,"sum":4418}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.015723299235105515,"min":0.0008639000006951392,"sampleCount":19,"sum":0.17759039759403095},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605563}} | |
2016-08-19T11:19:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:19:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:19:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:19:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"b6f8bfdd-85ef-4acf-9a59-b7cb11b67b5b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.028087599202990532,"min":0.000896100013051182,"sampleCount":19,"sum":0.19474899937631562},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":2.6747684478759766,"min":0,"sampleCount":19,"sum":8.287817704491317},"memoryStatsSet":{"max":220,"min":214,"sampleCount":20,"sum":4379}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605583}} | |
2016-08-19T11:19:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:19:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:19:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:19:45Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:20:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Checking task to make sure it's still at steadystate module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:20:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Checking task to make sure it's still at steadystate module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:20:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Got container event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Handling container change module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" change="{container:0xc82015a000 event:{Status:3 DockerContainerMetadata:{DockerId:8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 ExitCode:<nil> PortBindings:[{ContainerPort:8088 HostPort:8081 BindIp:0.0.0.0 Protocol:0}] Error:<nil> Volumes:map[]}}}" | |
2016-08-19T11:20:03Z [INFO] Redundant container state change for task contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]: contrib_app(301063766409.dkr.ecr.eu-west-1.amazonaws.com/stock/contributors_app:35101c16a116) (RUNNING->RUNNING) to RUNNING, but already RUNNING | |
2016-08-19T11:20:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:20:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Got container event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] Handling container change module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" change="{container:0xc82015a160 event:{Status:3 DockerContainerMetadata:{DockerId:c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56 ExitCode:<nil> PortBindings:[{ContainerPort:80 HostPort:8080 BindIp:0.0.0.0 Protocol:0}] Error:<nil> Volumes:map[]}}}" | |
2016-08-19T11:20:03Z [INFO] Redundant container state change for task contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]: contrib_lb(301063766409.dkr.ecr.eu-west-1.amazonaws.com/infra/haproxy_stage:c5771e8af3e2) (RUNNING->RUNNING) to RUNNING, but already RUNNING | |
2016-08-19T11:20:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:20:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:20:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"e3948757-86fb-47b9-8d23-edcecdcd64fe"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.3909099102020264,"min":0,"sampleCount":19,"sum":7.81795406085439},"memoryStatsSet":{"max":215,"min":214,"sampleCount":20,"sum":4290}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02589610032737255,"min":0.0007205000147223473,"sampleCount":19,"sum":0.18979430082254112},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605603}} | |
2016-08-19T11:20:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:20:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:20:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:20:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"e2e43488-2791-4324-accf-f6dd6cf39c2f"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.027704600244760513,"min":0.0008581000147387385,"sampleCount":19,"sum":0.18413869966752827},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.7862470746040344,"min":0,"sampleCount":19,"sum":2.7825379965361208},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4307}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605623}} | |
2016-08-19T11:20:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:20:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:20:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:20:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"735d9d0d-5207-4e28-9c33-b8879716495b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.02828270010650158,"min":0.0008613999816589057,"sampleCount":19,"sum":0.18044050014577806},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.4865301251411438,"min":0,"sampleCount":19,"sum":2.4028165275231004},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4314}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605643}} | |
2016-08-19T11:20:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:20:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:20:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:21:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a190d898-597d-4cd9-a89d-7b6b306fa8d0"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3448486030101776,"min":0,"sampleCount":19,"sum":2.3010941799730062},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4318}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.027327600866556168,"min":0.0008996999822556973,"sampleCount":19,"sum":0.16550970257958397},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605663}} | |
2016-08-19T11:21:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:21:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:21:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:21:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"c4638226-71e9-49d8-8d6d-b7498a840048"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5740324854850769,"min":0,"sampleCount":19,"sum":2.4485261775553226},"memoryStatsSet":{"max":216,"min":216,"sampleCount":20,"sum":4320}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.0274702999740839,"min":0.0008800000068731606,"sampleCount":19,"sum":0.15456390008330345},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605683}} | |
2016-08-19T11:21:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:21:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:21:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:21:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"103b8b56-40a3-4236-b415-25064dd4b2a4"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.43336379528045654,"min":0,"sampleCount":19,"sum":2.3537187669426203},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4331}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.027307400479912758,"min":0.0008656000136397779,"sampleCount":19,"sum":0.17744950210908428},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605703}} | |
2016-08-19T11:21:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:21:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:21:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:21:47Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:21:47Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:22:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a62bf150-411a-4694-9deb-a35ea244995f"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.4018765091896057,"min":0,"sampleCount":19,"sum":2.278029221110046},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4335}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02936379984021187,"min":0.0009890999644994736,"sampleCount":19,"sum":0.18181999900843948},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605723}} | |
2016-08-19T11:22:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:22:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:22:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:22:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"21121bb7-809c-4ee3-95d2-9df17c485a09"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5771194100379944,"min":0,"sampleCount":19,"sum":2.3946828292682767},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4338}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02855920046567917,"min":0.0008680999744683504,"sampleCount":19,"sum":0.17224159953184426},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605743}} | |
2016-08-19T11:22:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:22:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:22:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:22:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"6b41bb19-6fcc-4a17-8877-c70d6594c3da"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.510895311832428,"min":0,"sampleCount":19,"sum":2.4029495930299163},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4348}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.028461899608373642,"min":0.001004299963824451,"sampleCount":19,"sum":0.1892664988990873},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605763}} | |
2016-08-19T11:22:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:22:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:22:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:22:47Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:23:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"7d2fdd80-ef11-4c35-a4ae-c044bb6322f5"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.03283210098743439,"min":0.0009597999742254615,"sampleCount":19,"sum":0.18170150223886594},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.35373252630233765,"min":0,"sampleCount":19,"sum":2.3119644140824676},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4357}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605783}} | |
2016-08-19T11:23:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:23:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:23:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:23:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"bd4a1d36-f089-4e7e-9ce7-86362949ca28"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.0210976991802454,"min":0.0005506000015884638,"sampleCount":19,"sum":0.15993740019621328},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.5041778087615967,"min":0,"sampleCount":19,"sum":2.39193451940082},"memoryStatsSet":{"max":219,"min":217,"sampleCount":20,"sum":4361}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605803}} | |
2016-08-19T11:23:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:23:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:23:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:23:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"6f2a3fe7-7461-4825-986f-3ee2737e5baf"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.6482446193695068,"min":0,"sampleCount":19,"sum":2.311269324272871},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4369}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02544509992003441,"min":0.0008580000139772892,"sampleCount":19,"sum":0.1914704997325316},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605823}} | |
2016-08-19T11:23:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:23:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:23:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:24:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"bbfe501a-8614-48af-aeb6-97069b860302"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.37068942189216614,"min":0,"sampleCount":19,"sum":2.5146985575556755},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4375}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.046097300946712494,"min":0.0008874000050127506,"sampleCount":19,"sum":0.17025650048162788},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605843}} | |
2016-08-19T11:24:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:24:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:24:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:24:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"4eb3cd32-b90f-4576-a17f-0503e92c59a2"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5919630527496338,"min":0,"sampleCount":19,"sum":2.62378579354845},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4377}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.0275861993432045,"min":0.0010061999782919884,"sampleCount":19,"sum":0.17052889778278768},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605863}} | |
2016-08-19T11:24:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:24:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:24:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:24:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"3528b81d-492e-4aa0-9068-b9774fe64eea"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5019981861114502,"min":0,"sampleCount":19,"sum":2.4117930764332414},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4392}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03734470158815384,"min":0.000860599975567311,"sampleCount":19,"sum":0.1889812020235695},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605883}} | |
2016-08-19T11:24:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:24:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:24:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:25:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"42a1b24a-0079-4644-ba47-a2333640b44e"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.2941865026950836,"min":0,"sampleCount":19,"sum":2.299278785008937},"memoryStatsSet":{"max":220,"min":219,"sampleCount":20,"sum":4396}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03135500103235245,"min":0.0008496000082232058,"sampleCount":19,"sum":0.18017810204764828},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605903}} | |
2016-08-19T11:25:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:25:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:25:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:25:10Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:25:10Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:25:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"430c785d-3bde-49bf-b5b8-290141d83036"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5920987129211426,"min":0,"sampleCount":19,"sum":2.512830139603466},"memoryStatsSet":{"max":220,"min":220,"sampleCount":20,"sum":4400}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.032146699726581573,"min":0.0009564000065438449,"sampleCount":19,"sum":0.17626720078988},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605923}} | |
2016-08-19T11:25:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:25:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:25:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:25:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"56da52f4-1ce7-491c-a8bb-b22fbac46e1b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.8190295696258545,"min":0,"sampleCount":19,"sum":5.262142811901867},"memoryStatsSet":{"max":221,"min":220,"sampleCount":20,"sum":4410}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.022885799407958984,"min":0.0009749999735504389,"sampleCount":19,"sum":0.1971538997022435},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605943}} | |
2016-08-19T11:25:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:25:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:25:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:26:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"cf052f58-ac13-4fbb-8836-b8f291a00268"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.02218030020594597,"min":0.000979200005531311,"sampleCount":19,"sum":0.17740530043374747},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":2.8012869358062744,"min":0,"sampleCount":19,"sum":7.070675762370229},"memoryStatsSet":{"max":221,"min":218,"sampleCount":20,"sum":4382}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471605963}} | |
2016-08-19T11:26:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:26:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:26:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:26:03Z [DEBUG] Connecting to TCS endpoint https://ecs-t-1.eu-west-1.amazonaws.com/ module="tcs handler" | |
2016-08-19T11:26:03Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:26:03Z [DEBUG] TCS client starting websocket poll loop | |
2016-08-19T11:26:03Z [WARN] Error getting cpu stats module="stats" err="No data in the queue" container="&{DockerID:8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16}" | |
2016-08-19T11:26:03Z [DEBUG] Empty containerMetrics for task, ignoring module="stats" task="arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158" | |
2016-08-19T11:26:03Z [WARN] Error getting cpu stats module="stats" err="No data in the queue" container="&{DockerID:c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56}" | |
2016-08-19T11:26:03Z [DEBUG] Empty containerMetrics for task, ignoring module="stats" task="arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166" | |
2016-08-19T11:26:03Z [WARN] Error getting instance metrics: No task metrics to report | |
2016-08-19T11:26:10Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:26:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"89644cdb-bf81-4301-9bce-c3ced8f5511d"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":2.7654683589935303,"min":0,"sampleCount":19,"sum":9.424098379909992},"memoryStatsSet":{"max":219,"min":214,"sampleCount":20,"sum":4305}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.01729620061814785,"min":0.000988899962976575,"sampleCount":19,"sum":0.16932249953970313},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471605983}} | |
2016-08-19T11:26:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:26:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:26:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:26:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"6934b5da-777e-4a3d-973c-858a61e3a736"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5328124165534973,"min":0,"sampleCount":19,"sum":2.7496136650443077},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4304}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.03293450176715851,"min":0.0007377999718300998,"sampleCount":19,"sum":0.19422550150193274},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606003}} | |
2016-08-19T11:26:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:26:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:26:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:27:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"5123bc94-bd49-47d9-b9f3-93ffb04a3659"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.4328360855579376,"min":0,"sampleCount":19,"sum":2.6265285182744265},"memoryStatsSet":{"max":216,"min":215,"sampleCount":20,"sum":4318}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.032604899257421494,"min":0.0009147999808192253,"sampleCount":19,"sum":0.1858811005949974},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606023}} | |
2016-08-19T11:27:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:27:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:27:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:27:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"50848e34-e0a3-4f96-ac4c-c7923094ac6f"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.03456680104136467,"min":0.0007053000153973699,"sampleCount":19,"sum":0.19227250129915774},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.6243955492973328,"min":0,"sampleCount":19,"sum":2.6649119216017425},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4326}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471606043}} | |
2016-08-19T11:27:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:27:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:27:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:27:39Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:pull Type:image Actor:{ID:amazon/amazon-ecs-agent:v1.12.0 Attributes:map[name:amazon/amazon-ecs-agent]} Status:pull ID:amazon/amazon-ecs-agent:v1.12.0 From: Time:1471606059 TimeNano:1471606059633192420}" | |
2016-08-19T11:27:39Z [DEBUG] Got event from docker daemon module="TaskEngine" event="&{Action:pull Type:image Actor:{ID:amazon/amazon-ecs-agent:v1.12.0 Attributes:map[name:amazon/amazon-ecs-agent]} Status:pull ID:amazon/amazon-ecs-agent:v1.12.0 From: Time:1471606059 TimeNano:1471606059633192420}" | |
2016-08-19T11:27:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"10a75619-f551-4d5c-a9d3-9283b09be3e8"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.4556879997253418,"min":0,"sampleCount":19,"sum":2.4812396774068475},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4339}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.043568599969148636,"min":0.000584100023843348,"sampleCount":19,"sum":0.16770820022793487},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606063}} | |
2016-08-19T11:27:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:27:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:27:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:27:54Z [WARN] Error retrieving stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16: io: read/write on closed pipe | |
2016-08-19T11:27:54Z [DEBUG] Disconnected from docker stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 | |
2016-08-19T11:27:54Z [DEBUG] Collecting stats for container 8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 | |
2016-08-19T11:28:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a4beb701-5183-4970-94c6-3a43775e9eeb"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.37109020352363586,"min":0,"sampleCount":19,"sum":2.3304341454058886},"memoryStatsSet":{"max":217,"min":216,"sampleCount":20,"sum":4339}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.024101700633764267,"min":0.0005478999810293317,"sampleCount":19,"sum":0.15610209968872368},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606083}} | |
2016-08-19T11:28:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:28:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:28:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:28:14Z [INFO] Creating poll dialer, proxy: %sproxy:3128 | |
2016-08-19T11:28:14Z [DEBUG] Starting websocket poll loop module="acs client" | |
2016-08-19T11:28:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a09e0de7-1340-4ff5-a6a9-524c87602a96"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5870899558067322,"min":0,"sampleCount":19,"sum":2.499800547491759},"memoryStatsSet":{"max":217,"min":217,"sampleCount":20,"sum":4340}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.0273033007979393,"min":0.0009129000245593488,"sampleCount":19,"sum":0.18864049954572693},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606103}} | |
2016-08-19T11:28:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:28:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:28:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:28:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a5f9030a-b30c-4537-b9f6-66bcb77a781b"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.025980999693274498,"min":0.0005339999916031957,"sampleCount":19,"sum":0.18536269868491217},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"},{"containerMetrics":[{"cpuStatsSet":{"max":0.49287962913513184,"min":0,"sampleCount":19,"sum":2.3576112193986773},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4351}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"}],"timestamp":1471606123}} | |
2016-08-19T11:28:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:28:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:28:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:29:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"f45616c8-b992-4b1e-b852-dfe927a419b6"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.3890252113342285,"min":0,"sampleCount":19,"sum":2.3822404467500746},"memoryStatsSet":{"max":218,"min":217,"sampleCount":20,"sum":4354}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.022915299981832504,"min":0.000902600004337728,"sampleCount":19,"sum":0.1753398009459488},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606143}} | |
2016-08-19T11:29:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:29:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:29:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:29:14Z [INFO] Error from acs; backing off, err: unexpected EOF | |
2016-08-19T11:29:23Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"a395cd30-bc1b-4146-92a1-abe89bb8627d"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.7269240617752075,"min":0,"sampleCount":19,"sum":2.421318943845108},"memoryStatsSet":{"max":219,"min":217,"sampleCount":20,"sum":4361}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.020037800073623657,"min":0.0009462999878451228,"sampleCount":19,"sum":0.1599970981478691},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606163}} | |
2016-08-19T11:29:23Z [DEBUG] Got a message from websocket | |
2016-08-19T11:29:23Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:29:23Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:29:43Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"4ada15c3-d510-45e7-83d2-8ea4ada80163"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.6567575335502625,"min":0,"sampleCount":19,"sum":2.5555053278803825},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4370}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02391890063881874,"min":0.0008487000013701618,"sampleCount":19,"sum":0.18340510211419314},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606183}} | |
2016-08-19T11:29:43Z [DEBUG] Got a message from websocket | |
2016-08-19T11:29:43Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:29:43Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" | |
2016-08-19T11:30:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Checking task to make sure it's still at steadystate module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:30:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Got container event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Handling container change module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" change="{container:0xc82015a000 event:{Status:3 DockerContainerMetadata:{DockerId:8f03711565f7464fda7bbf53ee423a269f465b1999b634450da2176b5f7f8d16 ExitCode:<nil> PortBindings:[{ContainerPort:8088 HostPort:8081 BindIp:0.0.0.0 Protocol:0}] Error:<nil> Volumes:map[]}}}" | |
2016-08-19T11:30:03Z [INFO] Redundant container state change for task contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]: contrib_app(301063766409.dkr.ecr.eu-west-1.amazonaws.com/stock/contributors_app:35101c16a116) (RUNNING->RUNNING) to RUNNING, but already RUNNING | |
2016-08-19T11:30:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:30:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_app:239 arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158, Status: (RUNNING->RUNNING) Containers: [contrib_app (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] No longer waiting module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Checking task to make sure it's still at steadystate module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:30:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Got container event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] Handling container change module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" change="{container:0xc82015a160 event:{Status:3 DockerContainerMetadata:{DockerId:c1828b85920bfe0ac29b9072a633ae6e77befac4c5a392445f91ef3693c13f56 ExitCode:<nil> PortBindings:[{ContainerPort:80 HostPort:8080 BindIp:0.0.0.0 Protocol:0}] Error:<nil> Volumes:map[]}}}" | |
2016-08-19T11:30:03Z [INFO] Redundant container state change for task contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]: contrib_lb(301063766409.dkr.ecr.eu-west-1.amazonaws.com/infra/haproxy_stage:c5771e8af3e2) (RUNNING->RUNNING) to RUNNING, but already RUNNING | |
2016-08-19T11:30:03Z [DEBUG] Task at steady state module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" state="RUNNING" | |
2016-08-19T11:30:03Z [DEBUG] Waiting for event for task module="TaskEngine" task="contributors_lb:12 arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166, Status: (RUNNING->RUNNING) Containers: [contrib_lb (RUNNING->RUNNING),]" | |
2016-08-19T11:30:03Z [DEBUG] TCS client sending payload: {"type":"PublishMetricsRequest","message":{"metadata":{"cluster":"stock-ecs-stage","containerInstance":"arn:aws:ecs:eu-west-1:308356494921:container-instance/52e7ce90-b5b7-4da1-8a04-a6914888085d","fin":true,"idle":false,"messageId":"fbe08401-9417-42e4-a730-6f1a71cd2b57"},"taskMetrics":[{"containerMetrics":[{"cpuStatsSet":{"max":0.5575516223907471,"min":0,"sampleCount":19,"sum":2.519161003874615},"memoryStatsSet":{"max":219,"min":218,"sampleCount":20,"sum":4377}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/c14399a0-03ef-4de4-9b6d-9a8e41bb5158","taskDefinitionFamily":"contributors_app","taskDefinitionVersion":"239"},{"containerMetrics":[{"cpuStatsSet":{"max":0.02397949993610382,"min":0.0008304999792017043,"sampleCount":19,"sum":0.1756185016129166},"memoryStatsSet":{"max":5,"min":5,"sampleCount":20,"sum":100}}],"taskArn":"arn:aws:ecs:eu-west-1:308356494921:task/baf2c420-3831-4b18-992d-9356171d0166","taskDefinitionFamily":"contributors_lb","taskDefinitionVersion":"12"}],"timestamp":1471606203}} | |
2016-08-19T11:30:03Z [DEBUG] Got a message from websocket | |
2016-08-19T11:30:03Z [DEBUG] Received message of type: AckPublishMetric | |
2016-08-19T11:30:03Z [DEBUG] Received AckPublishMetric from tcs module="tcs handler" |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment