Navigation Menu

Skip to content

Instantly share code, notes, and snippets.

@StephenWeber
Last active June 8, 2018 01:00
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save StephenWeber/c241f14df8798336b530e53b6f3fdedc to your computer and use it in GitHub Desktop.
Save StephenWeber/c241f14df8798336b530e53b6f3fdedc to your computer and use it in GitHub Desktop.
Investigating the Alarmist timeouts / false positives
time="2018-06-08T00:46:28Z"
level=debug
msg="alerter-main: Alert details"
AlerterMessageOptions=map[
DisplayMessage:
http: Check failed with exit 2 for prod-clm-10-vip-status-check-auto-generated-prod-lag-10.nr-ops.net (host: prod-lag-10.nr-ops.net)! Error: HTTP request failed: Get http://prod-lag-10.nr-ops.net:80/status/check: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)! Details:
StatusCode:0 AttemptCount:82423 ExitCode:2 AlertKey:edge-clm-10
Service:prod-clm-10-vip-status-check-auto-generated-prod-lag-10.nr-ops.net StatusMessage:
HTTP request failed:
Get http://prod-lag-10.nr-ops.net:80/status/check:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)
]
[Failure] eu-prod-kafka-cluster-monitor-vip-status-check-isr-rf-1-auto-generated-kafka-cluster-monitor.eu.c2.nr-ops.net
http: Check failed with exit 2 for
eu-prod-kafka-cluster-monitor-vip-status-check-isr-rf-1-auto-generated-kafka-cluster-monitor.eu.c2.nr-ops.net
(host: kafka-cluster-monitor.eu.c2.nr-ops.net)!
Error: HTTP request failed:
Get https://kafka-cluster-monitor.eu.c2.nr-ops.net:443/status/check/isr/rf/1:
net/http: request canceled while waiting for connection
(Client.Timeout exceeded while awaiting headers)!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment