Skip to content

Instantly share code, notes, and snippets.

@stenio123

stenio123/Consul server log

Last active December 29, 2016 04:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save stenio123/f0196e0305cbb50d4fb01be0903a7270 to your computer and use it in GitHub Desktop.
Save stenio123/f0196e0305cbb50d4fb01be0903a7270 to your computer and use it in GitHub Desktop.
Download ZIP
This is the Consul log at DEBUG level on the server.
Raw
Consul server log
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: raft: Initial configuration (index=0): []
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: raft: Node at 10.228.32.92:8300 [Follower] entering Follower state (Leader: "")
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: serf: EventMemberJoin: consul-i-0ada6114c8d15aca7-stenio 10.228.32.92
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: serf: EventMemberJoin: consul-i-0ada6114c8d15aca7-stenio.dc1 10.228.32.92
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: consul: Adding LAN server consul-i-0ada6114c8d15aca7-stenio (Addr: tcp/10.228.32.92:8300) (DC: dc1)
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: consul: Adding WAN server consul-i-0ada6114c8d15aca7-stenio.dc1 (Addr: tcp/10.228.32.92:8300) (DC: dc1)
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: agent: Joining cluster...
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: agent: No EC2 region provided, querying instance metadata endpoint...
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: agent: Discovered 6 servers from EC2...
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: agent: (LAN) joining: [10.228.35.76 10.228.32.92 10.228.5.245 10.228.0.93 10.228.0.59 10.228.34.182]
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Initiating push/pull sync with: 10.228.35.76:8301
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: serf: EventMemberJoin: consul-i-0e1020f342518cbb2-stenio 10.228.34.182
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: serf: EventMemberJoin: consul-i-0bbb54e0330052c39-stenio 10.228.35.76
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: serf: EventMemberJoin: mongo-i-061dcfd9ea976915b-stenio 10.228.0.93
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: serf: EventMemberJoin: mongo-i-0231ba03ba56647a6-stenio 10.228.5.245
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: consul: Adding LAN server consul-i-0e1020f342518cbb2-stenio (Addr: tcp/10.228.34.182:8300) (DC: dc1)
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Initiating push/pull sync with: 10.228.32.92:8301
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: TCP connection from=10.228.32.92:39484
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Initiating push/pull sync with: 10.228.32.92:8301
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: TCP connection from=10.228.32.92:39484
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Initiating push/pull sync with: 10.228.5.245:8301
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Initiating push/pull sync with: 10.228.0.93:8301
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: consul: Existing Raft peers reported by consul-i-0bbb54e0330052c39-stenio, disabling bootstrap mode
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: consul: Adding LAN server consul-i-0bbb54e0330052c39-stenio (Addr: tcp/10.228.35.76:8300) (DC: dc1)
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Failed to join 10.228.0.59: dial tcp 10.228.0.59:8301: getsockopt: connection refused
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: memberlist: Initiating push/pull sync with: 10.228.34.182:8301
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: agent: (LAN) joined: 5 Err: <nil>
Dec 29 04:50:52 ip-10-228-32-92 consul[10098]: agent: Join completed. Synced with 5 initial agents
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: agent.rpc: Accepted client: 127.0.0.1:34010
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: http: Shutting down http server (0.0.0.0:8500)
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: agent: requesting shutdown
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: consul: shutting down server
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: serf: Shutdown without a Leave
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: dns: error starting tcp server: accept tcp [::]:8600: use of closed network connection
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: agent: failed to sync remote state: No cluster leader
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: serf: Shutdown without a Leave
Dec 29 04:50:53 ip-10-228-32-92 consul[10098]: agent: shutdown complete
Dec 29 04:50:53 ip-10-228-32-92 init: consul main process (10098) terminated with status 1
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: raft: Initial configuration (index=0): []
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: consul-i-0ada6114c8d15aca7-stenio 10.228.32.92
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: consul-i-0ada6114c8d15aca7-stenio.dc1 10.228.32.92
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: raft: Node at 10.228.32.92:8300 [Follower] entering Follower state (Leader: "")
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: Attempting re-join to previously known node: consul-i-0e1020f342518cbb2-stenio: 10.228.34.182:8301
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: consul: Adding LAN server consul-i-0ada6114c8d15aca7-stenio (Addr: tcp/10.228.32.92:8300) (DC: dc1)
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: Failed to re-join any previously known node
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: consul: Adding WAN server consul-i-0ada6114c8d15aca7-stenio.dc1 (Addr: tcp/10.228.32.92:8300) (DC: dc1)
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: agent: Joining cluster...
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.34.182:8301
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: agent: No EC2 region provided, querying instance metadata endpoint...
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.34.182:8301
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: agent: No EC2 region provided, querying instance metadata endpoint...
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: mongo-i-061dcfd9ea976915b-stenio 10.228.0.93
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: memberlist: Refuting an alive message
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: mongo-i-0231ba03ba56647a6-stenio 10.228.5.245
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: consul-i-0bbb54e0330052c39-stenio 10.228.35.76
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: consul-i-0e1020f342518cbb2-stenio 10.228.34.182
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: Re-joined to previously known node: consul-i-0e1020f342518cbb2-stenio: 10.228.34.182:8301
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: consul: Adding LAN server consul-i-0bbb54e0330052c39-stenio (Addr: tcp/10.228.35.76:8300) (DC: dc1)
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: consul: Existing Raft peers reported by consul-i-0bbb54e0330052c39-stenio, disabling bootstrap mode
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: consul: Adding LAN server consul-i-0e1020f342518cbb2-stenio (Addr: tcp/10.228.34.182:8300) (DC: dc1)
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: raft-net: 10.228.32.92:8300 accepted connection from: 10.228.35.76:60448
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: raft-net: 10.228.32.92:8300 accepted connection from: 10.228.35.76:60452
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: raft: Failed to get previous log: 1 log not found (last: 0)
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: serf: messageUserEventType: consul:new-leader
Dec 29 04:50:53 ip-10-228-32-92 consul[10136]: consul: New leader elected: consul-i-0bbb54e0330052c39-stenio
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageUserEventType: consul:new-leader
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: agent: Discovered 6 servers from EC2...
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: agent: (LAN) joining: [10.228.35.76 10.228.32.92 10.228.5.245 10.228.0.93 10.228.0.59 10.228.34.182]
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.35.76:8301
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.32.92:8301
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: TCP connection from=10.228.32.92:39522
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.5.245:8301
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageUserEventType: consul:new-leader
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.0.93:8301
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: Failed to join 10.228.0.59: dial tcp 10.228.0.59:8301: getsockopt: connection refused
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.34.182:8301
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: agent: (LAN) joined: 5 Err: <nil>
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: agent: Join completed. Synced with 5 initial agents
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageUserEventType: consul:new-leader
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: agent: Synced service 'consul'
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: agent: Node info in sync
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:50:54 ip-10-228-32-92 consul[10136]: serf: messageJoinType: consul-i-0ada6114c8d15aca7-stenio
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config/checks/blacklist/services/mongo?dc=dc1&token=%22%22 (455.986µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config/checks/blacklist/checks/service:mongo?dc=dc1&token=%22%22 (479.973µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config/checks/blacklist/single/mongo-i-061dcfd9ea976915b-stenio/mongo/service:mongo?dc=dc1&token=%22%22 (446.502µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/checks/mongo-i-061dcfd9ea976915b-stenio/mongo/service:mongo?dc=dc1&token=%22%22 (479.856µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request PUT /v1/kv/consul-alerts/checks/mongo-i-061dcfd9ea976915b-stenio/mongo/service:mongo?dc=dc1&token=%22%22 (3.674198ms) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/checks/mongo-i-0889ee9c7bb38e8a1-stenio/_/serfHealth?dc=dc1&token=%22%22 (547.496µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config/checks/blacklist/nodes/mongo-i-0889ee9c7bb38e8a1-stenio?dc=dc1&token=%22%22 (466.454µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config/checks/blacklist/checks/serfHealth?dc=dc1&token=%22%22 (447.586µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config/checks/blacklist/single/mongo-i-0889ee9c7bb38e8a1-stenio/_/serfHealth?dc=dc1&token=%22%22 (478.112µs) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: http: Request PUT /v1/kv/consul-alerts/checks/mongo-i-0889ee9c7bb38e8a1-stenio/_/serfHealth?dc=dc1&token=%22%22 (5.80279ms) from=[::1]:42716
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: serf: messageJoinType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: serf: messageJoinType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: serf: messageJoinType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:51:58 ip-10-228-32-92 consul[10136]: serf: messageJoinType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:51:59 ip-10-228-32-92 consul[10136]: http: Request GET /v1/health/state/any?dc=dc1&index=37 (908.102591ms) from=[::1]:42708
Dec 29 04:51:59 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config?dc=dc1&recurse=&token=%22%22 (578.316µs) from=[::1]:42716
Dec 29 04:52:03 ip-10-228-32-92 consul[10136]: http: Request PUT /v1/session/renew/841a26b7-b6e6-957a-8b32-2826bb749036?dc=dc1&token=%22%22 (751.81µs) from=[::1]:42716
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: serf: messageLeaveType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.35.76:8301
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: serf: messageLeaveType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: serf: messageLeaveType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: serf: EventMemberLeave: mongo-i-0889ee9c7bb38e8a1-stenio 10.228.0.59
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: http: Request GET /v1/health/state/any?dc=dc1&index=48 (6.499805564s) from=[::1]:42708
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: http: Request GET /v1/kv/consul-alerts/config?dc=dc1&recurse=&token=%22%22 (542.967µs) from=[::1]:42716
Dec 29 04:52:05 ip-10-228-32-92 consul[10136]: serf: messageLeaveType: mongo-i-0889ee9c7bb38e8a1-stenio
Dec 29 04:52:06 ip-10-228-32-92 consul[10136]: memberlist: TCP connection from=10.228.0.59:46600
Dec 29 04:52:06 ip-10-228-32-92 consul[10136]: serf: EventMemberJoin: mongo-i-0889ee9c7bb38e8a1-stenio 10.228.0.59
Dec 29 04:56:48 ip-10-228-32-92 consul[10136]: http: Request PUT /v1/session/renew/841a26b7-b6e6-957a-8b32-2826bb749036?dc=dc1&token=%22%22 (713.982µs) from=[::1]:42716
Dec 29 04:56:56 ip-10-228-32-92 consul[10136]: http: Request PUT /v1/session/renew/841a26b7-b6e6-957a-8b32-2826bb749036?dc=dc1&token=%22%22 (667.069µs) from=[::1]:42716
Dec 29 04:57:03 ip-10-228-32-92 consul[10136]: http: Request PUT /v1/session/renew/841a26b7-b6e6-957a-8b32-2826bb749036?dc=dc1&token=%22%22 (761.493µs) from=[::1]:42716
Dec 29 04:57:05 ip-10-228-32-92 consul[10136]: memberlist: Initiating push/pull sync with: 10.228.35.76:8301
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment