Skip to content

Instantly share code, notes, and snippets.

@adrahon

adrahon/ipvs on ubuntu 14.04

Created September 15, 2016 16:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save adrahon/2feffc793bace46303993fe123455c64 to your computer and use it in GitHub Desktop.
Save adrahon/2feffc793bace46303993fe123455c64 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
ipvs on ubuntu 14.04
Linux ubuntu 3.19.0-25-generic #26~14.04.1-Ubuntu SMP
Server Version: 1.12.1-cs1-rc2
3 nodes running as VM on Fedora 23 4.6.6-200.fc23.x86_64 #1 SMP with KVM
docker service create --name nginx --replicas 4 -p 80 nginx:mainline-alpine
node 1: 1 replica
node 2: 1 replica
node 3: 2 replicas
node1:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
FWM 257 rr
-> 10.255.0.7:0 Masq 1 0 0
node2:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
FWM 257 rr
-> 10.255.0.8:0 Masq 1 0 0
node3:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
FWM 257 rr
-> 10.255.0.9:0 Masq 1 0 0
-> 10.255.0.10:0 Masq 1 0 0
node1:
Sep 15 18:11:29 ubuntu kernel: [ 1498.838522] aufs au_opts_verify:1612:dockerd[3418]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1498.967276] aufs au_opts_verify:1612:dockerd[3418]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1499.178999] aufs au_opts_verify:1612:dockerd[3418]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1499.352605] veth4: renamed from vetheecce45
Sep 15 18:11:29 ubuntu kernel: [ 1499.352751] device veth4 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1499.352818] IPv6: ADDRCONF(NETDEV_UP): veth4: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1499.420652] device vetha900aa6 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1499.420692] IPv6: ADDRCONF(NETDEV_UP): vetha900aa6: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1499.420695] docker_gwbridge: port 2(vetha900aa6) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1499.420697] docker_gwbridge: port 2(vetha900aa6) entered forwarding state
Sep 15 18:11:30 ubuntu kernel: [ 1499.758579] IPVS: Creating netns size=2056 id=5
Sep 15 18:11:30 ubuntu kernel: [ 1499.816394] eth0: renamed from veth01ffc7c
Sep 15 18:11:30 ubuntu kernel: [ 1499.817579] IPv6: ADDRCONF(NETDEV_CHANGE): veth4: link becomes ready
Sep 15 18:11:30 ubuntu kernel: [ 1499.817594] br0: port 3(veth4) entered forwarding state
Sep 15 18:11:30 ubuntu kernel: [ 1499.817598] br0: port 3(veth4) entered forwarding state
Sep 15 18:11:30 ubuntu kernel: [ 1499.870235] eth1: renamed from veth202305a
Sep 15 18:11:30 ubuntu kernel: [ 1499.876144] IPv6: ADDRCONF(NETDEV_CHANGE): vetha900aa6: link becomes ready
node2:
Sep 15 18:11:29 ubuntu kernel: [ 1496.786679] aufs au_opts_verify:1612:dockerd[3332]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1496.856475] aufs au_opts_verify:1612:dockerd[3332]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1497.016815] aufs au_opts_verify:1612:dockerd[3332]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1497.171510] veth5: renamed from vethe4c5308
Sep 15 18:11:29 ubuntu kernel: [ 1497.171656] device veth5 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1497.171711] IPv6: ADDRCONF(NETDEV_UP): veth5: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1497.235396] device veth3d8c1b4 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1497.235422] IPv6: ADDRCONF(NETDEV_UP): veth3d8c1b4: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1497.235425] docker_gwbridge: port 2(veth3d8c1b4) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1497.235426] docker_gwbridge: port 2(veth3d8c1b4) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1497.495128] IPVS: Creating netns size=2056 id=6
Sep 15 18:11:29 ubuntu kernel: [ 1497.561128] eth0: renamed from veth86e29b3
Sep 15 18:11:29 ubuntu kernel: [ 1497.562506] IPv6: ADDRCONF(NETDEV_CHANGE): veth5: link becomes ready
Sep 15 18:11:29 ubuntu kernel: [ 1497.562521] br0: port 3(veth5) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1497.562524] br0: port 3(veth5) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1497.622163] eth1: renamed from veth52a12a4
Sep 15 18:11:29 ubuntu kernel: [ 1497.622319] IPv6: ADDRCONF(NETDEV_CHANGE): veth3d8c1b4: link becomes ready
Sep 15 18:11:44 ubuntu kernel: [ 1512.288119] docker_gwbridge: port 2(veth3d8c1b4) entered forwarding state
Sep 15 18:11:44 ubuntu kernel: [ 1512.608066] br0: port 3(veth5) entered forwarding state
node3:
Sep 15 18:11:29 ubuntu kernel: [ 1430.289796] aufs au_opts_verify:1612:dockerd[2866]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1430.350818] aufs au_opts_verify:1612:dockerd[2862]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1430.460963] aufs au_opts_verify:1612:dockerd[2866]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1430.577431] aufs au_opts_verify:1612:dockerd[2862]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1430.840940] aufs au_opts_verify:1612:dockerd[2866]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1431.039016] aufs au_opts_verify:1612:dockerd[2862]: dirperm1 breaks the protection by the permission bits on the lower branch
Sep 15 18:11:29 ubuntu kernel: [ 1431.062060] veth4: renamed from veth169f8b5
Sep 15 18:11:29 ubuntu kernel: [ 1431.062194] device veth4 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1431.062259] IPv6: ADDRCONF(NETDEV_UP): veth4: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1431.157807] device vetha525c23 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1431.157834] IPv6: ADDRCONF(NETDEV_UP): vetha525c23: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1431.157837] docker_gwbridge: port 2(vetha525c23) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1431.157839] docker_gwbridge: port 2(vetha525c23) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1431.228527] veth5: renamed from vethbdf4b22
Sep 15 18:11:29 ubuntu kernel: [ 1431.228614] device veth5 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1431.228672] IPv6: ADDRCONF(NETDEV_UP): veth5: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1431.228674] br0: port 4(veth5) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1431.228676] br0: port 4(veth5) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1431.235541] device veth5b2e529 entered promiscuous mode
Sep 15 18:11:29 ubuntu kernel: [ 1431.235572] IPv6: ADDRCONF(NETDEV_UP): veth5b2e529: link is not ready
Sep 15 18:11:29 ubuntu kernel: [ 1431.235574] docker_gwbridge: port 3(veth5b2e529) entered forwarding state
Sep 15 18:11:29 ubuntu kernel: [ 1431.235576] docker_gwbridge: port 3(veth5b2e529) entered forwarding state
Sep 15 18:11:30 ubuntu kernel: [ 1431.604563] IPVS: Creating netns size=2056 id=5
Sep 15 18:11:30 ubuntu kernel: [ 1431.639239] IPVS: Creating netns size=2056 id=6
Sep 15 18:11:30 ubuntu kernel: [ 1431.692282] eth0: renamed from vethcb3507e
Sep 15 18:11:30 ubuntu kernel: [ 1431.693502] IPv6: ADDRCONF(NETDEV_CHANGE): veth4: link becomes ready
Sep 15 18:11:30 ubuntu kernel: [ 1431.693514] br0: port 3(veth4) entered forwarding state
Sep 15 18:11:30 ubuntu kernel: [ 1431.693517] br0: port 3(veth4) entered forwarding state
Sep 15 18:11:30 ubuntu kernel: [ 1431.720361] eth0: renamed from veth42019b0
Sep 15 18:11:30 ubuntu kernel: [ 1431.721377] IPv6: ADDRCONF(NETDEV_CHANGE): veth5: link becomes ready
Sep 15 18:11:30 ubuntu kernel: [ 1431.728903] eth1: renamed from veth8b772dd
Sep 15 18:11:30 ubuntu kernel: [ 1431.730571] IPv6: ADDRCONF(NETDEV_CHANGE): vetha525c23: link becomes ready
Sep 15 18:11:30 ubuntu kernel: [ 1431.744330] eth1: renamed from veth8341b76
Sep 15 18:11:30 ubuntu kernel: [ 1431.744782] IPv6: ADDRCONF(NETDEV_CHANGE): veth5b2e529: link becomes ready
Sep 15 18:11:44 ubuntu kernel: [ 1446.176139] docker_gwbridge: port 2(vetha525c23) entered forwarding state
Sep 15 18:11:44 ubuntu kernel: [ 1446.240035] br0: port 4(veth5) entered forwarding state
Sep 15 18:11:44 ubuntu kernel: [ 1446.240051] docker_gwbridge: port 3(veth5b2e529) entered forwarding state
Sep 15 18:11:45 ubuntu kernel: [ 1446.720054] br0: port 3(veth4) entered forwarding state
----
docker service scale nginx=2
node 1: 1 replica
node 2: 0 replica
node 3: 1 replica
node1:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
FWM 257 rr
-> 10.255.0.7:0 Masq 1 0 0
node2:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
node3:
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
-> RemoteAddress:Port Forward Weight ActiveConn InActConn
FWM 257 rr
-> 10.255.0.9:0 Masq 1 0 0
node1:
[no new log msg]
node2:
Sep 15 18:16:01 ubuntu kernel: [ 1768.977865] br0: port 3(veth5) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1768.977898] veth86e29b3: renamed from eth0
Sep 15 18:16:01 ubuntu kernel: [ 1768.995409] IPVS: __ip_vs_del_service: enter
Sep 15 18:16:01 ubuntu kernel: [ 1769.027601] veth52a12a4: renamed from eth1
Sep 15 18:16:01 ubuntu kernel: [ 1769.097939] docker_gwbridge: port 2(veth3d8c1b4) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1769.100882] device veth3d8c1b4 left promiscuous mode
Sep 15 18:16:01 ubuntu kernel: [ 1769.100885] docker_gwbridge: port 2(veth3d8c1b4) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1769.154965] br0: port 3(veth5) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1769.155601] device veth5 left promiscuous mode
Sep 15 18:16:01 ubuntu kernel: [ 1769.155604] br0: port 3(veth5) entered disabled state
node3:
Sep 15 18:16:01 ubuntu kernel: [ 1702.387451] vethcb3507e: renamed from eth0
Sep 15 18:16:01 ubuntu kernel: [ 1702.395684] br0: port 3(veth4) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1702.397137] veth8b772dd: renamed from eth1
Sep 15 18:16:01 ubuntu kernel: [ 1702.454736] docker_gwbridge: port 2(vetha525c23) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1702.455583] device vetha525c23 left promiscuous mode
Sep 15 18:16:01 ubuntu kernel: [ 1702.455586] docker_gwbridge: port 2(vetha525c23) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1702.507084] br0: port 3(veth4) entered disabled state
Sep 15 18:16:01 ubuntu kernel: [ 1702.507885] device veth4 left promiscuous mode
Sep 15 18:16:01 ubuntu kernel: [ 1702.507898] br0: port 3(veth4) entered disabled state
@adrahon
Copy link
Author

adrahon commented Sep 15, 2016 •
edited

Node3

Waiting for /var/run/docker.sock
time="2016-09-15T17:50:47.978956335+02:00" level=info msg="libcontainerd: new containerd process, pid: 2855" 
time="2016-09-15T17:50:48.358004620+02:00" level=info msg="Graph migration to content-addressability took 0.00 seconds" 
time="2016-09-15T17:50:48.358316755+02:00" level=warning msg="Your kernel does not support swap memory limit." 
time="2016-09-15T17:50:48.358497713+02:00" level=warning msg="mountpoint for pids not found" 
time="2016-09-15T17:50:48.358759901+02:00" level=info msg="Loading containers: start." 
time="2016-09-15T17:50:48.409132594+02:00" level=info msg="Firewalld running: false" 
time="2016-09-15T17:50:48.771208791+02:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" 

time="2016-09-15T17:50:49.060804181+02:00" level=info msg="Loading containers: done." 
time="2016-09-15T17:50:49.060984773+02:00" level=info msg="Daemon has completed initialization" 
time="2016-09-15T17:50:49.061055024+02:00" level=info msg="Docker daemon" commit=0125703 graphdriver=aufs version=1.12.1-cs1-rc2 
time="2016-09-15T17:50:49.079884040+02:00" level=info msg="API listen on /var/run/docker.sock" 
time="2016-09-15T17:51:41.309720987+02:00" level=info msg="Waiting for TLS certificate to be issued..." 
time="2016-09-15T17:51:41.429195130+02:00" level=info msg="Downloaded new TLS credentials with role: swarm-manager." 
time="2016-09-15T17:51:41.488231627+02:00" level=info msg="Listening for connections" addr="[::]:2377" proto=tcp 
time="2016-09-15T17:51:41.488412094+02:00" level=info msg="Listening for local connections" addr="/var/lib/docker/swarm/control.sock" proto=unix 
time="2016-09-15T17:51:41.629062390+02:00" level=info msg="206dea5fabe5b525 became follower at term 0" 
time="2016-09-15T17:51:41.629237044+02:00" level=info msg="newRaft 206dea5fabe5b525 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]" 
time="2016-09-15T17:51:41.629317775+02:00" level=info msg="206dea5fabe5b525 became follower at term 1" 
time="2016-09-15T17:51:41.706114382+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.73 Adv-addr=192.168.100.73 Remote-addr =192.168.100.71" 
time="2016-09-15T17:51:41.721973458+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.73 Adv-addr=192.168.100.73 Remote-addr =192.168.100.71" 
time="2016-09-15T17:51:41.724939693+02:00" level=warning msg="2016/09/15 17:51:41 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.73:7946 Theirs: 192.168.100.71:7946\n" 
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T17:51:42.181426821+02:00" level=info msg="206dea5fabe5b525 [term: 1] received a MsgHeartbeat message with higher term from 248e2ffda4e491a [term: 2]" 
time="2016-09-15T17:51:42.181540050+02:00" level=info msg="206dea5fabe5b525 became follower at term 2" 
time="2016-09-15T17:51:42.181568656+02:00" level=info msg="raft.node: 206dea5fabe5b525 elected leader 248e2ffda4e491a at term 2" 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T17:59:15.942281112+02:00" level=error msg="Handler for POST /v1.24/containers/create returned error: No such image: jpetazzo/nsenter:latest" 
time="2016-09-15T18:10:48.367479469+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=a7k4okm1zhgz349wb6cxbzi7l 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:16:00.056957987+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=7smes30ev3oyreh5bvo1x1hcp 
time="2016-09-15T18:25:07.506457142+02:00" level=error msg="agent: session failed" error="rpc error: code = 13 desc = transport is closing" module=agent 
time="2016-09-15T18:25:07.523833190+02:00" level=error msg="agent: session failed" error="rpc error: code = 13 desc = transport is closing" module=agent 
time="2016-09-15T18:25:10.487678333+02:00" level=info msg="206dea5fabe5b525 is starting a new election at term 2" 
time="2016-09-15T18:25:10.487823285+02:00" level=info msg="206dea5fabe5b525 became candidate at term 3" 
time="2016-09-15T18:25:10.487886232+02:00" level=info msg="206dea5fabe5b525 received vote from 206dea5fabe5b525 at term 3" 
time="2016-09-15T18:25:10.487943346+02:00" level=info msg="206dea5fabe5b525 [logterm: 2, index: 59] sent vote request to 248e2ffda4e491a at term 3" 
time="2016-09-15T18:25:10.488001401+02:00" level=info msg="206dea5fabe5b525 [logterm: 2, index: 59] sent vote request to 1d174fa03b7d1b3c at term 3" 
time="2016-09-15T18:25:10.488085624+02:00" level=info msg="raft.node: 206dea5fabe5b525 lost leader 248e2ffda4e491a at term 3" 
time="2016-09-15T18:25:10.538194936+02:00" level=info msg="206dea5fabe5b525 received vote from 248e2ffda4e491a at term 3" 
time="2016-09-15T18:25:10.538404815+02:00" level=info msg="206dea5fabe5b525 [quorum:2] has received 2 votes and 0 vote rejections" 
time="2016-09-15T18:25:10.538517504+02:00" level=info msg="206dea5fabe5b525 became leader at term 3" 
time="2016-09-15T18:25:10.538587859+02:00" level=info msg="raft.node: 206dea5fabe5b525 elected leader 206dea5fabe5b525 at term 3" 
time="2016-09-15T18:25:11.030951973+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=465rswagcvyhosvu5fcnjk4nb

@adrahon
Copy link
Author

adrahon commented Sep 15, 2016

Node1
[restarted in debug mode at 2016-09-15T18:25:07.873182113+02:00]

Waiting for /var/run/docker.sock
time="2016-09-15T17:50:34.833574440+02:00" level=info msg="libcontainerd: new containerd process, pid: 2854" 
/var/run/docker.sock is up
time="2016-09-15T17:50:35.113883353+02:00" level=info msg="Graph migration to content-addressability took 0.00 seconds" 
time="2016-09-15T17:50:35.114293803+02:00" level=warning msg="Your kernel does not support swap memory limit." 
time="2016-09-15T17:50:35.114495551+02:00" level=warning msg="mountpoint for pids not found" 
time="2016-09-15T17:50:35.114790405+02:00" level=info msg="Loading containers: start." 
time="2016-09-15T17:50:35.183361796+02:00" level=info msg="Firewalld running: false" 
time="2016-09-15T17:50:35.492751800+02:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" 

time="2016-09-15T17:50:35.683194962+02:00" level=info msg="Loading containers: done." 
time="2016-09-15T17:50:35.683460131+02:00" level=info msg="Daemon has completed initialization" 
time="2016-09-15T17:50:35.683609495+02:00" level=info msg="Docker daemon" commit=0125703 graphdriver=aufs version=1.12.1-cs1-rc2 
time="2016-09-15T17:50:35.702186796+02:00" level=info msg="API listen on /var/run/docker.sock" 
time="2016-09-15T17:51:25.988752790+02:00" level=info msg="Listening for connections" addr="[::]:2377" proto=tcp 
time="2016-09-15T17:51:25.988958155+02:00" level=info msg="Listening for local connections" addr="/var/lib/docker/swarm/control.sock" proto=unix 
time="2016-09-15T17:51:26.005880745+02:00" level=info msg="248e2ffda4e491a became follower at term 0" 
time="2016-09-15T17:51:26.006300083+02:00" level=info msg="newRaft 248e2ffda4e491a [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]" 
time="2016-09-15T17:51:26.006343349+02:00" level=info msg="248e2ffda4e491a became follower at term 1" 
time="2016-09-15T17:51:26.006560357+02:00" level=info msg="248e2ffda4e491a is starting a new election at term 1" 
time="2016-09-15T17:51:26.006694786+02:00" level=info msg="248e2ffda4e491a became candidate at term 2" 
time="2016-09-15T17:51:26.006750258+02:00" level=info msg="248e2ffda4e491a received vote from 248e2ffda4e491a at term 2" 
time="2016-09-15T17:51:26.006811937+02:00" level=info msg="248e2ffda4e491a became leader at term 2" 
time="2016-09-15T17:51:26.006885191+02:00" level=info msg="raft.node: 248e2ffda4e491a elected leader 248e2ffda4e491a at term 2" 
time="2016-09-15T17:51:26.069159553+02:00" level=error msg="agent: session failed" error="rpc error: code = 10 desc = dispatcher is stopped" module=agent 
time="2016-09-15T17:51:26.254601618+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.71 Adv-addr=192.168.100.71 Remote-addr =" 
time="2016-09-15T17:51:26.269767316+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.71 Adv-addr=192.168.100.71 Remote-addr =" 
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T17:51:40.043872055+02:00" level=warning msg="2016/09/15 17:51:40 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.71:7946 Theirs: 192.168.100.72:7946\n" 
time="2016-09-15T17:51:41.532256471+02:00" level=warning msg="2016/09/15 17:51:41 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.71:7946 Theirs: 192.168.100.73:7946\n" 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T17:59:12.615891738+02:00" level=error msg="Handler for POST /v1.24/containers/create returned error: No such image: jpetazzo/nsenter:latest" 
time="2016-09-15T18:10:48.433162098+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=5dbt3h1qryz8f8qpndcq5n7uz 
time="2016-09-15T18:10:48.464009097+02:00" level=warning msg="cannot find target task in store" method="(*Dispatcher).UpdateTaskStatus" node.id=e53hio85xy1wb6ro36gwbbx1u node.session=1g5jjk3j7wv2otvqxhkz5wbbb task.id=a7k4okm1zhgz349wb6cxbzi7l 
time="2016-09-15T18:10:48.473668422+02:00" level=warning msg="cannot find target task in store" method="(*Dispatcher).UpdateTaskStatus" node.id=8b2ivp4nv0wp59vq7iy8oszry node.session=1wynqu5lwdpam5swjynjarqfx task.id=9oo0g0c1nbqey2u5rgp2fowoa 
time="2016-09-15T18:10:48.476330883+02:00" level=warning msg="cannot find target task in store" method="(*Dispatcher).UpdateTaskStatus" node.id=4fa0qa46gaisyelxa3n3l7zim node.session=a2l1so4ybol4cw65o05b53z5s task.id=5dbt3h1qryz8f8qpndcq5n7uz 
time="2016-09-15T18:10:48.482698194+02:00" level=error msg="task unavailable" method="(*Dispatcher).processTaskUpdates" module=dispatcher task.id=a7k4okm1zhgz349wb6cxbzi7l 
time="2016-09-15T18:10:48.482803941+02:00" level=error msg="task unavailable" method="(*Dispatcher).processTaskUpdates" module=dispatcher task.id=9oo0g0c1nbqey2u5rgp2fowoa 
time="2016-09-15T18:10:48.482874526+02:00" level=error msg="task unavailable" method="(*Dispatcher).processTaskUpdates" module=dispatcher task.id=5dbt3h1qryz8f8qpndcq5n7uz 
time="2016-09-15T18:10:48.504628423+02:00" level=warning msg="cannot find target task in store" method="(*Dispatcher).UpdateTaskStatus" node.id=8b2ivp4nv0wp59vq7iy8oszry node.session=1wynqu5lwdpam5swjynjarqfx task.id=a20z0fiwfuwb9lxeyd180a4e9 
time="2016-09-15T18:10:48.583104710+02:00" level=error msg="task unavailable" method="(*Dispatcher).processTaskUpdates" module=dispatcher task.id=a20z0fiwfuwb9lxeyd180a4e9 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:25:07.569504596+02:00" level=info msg="Processing signal 'terminated'" 
time="2016-09-15T18:25:07.570072772+02:00" level=info msg="Stopping manager" 
time="2016-09-15T18:25:07.570459433+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.71 Adv-addr=192.168.100.71 Remote-addr =192.168.100.72" 
time="2016-09-15T18:25:07.570864790+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:07.571263654+02:00" level=error msg="failed to remove node" error="rpc error: code = 10 desc = dispatcher is stopped" method="(*Dispatcher).Session" node.id=e53hio85xy1wb6ro36gwbbx1u node.session=1g5jjk3j7wv2otvqxhkz5wbbb 
time="2016-09-15T18:25:07.571538785+02:00" level=error msg="failed to remove node" error="rpc error: code = 10 desc = dispatcher is stopped" method="(*Dispatcher).Session" node.id=4fa0qa46gaisyelxa3n3l7zim node.session=a2l1so4ybol4cw65o05b53z5s 
time="2016-09-15T18:25:07.571752517+02:00" level=error msg="failed to remove node" error="rpc error: code = 10 desc = dispatcher is stopped" method="(*Dispatcher).Session" node.id=8b2ivp4nv0wp59vq7iy8oszry node.session=1wynqu5lwdpam5swjynjarqfx 
time="2016-09-15T18:25:07.573814585+02:00" level=warning msg="2016/09/15 18:25:07 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.71:7946 Theirs: 192.168.100.72:7946\n" 
time="2016-09-15T18:25:07.588283079+02:00" level=info msg="Manager shut down" 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[2073] stopping containerd after receiving terminated 
Waiting for /var/run/docker.sock
time="2016-09-15T18:25:07.873182113+02:00" level=debug msg="docker group found. gid: 999" 
time="2016-09-15T18:25:07.873312130+02:00" level=debug msg="Listener created for HTTP on unix (/var/run/docker.sock)" 
time="2016-09-15T18:25:07.877972602+02:00" level=info msg="libcontainerd: new containerd process, pid: 4004" 
�[37mDEBU�[0m[0000] containerd: read past events                  �[37mcount�[0m=6
�[37mDEBU�[0m[0000] containerd: supervisor running                �[37mcpus�[0m=1 �[37mmemory�[0m=3952 �[37mruntime�[0m=docker-runc �[37mruntimeArgs�[0m=[] �[37mstateDir�[0m=/var/run/docker/libcontainerd/containerd
�[37mDEBU�[0m[0000] containerd: grpc api on /var/run/docker/libcontainerd/docker-containerd.sock 
time="2016-09-15T18:25:07.886300748+02:00" level=debug msg="libcontainerd: containerd connection state change: READY" 
time="2016-09-15T18:25:07.886767248+02:00" level=debug msg="Using default logging driver json-file" 
time="2016-09-15T18:25:07.886920448+02:00" level=debug msg="Golang's threads limit set to 28260" 
time="2016-09-15T18:25:07.933723362+02:00" level=info msg="[graphdriver] using prior storage driver \"aufs\"" 
time="2016-09-15T18:25:07.933825041+02:00" level=debug msg="Using graph driver aufs" 
time="2016-09-15T18:25:07.934775441+02:00" level=debug msg="Max Concurrent Downloads: 3" 
time="2016-09-15T18:25:07.934833504+02:00" level=debug msg="Max Concurrent Uploads: 5" 
time="2016-09-15T18:25:07.953803374+02:00" level=info msg="Graph migration to content-addressability took 0.00 seconds" 
time="2016-09-15T18:25:07.954086796+02:00" level=warning msg="Your kernel does not support swap memory limit." 
time="2016-09-15T18:25:07.954253680+02:00" level=warning msg="mountpoint for pids not found" 
time="2016-09-15T18:25:07.955477170+02:00" level=debug msg="Loaded container 57cfcfa5da891b3d5677dac5e459696309c44466e84d6b0ab027a5ceca076e67" 
time="2016-09-15T18:25:07.955967799+02:00" level=debug msg="Option DefaultDriver: bridge" 
time="2016-09-15T18:25:07.956036592+02:00" level=debug msg="Option DefaultNetwork: bridge" 
time="2016-09-15T18:25:07.959921116+02:00" level=info msg="Firewalld running: false" 
time="2016-09-15T18:25:07.961003437+02:00" level=debug msg="/sbin/iptables, [--wait --version]" 
time="2016-09-15T18:25:07.961870933+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:07.962752253+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL ! --dst 127.0.0.0/8 -j DOCKER]" 
time="2016-09-15T18:25:07.963620411+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D OUTPUT -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:07.964549012+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D PREROUTING]" 
/var/run/docker.sock is up
time="2016-09-15T18:25:07.968649379+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D OUTPUT]" 
time="2016-09-15T18:25:07.969623484+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -F DOCKER]" 
time="2016-09-15T18:25:07.970449964+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -X DOCKER]" 
time="2016-09-15T18:25:07.971305321+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -F DOCKER]" 
time="2016-09-15T18:25:07.972142865+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -X DOCKER]" 
time="2016-09-15T18:25:07.972916011+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -F DOCKER-ISOLATION]" 
time="2016-09-15T18:25:07.973655152+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -X DOCKER-ISOLATION]" 
time="2016-09-15T18:25:07.974427385+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -n -L DOCKER]" 
time="2016-09-15T18:25:07.975179199+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -N DOCKER]" 
time="2016-09-15T18:25:07.975982537+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -n -L DOCKER]" 
time="2016-09-15T18:25:07.976769746+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -n -L DOCKER-ISOLATION]" 
time="2016-09-15T18:25:07.977600612+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -j RETURN]" 
time="2016-09-15T18:25:07.978551365+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-ISOLATION -j RETURN]" 
time="2016-09-15T18:25:07.983337357+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.18.0.0/16 ! -o docker_gwbridge -j MASQUERADE]" 
time="2016-09-15T18:25:07.984279194+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C DOCKER -i docker_gwbridge -j RETURN]" 
time="2016-09-15T18:25:07.985118797+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -I DOCKER -i docker_gwbridge -j RETURN]" 
time="2016-09-15T18:25:07.986154325+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -i docker_gwbridge -o docker_gwbridge -j ACCEPT]" 
time="2016-09-15T18:25:07.988590166+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker_gwbridge -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:07.990158872+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker_gwbridge ! -o docker_gwbridge -j ACCEPT]" 
time="2016-09-15T18:25:07.990992044+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker_gwbridge -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT]" 
time="2016-09-15T18:25:07.991922644+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:07.992840121+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -A PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:07.993713044+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8]" 
time="2016-09-15T18:25:07.994692639+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -A OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8]" 
time="2016-09-15T18:25:07.997496302+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker_gwbridge -j DOCKER]" 
time="2016-09-15T18:25:08.000177749+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker_gwbridge -j DOCKER]" 
time="2016-09-15T18:25:08.001176764+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.002146303+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.004093810+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.006076922+02:00" level=debug msg="Network (314f339) restored" 
time="2016-09-15T18:25:08.006274736+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE]" 
time="2016-09-15T18:25:08.007122774+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C DOCKER -i docker0 -j RETURN]" 
time="2016-09-15T18:25:08.008053650+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -I DOCKER -i docker0 -j RETURN]" 
time="2016-09-15T18:25:08.008901788+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -i docker0 -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.009739153+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.010580735+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker0 ! -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.011447109+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT]" 
time="2016-09-15T18:25:08.012381017+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:08.013241849+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:08.014133704+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8]" 
time="2016-09-15T18:25:08.014996120+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8]" 
time="2016-09-15T18:25:08.015993759+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.016878595+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.017669443+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.018464105+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.019279246+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.020164359+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -i docker0 -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:08.021020685+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-ISOLATION -i docker0 -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:08.021816265+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -i docker_gwbridge -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.022626345+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-ISOLATION -i docker_gwbridge -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.023478968+02:00" level=debug msg="Network (697e2da) restored" 
time="2016-09-15T18:25:08.024548112+02:00" level=debug msg="Endpoint (429948d) restored to network (314f339)" 
time="2016-09-15T18:25:08.024751798+02:00" level=debug msg="Network (8ntztu1) not found for restored endpoint (b9855bd)" 
time="2016-09-15T18:25:08.024804008+02:00" level=debug msg="Deleting stale overlay endpoint (b9855bd) from store" 
time="2016-09-15T18:25:08.051090908+02:00" level=debug msg="Allocating IPv4 pools for network bridge (697e2da0d46d1abfbc22ff32e1506beb97865940b9995540337e22ff3f602e5a)" 
time="2016-09-15T18:25:08.051199941+02:00" level=debug msg="RequestPool(LocalDefault, 172.17.0.0/16, , map[], false)" 
time="2016-09-15T18:25:08.051258214+02:00" level=debug msg="RequestAddress(LocalDefault/172.17.0.0/16, 172.17.0.1, map[RequestAddressType:com.docker.network.gateway])" 
time="2016-09-15T18:25:08.051366996+02:00" level=debug msg="Allocating IPv4 pools for network docker_gwbridge (314f3391316f59f66fb07dff018ad09a3edd9643fc385acaa50b0032161687ee)" 
time="2016-09-15T18:25:08.051413810+02:00" level=debug msg="RequestPool(LocalDefault, 172.18.0.0/16, , map[], false)" 
time="2016-09-15T18:25:08.051460167+02:00" level=debug msg="RequestAddress(LocalDefault/172.18.0.0/16, 172.18.0.1, map[RequestAddressType:com.docker.network.gateway])" 
time="2016-09-15T18:25:08.051642010+02:00" level=debug msg="Assigning addresses for endpoint gateway_ingress-sbox's interface on network docker_gwbridge" 
time="2016-09-15T18:25:08.051711887+02:00" level=debug msg="RequestAddress(LocalDefault/172.18.0.0/16, 172.18.0.2, map[])" 
time="2016-09-15T18:25:08.331169921+02:00" level=info msg="Removing stale sandbox e30596d3bca6c00101476028b9dea1c7e8776e343442dde9dba8e120be41cbff (ingress-sbox)" 
time="2016-09-15T18:25:08.331327332+02:00" level=debug msg="Revoking external connectivity on endpoint gateway_ingress-sbox (429948d7ce273ef4c7e8a36271f0c0b6a9c6354cb4aaecee0cece56742deb63b)" 
time="2016-09-15T18:25:08.399584941+02:00" level=debug msg="Releasing addresses for endpoint gateway_ingress-sbox's interface on network docker_gwbridge" 
time="2016-09-15T18:25:08.399733627+02:00" level=debug msg="ReleaseAddress(LocalDefault/172.18.0.0/16, 172.18.0.2)" 
time="2016-09-15T18:25:08.440087811+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE]" 
time="2016-09-15T18:25:08.441563329+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE]" 
time="2016-09-15T18:25:08.442406818+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C DOCKER -i docker0 -j RETURN]" 
time="2016-09-15T18:25:08.443121395+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -D DOCKER -i docker0 -j RETURN]" 
time="2016-09-15T18:25:08.443872228+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.444662140+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -i docker0 -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.445394934+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker0 ! -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.446098089+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -i docker0 ! -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.446820269+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT]" 
time="2016-09-15T18:25:08.447603160+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT]" 
time="2016-09-15T18:25:08.448446003+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.449196522+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.450456782+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.451275537+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -i docker0 -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:08.452123820+02:00" level=debug msg="/sbin/iptables, [--wait -D DOCKER-ISOLATION -i docker0 -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:08.452880775+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -i docker_gwbridge -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.453613047+02:00" level=debug msg="/sbin/iptables, [--wait -D DOCKER-ISOLATION -i docker_gwbridge -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.465596298+02:00" level=debug msg="releasing IPv4 pools from network bridge (697e2da0d46d1abfbc22ff32e1506beb97865940b9995540337e22ff3f602e5a)" 
time="2016-09-15T18:25:08.465702529+02:00" level=debug msg="ReleaseAddress(LocalDefault/172.17.0.0/16, 172.17.0.1)" 
time="2016-09-15T18:25:08.465777857+02:00" level=debug msg="ReleasePool(LocalDefault/172.17.0.0/16)" 
time="2016-09-15T18:25:08.516283643+02:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" 
time="2016-09-15T18:25:08.516410137+02:00" level=debug msg="Allocating IPv4 pools for network bridge (6ea13765e13fecec800a3dc6a845dcdbab3d0685639acd58e43236b84f405be4)" 
time="2016-09-15T18:25:08.516467621+02:00" level=debug msg="RequestPool(LocalDefault, 172.17.0.0/16, , map[], false)" 
time="2016-09-15T18:25:08.516535505+02:00" level=debug msg="RequestAddress(LocalDefault/172.17.0.0/16, 172.17.0.1, map[RequestAddressType:com.docker.network.gateway])" 
time="2016-09-15T18:25:08.516706131+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE]" 
time="2016-09-15T18:25:08.517744897+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -I POSTROUTING -s 172.17.0.0/16 ! -o docker0 -j MASQUERADE]" 
time="2016-09-15T18:25:08.518567078+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C DOCKER -i docker0 -j RETURN]" 
time="2016-09-15T18:25:08.519322174+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -I DOCKER -i docker0 -j RETURN]" 
time="2016-09-15T18:25:08.520080812+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -i docker0 -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.520811804+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker0 -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.521515870+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -i docker0 -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.522236875+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -i docker0 ! -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.522955486+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -i docker0 ! -o docker0 -j ACCEPT]" 
time="2016-09-15T18:25:08.523693985+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT]" 
time="2016-09-15T18:25:08.524496709+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -o docker0 -m conntrack --ctstate RELATED,ESTABLISHED -j ACCEPT]" 
time="2016-09-15T18:25:08.525289361+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:08.526061274+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER]" 
time="2016-09-15T18:25:08.526842244+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8]" 
time="2016-09-15T18:25:08.527713561+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER ! --dst 127.0.0.0/8]" 
time="2016-09-15T18:25:08.528540434+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.529308907+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -o docker0 -j DOCKER]" 
time="2016-09-15T18:25:08.530032339+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.530748155+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.531485202+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -j DOCKER-ISOLATION]" 
time="2016-09-15T18:25:08.532274978+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -i docker0 -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:08.533009383+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-ISOLATION -i docker0 -o docker_gwbridge -j DROP]" 
time="2016-09-15T18:25:08.533739570+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-ISOLATION -i docker_gwbridge -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.534459007+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-ISOLATION -i docker_gwbridge -o docker0 -j DROP]" 
time="2016-09-15T18:25:08.618042754+02:00" level=debug msg="successfully loaded the Root CA: /var/lib/docker/swarm/certificates/swarm-root-ca.crt" 
time="2016-09-15T18:25:08.638020087+02:00" level=debug msg="successfully loaded the Root CA: /var/lib/docker/swarm/certificates/swarm-root-ca.crt" 
time="2016-09-15T18:25:08.638114685+02:00" level=debug msg="loaded local CA certificate: /var/lib/docker/swarm/certificates/swarm-root-ca.crt." 
time="2016-09-15T18:25:08.638681481+02:00" level=debug msg="loaded local TLS credentials: /var/lib/docker/swarm/certificates/swarm-node.crt." 
time="2016-09-15T18:25:08.639059350+02:00" level=debug msg="successfully loaded the Root CA: /var/lib/docker/swarm/certificates/swarm-root-ca.crt" 
time="2016-09-15T18:25:08.639560518+02:00" level=debug msg="Requesting certificate for NodeID: 4fa0qa46gaisyelxa3n3l7zim" 
time="2016-09-15T18:25:08.640484831+02:00" level=warning msg="ignoring request to join cluster, because raft state already exists" 
time="2016-09-15T18:25:08.640566590+02:00" level=info msg="248e2ffda4e491a became follower at term 2" 
time="2016-09-15T18:25:08.640608122+02:00" level=info msg="newRaft 248e2ffda4e491a [peers: [], term: 2, commit: 59, applied: 0, lastindex: 59, lastterm: 2]" 
time="2016-09-15T18:25:08.640682992+02:00" level=debug msg="(*Agent).run" module=agent 
time="2016-09-15T18:25:08.657275351+02:00" level=info msg="Listening for connections" addr="[::]:2377" proto=tcp 
time="2016-09-15T18:25:08.657441890+02:00" level=info msg="Listening for local connections" addr="/var/lib/docker/swarm/control.sock" proto=unix 
time="2016-09-15T18:25:08.668913349+02:00" level=debug msg="(*session).start" module=agent 
time="2016-09-15T18:25:08.670817543+02:00" level=debug msg="state changed" module=taskmanager state.desired=RUNNING state.transition="RUNNING->COMPLETE" task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:08.671264041+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:08.671384036+02:00" level=debug msg="waiting on events" module=taskmanager task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:10.576394435+02:00" level=info msg="248e2ffda4e491a [term: 2] received a MsgVote message with higher term from 206dea5fabe5b525 [term: 3]" 
time="2016-09-15T18:25:10.576627353+02:00" level=info msg="248e2ffda4e491a became follower at term 3" 
time="2016-09-15T18:25:10.576695625+02:00" level=info msg="248e2ffda4e491a [logterm: 2, index: 59, vote: 0] voted for 206dea5fabe5b525 [logterm: 2, index: 59] at term 3" 
time="2016-09-15T18:25:10.622632204+02:00" level=info msg="raft.node: 248e2ffda4e491a elected leader 206dea5fabe5b525 at term 3" 
time="2016-09-15T18:25:11.036399088+02:00" level=debug msg="(*session).listen" module=agent session.id=ajj98w1u0wusy2fddyon6t6v5 
time="2016-09-15T18:25:11.037188485+02:00" level=debug msg="(*session).heartbeat" module=agent session.id=ajj98w1u0wusy2fddyon6t6v5 
time="2016-09-15T18:25:11.037338636+02:00" level=debug msg="(*session).watch" module=agent session.id=ajj98w1u0wusy2fddyon6t6v5 
time="2016-09-15T18:25:11.176358553+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.71 Adv-addr=192.168.100.71 Remote-addr =192.168.100.72" 
time="2016-09-15T18:25:11.176548450+02:00" level=debug msg="(*worker).Assign" len(tasks)=1 module=agent 
time="2016-09-15T18:25:11.176629849+02:00" level=debug msg=assigned module=agent task.desiredstate=RUNNING task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:11.195489962+02:00" level=debug msg="agent: registered" module=agent 
time="2016-09-15T18:25:11.196077329+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.71 Adv-addr=192.168.100.71 Remote-addr =192.168.100.72" 
time="2016-09-15T18:25:11.196260374+02:00" level=debug msg="Encryption key 1: 64dc9" 
time="2016-09-15T18:25:11.196329967+02:00" level=debug msg="Encryption key 2: 1412a" 
time="2016-09-15T18:25:11.196380704+02:00" level=debug msg="Encryption key 3: 68dc7" 
time="2016-09-15T18:25:11.196594506+02:00" level=info msg="Daemon has completed initialization" 
time="2016-09-15T18:25:11.196662299+02:00" level=info msg="Docker daemon" commit=0125703 graphdriver=aufs version=1.12.1-cs1-rc2 
time="2016-09-15T18:25:11.196766909+02:00" level=debug msg="Registering routers" 
time="2016-09-15T18:25:11.196821692+02:00" level=debug msg="Registering HEAD, /containers/{name:.*}/archive" 
time="2016-09-15T18:25:11.197024479+02:00" level=debug msg="Registering GET, /containers/json" 
time="2016-09-15T18:25:11.197159885+02:00" level=debug msg="Registering GET, /containers/{name:.*}/export" 
time="2016-09-15T18:25:11.197289935+02:00" level=debug msg="Registering GET, /containers/{name:.*}/changes" 
time="2016-09-15T18:25:11.197414866+02:00" level=debug msg="Registering GET, /containers/{name:.*}/json" 
time="2016-09-15T18:25:11.197531581+02:00" level=debug msg="Registering GET, /containers/{name:.*}/top" 
time="2016-09-15T18:25:11.197669872+02:00" level=debug msg="Registering GET, /containers/{name:.*}/logs" 
time="2016-09-15T18:25:11.197798447+02:00" level=debug msg="Registering GET, /containers/{name:.*}/stats" 
time="2016-09-15T18:25:11.197915339+02:00" level=debug msg="Registering GET, /containers/{name:.*}/attach/ws" 
time="2016-09-15T18:25:11.198042116+02:00" level=debug msg="Registering GET, /exec/{id:.*}/json" 
time="2016-09-15T18:25:11.198153894+02:00" level=debug msg="Registering GET, /containers/{name:.*}/archive" 
time="2016-09-15T18:25:11.198276903+02:00" level=debug msg="Registering POST, /containers/create" 
time="2016-09-15T18:25:11.198459444+02:00" level=debug msg="Registering POST, /containers/{name:.*}/kill" 
time="2016-09-15T18:25:11.198647189+02:00" level=debug msg="Registering POST, /containers/{name:.*}/pause" 
time="2016-09-15T18:25:11.198824214+02:00" level=debug msg="Registering POST, /containers/{name:.*}/unpause" 
time="2016-09-15T18:25:11.198959958+02:00" level=debug msg="Registering POST, /containers/{name:.*}/restart" 
time="2016-09-15T18:25:11.199088721+02:00" level=debug msg="Registering POST, /containers/{name:.*}/start" 
time="2016-09-15T18:25:11.199213858+02:00" level=debug msg="Registering POST, /containers/{name:.*}/stop" 
time="2016-09-15T18:25:11.199339410+02:00" level=debug msg="Registering POST, /containers/{name:.*}/wait" 
time="2016-09-15T18:25:11.199456248+02:00" level=debug msg="Registering POST, /containers/{name:.*}/resize" 
time="2016-09-15T18:25:11.199589257+02:00" level=debug msg="Registering POST, /containers/{name:.*}/attach" 
time="2016-09-15T18:25:11.199752255+02:00" level=debug msg="Registering POST, /containers/{name:.*}/copy" 
time="2016-09-15T18:25:11.199876356+02:00" level=debug msg="Registering POST, /containers/{name:.*}/exec" 
time="2016-09-15T18:25:11.200010985+02:00" level=debug msg="Registering POST, /exec/{name:.*}/start" 
time="2016-09-15T18:25:11.200120773+02:00" level=debug msg="Registering POST, /exec/{name:.*}/resize" 
time="2016-09-15T18:25:11.200250317+02:00" level=debug msg="Registering POST, /containers/{name:.*}/rename" 
time="2016-09-15T18:25:11.200393308+02:00" level=debug msg="Registering POST, /containers/{name:.*}/update" 
time="2016-09-15T18:25:11.200521550+02:00" level=debug msg="Registering PUT, /containers/{name:.*}/archive" 
time="2016-09-15T18:25:11.200659083+02:00" level=debug msg="Registering DELETE, /containers/{name:.*}" 
time="2016-09-15T18:25:11.200808607+02:00" level=debug msg="Registering GET, /images/json" 
time="2016-09-15T18:25:11.200910610+02:00" level=debug msg="Registering GET, /images/search" 
time="2016-09-15T18:25:11.201017338+02:00" level=debug msg="Registering GET, /images/get" 
time="2016-09-15T18:25:11.201116236+02:00" level=debug msg="Registering GET, /images/{name:.*}/get" 
time="2016-09-15T18:25:11.201234834+02:00" level=debug msg="Registering GET, /images/{name:.*}/history" 
time="2016-09-15T18:25:11.201332545+02:00" level=debug msg="Registering GET, /images/{name:.*}/json" 
time="2016-09-15T18:25:11.201455119+02:00" level=debug msg="Registering POST, /commit" 
time="2016-09-15T18:25:11.201538310+02:00" level=debug msg="Registering POST, /images/load" 
time="2016-09-15T18:25:11.201624168+02:00" level=debug msg="Registering POST, /images/create" 
time="2016-09-15T18:25:11.201711093+02:00" level=debug msg="Registering POST, /images/{name:.*}/push" 
time="2016-09-15T18:25:11.201839973+02:00" level=debug msg="Registering POST, /images/{name:.*}/tag" 
time="2016-09-15T18:25:11.201947475+02:00" level=debug msg="Registering DELETE, /images/{name:.*}" 
time="2016-09-15T18:25:11.202071873+02:00" level=debug msg="Registering OPTIONS, /{anyroute:.*}" 
time="2016-09-15T18:25:11.202193728+02:00" level=debug msg="Registering GET, /_ping" 
time="2016-09-15T18:25:11.202269532+02:00" level=debug msg="Registering GET, /events" 
time="2016-09-15T18:25:11.202344871+02:00" level=debug msg="Registering GET, /info" 
time="2016-09-15T18:25:11.202426066+02:00" level=debug msg="Registering GET, /version" 
time="2016-09-15T18:25:11.202514751+02:00" level=debug msg="Registering POST, /auth" 
time="2016-09-15T18:25:11.202589011+02:00" level=debug msg="Registering GET, /volumes" 
time="2016-09-15T18:25:11.202670629+02:00" level=debug msg="Registering GET, /volumes/{name:.*}" 
time="2016-09-15T18:25:11.202793409+02:00" level=debug msg="Registering POST, /volumes/create" 
time="2016-09-15T18:25:11.202889087+02:00" level=debug msg="Registering DELETE, /volumes/{name:.*}" 
time="2016-09-15T18:25:11.203013612+02:00" level=debug msg="Registering POST, /build" 
time="2016-09-15T18:25:11.203088140+02:00" level=debug msg="Registering POST, /swarm/init" 
time="2016-09-15T18:25:11.203169926+02:00" level=debug msg="Registering POST, /swarm/join" 
time="2016-09-15T18:25:11.203262840+02:00" level=debug msg="Registering POST, /swarm/leave" 
time="2016-09-15T18:25:11.203351479+02:00" level=debug msg="Registering GET, /swarm" 
time="2016-09-15T18:25:11.203423820+02:00" level=debug msg="Registering POST, /swarm/update" 
time="2016-09-15T18:25:11.203503482+02:00" level=debug msg="Registering GET, /services" 
time="2016-09-15T18:25:11.203592868+02:00" level=debug msg="Registering GET, /services/{id:.*}" 
time="2016-09-15T18:25:11.203712793+02:00" level=debug msg="Registering POST, /services/create" 
time="2016-09-15T18:25:11.203818332+02:00" level=debug msg="Registering POST, /services/{id:.*}/update" 
time="2016-09-15T18:25:11.203947082+02:00" level=debug msg="Registering DELETE, /services/{id:.*}" 
time="2016-09-15T18:25:11.204059955+02:00" level=debug msg="Registering GET, /nodes" 
time="2016-09-15T18:25:11.204142348+02:00" level=debug msg="Registering GET, /nodes/{id:.*}" 
time="2016-09-15T18:25:11.204240892+02:00" level=debug msg="Registering DELETE, /nodes/{id:.*}" 
time="2016-09-15T18:25:11.204346014+02:00" level=debug msg="Registering POST, /nodes/{id:.*}/update" 
time="2016-09-15T18:25:11.204454636+02:00" level=debug msg="Registering GET, /tasks" 
time="2016-09-15T18:25:11.204528678+02:00" level=debug msg="Registering GET, /tasks/{id:.*}" 
time="2016-09-15T18:25:11.204633963+02:00" level=debug msg="Registering GET, /networks" 
time="2016-09-15T18:25:11.204725014+02:00" level=debug msg="Registering GET, /networks/{id:.*}" 
time="2016-09-15T18:25:11.204838227+02:00" level=debug msg="Registering POST, /networks/create" 
time="2016-09-15T18:25:11.204930821+02:00" level=debug msg="Registering POST, /networks/{id:.*}/connect" 
time="2016-09-15T18:25:11.205035803+02:00" level=debug msg="Registering POST, /networks/{id:.*}/disconnect" 
time="2016-09-15T18:25:11.205154493+02:00" level=debug msg="Registering DELETE, /networks/{id:.*}" 
time="2016-09-15T18:25:11.205874133+02:00" level=info msg="API listen on /var/run/docker.sock" 
time="2016-09-15T18:25:11.206080507+02:00" level=debug msg="Initial encryption keys: [(key: b79bd, tag: 0x399b) (key: 684a7, tag: 0x399a) (key: d61a6, tag: 0x399d)]" 
time="2016-09-15T18:25:11.206800088+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:11.206940655+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:11.207130771+02:00" level=debug msg="2016/09/15 18:25:11 [DEBUG] memberlist: Initiating push/pull sync with: 192.168.100.72:7946\n" 
time="2016-09-15T18:25:11.208362685+02:00" level=warning msg="2016/09/15 18:25:11 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.71:7946 Theirs: 192.168.100.72:7946\n" 
time="2016-09-15T18:25:11.208781179+02:00" level=debug msg="Allocating IPv4 pools for network ingress (8ntztu1ghs042t20rl5bdp3sy)" 
time="2016-09-15T18:25:11.208913167+02:00" level=debug msg="RequestPool(LocalDefault, 10.255.0.0/16, , map[], false)" 
time="2016-09-15T18:25:11.208992863+02:00" level=debug msg="RequestAddress(LocalDefault/10.255.0.0/16, 10.255.0.1, map[RequestAddressType:com.docker.network.gateway])" 
time="2016-09-15T18:25:11.209048833+02:00" level=debug msg="overlay: Received vxlan IDs: 256" 
time="2016-09-15T18:25:11.209100576+02:00" level=debug msg="/sbin/iptables, [--wait -t mangle -C OUTPUT -p udp --dport 4789 -m u32 --u32 0>>22&0x3C@12&0xFFFFFF00=65536 -j MARK --set-mark 13681891]" 
time="2016-09-15T18:25:11.210607540+02:00" level=debug msg="ubuntu: joined network 8ntztu1ghs042t20rl5bdp3sy" 
time="2016-09-15T18:25:11.210698070+02:00" level=debug msg="ubuntu: Initiating bulk sync with nodes [ubuntu]" 
time="2016-09-15T18:25:11.210800259+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -L DOCKER-INGRESS]" 
time="2016-09-15T18:25:11.211910574+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-INGRESS]" 
time="2016-09-15T18:25:11.212827624+02:00" level=debug msg="/sbin/iptables, [--wait -D FORWARD -j DOCKER-INGRESS]" 
time="2016-09-15T18:25:11.213652478+02:00" level=debug msg="/sbin/iptables, [--wait -I FORWARD -j DOCKER-INGRESS]" 
time="2016-09-15T18:25:11.230567689+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:11.242790483+02:00" level=debug msg="Assigning addresses for endpoint ingress-endpoint's interface on network ingress" 
time="2016-09-15T18:25:11.242916290+02:00" level=debug msg="RequestAddress(LocalDefault/10.255.0.0/16, 10.255.0.3, map[])" 
time="2016-09-15T18:25:11.257480893+02:00" level=debug msg="Assigning addresses for endpoint ingress-endpoint's interface on network ingress" 
time="2016-09-15T18:25:11.332454423+02:00" level=debug msg="checkEncryption(8ntztu1, <nil>, 256, true)" 
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:25:11.432443681+02:00" level=debug msg="Assigning addresses for endpoint gateway_ingress-sbox's interface on network docker_gwbridge" 
time="2016-09-15T18:25:11.432476405+02:00" level=debug msg="RequestAddress(LocalDefault/172.18.0.0/16, <nil>, map[])" 
time="2016-09-15T18:25:11.453555360+02:00" level=debug msg="(*worker).Assign" len(tasks)=1 module=agent 
time="2016-09-15T18:25:11.453582260+02:00" level=debug msg=assigned module=agent task.desiredstate=SHUTDOWN task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:11.476610696+02:00" level=debug msg="Assigning addresses for endpoint gateway_ingress-sbox's interface on network docker_gwbridge" 
time="2016-09-15T18:25:11.483089826+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:11.484188599+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:11.601880156+02:00" level=debug msg="(*worker).Assign" len(tasks)=2 module=agent 
time="2016-09-15T18:25:11.602025472+02:00" level=debug msg=assigned module=agent task.desiredstate=SHUTDOWN task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:11.602128555+02:00" level=debug msg=assigned module=agent task.desiredstate=READY task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:11.602210281+02:00" level=debug msg="state changed" module=agent state.desired=READY state.transition="ASSIGNED->ACCEPTED" task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:11.602545736+02:00" level=debug msg="state changed" module=taskmanager state.desired=READY state.transition="ASSIGNED->ACCEPTED" task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:11.602695136+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:11.618134400+02:00" level=debug msg="Programming external connectivity on endpoint gateway_ingress-sbox (88ebcfdf3ad39ef8cf5fa3621ae7c3b24980c47f21249e9e91b878ddebf2ead6)" 
time="2016-09-15T18:25:11.666168033+02:00" level=debug msg="state changed" module=taskmanager state.desired=READY state.transition="ACCEPTED->PREPARING" task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:11.682073689+02:00" level=debug msg="Trying to pull nginx from https://registry-1.docker.io v2" 
time="2016-09-15T18:25:11.685284186+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:11.685410067+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:11.686270099+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:13.236329910+02:00" level=debug msg="Increasing token expiration to: 60 seconds" 
time="2016-09-15T18:25:13.720601188+02:00" level=debug msg="Pulling ref from V2 registry: nginx:mainline-alpine" 
time="2016-09-15T18:25:13.721738546+02:00" level=debug msg="pull progress map[status:Pulling from library/nginx id:mainline-alpine]" 
time="2016-09-15T18:25:13.721818784+02:00" level=debug msg="pull progress map[status:Digest: sha256:01a97a837e2af35ae0e2bf0d5609af4b1e2f698f0856b36e3975c9d5eec3f836 id:mainline-alpine]" 
time="2016-09-15T18:25:13.721881760+02:00" level=debug msg="pull progress map[status:Status: Image is up to date for nginx:mainline-alpine id:mainline-alpine]" 
time="2016-09-15T18:25:13.792372982+02:00" level=debug msg="container mounted via layerStore: /var/lib/docker/aufs/mnt/37cc27a57955fe4e86915bd6d92def47f1376f1b516aef05551f5bf1c29b08f9" 
time="2016-09-15T18:25:13.846433210+02:00" level=debug msg="Creating service config in agent for t = &Task{ID:ar4c50aqf7el56hblac7atuop,Meta:Meta{Version:Version{Index:74,},CreatedAt:&docker_swarmkit_v1.Timestamp{Seconds:1473956711,Nanos:296545984,},UpdatedAt:&docker_swarmkit_v1.Timestamp{Seconds:1473956711,Nanos:440581221,},},Spec:TaskSpec{Runtime:&TaskSpec_Container{Container:&ContainerSpec{Image:nginx:mainline-alpine,Labels:map[string]string{},Command:[],Args:[],Env:[],Dir:,User:,Mounts:[],StopGracePeriod:nil,PullOptions:nil,},},Resources:&ResourceRequirements{Limits:&Resources{NanoCPUs:0,MemoryBytes:0,},Reservations:&Resources{NanoCPUs:0,MemoryBytes:0,},},Restart:&RestartPolicy{Condition:ANY,Delay:nil,MaxAttempts:0,Window:nil,},Placement:&Placement{Constraints:[],},LogDriver:nil,Networks:[],},ServiceID:ddq23aw4oox4837ofwmdq72df,Slot:4,NodeID:4fa0qa46gaisyelxa3n3l7zim,Annotations:Annotations{Name:,Labels:map[string]string{},},ServiceAnnotations:Annotations{Name:nginx,Labels:map[string]string{},},Status:TaskStatus{Timestamp:&docker_swarmkit_v1.Timestamp{Seconds:1473956711,Nanos:440519523,},State:ASSIGNED,Message:scheduler assigned task to node,Err:,RuntimeStatus:<nil>,},DesiredState:READY,Networks:[&NetworkAttachment{Network:&Network{ID:8ntztu1ghs042t20rl5bdp3sy,Meta:Meta{Version:Version{Index:63,},CreatedAt:&docker_swarmkit_v1.Timestamp{Seconds:1473954686,Nanos:109232804,},UpdatedAt:&docker_swarmkit_v1.Timestamp{Seconds:1473956710,Nanos:723089602,},},Spec:NetworkSpec{Annotations:Annotations{Name:ingress,Labels:map[string]string{com.docker.swarm.internal: true,},},DriverConfig:&Driver{Name:,Options:map[string]string{},},Ipv6Enabled:false,Internal:false,IPAM:&IPAMOptions{Driver:&Driver{Name:,Options:map[string]string{},},Configs:[&IPAMConfig{Family:UNKNOWN,Subnet:10.255.0.0/16,Range:,Gateway:10.255.0.1,Reserved:map[string]string{},}],},Attachable:false,},DriverState:&Driver{Name:overlay,Options:map[string]string{com.docker.network.driver.overlay.vxlanid_list: 256,},},IPAM:&IPAMOptions{Driver:&Driver{Name:default,Options:map[string]string{},},Configs:[&IPAMConfig{Family:UNKNOWN,Subnet:10.255.0.0/16,Range:,Gateway:10.255.0.1,Reserved:map[string]string{},}],},},Addresses:[10.255.0.2/16],Aliases:[],}],Endpoint:&Endpoint{Spec:&EndpointSpec{Mode:VIP,Ports:[&PortConfig{Name:,Protocol:TCP,TargetPort:80,PublishedPort:0,}],},Ports:[&PortConfig{Name:,Protocol:TCP,TargetPort:80,PublishedPort:30000,}],VirtualIPs:[&Endpoint_VirtualIP{NetworkID:8ntztu1ghs042t20rl5bdp3sy,Addr:10.255.0.6/16,}],},LogDriver:nil,}" 
time="2016-09-15T18:25:13.846628637+02:00" level=debug msg="state changed" module=taskmanager state.desired=READY state.transition="PREPARING->READY" task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:13.846954434+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:13.848088707+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:13.863368400+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:13.864523740+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:16.461061976+02:00" level=debug msg="(*worker).Assign" len(tasks)=2 module=agent 
time="2016-09-15T18:25:16.461205798+02:00" level=debug msg=assigned module=agent task.desiredstate=SHUTDOWN task.id=37z2fp6pxthas582fbwptymmw 
time="2016-09-15T18:25:16.461302870+02:00" level=debug msg=assigned module=agent task.desiredstate=RUNNING task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:16.461741099+02:00" level=debug msg="state changed" module=taskmanager state.desired=RUNNING state.transition="READY->STARTING" task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:16.477136903+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:16.478592246+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:16.495490801+02:00" level=debug msg="container mounted via layerStore: /var/lib/docker/aufs/mnt/37cc27a57955fe4e86915bd6d92def47f1376f1b516aef05551f5bf1c29b08f9" 
time="2016-09-15T18:25:16.495995181+02:00" level=debug msg="Assigning addresses for endpoint nginx.4.ar4c50aqf7el56hblac7atuop's interface on network ingress" 
time="2016-09-15T18:25:16.496085926+02:00" level=debug msg="RequestAddress(LocalDefault/10.255.0.0/16, 10.255.0.2, map[])" 
time="2016-09-15T18:25:16.512446610+02:00" level=debug msg="Assigning addresses for endpoint nginx.4.ar4c50aqf7el56hblac7atuop's interface on network ingress" 
time="2016-09-15T18:25:16.596752189+02:00" level=debug msg="checkEncryption(8ntztu1, <nil>, 256, true)" 
time="2016-09-15T18:25:16.604545804+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -L DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.608981399+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -L DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.612748101+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -F DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.614299585+02:00" level=debug msg="/sbin/iptables, [--wait -F DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.615769201+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C DOCKER-INGRESS -j RETURN]" 
time="2016-09-15T18:25:16.617268250+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -A DOCKER-INGRESS -j RETURN]" 
time="2016-09-15T18:25:16.618858364+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C DOCKER-INGRESS -j RETURN]" 
time="2016-09-15T18:25:16.620402545+02:00" level=debug msg="/sbin/iptables, [--wait -A DOCKER-INGRESS -j RETURN]" 
time="2016-09-15T18:25:16.621922042+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C OUTPUT -m addrtype --dst-type LOCAL -j DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.623500993+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C PREROUTING -m addrtype --dst-type LOCAL -j DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.625169001+02:00" level=debug msg="/sbin/iptables, [--wait -t filter -C FORWARD -j DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.626790345+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -C POSTROUTING -m addrtype --src-type LOCAL -o docker_gwbridge -j MASQUERADE]" 
time="2016-09-15T18:25:16.635086595+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -L DOCKER-INGRESS]" 
time="2016-09-15T18:25:16.636810664+02:00" level=debug msg="/sbin/iptables, [--wait -t nat -I DOCKER-INGRESS -p tcp --dport 30000 -j DNAT --to-destination 172.18.0.2:30000]" 
time="2016-09-15T18:25:16.638482490+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-INGRESS -m state -p tcp --sport 30000 --state ESTABLISHED,RELATED -j ACCEPT]" 
time="2016-09-15T18:25:16.640336168+02:00" level=debug msg="/sbin/iptables, [--wait -I DOCKER-INGRESS -p tcp --dport 30000 -j ACCEPT]" 
time="2016-09-15T18:25:16.642260998+02:00" level=debug msg="Creating service for vip 10.255.0.6 fwMark 256 ingressPorts []*libnetwork.PortConfig{&libnetwork.PortConfig{Name: \"\",\nProtocol: 0,\nTargetPort: 0x50,\nPublishedPort: 0x7530,\n}}" 
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:25:16.662353134+02:00" level=debug msg="Assigning addresses for endpoint gateway_4dbd0a76cf22's interface on network docker_gwbridge" 
time="2016-09-15T18:25:16.662464109+02:00" level=debug msg="RequestAddress(LocalDefault/172.18.0.0/16, <nil>, map[])" 
time="2016-09-15T18:25:16.691262928+02:00" level=debug msg="Assigning addresses for endpoint gateway_4dbd0a76cf22's interface on network docker_gwbridge" 
time="2016-09-15T18:25:16.748365712+02:00" level=debug msg="Programming external connectivity on endpoint gateway_4dbd0a76cf22 (706275370bb1a0e632558bf55890a8bd725640f963be431d7ba01adabcd0cb3f)" 
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:25:16.918798144+02:00" level=debug msg="sandbox set key processing took 101.513848ms for container 4dbd0a76cf2202618c5b8aca42dbb10d5b2b587f9e0df610efc3197bd068394f" 
time="2016-09-15T18:25:16.939509112+02:00" level=debug msg="libcontainerd: received containerd event: &types.Event{Type:\"start-container\", Id:\"4dbd0a76cf2202618c5b8aca42dbb10d5b2b587f9e0df610efc3197bd068394f\", Status:0x0, Pid:\"\", Timestamp:(*timestamp.Timestamp)(0xc821075ea0)}" 
time="2016-09-15T18:25:17.004235072+02:00" level=debug msg="state changed" module=taskmanager state.desired=RUNNING state.transition="STARTING->RUNNING" task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:17.004505900+02:00" level=debug msg="(*Agent).UpdateTaskStatus" module=agent task.id=ar4c50aqf7el56hblac7atuop 
time="2016-09-15T18:25:17.004593388+02:00" level=debug msg="libcontainerd: event unhandled: type:\"start-container\" id:\"4dbd0a76cf2202618c5b8aca42dbb10d5b2b587f9e0df610efc3197bd068394f\" timestamp:<seconds:1473956716 nanos:938685410 > " 
time="2016-09-15T18:25:17.005955298+02:00" level=debug msg="task status reported" module=agent 
time="2016-09-15T18:25:17.021019546+02:00" level=debug msg="waiting on events" module=taskmanager task.id=ar4c50aqf7el56hblac7atuop

@adrahon
Copy link
Author

adrahon commented Sep 15, 2016

Node2

Waiting for /var/run/docker.sock
time="2016-09-15T17:50:48.441406122+02:00" level=info msg="libcontainerd: new containerd process, pid: 2858" 
time="2016-09-15T17:50:48.813291349+02:00" level=info msg="Graph migration to content-addressability took 0.00 seconds" 
time="2016-09-15T17:50:48.813577130+02:00" level=warning msg="Your kernel does not support swap memory limit." 
time="2016-09-15T17:50:48.813789919+02:00" level=warning msg="mountpoint for pids not found" 
time="2016-09-15T17:50:48.814070268+02:00" level=info msg="Loading containers: start." 
time="2016-09-15T17:50:48.886359951+02:00" level=info msg="Firewalld running: false" 
time="2016-09-15T17:50:49.424429183+02:00" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" 

time="2016-09-15T17:50:49.761214403+02:00" level=info msg="Loading containers: done." 
time="2016-09-15T17:50:49.761387625+02:00" level=info msg="Daemon has completed initialization" 
time="2016-09-15T17:50:49.761468996+02:00" level=info msg="Docker daemon" commit=0125703 graphdriver=aufs version=1.12.1-cs1-rc2 
time="2016-09-15T17:50:49.781378113+02:00" level=info msg="API listen on /var/run/docker.sock" 
time="2016-09-15T17:51:39.645342511+02:00" level=info msg="Waiting for TLS certificate to be issued..." 
time="2016-09-15T17:51:39.702779069+02:00" level=info msg="Downloaded new TLS credentials with role: swarm-manager." 
time="2016-09-15T17:51:39.790495248+02:00" level=info msg="Listening for connections" addr="[::]:2377" proto=tcp 
time="2016-09-15T17:51:39.790668645+02:00" level=info msg="Listening for local connections" addr="/var/lib/docker/swarm/control.sock" proto=unix 
time="2016-09-15T17:51:39.854683229+02:00" level=info msg="1d174fa03b7d1b3c became follower at term 0" 
time="2016-09-15T17:51:39.854867176+02:00" level=info msg="newRaft 1d174fa03b7d1b3c [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]" 
time="2016-09-15T17:51:39.854927463+02:00" level=info msg="1d174fa03b7d1b3c became follower at term 1" 
time="2016-09-15T17:51:39.858833268+02:00" level=info msg="1d174fa03b7d1b3c [term: 1] received a MsgApp message with higher term from 248e2ffda4e491a [term: 2]" 
time="2016-09-15T17:51:39.858979148+02:00" level=info msg="1d174fa03b7d1b3c became follower at term 2" 
time="2016-09-15T17:51:39.859045056+02:00" level=info msg="raft.node: 1d174fa03b7d1b3c elected leader 248e2ffda4e491a at term 2" 
time="2016-09-15T17:51:39.964847128+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.72 Adv-addr=192.168.100.72 Remote-addr =192.168.100.71" 
time="2016-09-15T17:51:39.965155173+02:00" level=info msg="Initializing Libnetwork Agent Local-addr=192.168.100.72 Adv-addr=192.168.100.72 Remote-addr =192.168.100.71" 
time="2016-09-15T17:51:39.967870469+02:00" level=warning msg="2016/09/15 17:51:39 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.72:7946 Theirs: 192.168.100.71:7946\n" 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T17:59:14.907360077+02:00" level=error msg="Handler for POST /v1.24/containers/create returned error: No such image: jpetazzo/nsenter:latest" 
time="2016-09-15T18:10:48.497107354+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=a20z0fiwfuwb9lxeyd180a4e9 
time="2016-09-15T18:10:48.497323235+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=9oo0g0c1nbqey2u5rgp2fowoa 
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:16:00.185346484+02:00" level=error msg="container status unavailable" error="context canceled" module=taskmanager task.id=b6aul1lo4k8wvku3gocmigh9o 
�[34mINFO�[0m[0000] Firewalld running: false                     
time="2016-09-15T18:25:07.636042633+02:00" level=warning msg="2016/09/15 18:25:07 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.72:7946 Theirs: 192.168.100.71:7946\n" 
time="2016-09-15T18:25:07.636548843+02:00" level=error msg="agent: session failed" error="rpc error: code = 13 desc = transport is closing" module=agent 
time="2016-09-15T18:25:09.957397027+02:00" level=error msg="agent: session failed" error="rpc error: code = 8 desc = more than one redirect to leader from: [192.168.100.72:48305]" module=agent 
time="2016-09-15T18:25:10.177973765+02:00" level=error msg="agent: session failed" error="rpc error: code = 8 desc = more than one redirect to leader from: [192.168.100.72:48313]" module=agent 
time="2016-09-15T18:25:10.364502214+02:00" level=error msg="agent: session failed" error="rpc error: code = 8 desc = more than one redirect to leader from: [192.168.100.72:48314]" module=agent 
time="2016-09-15T18:25:10.639508096+02:00" level=info msg="1d174fa03b7d1b3c [term: 2] received a MsgVote message with higher term from 206dea5fabe5b525 [term: 3]" 
time="2016-09-15T18:25:10.639713232+02:00" level=info msg="1d174fa03b7d1b3c became follower at term 3" 
time="2016-09-15T18:25:10.639801127+02:00" level=info msg="1d174fa03b7d1b3c [logterm: 2, index: 59, vote: 0] voted for 206dea5fabe5b525 [logterm: 2, index: 59] at term 3" 
time="2016-09-15T18:25:10.639894319+02:00" level=info msg="raft.node: 1d174fa03b7d1b3c lost leader 248e2ffda4e491a at term 3" 
time="2016-09-15T18:25:10.685759059+02:00" level=info msg="raft.node: 1d174fa03b7d1b3c elected leader 206dea5fabe5b525 at term 3" 
time="2016-09-15T18:25:11.270823487+02:00" level=warning msg="2016/09/15 18:25:11 [ERR] memberlist: Conflicting address for ubuntu. Mine: 192.168.100.72:7946 Theirs: 192.168.100.71:7946\n"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment