client logs

INFO[0014] Restore successfully completed for replica 3c310c027e31 
DEBU[0071] Deleting container 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e 
DEBU[0071] Failed to remove container: Error response from daemon: Error response from daemon: Unable to remove filesystem for 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: remove /var/lib/docker/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e/shm: device or resource busy 
DEBU[0071] Ignored error, but retrying Error response from daemon: Error response from daemon: Unable to remove filesystem for 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: remove /var/lib/docker/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e/shm: device or resource busy... 
DEBU[0072] Deleting container 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e 
DEBU[0073] Failed to remove container: Error response from daemon: Error response from daemon: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: rename /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7 /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7-removing: device or resource busy 
DEBU[0073] Ignored error, but retrying Error response from daemon: Error response from daemon: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: rename /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7 /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7-removing: device or resource busy... 
DEBU[0074] Deleting container 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e 
DEBU[0074] Failed to remove container: Error response from daemon: Error response from daemon: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: no such file or directory 
FATA[0074] Problem removing the phase 2 container: Unknown error: Error response from daemon: Error response from daemon: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: no such file or directory 

daemon data

http://www.filedropper.com/clusterdtr-buildk-c0-1f39machine2daemondata

daemon info

Client:
 Version:      1.13.0
 API version:  1.25
 Go version:   go1.7.3
 Git commit:   49bf474
 Built:        Tue Jan 17 09:50:17 2017
 OS/Arch:      linux/amd64

Server:
 Version:      1.13.0
 API version:  1.25 (minimum version 1.12)
 Go version:   go1.7.3
 Git commit:   49bf474
 Built:        Tue Jan 17 09:50:17 2017
 OS/Arch:      linux/amd64
 Experimental: false
Containers: 3
 Running: 2
 Paused: 0
 Stopped: 1
Images: 12
Server Version: 1.13.0
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 54
 Dirperm1 Supported: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins: 
 Volume: local
 Network: bridge host macvlan null overlay
Swarm: active
 NodeID: kklxzjy3k1gfuy5cr6a0ouah8
 Is Manager: false
 Node Address: 10.0.0.136
 Manager Addresses:
  10.0.0.181:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 03e5862ec0d8d3b3f750e19fca3ee367e13c090e
runc version: 2f7393a47307a16f8cee44a37b262e8b81021e3e
init version: 949e6fa
Security Options:
 apparmor
Kernel Version: 3.13.0-107-generic
Operating System: Ubuntu 14.04.4 LTS
OSType: linux
Architecture: x86_64
CPUs: 1
Total Memory: 3.676 GiB
Name: ip-10-0-0-136
ID: ZJZM:H42Q:PCPS:AU3F:BHE4:5XUC:NMD7:GN3G:U3XR:GN6E:JS5H:JA3G
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Experimental: false
Insecure Registries:
 127.0.0.0/8
Live Restore Enabled: false
WARNING: No swap limit support
Error response from daemon: This node is not a swarm manager. Worker nodes can't be used to view or modify cluster state. Please run this command on a manager node or promote the current node to a manager.

daemon log

time="2017-01-20T08:55:00.973898241Z" level=warning msg="Your kernel does not support swap memory limit." 
time="2017-01-20T08:55:00.974038067Z" level=warning msg="Your kernel does not support cgroup rt period" 
time="2017-01-20T08:55:00.974057849Z" level=warning msg="Your kernel does not support cgroup rt runtime" 
time="2017-01-20T08:55:00.974160427Z" level=warning msg="mountpoint for pids not found" 
INFO[0000] Firewalld running: false                     
INFO[0000] Firewalld running: false                     
INFO[0000] Firewalld running: false                     
INFO[0000] Firewalld running: false                     
ERRO[1033] containerd: deleting container                error=exit status 1: "container 8d93de6bd0d1b47c12051c6a7846f0122ea51bbb9003e55c63dee7f369e4cd5d does not exist\none or more of the container deletions failed\n"
ERRO[1034] containerd: deleting container                error=exit status 1: "container f11522b41dd0085d464b4ea743a87364ac15e8b89ccdc866ec8d7b96634f0d28 does not exist\none or more of the container deletions failed\n"
ERRO[1035] containerd: deleting container                error=exit status 1: "container 00a37274f34e841a45c2fb213e46e60c6a0fcaa82eafa85fa9c70771243f5f54 does not exist\none or more of the container deletions failed\n"
ERRO[1035] containerd: deleting container                error=exit status 1: "container 9dcc1a314b53c30120b1629f56a93707fcaf169b7c1054222fd73df5fd71cb63 does not exist\none or more of the container deletions failed\n"
ERRO[1035] containerd: deleting container                error=exit status 1: "container 487b7b34c31e3b53aebb5cd2523c3d184bc1497c9125946d187deccce02e6743 does not exist\none or more of the container deletions failed\n"
ERRO[1035] containerd: deleting container                error=exit status 1: "container 1540405ad4d80d0c7b97f10ff1755555d236d5be95d77c48b8d0e55c73c83856 does not exist\none or more of the container deletions failed\n"
time="2017-01-20T08:55:06.185866366Z" level=warning msg="Your kernel does not support swap memory limit." 
ERRO[1036] containerd: deleting container                error=exit status 1: "container 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e does not exist\none or more of the container deletions failed\n"
time="2017-01-20T08:55:06.186307535Z" level=warning msg="Your kernel does not support cgroup rt period" 
time="2017-01-20T08:55:06.186337649Z" level=warning msg="Your kernel does not support cgroup rt runtime" 
time="2017-01-20T08:55:06.186458604Z" level=warning msg="mountpoint for pids not found" 
time="2017-01-20T08:55:06.501010396Z" level=warning msg="error detaching from network dtr-ol: could not find network attachment for container 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e to network dtr-ol" 
time="2017-01-20T08:55:06.588564354Z" level=error msg="Handler for DELETE /v1.25/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e returned error: Unable to remove filesystem for 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: remove /var/lib/docker/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e/shm: device or resource busy" 
time="2017-01-20T08:55:06.772820658Z" level=warning msg="Your kernel does not support swap memory limit." 
time="2017-01-20T08:55:06.783587131Z" level=warning msg="Your kernel does not support cgroup rt period" 
time="2017-01-20T08:55:06.783609456Z" level=warning msg="Your kernel does not support cgroup rt runtime" 
time="2017-01-20T08:55:06.783704773Z" level=warning msg="mountpoint for pids not found" 
time="2017-01-20T08:55:06.783462977Z" level=warning msg="Your kernel does not support swap memory limit." 
time="2017-01-20T08:55:06.784261989Z" level=warning msg="Your kernel does not support cgroup rt period" 
time="2017-01-20T08:55:06.785439879Z" level=warning msg="Your kernel does not support cgroup rt runtime" 
time="2017-01-20T08:55:06.785528626Z" level=warning msg="mountpoint for pids not found" 
time="2017-01-20T08:55:07.173015570Z" level=warning msg="Your kernel does not support swap memory limit." 
time="2017-01-20T08:55:07.173095779Z" level=warning msg="Your kernel does not support cgroup rt period" 
time="2017-01-20T08:55:07.173116277Z" level=warning msg="Your kernel does not support cgroup rt runtime" 
time="2017-01-20T08:55:07.173232103Z" level=warning msg="mountpoint for pids not found" 
INFO[0000] Firewalld running: false                     
time="2017-01-20T08:55:07.498809299Z" level=warning msg="Your kernel does not support swap memory limit." 
time="2017-01-20T08:55:07.498883237Z" level=warning msg="Your kernel does not support cgroup rt period" 
time="2017-01-20T08:55:07.498905765Z" level=warning msg="Your kernel does not support cgroup rt runtime" 
time="2017-01-20T08:55:07.498997409Z" level=warning msg="mountpoint for pids not found" 
time="2017-01-20T08:55:07.866884917Z" level=error msg="Error removing mounted layer 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: rename /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7 /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7-removing: device or resource busy" 
time="2017-01-20T08:55:07.866953405Z" level=error msg="Handler for DELETE /v1.25/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e returned error: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: rename /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7 /var/lib/docker/aufs/diff/0ff5f857e00e257efda70f1fb6c2d5e17304acf61030a6d7cdde361046d85ca7-removing: device or resource busy" 
INFO[0000] Firewalld running: false                     
INFO[0000] Firewalld running: false                     
INFO[0000] Firewalld running: false                     
INFO[0000] Firewalld running: false                     
time="2017-01-20T08:55:09.023866665Z" level=error msg="Error removing mounted layer 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: no such file or directory" 
time="2017-01-20T08:55:09.024003864Z" level=error msg="Handler for DELETE /v1.25/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e returned error: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: no such file or directory" 
time="2017-01-20T08:55:09.327380486Z" level=error msg="Error removing mounted layer 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: no such file or directory" 
time="2017-01-20T08:55:09.327506077Z" level=error msg="Handler for DELETE /v1.25/containers/985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e returned error: Driver aufs failed to remove root filesystem 985aab3e748cfa1b11a8bdccf7cd847998ba9aa865392e6c8912d2f1e7fcb21e: no such file or directory" 
time="2017-01-20T08:58:44.322904456Z" level=info msg="goroutine stacks written to /var/run/docker/goroutine-stacks-2017-01-20T085844Z.log" 
time="2017-01-20T08:58:45.115977446Z" level=info msg="daemon datastructure dump written to /var/run/docker/daemon-data-2017-01-20T085844Z.log"