Skip to content

Instantly share code, notes, and snippets.

@dotemacs
Created August 17, 2017 11:26
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dotemacs/8db621ed433b6d342dad5c8e7b4e4f01 to your computer and use it in GitHub Desktop.
Save dotemacs/8db621ed433b6d342dad5c8e7b4e4f01 to your computer and use it in GitHub Desktop.
# df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 7.4G 0 7.4G 0% /dev
tmpfs 7.4G 0 7.4G 0% /dev/shm
tmpfs 7.4G 804K 7.4G 1% /run
tmpfs 7.4G 0 7.4G 0% /sys/fs/cgroup
/dev/xvda9 5.5G 2.3G 3.0G 44% /
/dev/mapper/usr 985M 625M 309M 67% /usr
/dev/xvda1 128M 39M 90M 31% /boot
tmpfs 7.4G 236K 7.4G 1% /tmp
tmpfs 7.4G 0 7.4G 0% /media
/dev/xvda6 108M 64K 99M 1% /usr/share/oem
/dev/xvdb 37G 36G 0 100% /var/lib
overlay 37G 36G 0 100% /var/lib/docker/overlay/be27aa1cddc26ba8f6e4c9a90c436678395f2c4c821c3ea8053a1d173392f6ee/merged
shm 64M 0 64M 0% /var/lib/docker/containers/566e781d540a176ea3461d2b77ccf0676b1b04a1d6d4d827236d0b84c013f719/shm
overlay 37G 36G 0 100% /var/lib/docker/overlay/547b76cafcacb9cb3df12537eada117f079cfe7fa449bd7f35f0fd4a6eac5a93/merged
shm 64M 0 64M 0% /var/lib/docker/containers/68d555ef0b445343fa8f75815a326c6718a69e8fb384d614ff168412b058bd74/shm
overlay 37G 36G 0 100% /var/lib/docker/overlay/e4e3804dcb7b05428ce2999a951047d77122c5304dd1fb5c0ad3d444f033b40b/merged
shm 64M 0 64M 0% /var/lib/docker/containers/5a5e1a583f1b4716132481314ea3f952525cb0793929674e3df0f7e3538abb48/shm
overlay 37G 36G 0 100% /var/lib/docker/overlay/d94db1e18b8e043b9d97680d94b53164a101730eaa5f71ae7b4d057ec4c532db/merged
shm 64M 0 64M 0% /var/lib/docker/containers/26207b8311df8673da972482482ca3752fbe6c43e0ff006fc0030a577ae8986f/shm
overlay 37G 36G 0 100% /var/lib/docker/overlay/ea6389ea6cf21436950682bd3cb350925a73acceb32ec638ae83df0e528f14d0/merged
shm 64M 0 64M 0% /var/lib/docker/containers/8b38d65f92a9656eea85189c3c7cb7173d99f3219f65201848a6330f48408860/shm
overlay 37G 36G 0 100% /var/lib/docker/overlay/346b0464d310e8731888cc825120163743b2c25ad0e7d36f7471d527d49c6dd3/merged
shm 64M 0 64M 0% /var/lib/docker/containers/fa1cca808208d5777216892a7016266447a2f04ede5c4f787f554e4c8a99a03e/shm
tmpfs 1.5G 0 1.5G 0% /run/user/500
And from the logs:
Aug 17 08:59:04 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Main process exited, code=exited, status=1/FAILURE
Aug 17 08:59:04 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Unit entered failed state.
Aug 17 08:59:04 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Failed with result 'exit-code'.
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Service hold-off time over, scheduling restart.
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: Stopped Docker GC: periodically garbage collects Docker containers and images.
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: Started Docker GC: periodically garbage collects Docker containers and images.
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal docker-gc[13495]: /opt/mesosphere/packages/docker-gc--59a98ed6446a084bf74e4ff4b8e3479f59ea8528/docker-gc: line 67: echo: write error: No space left on device
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Main process exited, code=exited, status=1/FAILURE
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Unit entered failed state.
Aug 17 08:59:24 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Failed with result 'exit-code'.
Aug 17 08:59:44 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: dcos-docker-gc.service: Service hold-off time over, scheduling restart.
Aug 17 08:59:44 ip-10-0-3-232.eu-west-1.compute.internal systemd[1]: Stopped Docker GC: periodically garbage collects Docker containers and images.
@dotemacs
Copy link
Author

 # /opt/mesosphere/packages/docker-gc--59a98ed6446a084bf74e4ff4b8e3479f59ea8528/docker-gc
Container running 26207b8311df8673da972482482ca3752fbe6c43e0ff006fc0030a577ae8986f /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.d831780a-5c8d-4381-9ff0-39c543f93ecf
Container running 5a5e1a583f1b4716132481314ea3f952525cb0793929674e3df0f7e3538abb48 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.cfc38f6b-ee4f-4f98-a6e5-a347934c46c8
Container running 68d555ef0b445343fa8f75815a326c6718a69e8fb384d614ff168412b058bd74 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.e847fef7-8771-4b0d-98f7-5e30ba799fed
Container running 8b38d65f92a9656eea85189c3c7cb7173d99f3219f65201848a6330f48408860 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.a753fdb5-93df-4a4c-b2c2-858332c2522e
Container running 9a2df972bc13bb503ace95d0a55bca6db869a9608faacc50430f802464692136 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.6eb5760e-7306-424a-866a-2e7e63d75072
Container running fa1cca808208d5777216892a7016266447a2f04ede5c4f787f554e4c8a99a03e /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.0d18b1f5-60ae-49bc-aa46-8f417a208e7e
Container not running 146e28f9a1d0646279caa734b54fbb47c4c9a66e1f5b0b5bb1967a1947d9e410 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.0d7b0755-d524-4533-bc3e-0a93ed554663
Container not running 244fc99a9801de5776c3eb99527df41a8a4b10a4e05ba02ae822011e51aab112 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.27ae756a-e1e4-42e9-9ead-03f0622c374c
Container not running 40551e2ef3e0e722d3a8e20358b77f435c0a82b00d9a58316dd9ee4c3011884e /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.46d46cce-e771-42a9-9ed7-6972d3d109ae
Container not running 95a6d88ced2f6e2b757c5b9e6f0f9a1db78341fd72bd50435de5c90603171312 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.a3af68c5-0350-4755-9ada-10cc14827f6e
Container not running a764e0a538d5b27e35b278232d66ef1629f60e9013aecb35d5a65f5f90a3c665 /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.9133efdc-84cd-4a0f-b29b-0e8d16d8a397
Container not running d6eae2c68d305b31270068415ff31c21b5a3feb427a00a61a0adaae0e6f0bb0e /mesos-c1785622-bc44-401a-b79b-3fa7e548ecc2-S24.68041b5f-baaf-4c61-a29e-738e67158c4b

@dotemacs
Copy link
Author

# df -h
Filesystem       Size  Used Avail Use% Mounted on
devtmpfs         7.4G     0  7.4G   0% /dev
tmpfs            7.4G     0  7.4G   0% /dev/shm
tmpfs            7.4G  808K  7.4G   1% /run
tmpfs            7.4G     0  7.4G   0% /sys/fs/cgroup
/dev/xvda9       5.5G  2.3G  3.0G  43% /
/dev/mapper/usr  985M  625M  309M  67% /usr
/dev/xvda1       128M   39M   90M  31% /boot
tmpfs            7.4G  140K  7.4G   1% /tmp
tmpfs            7.4G     0  7.4G   0% /media
/dev/xvda6       108M   64K   99M   1% /usr/share/oem
/dev/xvdb         37G   34G  991M  98% /var/lib
overlay           37G   34G  991M  98% /var/lib/docker/overlay/547b76cafcacb9cb3df12537eada117f079cfe7fa449bd7f35f0fd4a6eac5a93/merged
shm               64M     0   64M   0% /var/lib/docker/containers/68d555ef0b445343fa8f75815a326c6718a69e8fb384d614ff168412b058bd74/shm
overlay           37G   34G  991M  98% /var/lib/docker/overlay/e4e3804dcb7b05428ce2999a951047d77122c5304dd1fb5c0ad3d444f033b40b/merged
shm               64M     0   64M   0% /var/lib/docker/containers/5a5e1a583f1b4716132481314ea3f952525cb0793929674e3df0f7e3538abb48/shm
overlay           37G   34G  991M  98% /var/lib/docker/overlay/d94db1e18b8e043b9d97680d94b53164a101730eaa5f71ae7b4d057ec4c532db/merged
shm               64M     0   64M   0% /var/lib/docker/containers/26207b8311df8673da972482482ca3752fbe6c43e0ff006fc0030a577ae8986f/shm
overlay           37G   34G  991M  98% /var/lib/docker/overlay/ea6389ea6cf21436950682bd3cb350925a73acceb32ec638ae83df0e528f14d0/merged
shm               64M     0   64M   0% /var/lib/docker/containers/8b38d65f92a9656eea85189c3c7cb7173d99f3219f65201848a6330f48408860/shm
overlay           37G   34G  991M  98% /var/lib/docker/overlay/346b0464d310e8731888cc825120163743b2c25ad0e7d36f7471d527d49c6dd3/merged
shm               64M     0   64M   0% /var/lib/docker/containers/fa1cca808208d5777216892a7016266447a2f04ede5c4f787f554e4c8a99a03e/shm
tmpfs            1.5G     0  1.5G   0% /run/user/500
overlay           37G   34G  991M  98% /var/lib/docker/overlay/2c406c8ecca6961c64788648418ae8edc86ef1b1b7ad78a3b4718d0162daf1ee/merged
shm               64M     0   64M   0% /var/lib/docker/containers/9a2df972bc13bb503ace95d0a55bca6db869a9608faacc50430f802464692136/shm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment