Skip to content

Instantly share code, notes, and snippets.

@alexcpn
Created April 13, 2022 11:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save alexcpn/540c95e6a3c96d77957bad7ea3bf320a to your computer and use it in GitHub Desktop.
Save alexcpn/540c95e6a3c96d77957bad7ea3bf320a to your computer and use it in GitHub Desktop.
```
^Croot@balamurugan-VirtualBox:~# kubectl logs rook-ceph-osd-8-ccb58986d-5bm22 -n rook-ceph -f
debug 2022-04-13T08:55:05.330+0000 7f580cf7af40 0 set uid:gid to 167:167 (ceph:ceph)
debug 2022-04-13T08:55:05.330+0000 7f580cf7af40 0 ceph version 15.2.4 (7447c15c6ff58d7fce91843b705a268a1917325c) octopus (stable), process ceph-osd, pid 1
debug 2022-04-13T08:55:05.330+0000 7f580cf7af40 0 pidfile_write: ignore empty --pid-file
debug 2022-04-13T08:55:05.331+0000 7f580cf7af40 1 bdev create path /var/lib/ceph/osd/ceph-8/block type kernel
debug 2022-04-13T08:55:05.331+0000 7f580cf7af40 1 bdev(0x56533512c000 /var/lib/ceph/osd/ceph-8/block) open path /var/lib/ceph/osd/ceph-8/block
debug 2022-04-13T08:55:05.331+0000 7f580cf7af40 -1 bdev(0x56533512c000 /var/lib/ceph/osd/ceph-8/block) _aio_start io_setup(2) failed with EAGAIN; try increasing /proc/sys/fs/aio-max-nr
debug 2022-04-13T08:55:05.332+0000 7f580cf7af40 0 starting osd.8 osd_data /var/lib/ceph/osd/ceph-8 /var/lib/ceph/osd/ceph-8/journal
debug 2022-04-13T08:55:05.332+0000 7f580cf7af40 -1 Falling back to public interface
debug 2022-04-13T08:55:05.339+0000 7f580cf7af40 0 load: jerasure load: lrc load: isa
debug 2022-04-13T08:55:05.339+0000 7f580cf7af40 1 bdev create path /var/lib/ceph/osd/ceph-8/block type kernel
debug 2022-04-13T08:55:05.339+0000 7f580cf7af40 1 bdev(0x56533512c000 /var/lib/ceph/osd/ceph-8/block) open path /var/lib/ceph/osd/ceph-8/block
debug 2022-04-13T08:55:05.340+0000 7f580cf7af40 -1 bdev(0x56533512c000 /var/lib/ceph/osd/ceph-8/block) _aio_start io_setup(2) failed with EAGAIN; try increasing /proc/sys/fs/aio-max-nr
debug 2022-04-13T08:55:05.340+0000 7f580cf7af40 0 osd.8:0.OSDShard using op scheduler ClassedOpQueueScheduler(queue=WeightedPriorityQueue, cutoff=196)
debug 2022-04-13T08:55:05.340+0000 7f580cf7af40 0 osd.8:1.OSDShard using op scheduler ClassedOpQueueScheduler(queue=WeightedPriorityQueue, cutoff=196)
debug 2022-04-13T08:55:05.340+0000 7f580cf7af40 0 osd.8:2.OSDShard using op scheduler ClassedOpQueueScheduler(queue=WeightedPriorityQueue, cutoff=196)
debug 2022-04-13T08:55:05.340+0000 7f580cf7af40 0 osd.8:3.OSDShard using op scheduler ClassedOpQueueScheduler(queue=WeightedPriorityQueue, cutoff=196)
debug 2022-04-13T08:55:05.340+0000 7f580cf7af40 0 osd.8:4.OSDShard using op scheduler ClassedOpQueueScheduler(queue=WeightedPriorityQueue, cutoff=196)
debug 2022-04-13T08:55:05.353+0000 7f580cf7af40 1 bluestore(/var/lib/ceph/osd/ceph-8) _mount path /var/lib/ceph/osd/ceph-8
debug 2022-04-13T08:55:05.354+0000 7f580cf7af40 1 bdev create path /var/lib/ceph/osd/ceph-8/block type kernel
debug 2022-04-13T08:55:05.354+0000 7f580cf7af40 1 bdev(0x56533512c000 /var/lib/ceph/osd/ceph-8/block) open path /var/lib/ceph/osd/ceph-8/block
debug 2022-04-13T08:55:05.354+0000 7f580cf7af40 -1 bdev(0x56533512c000 /var/lib/ceph/osd/ceph-8/block) _aio_start io_setup(2) failed with EAGAIN; try increasing /proc/sys/fs/aio-max-nr
debug 2022-04-13T08:55:05.354+0000 7f580cf7af40 -1 osd.8 0 OSD:init: unable to mount object store
debug 2022-04-13T08:55:05.354+0000 7f580cf7af40 -1 ** ERROR: osd init failed: (11) Resource temporarily unavailable
```
To overcome this, you need to increase the value of fs.aio-max-nr of your sysctl configuration (typically /etc/sysctl.conf). You can do this with your favorite configuration management system.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment