Skip to content

Instantly share code, notes, and snippets.

@Vicente-Cheng

Vicente-Cheng/ceph-disk prepare log

Created October 13, 2015 02:17
Show Gist options
  • Save Vicente-Cheng/f1754b4268bbadc541b5 to your computer and use it in GitHub Desktop.
Save Vicente-Cheng/f1754b4268bbadc541b5 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
ceph-disk prepare log
# ceph-disk -v prepare --osd-uuid 0ce28232-6d5d-11e5-aec3-fa163e5c167b --journal-uuid 0ce28a16-6d5d-11e5-aec3-fa163e5c167b --dmcrypt /dev/vdb
DEBUG:ceph-disk:does /usr/bin/ceph-osd exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-osd exists
INFO:ceph-disk:Running command: /usr/bin/ceph-osd --check-allows-journal -i 0 --cluster ceph
DEBUG:ceph-disk:does /usr/bin/ceph-osd exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-osd exists
INFO:ceph-disk:Running command: /usr/bin/ceph-osd --check-wants-journal -i 0 --cluster ceph
DEBUG:ceph-disk:does /usr/bin/ceph-osd exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-osd exists
INFO:ceph-disk:Running command: /usr/bin/ceph-osd --check-needs-journal -i 0 --cluster ceph
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:does /usr/bin/ceph-osd exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-osd exists
INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_type
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_type
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
DEBUG:ceph-disk:does /usr/bin/ceph-osd exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-osd exists
INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_cryptsetup_parameters
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_dmcrypt_key_size
DEBUG:ceph-disk:does /usr/bin/ceph-conf exists ?
DEBUG:ceph-disk:yes, /usr/bin/ceph-conf exists
INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_dmcrypt_type
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
INFO:ceph-disk:Will colocate journal with data on /dev/vdb
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:Creating journal partition num 2 size 100 on /dev/vdb
DEBUG:ceph-disk:does /usr/bin/sgdisk exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/sgdisk exists ?
DEBUG:ceph-disk:does /usr/local/sbin/sgdisk exists ?
DEBUG:ceph-disk:does /sbin/sgdisk exists ?
DEBUG:ceph-disk:yes, /sbin/sgdisk exists
INFO:ceph-disk:Running command: /sbin/sgdisk --new=2:0:100M --change-name=2:ceph journal --partition-guid=2:0ce28a16-6d5d-11e5-aec3-fa163e5c167b --typecode=2:89c57f98-2fe5-4dc0-89c1-35865ceff2be --mbrtogpt -- /dev/vdb
The operation has completed successfully.
DEBUG:ceph-disk:Calling partprobe on prepared device /dev/vdb
DEBUG:ceph-disk:does /usr/bin/udevadm exists ?
DEBUG:ceph-disk:yes, /usr/bin/udevadm exists
INFO:ceph-disk:Running command: /usr/bin/udevadm settle
DEBUG:ceph-disk:does /usr/bin/partprobe exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/partprobe exists ?
DEBUG:ceph-disk:does /usr/local/sbin/partprobe exists ?
DEBUG:ceph-disk:does /sbin/partprobe exists ?
DEBUG:ceph-disk:yes, /sbin/partprobe exists
INFO:ceph-disk:Running command: /sbin/partprobe /dev/vdb
DEBUG:ceph-disk:does /usr/bin/udevadm exists ?
DEBUG:ceph-disk:yes, /usr/bin/udevadm exists
INFO:ceph-disk:Running command: /usr/bin/udevadm settle
DEBUG:ceph-disk:Journal is GPT partition /dev/mapper/0ce28a16-6d5d-11e5-aec3-fa163e5c167b
DEBUG:ceph-disk:does /usr/bin/sgdisk exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/sgdisk exists ?
DEBUG:ceph-disk:does /usr/local/sbin/sgdisk exists ?
DEBUG:ceph-disk:does /sbin/sgdisk exists ?
DEBUG:ceph-disk:yes, /sbin/sgdisk exists
INFO:ceph-disk:Running command: /sbin/sgdisk --typecode=2:45b0969e-9b03-4f30-b4c6-5ec00ceff106 -- /dev/vdb
The operation has completed successfully.
DEBUG:ceph-disk:Journal is GPT partition /dev/mapper/0ce28a16-6d5d-11e5-aec3-fa163e5c167b
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:Creating osd partition on /dev/vdb
DEBUG:ceph-disk:does /usr/bin/sgdisk exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/sgdisk exists ?
DEBUG:ceph-disk:does /usr/local/sbin/sgdisk exists ?
DEBUG:ceph-disk:does /sbin/sgdisk exists ?
DEBUG:ceph-disk:yes, /sbin/sgdisk exists
INFO:ceph-disk:Running command: /sbin/sgdisk --largest-new=1 --change-name=1:ceph data --partition-guid=1:0ce28232-6d5d-11e5-aec3-fa163e5c167b --typecode=1:89c57f98-2fe5-4dc0-89c1-5ec00ceff2be -- /dev/vdb
Warning: The kernel is still using the old partition table.
The new table will be used at the next reboot.
The operation has completed successfully.
DEBUG:ceph-disk:Calling partprobe on created device /dev/vdb
DEBUG:ceph-disk:does /usr/bin/udevadm exists ?
DEBUG:ceph-disk:yes, /usr/bin/udevadm exists
INFO:ceph-disk:Running command: /usr/bin/udevadm settle
DEBUG:ceph-disk:does /usr/bin/partprobe exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/partprobe exists ?
DEBUG:ceph-disk:does /usr/local/sbin/partprobe exists ?
DEBUG:ceph-disk:does /sbin/partprobe exists ?
DEBUG:ceph-disk:yes, /sbin/partprobe exists
INFO:ceph-disk:Running command: /sbin/partprobe /dev/vdb
DEBUG:ceph-disk:does /usr/bin/udevadm exists ?
DEBUG:ceph-disk:yes, /usr/bin/udevadm exists
INFO:ceph-disk:Running command: /usr/bin/udevadm settle
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:does /usr/bin/cryptsetup exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/cryptsetup exists ?
DEBUG:ceph-disk:does /usr/local/sbin/cryptsetup exists ?
DEBUG:ceph-disk:does /sbin/cryptsetup exists ?
DEBUG:ceph-disk:yes, /sbin/cryptsetup exists
INFO:ceph-disk:Running command: /sbin/cryptsetup --key-file /etc/ceph/dmcrypt-keys/0ce28232-6d5d-11e5-aec3-fa163e5c167b create 0ce28232-6d5d-11e5-aec3-fa163e5c167b /dev/vdb1 --key-size 256
DEBUG:ceph-disk:Creating xfs fs on /dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b
DEBUG:ceph-disk:does /usr/bin/mkfs exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/mkfs exists ?
DEBUG:ceph-disk:does /usr/local/sbin/mkfs exists ?
DEBUG:ceph-disk:does /sbin/mkfs exists ?
DEBUG:ceph-disk:yes, /sbin/mkfs exists
INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b
meta-data=/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b isize=2048 agcount=4, agsize=1042111 blks
= sectsz=512 attr=2, projid32bit=1
= crc=0 finobt=0
data = bsize=4096 blocks=4168443, imaxpct=25
= sunit=0 swidth=0 blks
naming =version 2 bsize=4096 ascii-ci=0 ftype=0
log =internal log bsize=4096 blocks=2560, version=2
= sectsz=512 sunit=0 blks, lazy-count=1
realtime =none extsz=4096 blocks=0, rtextents=0
DEBUG:ceph-disk:Mounting /dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b on /var/lib/ceph/tmp/mnt._SkL7j with options noatime,inode64
DEBUG:ceph-disk:does /usr/bin/mount exists ?
DEBUG:ceph-disk:yes, /usr/bin/mount exists
INFO:ceph-disk:Running command: /usr/bin/mount -t xfs -o noatime,inode64 -- /dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b /var/lib/ceph/tmp/mnt._SkL7j
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
INFO:ceph-disk:Running command: /sbin/restorecon /var/lib/ceph/tmp/mnt._SkL7j
DEBUG:ceph-disk:Preparing osd data dir /var/lib/ceph/tmp/mnt._SkL7j
DEBUG:ceph-disk:Creating symlink /var/lib/ceph/tmp/mnt._SkL7j/journal -> /dev/mapper/0ce28a16-6d5d-11e5-aec3-fa163e5c167b
DEBUG:ceph-disk:Creating symlink /var/lib/ceph/tmp/mnt._SkL7j/journal_dmcrypt -> /dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
INFO:ceph-disk:Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt._SkL7j/ceph_fsid.4169.tmp
DEBUG:ceph-disk:does /usr/bin/chown exists ?
DEBUG:ceph-disk:yes, /usr/bin/chown exists
INFO:ceph-disk:Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt._SkL7j/ceph_fsid.4169.tmp
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
INFO:ceph-disk:Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt._SkL7j/fsid.4169.tmp
DEBUG:ceph-disk:does /usr/bin/chown exists ?
DEBUG:ceph-disk:yes, /usr/bin/chown exists
INFO:ceph-disk:Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt._SkL7j/fsid.4169.tmp
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
INFO:ceph-disk:Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt._SkL7j/journal_uuid.4169.tmp
DEBUG:ceph-disk:does /usr/bin/chown exists ?
DEBUG:ceph-disk:yes, /usr/bin/chown exists
INFO:ceph-disk:Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt._SkL7j/journal_uuid.4169.tmp
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
INFO:ceph-disk:Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt._SkL7j/magic.4169.tmp
DEBUG:ceph-disk:does /usr/bin/chown exists ?
DEBUG:ceph-disk:yes, /usr/bin/chown exists
INFO:ceph-disk:Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt._SkL7j/magic.4169.tmp
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
DEBUG:ceph-disk:does /usr/bin/restorecon exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/restorecon exists ?
DEBUG:ceph-disk:does /usr/local/sbin/restorecon exists ?
DEBUG:ceph-disk:does /sbin/restorecon exists ?
DEBUG:ceph-disk:yes, /sbin/restorecon exists
INFO:ceph-disk:Running command: /sbin/restorecon -R /var/lib/ceph/tmp/mnt._SkL7j
DEBUG:ceph-disk:does /usr/bin/chown exists ?
DEBUG:ceph-disk:yes, /usr/bin/chown exists
INFO:ceph-disk:Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/tmp/mnt._SkL7j
DEBUG:ceph-disk:Unmounting /var/lib/ceph/tmp/mnt._SkL7j
INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt._SkL7j
/dev/vdb1
/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b
DEBUG:ceph-disk:does /usr/bin/cryptsetup exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/cryptsetup exists ?
DEBUG:ceph-disk:does /usr/local/sbin/cryptsetup exists ?
DEBUG:ceph-disk:does /sbin/cryptsetup exists ?
DEBUG:ceph-disk:yes, /sbin/cryptsetup exists
INFO:ceph-disk:Running command: /sbin/cryptsetup remove 0ce28232-6d5d-11e5-aec3-fa163e5c167b
device-mapper: remove ioctl on 0ce28232-6d5d-11e5-aec3-fa163e5c167b failed: Device or resource busy
device-mapper: remove ioctl on 0ce28232-6d5d-11e5-aec3-fa163e5c167b failed: Device or resource busy
semid 98304: semop failed for cookie 0xd4d199e: incorrect semaphore state
Failed to set a proper state for notification semaphore identified by cookie value 223156638 (0xd4d199e) to initialize waiting for incoming notifications.
DEBUG:ceph-disk:get_dm_uuid /dev/vdb uuid path is /sys/dev/block/253:16/dm/uuid
DEBUG:ceph-disk:does /usr/bin/sgdisk exists ?
DEBUG:ceph-disk:does /usr/lib64/ccache/sgdisk exists ?
DEBUG:ceph-disk:does /usr/local/sbin/sgdisk exists ?
DEBUG:ceph-disk:does /sbin/sgdisk exists ?
DEBUG:ceph-disk:yes, /sbin/sgdisk exists
INFO:ceph-disk:Running command: /sbin/sgdisk --typecode=1:4fbd7e29-9d25-41b8-afd0-5ec00ceff05d -- /dev/vdb
The operation has completed successfully.
Raw
udev debug log
version 208
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
restoring old watch on '/dev/vdb'
adding watch on '/dev/vdb'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
restoring old watch on '/dev/vdb'
adding watch on '/dev/vdb'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:04.0/virtio1/block/vda'
restoring old watch on '/dev/vda'
adding watch on '/dev/vda'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:08.0/virtio5/block/vdd'
restoring old watch on '/dev/vdd'
adding watch on '/dev/vdd'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:0a.0/virtio7/block/vdf'
restoring old watch on '/dev/vdf'
adding watch on '/dev/vdf'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:0b.0/virtio8/block/vdg'
restoring old watch on '/dev/vdg'
adding watch on '/dev/vdg'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:07.0/virtio4/block/vdc'
restoring old watch on '/dev/vdc'
adding watch on '/dev/vdc'
device 0x7f269e5b99a0 has devpath '/devices/pci0000:00/0000:00:04.0/virtio1/block/vda/vda1'
restoring old watch on '/dev/vda1'
adding watch on '/dev/vda1'
=== trie on-disk ===
tool version: 208
file size: 6345977 bytes
header size 80 bytes
strings 1401377 bytes
nodes 4944520 bytes
load module index
Skipping overridden file: /usr/lib/udev/rules.d/80-net-name-slot.rules.
read rules file: /usr/lib/udev/rules.d/10-dm.rules
read rules file: /usr/lib/udev/rules.d/11-dm-mpath.rules
read rules file: /usr/lib/udev/rules.d/13-dm-disk.rules
read rules file: /usr/lib/udev/rules.d/40-redhat.rules
read rules file: /usr/lib/udev/rules.d/42-usb-hid-pm.rules
read rules file: /usr/lib/udev/rules.d/50-rbd.rules
read rules file: /usr/lib/udev/rules.d/50-udev-default.rules
read rules file: /usr/lib/udev/rules.d/60-alias-kmsg.rules
read rules file: /usr/lib/udev/rules.d/60-cdrom_id.rules
read rules file: /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules
read rules file: /usr/lib/udev/rules.d/60-keyboard.rules
read rules file: /usr/lib/udev/rules.d/60-net.rules
read rules file: /usr/lib/udev/rules.d/60-persistent-alsa.rules
read rules file: /usr/lib/udev/rules.d/60-persistent-input.rules
read rules file: /usr/lib/udev/rules.d/60-persistent-serial.rules
read rules file: /usr/lib/udev/rules.d/60-persistent-storage-tape.rules
read rules file: /usr/lib/udev/rules.d/60-persistent-storage.rules
read rules file: /usr/lib/udev/rules.d/60-persistent-v4l.rules
read rules file: /usr/lib/udev/rules.d/60-raw.rules
read rules file: /usr/lib/udev/rules.d/61-accelerometer.rules
read rules file: /usr/lib/udev/rules.d/62-multipath.rules
read rules file: /usr/lib/udev/rules.d/64-btrfs.rules
read rules file: /usr/lib/udev/rules.d/70-power-switch.rules
read rules file: /usr/lib/udev/rules.d/70-uaccess.rules
read rules file: /usr/lib/udev/rules.d/71-seat.rules
read rules file: /usr/lib/udev/rules.d/73-idrac.rules
read rules file: /usr/lib/udev/rules.d/73-seat-late.rules
read rules file: /usr/lib/udev/rules.d/75-net-description.rules
read rules file: /usr/lib/udev/rules.d/75-probe_mtd.rules
read rules file: /usr/lib/udev/rules.d/75-tty-description.rules
read rules file: /usr/lib/udev/rules.d/78-sound-card.rules
read rules file: /usr/lib/udev/rules.d/80-drivers.rules
skip empty file: /etc/udev/rules.d/80-net-name-slot.rules
read rules file: /usr/lib/udev/rules.d/81-kvm-rhel.rules
read rules file: /usr/lib/udev/rules.d/90-vconsole.rules
read rules file: /usr/lib/udev/rules.d/91-drm-modeset.rules
read rules file: /usr/lib/udev/rules.d/95-ceph-osd.rules
read rules file: /usr/lib/udev/rules.d/95-dm-notify.rules
read rules file: /usr/lib/udev/rules.d/95-udev-late.rules
read rules file: /usr/lib/udev/rules.d/98-kexec.rules
read rules file: /usr/lib/udev/rules.d/99-systemd.rules
rules contain 24576 bytes tokens (2048 * 12 bytes), 11569 bytes strings
1743 strings (22587 bytes), 1173 de-duplicated (11589 bytes), 571 trie nodes used
set children_max to 16
validate module index
device 0x7f269e5c5b50 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2098 queued, 'change' 'block'
seq 2098 forked new worker [4203]
seq 2098 running
device 0x7f269e5b1300 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
device 0x7f269e5c8b90 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2099 queued, 'change' 'block'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4205] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c4760 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5c0480 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5caa40 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4207] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2098 processed with 0
seq 2098 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2099 running
device 0x7f269e5bfbe0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4209] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c90d0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5c3960 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bdd10 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4210] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2099 processed with 0
seq 2099 done with 0
seq 2100 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2100 running
device 0x7f269e5bdd10 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
seq 2101 queued, 'add' 'block'
udevd message (SYNC) received
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4213] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c3960 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5b1300 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5c90d0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4217] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2100 processed with 0
seq 2100 done with 0
passed 238 bytes to netlink monitor 0x7f269e5b1300
seq 2101 running
no db file to read /run/udev/data/b253:18: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
device 0x7f269e5b1720 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5b1720 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb2' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb2'
'/sbin/blkid -o udev -p /dev/vdb2' [4218] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part2' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb2 raid offset=0
LINK 'disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20journal' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
handling device node '/dev/vdb2', devnum=b253:18, mode=0660, uid=0, gid=6
set permissions /dev/vdb2, 060660, uid=0, gid=6
creating symlink '/dev/block/253:18' to '../vdb2'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '/dev/vdb2'
creating symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '../../vdb2'
creating link '/dev/disk/by-partlabel/ceph\x20journal' to '/dev/vdb2'
creating symlink '/dev/disk/by-partlabel/ceph\x20journal' to '../../vdb2'
creating link '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb2'
creating symlink '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
adding watch on '/dev/vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2101 processed with 0
seq 2101 done with 0
device 0x7f269e5c93e0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2102 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2103 queued, 'change' 'block'
seq 2102 running
device 0x7f269e5b1720 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
device 0x7f269e5bf070 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2104 queued, 'change' 'block'
device 0x7f269e5bd9d0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2105 queued, 'change' 'block'
device 0x7f269e5c8570 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
inotify event: 8000 for /dev/vdb2
device 0x7f269e5c8570 filled with db file data
removing watch on '/dev/vdb2'
seq 2106 queued, 'remove' 'block'
seq 2107 queued, 'add' 'block'
device 0x7f269e5c0240 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2108 queued, 'change' 'block'
udevd message (SYNC) received
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4221] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bdcf0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5c90d0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5c3bf0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4224] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2102 processed with 0
seq 2102 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2103 running
device 0x7f269e5bdcf0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4226] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bd760 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bd9d0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bc040 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4228] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2103 processed with 0
seq 2103 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2104 running
device 0x7f269e5bd9d0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4230] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bd760 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bdcf0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bf8c0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4232] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2104 processed with 0
validate module index
seq 2104 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2105 running
device 0x7f269e5bc040 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4234] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bf8a0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bf070 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5c39d0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4236] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2105 processed with 0
seq 2105 done with 0
passed 241 bytes to netlink monitor 0x7f269e5b1300
seq 2106 running
device 0x7f269e5bc040 filled with db file data
removing watch on '/dev/vdb2'
device 0x7f269e5c39d0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5c39d0 filled with db file data
no reference left, remove '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2'
no reference left, remove '/dev/disk/by-partlabel/ceph\x20journal'
no reference left, remove '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2106 processed with 0
seq 2106 done with 0
passed 238 bytes to netlink monitor 0x7f269e5b1300
seq 2107 running
no db file to read /run/udev/data/b253:18: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
device 0x7f269e5bc040 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5bc040 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb2' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb2'
'/sbin/blkid -o udev -p /dev/vdb2' [4238] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part2' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb2 raid offset=0
LINK 'disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20journal' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
handling device node '/dev/vdb2', devnum=b253:18, mode=0660, uid=0, gid=6
set permissions /dev/vdb2, 060660, uid=0, gid=6
creating symlink '/dev/block/253:18' to '../vdb2'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '/dev/vdb2'
creating symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '../../vdb2'
creating link '/dev/disk/by-partlabel/ceph\x20journal' to '/dev/vdb2'
creating symlink '/dev/disk/by-partlabel/ceph\x20journal' to '../../vdb2'
creating link '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb2'
creating symlink '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
adding watch on '/dev/vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2107 processed with 0
seq 2107 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2108 running
device 0x7f269e5bc040 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4240] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bf8a0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bd9d0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bf360 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4243] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2108 processed with 0
seq 2108 done with 0
device 0x7f269e5c0240 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2109 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2109 running
device 0x7f269e5bd9d0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
seq 2110 queued, 'change' 'block'
starting '/sbin/blkid -o udev -p /dev/vdb'
device 0x7f269e5c8670 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2111 queued, 'change' 'block'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4245] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bf880 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5c39b0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bd5c0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4248] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2109 processed with 0
seq 2109 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2110 running
device 0x7f269e5bd580 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4250] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bcdc0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bf820 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bfe10 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4251] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2110 processed with 0
seq 2110 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2111 running
device 0x7f269e5bf800 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4252] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c39b0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5c3360 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5b96f0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4254] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2111 processed with 0
seq 2111 done with 0
device 0x7f269e5c8670 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
inotify event: 8000 for (null)
seq 2112 queued, 'remove' 'block'
passed 241 bytes to netlink monitor 0x7f269e5b1300
seq 2112 running
device 0x7f269e5bf800 filled with db file data
removing watch on '/dev/vdb2'
device 0x7f269e5b96f0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5b96f0 filled with db file data
no reference left, remove '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2'
no reference left, remove '/dev/disk/by-partlabel/ceph\x20journal'
no reference left, remove '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2112 processed with 0
seq 2112 done with 0
seq 2113 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2113 running
device 0x7f269e5c3740 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
seq 2114 queued, 'add' 'block'
device 0x7f269e5b9b80 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2115 queued, 'change' 'block'
device 0x7f269e5bda90 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2116 queued, 'change' 'block'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4258] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5b96f0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bf800 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bc040 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4263] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2113 processed with 0
seq 2113 done with 0
passed 238 bytes to netlink monitor 0x7f269e5b1300
seq 2114 running
no db file to read /run/udev/data/b253:18: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
device 0x7f269e5bc040 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5bc040 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb2' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb2'
'/sbin/blkid -o udev -p /dev/vdb2' [4264] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part2' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb2 raid offset=0
LINK 'disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20journal' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
OWNER 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
GROUP 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
MODE 0660 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
RUN '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/$name' /usr/lib/udev/rules.d/95-ceph-osd.rules:44
handling device node '/dev/vdb2', devnum=b253:18, mode=0660, uid=1001, gid=1001
set permissions /dev/vdb2, 060660, uid=1001, gid=1001
creating symlink '/dev/block/253:18' to '../vdb2'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '/dev/vdb2'
creating symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '../../vdb2'
creating link '/dev/disk/by-partlabel/ceph\x20journal' to '/dev/vdb2'
creating symlink '/dev/disk/by-partlabel/ceph\x20journal' to '../../vdb2'
creating link '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb2'
creating symlink '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
starting '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: main_trigger: Namespace(dev='/dev/vdb2', func=<function main_trigger at 0x2263de8>, log_stdout=True, prepend_to_path='/usr/bin', prog='ceph-disk', statedir='/var/lib/ceph', sync=None, sysconfdir='/etc/ceph', verbose=True)'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: systemd detected, triggering ceph-disk@/dev/vdb2.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: does /usr/bin/systemctl exists ?'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: yes, /usr/bin/systemctl exists'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: Running command: /usr/bin/systemctl --no-block restart ceph-disk@/dev/vdb2.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2' [4265] exit with return code 0
adding watch on '/dev/vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2114 processed with 0
validate module index
seq 2114 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2115 running
device 0x7f269e5c3740 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4281] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c4e40 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bcc60 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bc290 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4283] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2115 processed with 0
seq 2115 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2116 running
device 0x7f269e5c33a0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4284] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bc4e0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bcc60 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5c4e40 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4286] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2116 processed with 0
seq 2116 done with 0
udevd message (SYNC) received
device 0x7f269e5bda90 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2117 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2118 queued, 'change' 'block'
seq 2117 running
device 0x7f269e5c33a0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
device 0x7f269e5bf070 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2119 queued, 'change' 'block'
device 0x7f269e5b96f0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
inotify event: 8 for /dev/vdb
device /dev/vdb closed, synthesising 'change'
seq 2120 queued, 'change' 'block'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4296] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c4e40 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bc040 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bc4a0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4298] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2117 processed with 0
seq 2117 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2118 running
device 0x7f269e5bc040 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4300] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5c4e40 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5c3330 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bfbe0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4302] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2118 processed with 0
seq 2118 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2119 running
device 0x7f269e5c3330 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4303] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bf800 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bcc40 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bdcf0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
device 0x7f269e5bf800 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
inotify event: 8000 for /dev/vdb2
device 0x7f269e5bf800 filled with db file data
removing watch on '/dev/vdb2'
seq 2121 queued, 'remove' 'block'
seq 2122 queued, 'add' 'block'
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
seq 2123 queued, 'add' 'block'
seq 2124 queued, 'change' 'block'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4304] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
udevd message (SYNC) received
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2119 processed with 0
seq 2119 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2120 running
device 0x7f269e5bf800 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4306] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bfbe0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bf390 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bdbe0 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4311] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2120 processed with 0
seq 2120 done with 0
passed 241 bytes to netlink monitor 0x7f269e5b1300
seq 2121 running
device 0x7f269e5bfbe0 filled with db file data
removing watch on '/dev/vdb2'
seq 2122 forked new worker [4312]
device 0x7f269e5b1300 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5b1300 filled with db file data
no reference left, remove '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2'
no reference left, remove '/dev/disk/by-partlabel/ceph\x20journal'
no reference left, remove '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2121 processed with 0
seq 2121 done with 0
passed 238 bytes to netlink monitor 0x7f269e5b1300
seq 2122 running
seq 2123 running
no db file to read /run/udev/data/b253:17: No such file or directory
no db file to read /run/udev/data/b253:18: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
device 0x7f269e5c3290 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5c05b0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5c3290 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb2' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
device 0x7f269e5c05b0 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb1' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb2'
starting '/sbin/blkid -o udev -p /dev/vdb1'
'/sbin/blkid -o udev -p /dev/vdb2' [4313] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part2' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb2 raid offset=0
'/sbin/blkid -o udev -p /dev/vdb1' [4314] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part1' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb1 raid offset=0
LINK 'disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20journal' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
OWNER 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
GROUP 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
MODE 0660 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
RUN '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/$name' /usr/lib/udev/rules.d/95-ceph-osd.rules:44
handling device node '/dev/vdb2', devnum=b253:18, mode=0660, uid=1001, gid=1001
set permissions /dev/vdb2, 060660, uid=1001, gid=1001
creating symlink '/dev/block/253:18' to '../vdb2'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '/dev/vdb2'
creating symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '../../vdb2'
creating link '/dev/disk/by-partlabel/ceph\x20journal' to '/dev/vdb2'
creating symlink '/dev/disk/by-partlabel/ceph\x20journal' to '../../vdb2'
creating link '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb2'
creating symlink '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
starting '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'
LINK 'disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20data' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
handling device node '/dev/vdb1', devnum=b253:17, mode=0660, uid=0, gid=6
set permissions /dev/vdb1, 060660, uid=0, gid=6
creating symlink '/dev/block/253:17' to '../vdb1'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1' to '/dev/vdb1'
creating symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1' to '../../vdb1'
creating link '/dev/disk/by-partlabel/ceph\x20data' to '/dev/vdb1'
creating symlink '/dev/disk/by-partlabel/ceph\x20data' to '../../vdb1'
creating link '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb1'
creating symlink '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb1'
created db file '/run/udev/data/b253:17' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
adding watch on '/dev/vdb1'
created db file '/run/udev/data/b253:17' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
passed -1 bytes to netlink monitor 0x7f269e5c0240
seq 2122 processed with 0
seq 2122 done with 0
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: main_trigger: Namespace(dev='/dev/vdb2', func=<function main_trigger at 0x231ede8>, log_stdout=True, prepend_to_path='/usr/bin', prog='ceph-disk', statedir='/var/lib/ceph', sync=None, sysconfdir='/etc/ceph', verbose=True)'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: systemd detected, triggering ceph-disk@/dev/vdb2.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: does /usr/bin/systemctl exists ?'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: yes, /usr/bin/systemctl exists'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: Running command: /usr/bin/systemctl --no-block restart ceph-disk@/dev/vdb2.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2' [4321] exit with return code 0
adding watch on '/dev/vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2123 processed with 0
seq 2123 done with 0
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2124 running
device 0x7f269e5b1300 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4328] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5b1720 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bcbd0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bf270 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4329] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2124 processed with 0
seq 2124 done with 0
device 0x7f269e5c04a0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
inotify event: 8 for /dev/vdb1
device /dev/vdb1 closed, synthesising 'change'
seq 2125 queued, 'add' 'bdi'
passed 152 bytes to netlink monitor 0x7f269e5b1300
seq 2126 queued, 'change' 'block'
passed 241 bytes to netlink monitor 0x7f269e5b1300
seq 2126 running
device 0x7f269e5c05b0 filled with db file data
removing watch on '/dev/vdb1'
seq 2125 running
no db file to read /run/udev/data/+bdi:252:0: No such file or directory
device 0x7f269e5bfbe0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2125 processed with 0
device 0x7f269e5bfbe0 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb1' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
seq 2125 done with 0
seq 2127 queued, 'add' 'block'
passed 204 bytes to netlink monitor 0x7f269e5b1300
seq 2127 running
no db file to read /run/udev/data/b252:0: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
IMPORT '/sbin/blkid -o udev -p /dev/dm-0' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
seq 2128 queued, 'add' 'slab'
starting '/sbin/blkid -o udev -p /dev/dm-0'
seq 2128 forked new worker [4339]
seq 2129 queued, 'change' 'block'
starting '/sbin/blkid -o udev -p /dev/vdb1'
seq 2128 running
no db file to read /run/udev/data/+slab::t-0000896: No such file or directory
device 0x7f269e5b1720 has devpath '/kernel/slab'
passed -1 bytes to netlink monitor 0x7f269e5bd9d0
seq 2128 processed with 0
seq 2128 done with 0
'/sbin/blkid -o udev -p /dev/vdb1' [4333] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part1' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb1 raid offset=0
LINK 'disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20data' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
handling device node '/dev/vdb1', devnum=b253:17, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:17' to '../vdb1'
found 'b253:17' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9-part1'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1' to '/dev/vdb1'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1' to '../../vdb1'
found 'b253:17' claiming '/run/udev/links/\x2fdisk\x2fby-partlabel\x2fceph\x5cx20data'
creating link '/dev/disk/by-partlabel/ceph\x20data' to '/dev/vdb1'
preserve already existing symlink '/dev/disk/by-partlabel/ceph\x20data' to '../../vdb1'
found 'b253:17' claiming '/run/udev/links/\x2fdisk\x2fby-partuuid\x2f0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb1'
preserve already existing symlink '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb1'
created db file '/run/udev/data/b253:17' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
adding watch on '/dev/vdb1'
created db file '/run/udev/data/b253:17' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
passed -1 bytes to netlink monitor 0x7f269e5c0240
seq 2126 processed with 0
seq 2126 done with 0
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID=5f22b8bc-0704-4217-85bd-55de53f91cf4'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID_ENC=5f22b8bc-0704-4217-85bd-55de53f91cf4'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_TYPE=xfs'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_USAGE=filesystem'
'/sbin/blkid -o udev -p /dev/dm-0' [4338] exit with return code 0
PROGRAM '/sbin/multipath -c /dev/dm-0' /usr/lib/udev/rules.d/62-multipath.rules:15
starting '/sbin/multipath -c /dev/dm-0'
'/sbin/multipath -c /dev/dm-0'(out) 'Oct 13 01:42:17 | the -c option requires a path to check'
'/sbin/multipath -c /dev/dm-0' [4365] exit with return code 1
handling device node '/dev/dm-0', devnum=b252:0, mode=0660, uid=0, gid=6
preserve permissions /dev/dm-0, 060660, uid=0, gid=6
preserve already existing symlink '/dev/block/252:0' to '../dm-0'
created db file '/run/udev/data/b252:0' for '/devices/virtual/block/dm-0'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2127 processed with 0
seq 2127 done with 0
passed 225 bytes to netlink monitor 0x7f269e5b1300
seq 2129 running
device 0x7f269e5bdb90 filled with db file data
IMPORT '/usr/sbin/dmsetup udevflags 4224415' /usr/lib/udev/rules.d/10-dm.rules:39
starting '/usr/sbin/dmsetup udevflags 4224415'
'/usr/sbin/dmsetup udevflags 4224415'(out) 'DM_UDEV_PRIMARY_SOURCE_FLAG='1''
'/usr/sbin/dmsetup udevflags 4224415' [4367] exit with return code 0
LINK 'mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/10-dm.rules:121
LINK 'disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/13-dm-disk.rules:17
LINK 'disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/13-dm-disk.rules:18
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/13-dm-disk.rules:23
probe /dev/dm-0 raid offset=0
LINK 'disk/by-uuid/5f22b8bc-0704-4217-85bd-55de53f91cf4' /usr/lib/udev/rules.d/13-dm-disk.rules:25
IMPORT '/sbin/blkid -o udev -p /dev/dm-0' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/dm-0'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID=5f22b8bc-0704-4217-85bd-55de53f91cf4'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID_ENC=5f22b8bc-0704-4217-85bd-55de53f91cf4'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_TYPE=xfs'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_USAGE=filesystem'
'/sbin/blkid -o udev -p /dev/dm-0' [4371] exit with return code 0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/dm-0' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/dm-0'
'/sbin/multipath -T 1444642445: -c /dev/dm-0' [4373] exit with return code 1
RUN '/usr/sbin/dmsetup udevcomplete $env{DM_COOKIE}' /usr/lib/udev/rules.d/95-dm-notify.rules:12
handling device node '/dev/dm-0', devnum=b252:0, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/252:0' to '../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fdm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fdm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-uuid\x2f5f22b8bc-0704-4217-85bd-55de53f91cf4'
creating link '/dev/disk/by-uuid/5f22b8bc-0704-4217-85bd-55de53f91cf4' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-uuid/5f22b8bc-0704-4217-85bd-55de53f91cf4' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fmapper\x2f0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../dm-0'
starting '/usr/sbin/dmsetup udevcomplete 4224415'
'/usr/sbin/dmsetup udevcomplete 4224415'(err) 'Could not find notification semaphore identified by cookie value 223180191 (0xd4d759f)'
'/usr/sbin/dmsetup udevcomplete 4224415'(err) 'Command failed'
'/usr/sbin/dmsetup udevcomplete 4224415' [4375] exit with return code 1
adding watch on '/dev/dm-0'
created db file '/run/udev/data/b252:0' for '/devices/virtual/block/dm-0'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2129 processed with 0
seq 2129 done with 0
validate module index
device 0x7f269e5bdc30 has devpath '/devices/virtual/block/dm-0'
inotify event: 8 for /dev/dm-0
device /dev/dm-0 closed, synthesising 'change'
seq 2130 queued, 'change' 'block'
passed 207 bytes to netlink monitor 0x7f269e5b1300
seq 2131 queued, 'change' 'block'
seq 2130 running
device 0x7f269e5b1300 filled with db file data
removing watch on '/dev/dm-0'
LINK 'mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/10-dm.rules:121
LINK 'disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/13-dm-disk.rules:17
LINK 'disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/13-dm-disk.rules:18
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/13-dm-disk.rules:23
probe /dev/dm-0 raid offset=0
LINK 'disk/by-uuid/ffc9830e-74d3-4fb4-8602-3dd48c82dd4e' /usr/lib/udev/rules.d/13-dm-disk.rules:25
IMPORT '/sbin/blkid -o udev -p /dev/dm-0' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/dm-0'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID=ffc9830e-74d3-4fb4-8602-3dd48c82dd4e'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID_ENC=ffc9830e-74d3-4fb4-8602-3dd48c82dd4e'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_TYPE=xfs'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_USAGE=filesystem'
'/sbin/blkid -o udev -p /dev/dm-0' [4396] exit with return code 0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/dm-0' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/dm-0'
'/sbin/multipath -T 1444642445: -c /dev/dm-0' [4398] exit with return code 1
update old name, '/dev/disk/by-uuid/5f22b8bc-0704-4217-85bd-55de53f91cf4' no longer belonging to '/devices/virtual/block/dm-0'
no reference left, remove '/dev/disk/by-uuid/5f22b8bc-0704-4217-85bd-55de53f91cf4'
handling device node '/dev/dm-0', devnum=b252:0, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/252:0' to '../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fdm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fdm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../dm-0'
creating link '/dev/disk/by-uuid/ffc9830e-74d3-4fb4-8602-3dd48c82dd4e' to '/dev/dm-0'
creating symlink '/dev/disk/by-uuid/ffc9830e-74d3-4fb4-8602-3dd48c82dd4e' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fmapper\x2f0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../dm-0'
created db file '/run/udev/data/b252:0' for '/devices/virtual/block/dm-0'
adding watch on '/dev/dm-0'
created db file '/run/udev/data/b252:0' for '/devices/virtual/block/dm-0'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2130 processed with 0
seq 2130 done with 0
passed 207 bytes to netlink monitor 0x7f269e5b1300
seq 2131 running
device 0x7f269e5bc040 filled with db file data
removing watch on '/dev/dm-0'
LINK 'mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/10-dm.rules:121
LINK 'disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/13-dm-disk.rules:17
LINK 'disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/13-dm-disk.rules:18
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/13-dm-disk.rules:23
probe /dev/dm-0 raid offset=0
LINK 'disk/by-uuid/ffc9830e-74d3-4fb4-8602-3dd48c82dd4e' /usr/lib/udev/rules.d/13-dm-disk.rules:25
IMPORT '/sbin/blkid -o udev -p /dev/dm-0' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/dm-0'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID=ffc9830e-74d3-4fb4-8602-3dd48c82dd4e'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_UUID_ENC=ffc9830e-74d3-4fb4-8602-3dd48c82dd4e'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_TYPE=xfs'
'/sbin/blkid -o udev -p /dev/dm-0'(out) 'ID_FS_USAGE=filesystem'
'/sbin/blkid -o udev -p /dev/dm-0' [4400] exit with return code 0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/dm-0' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/dm-0'
'/sbin/multipath -T 1444642445: -c /dev/dm-0' [4401] exit with return code 1
handling device node '/dev/dm-0', devnum=b252:0, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/252:0' to '../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fdm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-id/dm-name-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fdm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-id/dm-uuid-CRYPT-PLAIN-0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fdisk\x2fby-uuid\x2fffc9830e-74d3-4fb4-8602-3dd48c82dd4e'
creating link '/dev/disk/by-uuid/ffc9830e-74d3-4fb4-8602-3dd48c82dd4e' to '/dev/dm-0'
preserve already existing symlink '/dev/disk/by-uuid/ffc9830e-74d3-4fb4-8602-3dd48c82dd4e' to '../../dm-0'
found 'b252:0' claiming '/run/udev/links/\x2fmapper\x2f0ce28232-6d5d-11e5-aec3-fa163e5c167b'
creating link '/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/dm-0'
preserve already existing symlink '/dev/mapper/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../dm-0'
created db file '/run/udev/data/b252:0' for '/devices/virtual/block/dm-0'
adding watch on '/dev/dm-0'
created db file '/run/udev/data/b252:0' for '/devices/virtual/block/dm-0'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2131 processed with 0
seq 2131 done with 0
seq 2132 queued, 'remove' 'block'
passed 225 bytes to netlink monitor 0x7f269e5b1300
seq 2132 running
no db file to read /run/udev/data/b252:0: No such file or directory
RUN '/usr/sbin/dmsetup udevcomplete $env{DM_COOKIE}' /usr/lib/udev/rules.d/95-dm-notify.rules:12
seq 2133 queued, 'remove' 'slab'
starting '/usr/sbin/dmsetup udevcomplete 4200862'
passed 153 bytes to netlink monitor 0x7f269e5b1300
seq 2133 running
no db file to read /run/udev/data/+slab::t-0000896: No such file or directory
passed -1 bytes to netlink monitor 0x7f269e5c0240
seq 2133 processed with 0
seq 2133 done with 0
seq 2134 queued, 'remove' 'bdi'
passed 155 bytes to netlink monitor 0x7f269e5b1300
seq 2135 queued, 'remove' 'block'
seq 2134 running
no db file to read /run/udev/data/+bdi:252:0: No such file or directory
passed -1 bytes to netlink monitor 0x7f269e5c0240
seq 2134 processed with 0
seq 2134 done with 0
'/usr/sbin/dmsetup udevcomplete 4200862' [4406] exit with return code 0
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2132 processed with 0
seq 2132 done with 0
passed 207 bytes to netlink monitor 0x7f269e5b1300
seq 2135 running
no db file to read /run/udev/data/b252:0: No such file or directory
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2135 processed with 0
seq 2135 done with 0
seq 2136 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2136 running
device 0x7f269e5bc040 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4409] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bc360 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5b9770 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5c0f80 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4411] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2136 processed with 0
seq 2136 done with 0
seq 2137 queued, 'remove' 'block'
passed 241 bytes to netlink monitor 0x7f269e5b1300
seq 2137 running
device 0x7f269e5b9c10 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
inotify event: 8000 for (null)
device 0x7f269e5c0f80 filled with db file data
seq 2138 queued, 'remove' 'block'
removing watch on '/dev/vdb1'
passed 241 bytes to netlink monitor 0x7f269e5b1300
device 0x7f269e5b9770 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
seq 2138 running
device 0x7f269e5b9770 filled with db file data
device 0x7f269e5b1300 filled with db file data
no reference left, remove '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1'
removing watch on '/dev/vdb2'
no reference left, remove '/dev/disk/by-partlabel/ceph\x20data'
no reference left, remove '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b'
device 0x7f269e5bf800 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2137 processed with 0
seq 2137 done with 0
device 0x7f269e5bf800 filled with db file data
no reference left, remove '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2'
no reference left, remove '/dev/disk/by-partlabel/ceph\x20journal'
no reference left, remove '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b'
passed -1 bytes to netlink monitor 0x7f269e5c0240
seq 2138 processed with 0
seq 2138 done with 0
seq 2139 queued, 'change' 'block'
passed 230 bytes to netlink monitor 0x7f269e5b1300
seq 2140 queued, 'add' 'block'
seq 2141 queued, 'add' 'block'
seq 2139 running
device 0x7f269e5ca8f0 filled with db file data
removing watch on '/dev/vdb'
IMPORT '/sbin/blkid -o udev -p /dev/vdb' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb'
'/sbin/blkid -o udev -p /dev/vdb'(out) 'ID_PART_TABLE_TYPE=gpt'
'/sbin/blkid -o udev -p /dev/vdb' [4412] exit with return code 0
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9' /usr/lib/udev/rules.d/60-persistent-storage.rules:26
IMPORT builtin 'path_id' /usr/lib/udev/rules.d/60-persistent-storage.rules:58
device 0x7f269e5bde30 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3'
device 0x7f269e5bd5f0 has devpath '/devices/pci0000:00/0000:00:06.0'
device 0x7f269e5bc730 has devpath '/devices/pci0000:00'
IMPORT builtin 'path_id' returned non-zero
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb raid offset=0
PROGRAM '/sbin/multipath -T 1444642445: -c /dev/vdb' /usr/lib/udev/rules.d/62-multipath.rules:28
starting '/sbin/multipath -T 1444642445: -c /dev/vdb'
'/sbin/multipath -T 1444642445: -c /dev/vdb' [4415] exit with return code 1
no db file to read /run/udev/data/+virtio:virtio3: No such file or directory
handling device node '/dev/vdb', devnum=b253:16, mode=0600, uid=0, gid=0
preserve already existing symlink '/dev/block/253:16' to '../vdb'
found 'b253:16' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '/dev/vdb'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9' to '../../vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
adding watch on '/dev/vdb'
created db file '/run/udev/data/b253:16' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2139 processed with 0
seq 2139 done with 0
passed 238 bytes to netlink monitor 0x7f269e5b1300
passed 238 bytes to netlink monitor 0x7f269e5b1300
seq 2140 running
no db file to read /run/udev/data/b253:17: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
device 0x7f269e5bc340 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5bc340 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb1' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
seq 2141 running
no db file to read /run/udev/data/b253:18: No such file or directory
GROUP 6 /usr/lib/udev/rules.d/50-udev-default.rules:51
starting '/sbin/blkid -o udev -p /dev/vdb1'
device 0x7f269e5bd9d0 has devpath '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb'
device 0x7f269e5bd9d0 filled with db file data
IMPORT '/sbin/blkid -o udev -p /dev/vdb2' /usr/lib/udev/rules.d/60-ceph-partuuid-workaround.rules:28
starting '/sbin/blkid -o udev -p /dev/vdb2'
'/sbin/blkid -o udev -p /dev/vdb2' [4417] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part2' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb2 raid offset=0
'/sbin/blkid -o udev -p /dev/vdb1' [4416] exit with return code 2
LINK 'disk/by-id/virtio-9283de62-20eb-46e4-9-part1' /usr/lib/udev/rules.d/60-persistent-storage.rules:27
IMPORT builtin 'blkid' /usr/lib/udev/rules.d/60-persistent-storage.rules:73
probe /dev/vdb1 raid offset=0
LINK 'disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20journal' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
OWNER 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
GROUP 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
MODE 0660 /usr/lib/udev/rules.d/95-ceph-osd.rules:44
RUN '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/$name' /usr/lib/udev/rules.d/95-ceph-osd.rules:44
handling device node '/dev/vdb2', devnum=b253:18, mode=0660, uid=1001, gid=1001
preserve permissions /dev/vdb2, 060660, uid=1001, gid=1001
preserve already existing symlink '/dev/block/253:18' to '../vdb2'
found 'b253:18' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9-part2'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '/dev/vdb2'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part2' to '../../vdb2'
creating link '/dev/disk/by-partlabel/ceph\x20journal' to '/dev/vdb2'
creating symlink '/dev/disk/by-partlabel/ceph\x20journal' to '../../vdb2'
creating link '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb2'
creating symlink '/dev/disk/by-partuuid/0ce28a16-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
starting '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'
LINK 'disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' /usr/lib/udev/rules.d/60-persistent-storage.rules:87
LINK 'disk/by-partlabel/ceph\x20data' /usr/lib/udev/rules.d/60-persistent-storage.rules:88
OWNER 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:64
GROUP 1001 /usr/lib/udev/rules.d/95-ceph-osd.rules:64
MODE 0660 /usr/lib/udev/rules.d/95-ceph-osd.rules:64
RUN '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/$name' /usr/lib/udev/rules.d/95-ceph-osd.rules:64
handling device node '/dev/vdb1', devnum=b253:17, mode=0660, uid=1001, gid=1001
preserve permissions /dev/vdb1, 060660, uid=1001, gid=1001
preserve already existing symlink '/dev/block/253:17' to '../vdb1'
found 'b253:17' claiming '/run/udev/links/\x2fdisk\x2fby-id\x2fvirtio-9283de62-20eb-46e4-9-part1'
creating link '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1' to '/dev/vdb1'
preserve already existing symlink '/dev/disk/by-id/virtio-9283de62-20eb-46e4-9-part1' to '../../vdb1'
creating link '/dev/disk/by-partlabel/ceph\x20data' to '/dev/vdb1'
creating symlink '/dev/disk/by-partlabel/ceph\x20data' to '../../vdb1'
creating link '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '/dev/vdb1'
creating symlink '/dev/disk/by-partuuid/0ce28232-6d5d-11e5-aec3-fa163e5c167b' to '../../vdb1'
created db file '/run/udev/data/b253:17' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
starting '/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: main_trigger: Namespace(dev='/dev/vdb2', func=<function main_trigger at 0x25fcde8>, log_stdout=True, prepend_to_path='/usr/bin', prog='ceph-disk', statedir='/var/lib/ceph', sync=None, sysconfdir='/etc/ceph', verbose=True)'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: systemd detected, triggering ceph-disk@/dev/vdb2.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: does /usr/bin/systemctl exists ?'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: yes, /usr/bin/systemctl exists'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2'(out) 'ceph-disk: Running command: /usr/bin/systemctl --no-block restart ceph-disk@/dev/vdb2.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb2' [4420] exit with return code 0
adding watch on '/dev/vdb2'
created db file '/run/udev/data/b253:18' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb2'
passed -1 bytes to netlink monitor 0x7f269e5c0240
seq 2141 processed with 0
validate module index
seq 2141 done with 0
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1'(out) 'ceph-disk: main_trigger: Namespace(dev='/dev/vdb1', func=<function main_trigger at 0xeb5de8>, log_stdout=True, prepend_to_path='/usr/bin', prog='ceph-disk', statedir='/var/lib/ceph', sync=None, sysconfdir='/etc/ceph', verbose=True)'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1'(out) 'ceph-disk: systemd detected, triggering ceph-disk@/dev/vdb1.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1'(out) 'ceph-disk: does /usr/bin/systemctl exists ?'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1'(out) 'ceph-disk: yes, /usr/bin/systemctl exists'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1'(out) 'ceph-disk: Running command: /usr/bin/systemctl --no-block restart ceph-disk@/dev/vdb1.service'
'/usr/sbin/ceph-disk --log-stdout -v trigger /dev/vdb1' [4422] exit with return code 0
adding watch on '/dev/vdb1'
created db file '/run/udev/data/b253:17' for '/devices/pci0000:00/0000:00:06.0/virtio3/block/vdb/vdb1'
passed -1 bytes to netlink monitor 0x7f269e5bd140
seq 2140 processed with 0
seq 2140 done with 0
cleanup idle workers
validate module index
unload module indexunload module index
unload module index
worker [4312] exit
worker [4312] cleaned up
worker [4339] exit
worker [4339] cleaned up
worker [4203] exit
worker [4203] cleaned up
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment