gistfile1.txt

Jun  6 17:23:07 os-node6 kernel: [60296.245036] INFO: task md1_resync:7614 blocked for more than 120 seconds.
Jun  6 17:23:07 os-node6 kernel: [60296.245058]       Not tainted 4.13.0-36-generic #40~16.04.1-Ubuntu
Jun  6 17:23:07 os-node6 kernel: [60296.245076] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun  6 17:23:07 os-node6 kernel: [60296.245098] md1_resync      D    0  7614      2 0x00000000
Jun  6 17:23:07 os-node6 kernel: [60296.245100] Call Trace:
Jun  6 17:23:07 os-node6 kernel: [60296.245102]  __schedule+0x3d6/0x8b0
Jun  6 17:23:07 os-node6 kernel: [60296.245103]  schedule+0x36/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245105]  raise_barrier+0xd2/0x1a0 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245107]  ? wait_woken+0x80/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245108]  raid10_sync_request+0x9bd/0x1b10 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245112]  ? finish_task_switch+0x154/0x210
Jun  6 17:23:07 os-node6 kernel: [60296.245114]  md_do_sync+0xb81/0xfb0
Jun  6 17:23:07 os-node6 kernel: [60296.245116]  ? wait_woken+0x80/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245119]  md_thread+0x133/0x180
Jun  6 17:23:07 os-node6 kernel: [60296.245120]  ? md_thread+0x133/0x180
Jun  6 17:23:07 os-node6 kernel: [60296.245122]  kthread+0x10c/0x140
Jun  6 17:23:07 os-node6 kernel: [60296.245123]  ? state_show+0x320/0x320
Jun  6 17:23:07 os-node6 kernel: [60296.245124]  ? kthread_create_on_node+0x70/0x70
Jun  6 17:23:07 os-node6 kernel: [60296.245126]  ret_from_fork+0x35/0x40
Jun  6 17:23:07 os-node6 kernel: [60296.245138] INFO: task nova-compute:54137 blocked for more than 120 seconds.
Jun  6 17:23:07 os-node6 kernel: [60296.245160]       Not tainted 4.13.0-36-generic #40~16.04.1-Ubuntu
Jun  6 17:23:07 os-node6 kernel: [60296.245180] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun  6 17:23:07 os-node6 kernel: [60296.245203] nova-compute    D    0 54137      1 0x00000080
Jun  6 17:23:07 os-node6 kernel: [60296.245204] Call Trace:
Jun  6 17:23:07 os-node6 kernel: [60296.245206]  __schedule+0x3d6/0x8b0
Jun  6 17:23:07 os-node6 kernel: [60296.245208]  schedule+0x36/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245209]  wait_barrier+0x14e/0x1b0 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245211]  ? wait_woken+0x80/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245213]  raid10_write_request+0x3d/0x840 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245214]  ? r10bio_pool_alloc+0x24/0x30 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245216]  ? mempool_alloc+0x73/0x180
Jun  6 17:23:07 os-node6 kernel: [60296.245217]  ? md_write_start+0xc8/0x210
Jun  6 17:23:07 os-node6 kernel: [60296.245219]  raid10_make_request+0xd0/0x130 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245221]  md_handle_request+0xb5/0x130
Jun  6 17:23:07 os-node6 kernel: [60296.245222]  md_make_request+0x6c/0x170
Jun  6 17:23:07 os-node6 kernel: [60296.245224]  generic_make_request+0x12a/0x300
Jun  6 17:23:07 os-node6 kernel: [60296.245226]  submit_bio+0x73/0x150
Jun  6 17:23:07 os-node6 kernel: [60296.245228]  ? submit_bio+0x73/0x150
Jun  6 17:23:07 os-node6 kernel: [60296.245248]  ? xfs_setfilesize_trans_alloc.isra.14+0x3e/0x90 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245265]  xfs_submit_ioend+0x84/0x1a0 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245281]  xfs_vm_writepages+0xd1/0xf0 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245284]  do_writepages+0x1f/0x70
Jun  6 17:23:07 os-node6 kernel: [60296.245286]  __filemap_fdatawrite_range+0xc6/0x100
Jun  6 17:23:07 os-node6 kernel: [60296.245287]  filemap_flush+0x1c/0x20
Jun  6 17:23:07 os-node6 kernel: [60296.245306]  xfs_release+0x12b/0x170 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245323]  xfs_file_release+0x15/0x20 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245327]  __fput+0xea/0x230
Jun  6 17:23:07 os-node6 kernel: [60296.245328]  ____fput+0xe/0x10
Jun  6 17:23:07 os-node6 kernel: [60296.245330]  task_work_run+0x83/0xb0
Jun  6 17:23:07 os-node6 kernel: [60296.245333]  exit_to_usermode_loop+0xc4/0xd0
Jun  6 17:23:07 os-node6 kernel: [60296.245334]  do_syscall_64+0xbc/0xd0
Jun  6 17:23:07 os-node6 kernel: [60296.245336]  entry_SYSCALL64_slow_path+0x25/0x25
Jun  6 17:23:07 os-node6 kernel: [60296.245338] RIP: 0033:0x7faf0582f34b
Jun  6 17:23:07 os-node6 kernel: [60296.245338] RSP: 002b:00007fffcdfc9e48 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
Jun  6 17:23:07 os-node6 kernel: [60296.245340] RAX: 0000000000000000 RBX: 00000000045d3360 RCX: 00007faf0582f34b
Jun  6 17:23:07 os-node6 kernel: [60296.245341] RDX: 00000000ffffffff RSI: 00000000050a5530 RDI: 0000000000000021
Jun  6 17:23:07 os-node6 kernel: [60296.245342] RBP: 0000000000000000 R08: 00007faf05fb6700 R09: 0000000000017f90
Jun  6 17:23:07 os-node6 kernel: [60296.245342] R10: 0000000000000325 R11: 0000000000000246 R12: 0000000000000000
Jun  6 17:23:07 os-node6 kernel: [60296.245343] R13: 0000000000417470 R14: 0000000000000000 R15: 00000000045d3360
Jun  6 17:23:07 os-node6 kernel: [60296.245371] INFO: task worker:62034 blocked for more than 120 seconds.
Jun  6 17:23:07 os-node6 kernel: [60296.245404]       Not tainted 4.13.0-36-generic #40~16.04.1-Ubuntu
Jun  6 17:23:07 os-node6 kernel: [60296.245424] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jun  6 17:23:07 os-node6 kernel: [60296.245470] worker          D    0 62034      1 0x00000080
Jun  6 17:23:07 os-node6 kernel: [60296.245471] Call Trace:
Jun  6 17:23:07 os-node6 kernel: [60296.245473]  __schedule+0x3d6/0x8b0
Jun  6 17:23:07 os-node6 kernel: [60296.245475]  schedule+0x36/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245477]  wait_barrier+0x14e/0x1b0 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245479]  ? wait_woken+0x80/0x80
Jun  6 17:23:07 os-node6 kernel: [60296.245481]  raid10_write_request+0x3d/0x840 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245483]  ? r10bio_pool_alloc+0x24/0x30 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245484]  ? mempool_alloc+0x73/0x180
Jun  6 17:23:07 os-node6 kernel: [60296.245486]  ? md_write_start+0xc8/0x210
Jun  6 17:23:07 os-node6 kernel: [60296.245488]  raid10_make_request+0xd0/0x130 [raid10]
Jun  6 17:23:07 os-node6 kernel: [60296.245490]  md_handle_request+0xb5/0x130
Jun  6 17:23:07 os-node6 kernel: [60296.245491]  md_make_request+0x6c/0x170
Jun  6 17:23:07 os-node6 kernel: [60296.245494]  generic_make_request+0x12a/0x300
Jun  6 17:23:07 os-node6 kernel: [60296.245499]  ? iov_iter_get_pages+0xc0/0x340
Jun  6 17:23:07 os-node6 kernel: [60296.245501]  submit_bio+0x73/0x150
Jun  6 17:23:07 os-node6 kernel: [60296.245503]  ? submit_bio+0x73/0x150
Jun  6 17:23:07 os-node6 kernel: [60296.245504]  ? bio_iov_iter_get_pages+0xd7/0x120
Jun  6 17:23:07 os-node6 kernel: [60296.245509]  iomap_dio_actor+0x1fd/0x390
Jun  6 17:23:07 os-node6 kernel: [60296.245512]  ? iomap_dio_zero+0xf0/0xf0
Jun  6 17:23:07 os-node6 kernel: [60296.245514]  iomap_apply+0xa7/0x120
Jun  6 17:23:07 os-node6 kernel: [60296.245516]  iomap_dio_rw+0x2ba/0x3f0
Jun  6 17:23:07 os-node6 kernel: [60296.245517]  ? iomap_dio_zero+0xf0/0xf0
Jun  6 17:23:07 os-node6 kernel: [60296.245540]  xfs_file_dio_aio_write+0x119/0x290 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245558]  ? xfs_file_dio_aio_write+0x119/0x290 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245576]  xfs_file_write_iter+0x98/0x150 [xfs]
Jun  6 17:23:07 os-node6 kernel: [60296.245578]  new_sync_write+0xe5/0x140
Jun  6 17:23:07 os-node6 kernel: [60296.245580]  __vfs_write+0x29/0x40
Jun  6 17:23:07 os-node6 kernel: [60296.245581]  vfs_write+0xb8/0x1b0
Jun  6 17:23:07 os-node6 kernel: [60296.245583]  ? syscall_trace_enter+0x1d9/0x2f0
Jun  6 17:23:07 os-node6 kernel: [60296.245584]  SyS_pwrite64+0x95/0xb0
Jun  6 17:23:07 os-node6 kernel: [60296.245586]  do_syscall_64+0x61/0xd0
Jun  6 17:23:07 os-node6 kernel: [60296.245588]  entry_SYSCALL64_slow_path+0x25/0x25