Skip to content

Instantly share code, notes, and snippets.

@jdillon
Created July 16, 2016 18:32
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jdillon/6126028d7cb2210f35edc0393ae60dca to your computer and use it in GitHub Desktop.
Save jdillon/6126028d7cb2210f35edc0393ae60dca to your computer and use it in GitHub Desktop.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.264715] INFO: task jbd2/drbd100-8:2567 blocked for more than 120 seconds.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.272145] Tainted: G OE 4.4.0-31-generic #50-Ubuntu
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.278899] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286869] jbd2/drbd100-8 D ffff8800bb79ba78 0 2567 2 0x00000000
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286873] ffff8800bb79ba78 ffff8800bb23fb00 ffff8800b952b700 ffff8800b95bd280
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286875] ffff8800bb79c000 ffff88012fc16d00 7fffffffffffffff ffffffff8182a220
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286877] ffff8800bb79bbd0 ffff8800bb79ba90 ffffffff81829a25 0000000000000000
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286878] Call Trace:
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286886] [<ffffffff8182a220>] ? bit_wait+0x60/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286888] [<ffffffff81829a25>] schedule+0x35/0x80
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286890] [<ffffffff8182cb45>] schedule_timeout+0x1b5/0x270
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286892] [<ffffffff815b81ae>] ? scsi_request_fn+0x3e/0x610
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286896] [<ffffffff813bd27f>] ? part_round_stats+0x4f/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286899] [<ffffffff8106426e>] ? kvm_clock_get_cycles+0x1e/0x20
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286902] [<ffffffff810f597c>] ? ktime_get+0x3c/0xb0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286904] [<ffffffff8182a220>] ? bit_wait+0x60/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286905] [<ffffffff81828f54>] io_schedule_timeout+0xa4/0x110
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286907] [<ffffffff8182a23b>] bit_wait_io+0x1b/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286909] [<ffffffff81829dcd>] __wait_on_bit+0x5d/0x90
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286910] [<ffffffff8182a220>] ? bit_wait+0x60/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286912] [<ffffffff81829e82>] out_of_line_wait_on_bit+0x82/0xb0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286915] [<ffffffff810c3ce0>] ? autoremove_wake_function+0x40/0x40
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286918] [<ffffffff812445f2>] __wait_on_buffer+0x32/0x40
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286922] [<ffffffff812f2fed>] jbd2_write_superblock+0xbd/0x1d0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286924] [<ffffffff812f3b09>] jbd2_journal_update_sb_log_tail+0x39/0x90
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286926] [<ffffffff812eb5bb>] jbd2_journal_commit_transaction+0x2fb/0x1870
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286927] [<ffffffff810b6e11>] ? dequeue_entity+0x431/0xa80
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286930] [<ffffffff810ab110>] ? check_preempt_curr+0x80/0x90
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286931] [<ffffffff810ba44c>] ? set_next_entity+0x9c/0xb0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286934] [<ffffffff8102d66c>] ? __switch_to+0x1dc/0x5c0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286937] [<ffffffff810ec724>] ? lock_timer_base.isra.22+0x54/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286939] [<ffffffff810ec82e>] ? try_to_del_timer_sync+0x5e/0x90
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286941] [<ffffffff812f075a>] kjournald2+0xca/0x250
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286943] [<ffffffff810c3ca0>] ? wake_atomic_t_function+0x60/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286944] [<ffffffff812f0690>] ? commit_timeout+0x10/0x10
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286947] [<ffffffff810a0808>] kthread+0xd8/0xf0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286948] [<ffffffff810a0730>] ? kthread_create_on_node+0x1e0/0x1e0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286950] [<ffffffff8182decf>] ret_from_fork+0x3f/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286951] [<ffffffff810a0730>] ? kthread_create_on_node+0x1e0/0x1e0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.286954] INFO: task ext4lazyinit:2569 blocked for more than 120 seconds.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.294153] Tainted: G OE 4.4.0-31-generic #50-Ubuntu
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.300978] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308948] ext4lazyinit D ffff8800bb793b98 0 2569 2 0x00000000
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308953] ffff8800bb793b98 ffff88012fc16d70 ffffffff81e11500 ffff8800b95ba940
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308954] ffff8800bb794000 ffff88012fc16d00 7fffffffffffffff ffff8800b95ba940
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308956] ffffea0000082f00 ffff8800bb793bb0 ffffffff81829a25 0000000000000000
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308957] Call Trace:
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308965] [<ffffffff81829a25>] schedule+0x35/0x80
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308967] [<ffffffff8182cb45>] schedule_timeout+0x1b5/0x270
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308979] [<ffffffffc0344ce0>] ? drbd_make_request+0x220/0x370 [drbd]
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308983] [<ffffffff8106426e>] ? kvm_clock_get_cycles+0x1e/0x20
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308986] [<ffffffff810f597c>] ? ktime_get+0x3c/0xb0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308988] [<ffffffff81828f54>] io_schedule_timeout+0xa4/0x110
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308990] [<ffffffff81829c28>] ? preempt_schedule_common+0x18/0x30
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308992] [<ffffffff8182af33>] wait_for_completion_io+0xb3/0x140
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308994] [<ffffffff810ac0b0>] ? wake_up_q+0x70/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308997] [<ffffffff813ca775>] blkdev_issue_write_same+0x165/0x1a0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.308999] [<ffffffff813ca861>] blkdev_issue_zeroout+0xb1/0x250
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309001] [<ffffffff812e9f8b>] ? jbd2_journal_get_write_access+0x5b/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309003] [<ffffffff8129689d>] ext4_init_inode_table+0x18d/0x3a0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309005] [<ffffffff812ae370>] ext4_lazyinit_thread+0x120/0x2b0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309006] [<ffffffff812ae250>] ? ext4_chksum.isra.177+0x60/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309008] [<ffffffff810a0808>] kthread+0xd8/0xf0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309010] [<ffffffff810a0730>] ? kthread_create_on_node+0x1e0/0x1e0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309011] [<ffffffff8182decf>] ret_from_fork+0x3f/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309012] [<ffffffff810a0730>] ? kthread_create_on_node+0x1e0/0x1e0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.309015] INFO: task umount:2570 blocked for more than 120 seconds.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.315578] Tainted: G OE 4.4.0-31-generic #50-Ubuntu
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.322317] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331628] umount D ffff8800bb39fd38 0 2570 2126 0x00000000
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331634] ffff8800bb39fd38 0000000000000246 ffffffff81e11500 ffff8800b95bb700
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331637] ffff8800bb3a0000 0000000000000029 ffff8800ba9f0888 ffff8800ba9f0824
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331639] ffff8800bb39fd80 ffff8800bb39fd50 ffffffff81829a25 ffff8800ba9f0800
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331641] Call Trace:
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331650] [<ffffffff81829a25>] schedule+0x35/0x80
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331656] [<ffffffff812f0149>] jbd2_log_wait_commit+0xa9/0x130
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331660] [<ffffffff810c3ca0>] ? wake_atomic_t_function+0x60/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331664] [<ffffffff812ade46>] ext4_sync_fs+0x186/0x1e0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331670] [<ffffffff812412c1>] sync_filesystem+0x71/0xa0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331674] [<ffffffff8120f377>] generic_shutdown_super+0x27/0x100
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331677] [<ffffffff8120f74c>] kill_block_super+0x2c/0xa0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331679] [<ffffffff8120f8a3>] deactivate_locked_super+0x43/0x70
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331680] [<ffffffff8120fd7c>] deactivate_super+0x5c/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331682] [<ffffffff8122d6cf>] cleanup_mnt+0x3f/0x90
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331684] [<ffffffff8122d762>] __cleanup_mnt+0x12/0x20
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331687] [<ffffffff8109ec1f>] task_work_run+0x7f/0xa0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331689] [<ffffffff81003242>] exit_to_usermode_loop+0xc2/0xd0
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331692] [<ffffffff81003c6e>] syscall_return_slowpath+0x4e/0x60
Jul 15 20:00:35 elysium-test02 kernel: [ 1082.331693] [<ffffffff8182dc90>] int_ret_from_sys_call+0x25/0x8f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment