Skip to content

Instantly share code, notes, and snippets.

@mcgrof
Created April 12, 2022 21:41
Show Gist options
  • Save mcgrof/9f3b1b9592d2196eb79f8c22238dbfd9 to your computer and use it in GitHub Desktop.
Save mcgrof/9f3b1b9592d2196eb79f8c22238dbfd9 to your computer and use it in GitHub Desktop.
blktests srp/002 gets NMI on v5.17-rc7
[ 250.024229] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 250.026637] rcu: 4-...0: (1 GPs behind) idle=9f7/1/0x4000000000000000 softirq=7318/7319 fqs=2180
[ 250.028350] (detected by 0, t=5252 jiffies, g=12881, q=40098)
[ 250.029648] Sending NMI from CPU 0 to CPUs 4:
[ 250.030875] NMI backtrace for cpu 4
[ 250.030904] CPU: 4 PID: 223 Comm: kworker/4:1H Kdump: loaded Tainted: G E 5.17.0-rc7 #1
[ 250.030917] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.15.0-1 04/01/2014
[ 250.030939] Workqueue: kblockd blk_mq_run_work_fn
[ 250.031063] RIP: 0010:native_queued_spin_lock_slowpath+0x28/0x200
[ 250.031115] Code: 00 00 0f 1f 44 00 00 41 54 55 53 48 89 fb 66 90 ba 01 00 00 00 8b 03 85 c0 75 0d f0 0f b1 13 85 c0 75 f2 5b 5d 41 5c c3 f3 90 <eb> e9 81 fe 00 01 00 00 74 45 40 30 f6 85 f6 75 67 f0 0f ba 2b 08
[ 250.031119] RSP: 0018:ffffaae000174e58 EFLAGS: 00000002
[ 250.031124] RAX: 0000000000000001 RBX: ffff9714c7041610 RCX: 0000000000040035
[ 250.031132] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff9714c7041610
[ 250.031135] RBP: ffff9714c7041600 R08: ffff9714c52b3f80 R09: 0000000000000102
[ 250.031138] R10: ffffffffb86060c0 R11: 0000000000000000 R12: 0000000000000282
[ 250.031141] R13: ffff9714c70447e0 R14: ffff9714ce3ea260 R15: ffff9714c7041610
[ 250.031144] FS: 0000000000000000(0000) GS:ffff9715f7d00000(0000) knlGS:0000000000000000
[ 250.031148] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 250.031151] CR2: 00007f9d50038000 CR3: 000000013f958002 CR4: 0000000000770ee0
[ 250.031160] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 250.031162] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 250.031165] PKRU: 55555554
[ 250.031173] Call Trace:
[ 250.031200] <IRQ>
[ 250.031211] _raw_spin_lock_irqsave+0x44/0x50
[ 250.031306] srp_recv_done+0x11e/0x480 [ib_srp]
[ 250.031349] ? _raw_spin_lock_bh+0x13/0x30
[ 250.031380] __ib_process_cq+0x83/0x180 [ib_core]
[ 250.031566] ib_poll_handler+0x2b/0xc0 [ib_core]
[ 250.031602] irq_poll_softirq+0x8e/0x120
[ 250.031643] __do_softirq+0xec/0x2ea
[ 250.031655] do_softirq.part.0+0x9b/0xd0
[ 250.031680] </IRQ>
[ 250.031682] <TASK>
[ 250.031684] __local_bh_enable_ip+0x73/0x80
[ 250.031695] rxe_poll_cq+0xed/0x100 [rdma_rxe]
[ 250.031750] __ib_process_cq+0x54/0x180 [ib_core]
[ 250.031786] ib_process_cq_direct+0x2c/0x50 [ib_core]
[ 250.031822] ? slab_free_freelist_hook.constprop.0+0xca/0x140
[ 250.031885] ? iblock_bio_done+0x24/0x30 [target_core_iblock]
[ 250.031900] ? kmem_cache_free+0x271/0x2c0
[ 250.031906] ? iblock_bio_done+0x24/0x30 [target_core_iblock]
[ 250.031914] ? blk_update_request+0xfd/0x390
[ 250.031923] ? sbitmap_queue_clear+0x3b/0x60
[ 250.031929] ? unwind_next_frame+0x32b/0x690
[ 250.031948] ? orc_find.part.0+0x120/0x190
[ 250.031954] ? unwind_next_frame+0x118/0x690
[ 250.031960] ? ret_from_fork+0x1f/0x30
[ 250.031984] ? kernel_text_address+0x13/0xd0
[ 250.031999] ? create_prof_cpu_mask+0x20/0x20
[ 250.032020] ? arch_stack_walk+0x88/0xf0
[ 250.032036] ? ret_from_fork+0x1f/0x30
[ 250.032043] __srp_get_tx_iu+0x20/0xa0 [ib_srp]
[ 250.032053] srp_queuecommand+0xbe/0x98a [ib_srp]
[ 250.032079] ? scsi_alloc_sgtables+0xb9/0x3f0 [scsi_mod]
[ 250.032186] ? sd_init_command+0x4bd/0xd40 [sd_mod]
[ 250.032208] ? scsi_init_command+0x102/0x1a0 [scsi_mod]
[ 250.032235] scsi_queue_rq+0x37b/0xb10 [scsi_mod]
[ 250.032279] __blk_mq_try_issue_directly+0x14f/0x1c0
[ 250.032305] blk_insert_cloned_request+0xb7/0x190
[ 250.032338] dm_mq_queue_rq+0x1c7/0x410 [dm_mod]
[ 250.032429] blk_mq_dispatch_rq_list+0x1ef/0x890
[ 250.032439] ? update_load_avg+0x7e/0x720
[ 250.032458] ? dequeue_entity+0xe8/0x410
[ 250.032472] __blk_mq_sched_dispatch_requests+0xb0/0x140
[ 250.032491] blk_mq_sched_dispatch_requests+0x30/0x60
[ 250.032497] __blk_mq_run_hw_queue+0x35/0x90
[ 250.032510] process_one_work+0x1e2/0x3b0
[ 250.032518] ? rescuer_thread+0x390/0x390
[ 250.032522] worker_thread+0x50/0x3a0
[ 250.032528] ? rescuer_thread+0x390/0x390
[ 250.032533] kthread+0xe5/0x110
[ 250.032548] ? kthread_complete_and_exit+0x20/0x20
[ 250.032556] ret_from_fork+0x1f/0x30
[ 250.032566] </TASK>
[ 250.032578] INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.700 msecs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment