Skip to content

Instantly share code, notes, and snippets.

@mcgrof
Created April 12, 2022 22:27
Show Gist options
  • Save mcgrof/eed4d4683fa53960bffc10c3c4fe1fda to your computer and use it in GitHub Desktop.
Save mcgrof/eed4d4683fa53960bffc10c3c4fe1fda to your computer and use it in GitHub Desktop.
blktests srp/013 fails with an NMI on v5.17-rc7
[ 372.812662] sd 4:0:0:2: Attached scsi generic sg5 type 0
[ 372.813190] sd 4:0:0:0: [sde] Optimal transfer size 126976 bytes
[ 372.815753] sd 4:0:0:2: [sdf] Write Protect is off
[ 372.818635] scsi 4:0:0:1: Direct-Access LIO-ORG IBLOCK 4.0 PQ: 0 ANSI: 6
[ 372.818869] sd 4:0:0:2: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 372.821197] scsi 4:0:0:1: alua: supports implicit and explicit TPGS
[ 372.823230] sd 4:0:0:2: [sdf] Optimal transfer size 524288 bytes
[ 372.824332] scsi 4:0:0:1: alua: device naa.60014056e756c6c62310000000000000 port group 0 rel port 2
[ 372.828875] sd 4:0:0:1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
[ 372.829399] sd 4:0:0:1: Attached scsi generic sg6 type 0
[ 372.837593] sd 4:0:0:1: [sdg] 65536 512-byte logical blocks: (33.6 MB/32.0 MiB)
[ 372.839726] sd 4:0:0:1: [sdg] Write Protect is off
[ 372.841525] sd 4:0:0:1: [sdg] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[ 372.843790] sd 4:0:0:1: [sdg] Optimal transfer size 126976 bytes
[ 372.845781] scsi host5: ib_srp: Already connected to target port with id_ext=505400fffea6d62d;ioc_guid=505400fffea6d62d;dest=fe80:0000:0000:0000:5054:00ff:fec2:d9c8
[ 372.854554] sd 4:0:0:0: [sde] Attached SCSI disk
[ 372.874154] sd 4:0:0:2: [sdf] Attached SCSI disk
[ 372.901948] sd 4:0:0:1: [sdg] Attached SCSI disk
[ 375.576985] sched: RT throttling activated
[ 395.028944] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 395.030930] rcu: 3-...0: (1 GPs behind) idle=d8d/1/0x4000000000000000 softirq=6896/6909 fqs=2387
[ 395.032435] (detected by 2, t=5252 jiffies, g=16361, q=11138)
[ 395.033569] Sending NMI from CPU 2 to CPUs 3:
[ 395.034532] NMI backtrace for cpu 3
[ 395.034548] CPU: 3 PID: 1594 Comm: systemd-udevd Kdump: loaded Tainted: G E 5.17.0-rc7 #1
[ 395.034553] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.15.0-1 04/01/2014
[ 395.034564] RIP: 0010:native_queued_spin_lock_slowpath+0x28/0x200
[ 395.034611] Code: 00 00 0f 1f 44 00 00 41 54 55 53 48 89 fb 66 90 ba 01 00 00 00 8b 03 85 c0 75 0d f0 0f b1 13 85 c0 75 f2 5b 5d 41 5c c3 f3 90 <eb> e9 81 fe 00 01 00 00 74 45 40 30 f6 85 f6 75 67 f0 0f ba 2b 08
[ 395.034612] RSP: 0018:ffffb97580148e58 EFLAGS: 00000002
[ 395.034617] RAX: 0000000000000001 RBX: ffff952ec7f35490 RCX: 000000000003003c
[ 395.034620] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff952ec7f35490
[ 395.034621] RBP: ffff952ec7f35480 R08: ffff952ecf77e680 R09: ffff952ed3124800
[ 395.034622] R10: ffffffffb30060c0 R11: ffffb97580148ff8 R12: 0000000000000282
[ 395.034623] R13: ffff952ec7f317e0 R14: ffff952ecca551e0 R15: ffff952ec7f35490
[ 395.034625] FS: 00007feba863f8c0(0000) GS:ffff952ff7cc0000(0000) knlGS:0000000000000000
[ 395.034626] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 395.034627] CR2: 000055fe07174000 CR3: 000000011332e006 CR4: 0000000000770ee0
[ 395.034630] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 395.034631] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 395.034632] PKRU: 55555554
[ 395.034635] Call Trace:
[ 395.034647] <IRQ>
[ 395.034654] _raw_spin_lock_irqsave+0x44/0x50
[ 395.034703] srp_recv_done+0x11e/0x480 [ib_srp]
[ 395.034718] ? _raw_spin_lock_bh+0x13/0x30
[ 395.034728] __ib_process_cq+0x83/0x180 [ib_core]
[ 395.034807] ib_poll_handler+0x2b/0xc0 [ib_core]
[ 395.034818] irq_poll_softirq+0x8e/0x120
[ 395.034841] __do_softirq+0xec/0x2ea
[ 395.034847] do_softirq.part.0+0x9b/0xd0
[ 395.034860] </IRQ>
[ 395.034861] <TASK>
[ 395.034862] __local_bh_enable_ip+0x73/0x80
[ 395.034869] rxe_poll_cq+0xed/0x100 [rdma_rxe]
[ 395.034890] __ib_process_cq+0x54/0x180 [ib_core]
[ 395.034901] ib_process_cq_direct+0x2c/0x50 [ib_core]
[ 395.034911] ? blk_mq_sched_insert_requests+0x6a/0x150
[ 395.034923] ? kernel_text_address+0x13/0xd0
[ 395.034929] ? blk_mq_sched_insert_requests+0x6a/0x150
[ 395.034931] ? __kernel_text_address+0xe/0x30
[ 395.034933] ? unwind_get_return_address+0x1b/0x30
[ 395.034941] ? create_prof_cpu_mask+0x20/0x20
[ 395.034946] ? arch_stack_walk+0x75/0xf0
[ 395.034952] ? blk_mq_sched_insert_requests+0x6a/0x150
[ 395.034954] ? stack_trace_save+0x4b/0x70
[ 395.034955] ? _raw_spin_lock_irqsave+0x26/0x50
[ 395.034959] ? create_object.isra.0+0x1c8/0x330
[ 395.034972] ? _raw_spin_unlock_irqrestore+0x25/0x40
[ 395.034976] ? kmem_cache_alloc+0x2af/0x420
[ 395.034989] ? mempool_alloc+0x5f/0x1a0
[ 395.034997] ? __blk_rq_map_sg+0x11c/0x560
[ 395.035004] __srp_get_tx_iu+0x20/0xa0 [ib_srp]
[ 395.035007] srp_queuecommand+0xbe/0x98a [ib_srp]
[ 395.035016] ? scsi_alloc_sgtables+0xb9/0x3f0 [scsi_mod]
[ 395.035060] ? sd_init_command+0x4bd/0xd40 [sd_mod]
[ 395.035067] ? scsi_init_command+0x102/0x1a0 [scsi_mod]
[ 395.035076] scsi_queue_rq+0x37b/0xb10 [scsi_mod]
[ 395.035094] __blk_mq_try_issue_directly+0x14f/0x1c0
[ 395.035105] blk_insert_cloned_request+0xb7/0x190
[ 395.035111] dm_mq_queue_rq+0x1c7/0x410 [dm_mod]
[ 395.035145] blk_mq_dispatch_rq_list+0x1ef/0x890
[ 395.035148] ? elv_rb_add+0x30/0x70
[ 395.035154] ? sbitmap_get+0x86/0x190
[ 395.035156] __blk_mq_do_dispatch_sched+0xb8/0x320
[ 395.035163] ? __blk_mq_alloc_requests+0x15c/0x2a0
[ 395.035166] __blk_mq_sched_dispatch_requests+0xf4/0x140
[ 395.035168] blk_mq_sched_dispatch_requests+0x30/0x60
[ 395.035170] __blk_mq_run_hw_queue+0x35/0x90
[ 395.035175] __blk_mq_delay_run_hw_queue+0x178/0x1b0
[ 395.035178] blk_mq_sched_insert_requests+0x6a/0x150
[ 395.035180] blk_mq_flush_plug_list+0x1a6/0x3a0
[ 395.035184] blk_flush_plug+0x102/0x160
[ 395.035198] blk_finish_plug+0x21/0x30
[ 395.035200] read_pages+0x16d/0x240
[ 395.035213] page_cache_ra_unbounded+0x182/0x210
[ 395.035215] force_page_cache_ra+0xc7/0x100
[ 395.035217] filemap_get_pages+0xe9/0x5e0
[ 395.035225] ? atime_needs_update+0xfc/0x170
[ 395.035233] filemap_read+0xb9/0x2d0
[ 395.035235] ? security_compute_av_user+0x10/0x120
[ 395.035243] ? ptep_set_access_flags+0x2f/0x40
[ 395.035247] ? _raw_spin_unlock+0x16/0x30
[ 395.035249] ? wp_page_reuse+0x61/0x70
[ 395.035254] ? do_wp_page+0x1da/0x2f0
[ 395.035256] ? preempt_count_add+0x68/0xa0
[ 395.035264] ? aa_file_perm+0x11c/0x4c0
[ 395.035272] blkdev_read_iter+0xac/0x1c0
[ 395.035280] new_sync_read+0x115/0x1a0
[ 395.035288] vfs_read+0xf1/0x190
[ 395.035291] ksys_read+0x5f/0xe0
[ 395.035294] do_syscall_64+0x38/0xc0
[ 395.035306] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 395.035309] RIP: 0033:0x7feba8be910e
[ 395.035328] Code: 0f 1f 40 00 48 8b 15 b9 ae 00 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb ba 0f 1f 00 64 8b 04 25 18 00 00 00 85 c0 75 14 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 66 0f 1f 84 00 00 00 00 00 48 83 ec 28
[ 395.035332] RSP: 002b:00007ffff9d1e5e8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 395.035334] RAX: ffffffffffffffda RBX: 000055fe07135a88 RCX: 00007feba8be910e
[ 395.035335] RDX: 0000000000040000 RSI: 000055fe07135a98 RDI: 0000000000000006
[ 395.035336] RBP: 000055fe070ce2f0 R08: 000055fe07135a70 R09: 00007feba8bcdc00
[ 395.035336] R10: 0000000010000000 R11: 0000000000000246 R12: 0000000000000000
[ 395.035338] R13: 0000000000040000 R14: 000055fe07135a70 R15: 000055fe070ce340
[ 395.035340] </TASK>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment