GPU Hang DMESG

dmesg.log

[703818.609439] uvcvideo: Found UVC 1.00 device HTC Vive (0bb4:2c87)
[703818.677525] uvcvideo 1-13.1.2:1.0: Entity type for entity Extension 2 was not initialized!
[703818.677527] uvcvideo 1-13.1.2:1.0: Entity type for entity Extension 6 was not initialized!
[703818.677528] uvcvideo 1-13.1.2:1.0: Entity type for entity Extension 5 was not initialized!
[703818.677529] uvcvideo 1-13.1.2:1.0: Entity type for entity Processing 3 was not initialized!
[703818.677530] uvcvideo 1-13.1.2:1.0: Entity type for entity Camera 1 was not initialized!
[703818.677590] input: HTC Vive as /devices/pci0000:00/0000:00:01.3/0000:03:00.0/usb1/1-13/1-13.1/1-13.1.2/1-13.1.2:1.0/input/input37
[703818.917217] usb 1-13.1.4: new full-speed USB device number 43 using xhci_hcd
[703819.239442] usb 1-13.1.4: New USB device found, idVendor=0d8c, idProduct=0012, bcdDevice= 1.00
[703819.239444] usb 1-13.1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[703819.239445] usb 1-13.1.4: Product: USB Audio Device
[703819.239446] usb 1-13.1.4: Manufacturer: C-Media Electronics Inc.
[703819.622847] input: C-Media Electronics Inc. USB Audio Device as /devices/pci0000:00/0000:00:01.3/0000:03:00.0/usb1/1-13/1-13.1/1-13.1.4/1-13.1.4:1.3/0003:0D8C:0012.0028/input/input38
[703819.681298] hid-generic 0003:0D8C:0012.0028: input,hidraw19: USB HID v1.00 Device [C-Media Electronics Inc. USB Audio Device] on usb-0000:03:00.0-13.1.4/input3
[725135.059883] do_general_protection: 98 callbacks suppressed
[725135.059885] traps: vrwebhelper[31160] general protection ip:7fb6c3819d70 sp:7ffe00e90400 error:0 in libX11.so.6.3.0[7fb6c3815000+8a000]
[725140.255560] traps: vrwebhelper[31812] general protection ip:7f8294b77d70 sp:7ffd83011840 error:0 in libX11.so.6.3.0[7f8294b73000+8a000]
[725235.311059] traps: vrwebhelper[32571] general protection ip:7ff5b2737d70 sp:7ffdd1248de0 error:0 in libX11.so.6.3.0[7ff5b2733000+8a000]
[725237.183014] traps: vrwebhelper[32642] general protection ip:7f54be489d70 sp:7fff4ada4c80 error:0 in libX11.so.6.3.0[7f54be485000+8a000]
[725238.765445] traps: vrwebhelper[659] general protection ip:7ff42f28ed70 sp:7ffcf89e34b0 error:0 in libX11.so.6.3.0[7ff42f28a000+8a000]
[725238.843734] traps: vrwebhelper[679] general protection ip:7ff9b8cbcd70 sp:7ffc9ee00160 error:0 in libX11.so.6.3.0[7ff9b8cb8000+8a000]
[725242.094749] traps: vrwebhelper[997] general protection ip:7f241d6b6d70 sp:7ffff033a2b0 error:0 in libX11.so.6.3.0[7f241d6b2000+8a000]
[725285.376074] CIPCServer::Thr[24573]: segfault at 9 ip 0000000000000009 sp 00000000de7fedec error 14 in memfd:pulseaudio (deleted)[19300000+4000000]
[725285.376078] Code: Bad RIP value.
[725310.756655] traps: vrwebhelper[2218] general protection ip:7fe7f5e75d70 sp:7fff8ed58620 error:0 in libX11.so.6.3.0[7fe7f5e71000+8a000]
[726003.028314] uvcvideo: Failed to query (GET_INFO) UVC control 14 on unit 6: 0 (exp. 1).
[726003.031313] uvcvideo: Failed to query (GET_INFO) UVC control 14 on unit 6: 0 (exp. 1).
[726003.036315] uvcvideo: Failed to query (GET_LEN) UVC control 15 on unit 6: -32 (exp. 2).
[726428.904072] WARNING: CPU: 9 PID: 6928 at kernel/workqueue.c:1512 __queue_delayed_work+0x6c/0x80
[726428.904074] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726428.904099]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726428.904129]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726428.904139] CPU: 9 PID: 6928 Comm: kworker/9:1 Not tainted 4.19.0-5-amd64 #1 Debian 4.19.37-3
[726428.904140] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726428.904143] Workqueue: events drm_sched_job_finish [gpu_sched]
[726428.904145] RIP: 0010:__queue_delayed_work+0x6c/0x80
[726428.904146] Code: 50 48 01 c8 48 89 42 30 41 81 f8 00 02 00 00 75 1d e9 48 3f 06 00 44 89 c7 e9 70 f7 ff ff 0f 0b eb cb 0f 0b eb a9 0f 0b eb af <0f> 0b eb b2 44 89 c6 e9 98 33 06 00 0f 1f 84 00 00 00 00 00 0f 1f
[726428.904147] RSP: 0018:ffffa2494e1dbe50 EFLAGS: 00010086
[726428.904148] RAX: 0000000000000246 RBX: 0000000000000246 RCX: 00000000000009c4
[726428.904148] RDX: ffff96b7d36b4c60 RSI: ffff96b83e818c00 RDI: ffff96b7d36b4c80
[726428.904149] RBP: ffff96b837ff6dc0 R08: 0000000000000200 R09: 000073746e657665
[726428.904149] R10: 8080808080808080 R11: 0000000000000001 R12: ffff96b837ff6c80
[726428.904150] R13: ffff96b7d36b1000 R14: ffff96b7d36b4c50 R15: ffff96b7d36b1038
[726428.904151] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726428.904152] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726428.904152] CR2: 00007f886f2c26e0 CR3: 00000004560f8000 CR4: 00000000003406e0
[726428.904153] Call Trace:
[726428.904155]  queue_delayed_work_on+0x36/0x40
[726428.904157]  drm_sched_job_finish+0xa2/0x130 [gpu_sched]
[726428.904159]  process_one_work+0x1a7/0x3a0
[726428.904160]  worker_thread+0x30/0x390
[726428.904162]  ? create_worker+0x1a0/0x1a0
[726428.904162]  kthread+0x112/0x130
[726428.904163]  ? kthread_bind+0x30/0x30
[726428.904165]  ret_from_fork+0x22/0x40
[726428.904167] ---[ end trace d534e660e7faacff ]---
[726428.904169] ------------[ cut here ]------------
[726428.904170] kernel BUG at kernel/time/timer.c:1137!
[726428.904175] invalid opcode: 0000 [#1] SMP NOPTI
[726428.904177] CPU: 9 PID: 6928 Comm: kworker/9:1 Tainted: G        W         4.19.0-5-amd64 #1 Debian 4.19.37-3
[726428.904177] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726428.904179] Workqueue: events drm_sched_job_finish [gpu_sched]
[726428.904182] RIP: 0010:add_timer+0x1ab/0x280
[726428.904183] Code: 74 23 49 8b 45 00 49 8b 7d 08 49 83 c5 18 44 89 f9 4c 89 f2 48 89 de e8 b3 4e 90 00 49 8b 45 00 48 85 c0 75 e1 e9 44 ff ff ff <0f> 0b 0f 0b 49 89 ec e9 33 ff ff ff e8 34 cd fa ff 48 c7 c2 c0 a7
[726428.904184] RSP: 0018:ffffa2494e1dbe10 EFLAGS: 00010086
[726428.904185] RAX: 0000000000000000 RBX: 0000000000000246 RCX: 00000000000009c4
[726428.904185] RDX: ffff96b7d36b4c60 RSI: ffff96b83e818c00 RDI: ffff96b7d36b4c80
[726428.904186] RBP: ffff96b837ff6dc0 R08: 0000000000000200 R09: ffff96b7d36b4c68
[726428.904187] R10: 8080808080808080 R11: 0000000000000001 R12: ffff96b837ff6c80
[726428.904188] R13: ffff96b7d36b1000 R14: ffff96b7d36b4c50 R15: ffff96b7d36b1038
[726428.904189] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726428.904189] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726428.904190] CR2: 00007f886f2c26e0 CR3: 00000004560f8000 CR4: 00000000003406e0
[726428.904191] Call Trace:
[726428.904193]  queue_delayed_work_on+0x36/0x40
[726428.904194]  drm_sched_job_finish+0xa2/0x130 [gpu_sched]
[726428.904196]  process_one_work+0x1a7/0x3a0
[726428.904197]  worker_thread+0x30/0x390
[726428.904199]  ? create_worker+0x1a0/0x1a0
[726428.904200]  kthread+0x112/0x130
[726428.904201]  ? kthread_bind+0x30/0x30
[726428.904202]  ret_from_fork+0x22/0x40
[726428.904203] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726428.904217]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726428.904232]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726428.904238] ---[ end trace d534e660e7faad00 ]---
[726439.035362] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx timeout, signaled seq=224685071, emitted seq=224685071
[726439.035368] amdgpu 0000:23:00.0: GPU reset begin!
[726439.035462] WARNING: CPU: 5 PID: 13902 at kernel/kthread.c:501 kthread_park+0x6c/0x80
[726439.035463] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726439.035488]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726439.035517]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726439.035527] CPU: 5 PID: 13902 Comm: kworker/5:2 Tainted: G      D W         4.19.0-5-amd64 #1 Debian 4.19.37-3
[726439.035528] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726439.035531] Workqueue: events drm_sched_job_timedout [gpu_sched]
[726439.035533] RIP: 0010:kthread_park+0x6c/0x80
[726439.035534] Code: 18 e8 08 d3 67 00 be 40 00 00 00 48 89 df e8 bb b6 00 00 48 85 c0 74 1b 31 c0 5b 5d c3 0f 0b eb ae 0f 0b b8 da ff ff ff eb f0 <0f> 0b b8 f0 ff ff ff eb e7 0f 0b eb e3 0f 1f 80 00 00 00 00 0f 1f
[726439.035535] RSP: 0018:ffffa24968ab7e28 EFLAGS: 00010202
[726439.035537] RAX: 0000000000000004 RBX: ffff96b837ff6c08 RCX: ffff96b837ff6a28
[726439.035537] RDX: ffff96b837ff692c RSI: ffff96b8052332d8 RDI: ffff96b836a92c40
[726439.035538] RBP: ffff96b83aa32e40 R08: ffff96b83ed62660 R09: 0000000000000000
[726439.035539] R10: 0000000000000000 R11: 0000000000000000 R12: ffff96b837ff3480
[726439.035540] R13: ffff96b1d43c6400 R14: ffff96b837ff0000 R15: ffff96b837ff3430
[726439.035541] FS:  0000000000000000(0000) GS:ffff96b83ed40000(0000) knlGS:0000000000000000
[726439.035542] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726439.035542] CR2: 00007f37f767cfe0 CR3: 00000001554e6000 CR4: 00000000003406e0
[726439.035543] Call Trace:
[726439.035574]  amdgpu_device_gpu_recover+0xa5/0x6b0 [amdgpu]
[726439.035577]  process_one_work+0x1a7/0x3a0
[726439.035579]  worker_thread+0x30/0x390
[726439.035580]  ? create_worker+0x1a0/0x1a0
[726439.035581]  kthread+0x112/0x130
[726439.035582]  ? kthread_bind+0x30/0x30
[726439.035585]  ret_from_fork+0x22/0x40
[726439.035587] ---[ end trace d534e660e7faad01 ]---
[726439.039423] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma0 timeout, signaled seq=65339736, emitted seq=65339736
[726439.039426] amdgpu 0000:23:00.0: GPU reset begin!
[726450.059141] rcu: INFO: rcu_sched self-detected stall on CPU
[726450.059147] rcu:    1-....: (5250 ticks this GP) idle=f92/1/0x4000000000000002 softirq=32058193/32063442 fqs=2234 
[726450.059148] rcu:     (t=5250 jiffies g=188780045 q=37063)
[726450.059151] NMI backtrace for cpu 1
[726450.059153] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W         4.19.0-5-amd64 #1 Debian 4.19.37-3
[726450.059154] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726450.059155] Call Trace:
[726450.059158]  <IRQ>
[726450.059162]  dump_stack+0x5c/0x80
[726450.059165]  nmi_cpu_backtrace.cold.4+0x13/0x50
[726450.059168]  ? lapic_can_unplug_cpu.cold.29+0x3b/0x3b
[726450.059169]  nmi_trigger_cpumask_backtrace+0xf9/0xfb
[726450.059172]  rcu_dump_cpu_stacks+0x9b/0xcb
[726450.059174]  rcu_check_callbacks.cold.80+0x1db/0x338
[726450.059176]  ? tick_sched_do_timer+0x60/0x60
[726450.059178]  update_process_times+0x28/0x60
[726450.059179]  tick_sched_handle+0x22/0x60
[726450.059181]  tick_sched_timer+0x37/0x70
[726450.059182]  __hrtimer_run_queues+0x100/0x280
[726450.059184]  hrtimer_interrupt+0x100/0x220
[726450.059186]  smp_apic_timer_interrupt+0x6a/0x140
[726450.059187]  apic_timer_interrupt+0xf/0x20
[726450.059188]  </IRQ>
[726450.059190] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190
[726450.059192] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00
[726450.059193] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726450.059195] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726450.059196] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726450.059197] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726450.059198] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726450.059198] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726450.059201]  _raw_spin_lock+0x1c/0x20
[726450.059205]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726450.059207]  ? finish_wait+0x80/0x80
[726450.059209]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726450.059211]  kthread+0x112/0x130
[726450.059212]  ? kthread_bind+0x30/0x30
[726450.059214]  ret_from_fork+0x22/0x40
[726450.059219] Sending NMI from CPU 1 to CPUs 9:
[726450.059256] NMI backtrace for cpu 9
[726450.059257] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W         4.19.0-5-amd64 #1 Debian 4.19.37-3
[726450.059258] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726450.059258] Workqueue: events drm_sched_job_finish [gpu_sched]
[726450.059259] RIP: 0010:native_queued_spin_lock_slowpath+0xfc/0x190
[726450.059259] Code: 00 8b 07 85 c0 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01
[726450.059259] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202
[726450.059260] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726450.059260] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726450.059261] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726450.059261] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726450.059261] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726450.059261] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726450.059262] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726450.059262] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726450.059262] Call Trace:
[726450.059262]  _raw_spin_lock+0x1c/0x20
[726450.059262]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726450.059263]  process_one_work+0x1a7/0x3a0
[726450.059263]  worker_thread+0x30/0x390
[726450.059263]  ? create_worker+0x1a0/0x1a0
[726450.059263]  kthread+0x112/0x130
[726450.059263]  ? kthread_bind+0x30/0x30
[726450.059263]  ret_from_fork+0x22/0x40
[726459.317168] sysrq: SysRq : Keyboard mode set to system default
[726464.954912] watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [kworker/5:2:13902]
[726464.954917] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726464.954944]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726464.954973]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726464.954984] CPU: 5 PID: 13902 Comm: kworker/5:2 Tainted: G      D W         4.19.0-5-amd64 #1 Debian 4.19.37-3
[726464.954985] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726464.954991] Workqueue: events drm_sched_job_timedout [gpu_sched]
[726464.954995] RIP: 0010:native_queued_spin_lock_slowpath+0x15f/0x190
[726464.954996] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 80 28 02 00 48 03 04 f5 00 a7 0c b2 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 88 48 89 c6 0f 0d 08 eb
[726464.954997] RSP: 0018:ffffa24968ab7df8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[726464.954999] RAX: 0000000000000000 RBX: ffff96b837ff6c80 RCX: 0000000000180000
[726464.955000] RDX: ffff96b83ed62880 RSI: 0000000000000009 RDI: ffff96b837ff6dc0
[726464.955001] RBP: ffff96b1d43c6400 R08: ffff96b83ed62660 R09: 0000000000000000
[726464.955002] R10: 0000000000000000 R11: 0000000000000000 R12: ffff96b837ff6db0
[726464.955003] R13: ffff96b837ff6dc0 R14: ffff96b837ff0000 R15: ffff96b837ff3430
[726464.955004] FS:  0000000000000000(0000) GS:ffff96b83ed40000(0000) knlGS:0000000000000000
[726464.955005] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726464.955006] CR2: 00007f37f767cfe0 CR3: 00000001554e6000 CR4: 00000000003406e0
[726464.955007] Call Trace:
[726464.955010]  _raw_spin_lock+0x1c/0x20
[726464.955013]  drm_sched_hw_job_reset+0x2b/0x160 [gpu_sched]
[726464.955044]  amdgpu_device_gpu_recover+0xbc/0x6b0 [amdgpu]
[726464.955048]  process_one_work+0x1a7/0x3a0
[726464.955049]  worker_thread+0x30/0x390
[726464.955051]  ? create_worker+0x1a0/0x1a0
[726464.955052]  kthread+0x112/0x130
[726464.955054]  ? kthread_bind+0x30/0x30
[726464.955055]  ret_from_fork+0x22/0x40
[726476.942727] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [sdma1:799]
[726476.942731] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726476.942760]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726476.942789]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726476.942799] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726476.942800] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726476.942804] RIP: 0010:native_queued_spin_lock_slowpath+0x56/0x190
[726476.942807] Code: 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 8b 07 84 c0 <75> f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00 00 75 bf b8
[726476.942808] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726476.942810] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726476.942811] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726476.942812] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726476.942813] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726476.942813] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726476.942814] FS:  0000000000000000(0000) GS:ffff96b83ec40000(0000) knlGS:0000000000000000
[726476.942815] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726476.942816] CR2: 000000000233e148 CR3: 000000052c00a000 CR4: 00000000003406e0
[726476.942817] Call Trace:
[726476.942821]  _raw_spin_lock+0x1c/0x20
[726476.942826]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726476.942828]  ? finish_wait+0x80/0x80
[726476.942830]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726476.942832]  kthread+0x112/0x130
[726476.942833]  ? kthread_bind+0x30/0x30
[726476.942835]  ret_from_fork+0x22/0x40
[726476.962727] watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [kworker/9:0:4806]
[726476.962730] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726476.962755]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726476.962783]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726476.962793] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726476.962794] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726476.962799] Workqueue: events drm_sched_job_finish [gpu_sched]
[726476.962803] RIP: 0010:native_queued_spin_lock_slowpath+0x101/0x190
[726476.962805] Code: 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 8b 07 66 85 c0 <75> f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01 48 85 f6 74 11
[726476.962806] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726476.962808] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726476.962809] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726476.962809] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726476.962810] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726476.962811] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726476.962812] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726476.962813] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726476.962814] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726476.962815] Call Trace:
[726476.962818]  _raw_spin_lock+0x1c/0x20
[726476.962821]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726476.962824]  process_one_work+0x1a7/0x3a0
[726476.962826]  worker_thread+0x30/0x390
[726476.962828]  ? create_worker+0x1a0/0x1a0
[726476.962829]  kthread+0x112/0x130
[726476.962830]  ? kthread_bind+0x30/0x30
[726476.962831]  ret_from_fork+0x22/0x40
[726492.954478] watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [kworker/5:2:13902]
[726492.954481] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726492.954509]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726492.954538]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726492.954549] CPU: 5 PID: 13902 Comm: kworker/5:2 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726492.954550] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726492.954556] Workqueue: events drm_sched_job_timedout [gpu_sched]
[726492.954560] RIP: 0010:native_queued_spin_lock_slowpath+0x15f/0x190
[726492.954562] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 80 28 02 00 48 03 04 f5 00 a7 0c b2 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 88 48 89 c6 0f 0d 08 eb
[726492.954563] RSP: 0018:ffffa24968ab7df8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[726492.954565] RAX: 0000000000000000 RBX: ffff96b837ff6c80 RCX: 0000000000180000
[726492.954566] RDX: ffff96b83ed62880 RSI: 0000000000000009 RDI: ffff96b837ff6dc0
[726492.954567] RBP: ffff96b1d43c6400 R08: ffff96b83ed62660 R09: 0000000000000000
[726492.954567] R10: 0000000000000000 R11: 0000000000000000 R12: ffff96b837ff6db0
[726492.954568] R13: ffff96b837ff6dc0 R14: ffff96b837ff0000 R15: ffff96b837ff3430
[726492.954569] FS:  0000000000000000(0000) GS:ffff96b83ed40000(0000) knlGS:0000000000000000
[726492.954570] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726492.954571] CR2: 00007f37f767cfe0 CR3: 00000001554e6000 CR4: 00000000003406e0
[726492.954572] Call Trace:
[726492.954576]  _raw_spin_lock+0x1c/0x20
[726492.954578]  drm_sched_hw_job_reset+0x2b/0x160 [gpu_sched]
[726492.954610]  amdgpu_device_gpu_recover+0xbc/0x6b0 [amdgpu]
[726492.954613]  process_one_work+0x1a7/0x3a0
[726492.954615]  worker_thread+0x30/0x390
[726492.954617]  ? create_worker+0x1a0/0x1a0
[726492.954618]  kthread+0x112/0x130
[726492.954619]  ? kthread_bind+0x30/0x30
[726492.954621]  ret_from_fork+0x22/0x40
[726504.942128] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [sdma1:799]
[726504.942132] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726504.942161]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726504.942190]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726504.942201] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726504.942202] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726504.942206] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190
[726504.942208] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00
[726504.942210] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726504.942211] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726504.942212] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726504.942213] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726504.942214] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726504.942215] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726504.942216] FS:  0000000000000000(0000) GS:ffff96b83ec40000(0000) knlGS:0000000000000000
[726504.942217] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726504.942218] CR2: 000000000233e148 CR3: 000000052c00a000 CR4: 00000000003406e0
[726504.942219] Call Trace:
[726504.942223]  _raw_spin_lock+0x1c/0x20
[726504.942227]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726504.942229]  ? finish_wait+0x80/0x80
[726504.942231]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726504.942233]  kthread+0x112/0x130
[726504.942235]  ? kthread_bind+0x30/0x30
[726504.942236]  ret_from_fork+0x22/0x40
[726504.962126] watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [kworker/9:0:4806]
[726504.962130] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726504.962155]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726504.962183]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726504.962193] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726504.962194] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726504.962200] Workqueue: events drm_sched_job_finish [gpu_sched]
[726504.962204] RIP: 0010:native_queued_spin_lock_slowpath+0xfc/0x190
[726504.962205] Code: 00 8b 07 85 c0 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01
[726504.962207] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726504.962208] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726504.962209] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726504.962210] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726504.962211] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726504.962212] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726504.962213] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726504.962214] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726504.962214] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726504.962215] Call Trace:
[726504.962219]  _raw_spin_lock+0x1c/0x20
[726504.962222]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726504.962225]  process_one_work+0x1a7/0x3a0
[726504.962227]  worker_thread+0x30/0x390
[726504.962228]  ? create_worker+0x1a0/0x1a0
[726504.962230]  kthread+0x112/0x130
[726504.962231]  ? kthread_bind+0x30/0x30
[726504.962232]  ret_from_fork+0x22/0x40
[726513.069510] rcu: INFO: rcu_sched self-detected stall on CPU
[726513.069517] rcu:    1-....: (21003 ticks this GP) idle=f92/1/0x4000000000000002 softirq=32058193/32079195 fqs=8965 
[726513.069518] rcu:     (t=21004 jiffies g=188780045 q=44466)
[726513.069520] NMI backtrace for cpu 1
[726513.069523] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726513.069524] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726513.069525] Call Trace:
[726513.069528]  <IRQ>
[726513.069532]  dump_stack+0x5c/0x80
[726513.069534]  nmi_cpu_backtrace.cold.4+0x13/0x50
[726513.069537]  ? lapic_can_unplug_cpu.cold.29+0x3b/0x3b
[726513.069539]  nmi_trigger_cpumask_backtrace+0xf9/0xfb
[726513.069541]  rcu_dump_cpu_stacks+0x9b/0xcb
[726513.069543]  rcu_check_callbacks.cold.80+0x1db/0x338
[726513.069546]  ? tick_sched_do_timer+0x60/0x60
[726513.069547]  update_process_times+0x28/0x60
[726513.069549]  tick_sched_handle+0x22/0x60
[726513.069550]  tick_sched_timer+0x37/0x70
[726513.069552]  __hrtimer_run_queues+0x100/0x280
[726513.069553]  hrtimer_interrupt+0x100/0x220
[726513.069556]  smp_apic_timer_interrupt+0x6a/0x140
[726513.069557]  apic_timer_interrupt+0xf/0x20
[726513.069558]  </IRQ>
[726513.069561] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190
[726513.069562] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00
[726513.069563] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726513.069565] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726513.069566] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726513.069567] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726513.069568] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726513.069568] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726513.069571]  _raw_spin_lock+0x1c/0x20
[726513.069575]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726513.069577]  ? finish_wait+0x80/0x80
[726513.069579]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726513.069581]  kthread+0x112/0x130
[726513.069582]  ? kthread_bind+0x30/0x30
[726513.069584]  ret_from_fork+0x22/0x40
[726513.069590] Sending NMI from CPU 1 to CPUs 9:
[726513.069628] NMI backtrace for cpu 9
[726513.069628] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726513.069629] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726513.069629] Workqueue: events drm_sched_job_finish [gpu_sched]
[726513.069630] RIP: 0010:native_queued_spin_lock_slowpath+0xfc/0x190
[726513.069630] Code: 00 8b 07 85 c0 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01
[726513.069631] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202
[726513.069631] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726513.069631] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726513.069632] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726513.069632] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726513.069632] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726513.069633] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726513.069633] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726513.069633] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726513.069633] Call Trace:
[726513.069633]  _raw_spin_lock+0x1c/0x20
[726513.069634]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726513.069634]  process_one_work+0x1a7/0x3a0
[726513.069634]  worker_thread+0x30/0x390
[726513.069634]  ? create_worker+0x1a0/0x1a0
[726513.069634]  kthread+0x112/0x130
[726513.069634]  ? kthread_bind+0x30/0x30
[726513.069635]  ret_from_fork+0x22/0x40
[726520.952920] watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:2:13902]
[726520.952923] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726520.952954]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726520.952983]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726520.952994] CPU: 5 PID: 13902 Comm: kworker/5:2 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726520.952995] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726520.953001] Workqueue: events drm_sched_job_timedout [gpu_sched]
[726520.953005] RIP: 0010:native_queued_spin_lock_slowpath+0x15f/0x190
[726520.953007] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 80 28 02 00 48 03 04 f5 00 a7 0c b2 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 88 48 89 c6 0f 0d 08 eb
[726520.953008] RSP: 0018:ffffa24968ab7df8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[726520.953010] RAX: 0000000000000000 RBX: ffff96b837ff6c80 RCX: 0000000000180000
[726520.953011] RDX: ffff96b83ed62880 RSI: 0000000000000009 RDI: ffff96b837ff6dc0
[726520.953012] RBP: ffff96b1d43c6400 R08: ffff96b83ed62660 R09: 0000000000000000
[726520.953013] R10: 0000000000000000 R11: 0000000000000000 R12: ffff96b837ff6db0
[726520.953013] R13: ffff96b837ff6dc0 R14: ffff96b837ff0000 R15: ffff96b837ff3430
[726520.953015] FS:  0000000000000000(0000) GS:ffff96b83ed40000(0000) knlGS:0000000000000000
[726520.953016] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726520.953016] CR2: 00007f37f767cfe0 CR3: 00000001554e6000 CR4: 00000000003406e0
[726520.953017] Call Trace:
[726520.953021]  _raw_spin_lock+0x1c/0x20
[726520.953024]  drm_sched_hw_job_reset+0x2b/0x160 [gpu_sched]
[726520.953055]  amdgpu_device_gpu_recover+0xbc/0x6b0 [amdgpu]
[726520.953059]  process_one_work+0x1a7/0x3a0
[726520.953061]  worker_thread+0x30/0x390
[726520.953063]  ? create_worker+0x1a0/0x1a0
[726520.953064]  kthread+0x112/0x130
[726520.953065]  ? kthread_bind+0x30/0x30
[726520.953067]  ret_from_fork+0x22/0x40
[726540.939451] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [sdma1:799]
[726540.939455] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726540.939484]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726540.939513]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726540.939524] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726540.939525] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726540.939529] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190
[726540.939531] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00
[726540.939532] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726540.939534] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726540.939535] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726540.939536] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726540.939537] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726540.939538] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726540.939539] FS:  0000000000000000(0000) GS:ffff96b83ec40000(0000) knlGS:0000000000000000
[726540.939540] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726540.939541] CR2: 000000000233e148 CR3: 000000052c00a000 CR4: 00000000003406e0
[726540.939542] Call Trace:
[726540.939546]  _raw_spin_lock+0x1c/0x20
[726540.939550]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726540.939552]  ? finish_wait+0x80/0x80
[726540.939554]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726540.939556]  kthread+0x112/0x130
[726540.939558]  ? kthread_bind+0x30/0x30
[726540.939559]  ret_from_fork+0x22/0x40
[726540.959449] watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [kworker/9:0:4806]
[726540.959452] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726540.959478]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726540.959505]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726540.959514] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726540.959515] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726540.959521] Workqueue: events drm_sched_job_finish [gpu_sched]
[726540.959525] RIP: 0010:native_queued_spin_lock_slowpath+0xfc/0x190
[726540.959526] Code: 00 8b 07 85 c0 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01
[726540.959528] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726540.959529] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726540.959530] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726540.959531] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726540.959532] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726540.959532] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726540.959534] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726540.959535] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726540.959535] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726540.959536] Call Trace:
[726540.959540]  _raw_spin_lock+0x1c/0x20
[726540.959542]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726540.959545]  process_one_work+0x1a7/0x3a0
[726540.959547]  worker_thread+0x30/0x390
[726540.959548]  ? create_worker+0x1a0/0x1a0
[726540.959550]  kthread+0x112/0x130
[726540.959551]  ? kthread_bind+0x30/0x30
[726540.959552]  ret_from_fork+0x22/0x40
[726548.950873] watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:2:13902]
[726548.950877] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726548.950906]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726548.950934]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726548.950945] CPU: 5 PID: 13902 Comm: kworker/5:2 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726548.950946] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726548.950952] Workqueue: events drm_sched_job_timedout [gpu_sched]
[726548.950956] RIP: 0010:native_queued_spin_lock_slowpath+0x15f/0x190
[726548.950957] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 80 28 02 00 48 03 04 f5 00 a7 0c b2 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 88 48 89 c6 0f 0d 08 eb
[726548.950959] RSP: 0018:ffffa24968ab7df8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[726548.950960] RAX: 0000000000000000 RBX: ffff96b837ff6c80 RCX: 0000000000180000
[726548.950961] RDX: ffff96b83ed62880 RSI: 0000000000000009 RDI: ffff96b837ff6dc0
[726548.950962] RBP: ffff96b1d43c6400 R08: ffff96b83ed62660 R09: 0000000000000000
[726548.950963] R10: 0000000000000000 R11: 0000000000000000 R12: ffff96b837ff6db0
[726548.950964] R13: ffff96b837ff6dc0 R14: ffff96b837ff0000 R15: ffff96b837ff3430
[726548.950965] FS:  0000000000000000(0000) GS:ffff96b83ed40000(0000) knlGS:0000000000000000
[726548.950966] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726548.950967] CR2: 00007f37f767cfe0 CR3: 00000001554e6000 CR4: 00000000003406e0
[726548.950968] Call Trace:
[726548.950972]  _raw_spin_lock+0x1c/0x20
[726548.950974]  drm_sched_hw_job_reset+0x2b/0x160 [gpu_sched]
[726548.951008]  amdgpu_device_gpu_recover+0xbc/0x6b0 [amdgpu]
[726548.951011]  process_one_work+0x1a7/0x3a0
[726548.951013]  worker_thread+0x30/0x390
[726548.951015]  ? create_worker+0x1a0/0x1a0
[726548.951016]  kthread+0x112/0x130
[726548.951017]  ? kthread_bind+0x30/0x30
[726548.951019]  ret_from_fork+0x22/0x40
[726568.937457] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [sdma1:799]
[726568.937461] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726568.937489]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726568.937518]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726568.937529] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726568.937530] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726568.937534] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190
[726568.937536] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00
[726568.937537] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726568.937539] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726568.937540] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726568.937541] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726568.937542] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726568.937542] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726568.937544] FS:  0000000000000000(0000) GS:ffff96b83ec40000(0000) knlGS:0000000000000000
[726568.937544] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726568.937545] CR2: 000000000233e148 CR3: 000000052c00a000 CR4: 00000000003406e0
[726568.937546] Call Trace:
[726568.937550]  _raw_spin_lock+0x1c/0x20
[726568.937554]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726568.937557]  ? finish_wait+0x80/0x80
[726568.937559]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726568.937561]  kthread+0x112/0x130
[726568.937562]  ? kthread_bind+0x30/0x30
[726568.937563]  ret_from_fork+0x22/0x40
[726568.957456] watchdog: BUG: soft lockup - CPU#9 stuck for 23s! [kworker/9:0:4806]
[726568.957460] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726568.957486]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726568.957514]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726568.957525] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726568.957526] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726568.957531] Workqueue: events drm_sched_job_finish [gpu_sched]
[726568.957536] RIP: 0010:native_queued_spin_lock_slowpath+0xfc/0x190
[726568.957537] Code: 00 8b 07 85 c0 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01
[726568.957539] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726568.957540] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726568.957541] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726568.957542] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726568.957543] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726568.957544] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726568.957545] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726568.957546] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726568.957546] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726568.957547] Call Trace:
[726568.957551]  _raw_spin_lock+0x1c/0x20
[726568.957553]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726568.957557]  process_one_work+0x1a7/0x3a0
[726568.957558]  worker_thread+0x30/0x390
[726568.957560]  ? create_worker+0x1a0/0x1a0
[726568.957561]  kthread+0x112/0x130
[726568.957562]  ? kthread_bind+0x30/0x30
[726568.957564]  ret_from_fork+0x22/0x40
[726576.076960] rcu: INFO: rcu_sched self-detected stall on CPU
[726576.076967] rcu:    1-....: (36756 ticks this GP) idle=f92/1/0x4000000000000002 softirq=32058193/32094948 fqs=15830 
[726576.076969] rcu:     (t=36757 jiffies g=188780045 q=50841)
[726576.076972] NMI backtrace for cpu 1
[726576.076975] CPU: 1 PID: 799 Comm: sdma1 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726576.076977] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726576.076978] Call Trace:
[726576.076981]  <IRQ>
[726576.076986]  dump_stack+0x5c/0x80
[726576.076989]  nmi_cpu_backtrace.cold.4+0x13/0x50
[726576.076991]  ? lapic_can_unplug_cpu.cold.29+0x3b/0x3b
[726576.076993]  nmi_trigger_cpumask_backtrace+0xf9/0xfb
[726576.076996]  rcu_dump_cpu_stacks+0x9b/0xcb
[726576.076999]  rcu_check_callbacks.cold.80+0x1db/0x338
[726576.077001]  ? tick_sched_do_timer+0x60/0x60
[726576.077003]  update_process_times+0x28/0x60
[726576.077005]  tick_sched_handle+0x22/0x60
[726576.077007]  tick_sched_timer+0x37/0x70
[726576.077009]  __hrtimer_run_queues+0x100/0x280
[726576.077011]  hrtimer_interrupt+0x100/0x220
[726576.077013]  smp_apic_timer_interrupt+0x6a/0x140
[726576.077015]  apic_timer_interrupt+0xf/0x20
[726576.077016]  </IRQ>
[726576.077019] RIP: 0010:native_queued_spin_lock_slowpath+0x52/0x190
[726576.077021] Code: 74 37 81 e6 00 ff ff ff 75 5f f0 0f ba 2f 08 8b 07 72 56 89 c2 30 e6 a9 00 00 ff ff 75 47 85 d2 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 8b 37 81 fe 00 01 00
[726576.077023] RSP: 0018:ffffa24948227e78 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[726576.077024] RAX: 0000000000180101 RBX: ffff96b7d36b7000 RCX: 0000000000000000
[726576.077025] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726576.077026] RBP: ffff96b837ff6c80 R08: ffff96b3de2a6d80 R09: 000294b17eddab00
[726576.077027] R10: 00000000003d0900 R11: ffffa2494337d000 R12: ffff96b3de2a6d00
[726576.077028] R13: ffff96b837ff6c80 R14: 0000000000000000 R15: ffff96b837ff6dc0
[726576.077031]  _raw_spin_lock+0x1c/0x20
[726576.077035]  drm_sched_main+0x2e8/0x4a0 [gpu_sched]
[726576.077037]  ? finish_wait+0x80/0x80
[726576.077039]  ? drm_sched_select_entity+0xc0/0xc0 [gpu_sched]
[726576.077041]  kthread+0x112/0x130
[726576.077042]  ? kthread_bind+0x30/0x30
[726576.077044]  ret_from_fork+0x22/0x40
[726576.077049] Sending NMI from CPU 1 to CPUs 9:
[726576.077087] NMI backtrace for cpu 9
[726576.077088] CPU: 9 PID: 4806 Comm: kworker/9:0 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726576.077088] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726576.077089] Workqueue: events drm_sched_job_finish [gpu_sched]
[726576.077089] RIP: 0010:native_queued_spin_lock_slowpath+0x101/0x190
[726576.077090] Code: 75 0d be 01 00 00 00 f0 0f b1 37 85 c0 74 38 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3f 31 f6 eb 02 f3 90 8b 07 66 85 c0 <75> f7 41 89 c0 66 45 31 c0 44 39 c1 74 67 c6 07 01 48 85 f6 74 11
[726576.077090] RSP: 0018:ffffa2494d9c3e58 EFLAGS: 00000202
[726576.077091] RAX: 0000000000180101 RBX: ffff96b7d36b4c30 RCX: 0000000000280000
[726576.077091] RDX: ffff96b83ee62880 RSI: 0000000000000000 RDI: ffff96b837ff6dc0
[726576.077091] RBP: ffff96b837ff6dc0 R08: ffff96b83ed1a830 R09: 000073746e657665
[726576.077091] R10: 8080808080808080 R11: ffffa2494d9c3e9b R12: ffff96b837ff6c80
[726576.077092] R13: ffff96b7d36b4c00 R14: ffff96b1c2bebe00 R15: ffff96b7d36b4c38
[726576.077092] FS:  0000000000000000(0000) GS:ffff96b83ee40000(0000) knlGS:0000000000000000
[726576.077092] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726576.077092] CR2: 00007f886f2c26e0 CR3: 000000052c00a000 CR4: 00000000003406e0
[726576.077093] Call Trace:
[726576.077093]  _raw_spin_lock+0x1c/0x20
[726576.077093]  drm_sched_job_finish+0x33/0x130 [gpu_sched]
[726576.077093]  process_one_work+0x1a7/0x3a0
[726576.077093]  worker_thread+0x30/0x390
[726576.077094]  ? create_worker+0x1a0/0x1a0
[726576.077094]  kthread+0x112/0x130
[726576.077094]  ? kthread_bind+0x30/0x30
[726576.077094]  ret_from_fork+0x22/0x40
[726576.948901] watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:2:13902]
[726576.948904] Modules linked in: snd_seq_dummy snd_seq rndis_host cdc_ether usbnet mii dm_crypt algif_skcipher af_alg dm_mod loop vhost_net vhost macvtap macvlan tap arc4 md4 sha512_ssse3 sha512_generic nls_utf8 cifs ccm dns_resolver fscache nf_conntrack_netlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay rfcomm nft_chain_route_ipv4 xt_CHECKSUM nft_chain_nat_ipv4 ipt_MASQUERADE nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 nft_counter xt_tcpudp nft_compat tun bridge stp llc devlink nf_tables nfnetlink cmac bnep amdkfd binfmt_misc amdgpu snd_hda_codec_realtek uvcvideo snd_hda_codec_generic videobuf2_vmalloc snd_hda_codec_hdmi videobuf2_memops videobuf2_v4l2 btusb videobuf2_common snd_hda_intel chash btrtl btbcm gpu_sched btintel videodev
[726576.948932]  ttm edac_mce_amd bluetooth snd_usb_audio snd_hda_codec media drm_kms_helper snd_usbmidi_lib nls_ascii nls_cp437 snd_hda_core snd_rawmidi vfat fat kvm_amd efi_pstore snd_seq_device snd_hwdep drm kvm crct10dif_pclmul drbg snd_pcm crc32_pclmul ansi_cprng snd_timer ccp snd ecdh_generic rfkill wmi_bmof mxm_wmi ghash_clmulni_intel efivars pcspkr sp5100_tco k10temp evdev joydev cdc_acm i2c_algo_bit soundcore rng_core vfio_pci vfio_virqfd irqbypass vfio_iommu_type1 vfio sg wmi button parport_pc sunrpc ppdev lp parport cpuid msr efivarfs ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod sr_mod cdrom hid_steam sd_mod hid_logitech_hidpp
[726576.948961]  hid_logitech_dj hid_generic usbhid hid uas usb_storage crc32c_intel ahci xhci_pci libahci xhci_hcd libata aesni_intel usbcore scsi_mod r8169 aes_x86_64 crypto_simd cryptd glue_helper realtek i2c_piix4 libphy usb_common gpio_amdpt gpio_generic
[726576.948972] CPU: 5 PID: 13902 Comm: kworker/5:2 Tainted: G      D W    L    4.19.0-5-amd64 #1 Debian 4.19.37-3
[726576.948973] Hardware name: MSI MS-7A33/X370 SLI PLUS (MS-7A33), BIOS 3.40 06/22/2017
[726576.948979] Workqueue: events drm_sched_job_timedout [gpu_sched]
[726576.948982] RIP: 0010:native_queued_spin_lock_slowpath+0x15f/0x190
[726576.948984] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 80 28 02 00 48 03 04 f5 00 a7 0c b2 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 88 48 89 c6 0f 0d 08 eb
[726576.948985] RSP: 0018:ffffa24968ab7df8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[726576.948987] RAX: 0000000000000000 RBX: ffff96b837ff6c80 RCX: 0000000000180000
[726576.948988] RDX: ffff96b83ed62880 RSI: 0000000000000009 RDI: ffff96b837ff6dc0
[726576.948989] RBP: ffff96b1d43c6400 R08: ffff96b83ed62660 R09: 0000000000000000
[726576.948990] R10: 0000000000000000 R11: 0000000000000000 R12: ffff96b837ff6db0
[726576.948991] R13: ffff96b837ff6dc0 R14: ffff96b837ff0000 R15: ffff96b837ff3430
[726576.948992] FS:  0000000000000000(0000) GS:ffff96b83ed40000(0000) knlGS:0000000000000000
[726576.948993] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[726576.948994] CR2: 00007f37f767cfe0 CR3: 00000001554e6000 CR4: 00000000003406e0
[726576.948995] Call Trace:
[726576.948999]  _raw_spin_lock+0x1c/0x20
[726576.949001]  drm_sched_hw_job_reset+0x2b/0x160 [gpu_sched]
[726576.949034]  amdgpu_device_gpu_recover+0xbc/0x6b0 [amdgpu]
[726576.949038]  process_one_work+0x1a7/0x3a0
[726576.949040]  worker_thread+0x30/0x390
[726576.949041]  ? create_worker+0x1a0/0x1a0
[726576.949042]  kthread+0x112/0x130
[726576.949044]  ? kthread_bind+0x30/0x30
[726576.949045]  ret_from_fork+0x22/0x40