Skip to content

Instantly share code, notes, and snippets.

@notro

notro/gist:53afe9fdc3d0afbf0fb12678be1ab377

Created August 27, 2022 15:04
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save notro/53afe9fdc3d0afbf0fb12678be1ab377 to your computer and use it in GitHub Desktop.
Save notro/53afe9fdc3d0afbf0fb12678be1ab377 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
This command is run through ssh:
$ modetest -M vc4 -a -P 61@68:720x480 -s 45:720x480i
The kernel messages appears on the serial console.
This is the delimiter between runs:
####################################################################################################
[ 111.946668] 8<--- cut here ---
[ 111.950691] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 111.958859] [00000000] *pgd=80000000004003, *pmd=00000000
[ 111.965102] Internal error: : 1211 [#1] SMP ARM
[ 111.970309] Modules linked in: brcmfmac brcmutil vc4 cfg80211 snd_soc_core snd_pcm_dmaengine raspberrypi_hwmon crc32_arm_ce snd_pcm bcm2711_thermal snd_timer snd genet soundcore drm_dma_helper mdio_bcm_unimac cec nvmem_rmem
[ 111.992387] CPU: 2 PID: 22 Comm: kworker/2:0 Not tainted 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 112.002679] Hardware name: BCM2711
[ 112.006837] Workqueue: events_freezable_power_ thermal_zone_device_check
[ 112.014342] PC is at regmap_mmio_read+0x40/0x5c
[ 112.019661] LR is at regmap_mmio_read+0x40/0x5c
[ 112.024957] pc : [<c0953cb8>] lr : [<c0953cb8>] psr: 20000093
[ 112.032004] sp : f0881e40 ip : 00000000 fp : effc2905
[ 112.038014] r10: c1808f18 r9 : 00000000 r8 : c1fd7e50
[ 112.044023] r7 : f0881e90 r6 : f0881e90 r5 : 00000200 r4 : c523d100
[ 112.051356] r3 : f089b200 r2 : f0881e90 r1 : 00000200 r0 : 00000000
[ 112.058687] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[ 112.066736] Control: 30c5383d Table: 0396aa40 DAC: 55555555
[ 112.073284] Register r0 information: NULL pointer
[ 112.078778] Register r1 information: non-paged memory
[ 112.084627] Register r2 information: 2-page vmalloc region starting at 0xf0880000 allocated at kernel_clone+0x84/0x75c
[ 112.096919] Register r3 information: 0-page vmalloc region starting at 0xf089b000 allocated at of_iomap+0x54/0x7c
[ 112.108814] Register r4 information: slab kmalloc-64 start c523d100 pointer offset 0 size 64
[ 112.118929] Register r5 information: non-paged memory
[ 112.124819] Register r6 information: 2-page vmalloc region starting at 0xf0880000 allocated at kernel_clone+0x84/0x75c
[ 112.137183] Register r7 information: 2-page vmalloc region starting at 0xf0880000 allocated at kernel_clone+0x84/0x75c
[ 112.149578] Register r8 information: non-slab/vmalloc memory
[ 112.156092] Register r9 information: NULL pointer
[ 112.161625] Register r10 information: non-slab/vmalloc memory
[ 112.168191] Register r11 information: non-slab/vmalloc memory
[ 112.174726] Register r12 information: NULL pointer
[ 112.180276] Process kworker/2:0 (pid: 22, stack limit = 0x3d7c34b1)
[ 112.187339] Stack: (0xf0881e40 to 0xf0882000)
[ 112.192461] 1e40: c49c0c00 00000200 c49c0c00 c094cb80 c49c0c00 c0f04c00 00000001 c49c0c00
[ 112.202194] 1e60: 00000200 f0881e90 00000001 c1fd7e50 00000000 c1808f18 effc2905 c094cd8c
[ 112.211991] 1e80: 000641b8 f0881ee0 fffffe19 bf06d058 effc2905 c1808ec8 c29b8000 f0881ee0
[ 112.221847] 1ea0: c29b8358 c0bed780 c29b8000 00000000 c29b8358 c0bea6bc c29a30c0 00000000
[ 112.231764] 1ec0: effbecd0 60000093 c024723c c0296cfc 00000000 c0297088 00000001 c0ef4eb4
[ 112.241716] 1ee0: c29b83ac c1808ec8 effbecc0 c29b83ac c2932300 effbecc0 effc2900 c1973a60
[ 112.251741] 1f00: 00000000 c1808f18 effc2905 c02472d4 00000001 00000000 c0247228 c1808ec8
[ 112.261779] 1f20: c024782c effbecc0 c1fd7e80 c1dffc10 00000000 c144f7bc 00000000 c1808ec8
[ 112.271816] 1f40: effbecc0 c2932300 effbecc0 c2932318 effbecfc c1805d40 c29a30c0 00000008
[ 112.281859] 1f60: effbecc0 c02477b8 00000000 c29314c0 c29a30c0 c0247784 c2932300 c2932380
[ 112.291936] 1f80: f081dd94 00000000 00000000 c0250c54 c29314c0 c0250b60 00000000 00000000
[ 112.302013] 1fa0: 00000000 00000000 00000000 c0200100 00000000 00000000 00000000 00000000
[ 112.312134] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 112.322344] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 112.332635] regmap_mmio_read from _regmap_read+0x6c/0x234
[ 112.339213] _regmap_read from regmap_read+0x44/0x64
[ 112.345249] regmap_read from bcm2711_get_temp+0x58/0xa0 [bcm2711_thermal]
[ 112.353209] bcm2711_get_temp [bcm2711_thermal] from thermal_zone_get_temp+0x54/0x74
[ 112.362038] thermal_zone_get_temp from thermal_zone_device_update+0x80/0x568
[ 112.370244] thermal_zone_device_update from process_one_work+0x29c/0x74c
[ 112.378089] process_one_work from worker_thread+0x34/0x4d8
[ 112.384695] worker_thread from kthread+0xf4/0x110
[ 112.390496] kthread from ret_from_fork+0x14/0x34
[ 112.396190] Exception stack(0xf0881fb0 to 0xf0881ff8)
[ 112.402216] 1fa0: 00000000 00000000 00000000 00000000
[ 112.412303] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 112.422373] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 112.429953] Code: e5943014 e1a01005 e1a00004 e12fff33 (e5860000)
[ 112.437003] ---[ end trace 0000000000000000 ]---
[ 112.442548] note: kworker/2:0[22] exited with preempt_count 1
[ 112.449423] ------------[ cut here ]------------
[ 112.454982] WARNING: CPU: 2 PID: 855 at drivers/firmware/raspberrypi.c:63 rpi_firmware_property_list+0x204/0x270
[ 112.466985] Firmware transaction timeout
[ 112.466994] Modules linked in: brcmfmac brcmutil vc4 cfg80211 snd_soc_core snd_pcm_dmaengine raspberrypi_hwmon crc32_arm_ce snd_pcm bcm2711_thermal snd_timer snd genet soundcore drm_dma_helper mdio_bcm_unimac cec nvmem_rmem
[ 112.494423] CPU: 2 PID: 855 Comm: modetest Tainted: G D 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 112.506149] Hardware name: BCM2711
[ 112.510383] unwind_backtrace from show_stack+0x18/0x1c
[ 112.516454] show_stack from dump_stack_lvl+0x58/0x70
[ 112.522337] dump_stack_lvl from __warn+0xd4/0x200
[ 112.527954] __warn from warn_slowpath_fmt+0xa0/0xd0
[ 112.533740] warn_slowpath_fmt from rpi_firmware_property_list+0x204/0x270
[ 112.541449] rpi_firmware_property_list from rpi_firmware_property+0x68/0x94
[ 112.549326] rpi_firmware_property from raspberrypi_clock_property+0x50/0x84
[ 112.557197] raspberrypi_clock_property from raspberrypi_fw_set_rate+0x4c/0xc4
[ 112.565242] raspberrypi_fw_set_rate from clk_change_rate+0x16c/0x6f8
[ 112.572502] clk_change_rate from clk_core_set_rate_nolock+0x1c4/0x2a4
[ 112.579857] clk_core_set_rate_nolock from clk_set_rate_range.part.0+0x128/0x2ac
[ 112.588091] clk_set_rate_range.part.0 from vc4_atomic_commit_tail+0x2b4/0x854 [vc4]
[ 112.596832] vc4_atomic_commit_tail [vc4] from commit_tail+0xa4/0x19c
[ 112.604269] commit_tail from drm_atomic_helper_commit+0x16c/0x194
[ 112.611279] drm_atomic_helper_commit from drm_atomic_commit+0xb4/0xec
[ 112.618625] drm_atomic_commit from drm_mode_atomic_ioctl+0x8f0/0xb6c
[ 112.625877] drm_mode_atomic_ioctl from drm_ioctl_kernel+0xcc/0x170
[ 112.632950] drm_ioctl_kernel from drm_ioctl+0x1d8/0x374
[ 112.639056] drm_ioctl from sys_ioctl+0xe4/0xbac
[ 112.644462] sys_ioctl from ret_fast_syscall+0x0/0x1c
[ 112.650292] Exception stack(0xf0a05fa8 to 0xf0a05ff0)
[ 112.656108] 5fa0: 00040530 bebda338 00000003 c03864bc bebda338 00000000
[ 112.665798] 5fc0: 00040530 bebda338 c03864bc 00000036 bebda338 00042120 00042180 00042118
[ 112.675507] 5fe0: b6edc09c bebda30c b6ec363c b6e151ac
[ 112.681375] irq event stamp: 4914
[ 112.685441] hardirqs last enabled at (4913): [<c0f04e80>] _raw_spin_unlock_irqrestore+0x4c/0x50
[ 112.695779] hardirqs last disabled at (4914): [<c0ef8c20>] __schedule+0x4e0/0x964
[ 112.704099] softirqs last enabled at (4886): [<c0201808>] __do_softirq+0x308/0x534
[ 112.712593] softirqs last disabled at (4879): [<c022ecec>] irq_exit+0x170/0x1a0
[ 112.720717] ---[ end trace 0000000000000000 ]---
[ 112.726171] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-core frequency: -110
Pulled the plug
####################################################################################################
$ dmesg -w
The first part came fast, other parts of this came really slow:
[ 85.850197] 8<--- cut here ---
[ 85.854199] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 85.862365] [00000000] *pgd=80000000004003, *pmd=00000000
[ 85.868610] Internal error: : 1211 [#1] SMP ARM
[ 85.873814] Modules linked in: brcmfmac brcmutil cfg80211 vc4 snd_soc_core raspberrypi_hwmon snd_pcm_dmaengine snd_pcm crc32_arm_ce snd_timer snd soundcore drm_dma_helper genet cec bcm2711_thermal mdio_bcm_unimac nvmem_rmem
[ 85.895889] CPU: 1 PID: 91 Comm: kworker/1:2 Tainted: G W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 85.907564] Hardware name: BCM2711
[ 85.911710] Workqueue: events_freezable_power_ thermal_zone_device_check
[ 85.919205] PC is at regmap_mmio_read+0x40/0x5c
[ 85.924516] LR is at regmap_mmio_read+0x40/0x5c
[ 85.929800] pc : [<c0953cb8>] lr : [<c0953cb8>] psr: 20000093
[ 85.936835] sp : f0e49e40 ip : 00000000 fp : effb2905
[ 85.942833] r10: c1808f18 r9 : 00000000 r8 : c1fd7e50
[ 85.948832] r7 : f0e49e90 r6 : f0e49e90 r5 : 00000200 r4 : c3babec0
[ 85.956155] r3 : f10ce200 r2 : f0e49e90 r1 : 00000200 r0 : 00000000
[ 85.963478] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[ 85.971521] Control: 30c5383d Table: 02ad6bc0 DAC: 55555555
[ 85.978059] Register r0 information: NULL pointer
[ 85.983544] Register r1 information: non-paged memory
[ 85.989384] Register r2 information: 2-page vmalloc region starting at 0xf0e48000 allocated at kernel_clone+0x84/0x75c
[ 86.001659] Register r3 information: 0-page vmalloc region starting at 0xf10ce000 allocated at of_iomap+0x54/0x7c
[ 86.013537] Register r4 information: slab kmalloc-64 start c3babec0 pointer offset 0 size 64
[ 86.023636] Register r5 information: non-paged memory
[ 86.029518] Register r6 information: 2-page vmalloc region starting at 0xf0e48000 allocated at kernel_clone+0x84/0x75c
[ 86.041863] Register r7 information: 2-page vmalloc region starting at 0xf0e48000 allocated at kernel_clone+0x84/0x75c
[ 86.054237] Register r8 information: non-slab/vmalloc memory
[ 86.060741] Register r9 information: NULL pointer
[ 86.066262] Register r10 information: non-slab/vmalloc memory
[ 86.072818] Register r11 information: non-slab/vmalloc memory
[ 86.079346] Register r12 information: NULL pointer
[ 86.084896] Process kworker/1:2 (pid: 91, stack limit = 0xeb3aaee3)
[ 86.091964] Stack: (0xf0e49e40 to 0xf0e4a000)
[ 86.097086] 9e40: c5910400 00000200 c5910400 c094cb80 c5910400 c0f04c00 00000001 c5910400
[ 86.106817] 9e60: 00000200 f0e49e90 00000001 c1fd7e50 00000000 c1808f18 effb2905 c094cd8c
[ 86.116613] 9e80: 000641b8 f0e49ee0 fffffe19 bf012058 effb2905 c1808ec8 c29b8000 f0e49ee0
[ 86.126465] 9ea0: c29b8358 c0bed780 c29b8000 00000000 c29b8358 c0bea6bc c2b61040 00000000
[ 86.136372] 9ec0: effaecd0 60000093 c024723c c0296cfc 00000000 c0297088 00000001 c0ef4eb4
[ 86.146314] 9ee0: c29b83ac c1808ec8 effaecc0 c29b83ac c3996900 effaecc0 effb2900 c1973a60
[ 86.156328] 9f00: 00000000 c1808f18 effb2905 c02472d4 00000001 00000000 c0247228 c1808ec8
[ 86.166352] 9f20: c024782c effaecc0 c1fd7e80 c1dff698 00000000 c144f7bc 00000000 c1808ec8
[ 86.176377] 9f40: effaecc0 c3996900 effaecc0 c3996918 effaecfc c1805d40 c2b61040 00000008
[ 86.186407] 9f60: effaecc0 c02477b8 00000000 c3974b00 c2b61040 c0247784 c3996900 c2b49a00
[ 86.196471] 9f80: f0869ea4 00000000 00000000 c0250c54 c3974b00 c0250b60 00000000 00000000
[ 86.206536] 9fa0: 00000000 00000000 00000000 c0200100 00000000 00000000 00000000 00000000
[ 86.216642] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 86.226831] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 86.237103] regmap_mmio_read from _regmap_read+0x6c/0x234
[ 86.243671] _regmap_read from regmap_read+0x44/0x64
[ 86.249697] regmap_read from bcm2711_get_temp+0x58/0xa0 [bcm2711_thermal]
[ 86.257648] bcm2711_get_temp [bcm2711_thermal] from thermal_zone_get_temp+0x54/0x74
[ 86.266467] thermal_zone_get_temp from thermal_zone_device_update+0x80/0x568
[ 86.274663] thermal_zone_device_update from process_one_work+0x29c/0x74c
[ 86.282501] process_one_work from worker_thread+0x34/0x4d8
[ 86.289099] worker_thread from kthread+0xf4/0x110
[ 86.294894] kthread from ret_from_fork+0x14/0x34
[ 86.300583] Exception stack(0xf0e49fb0 to 0xf0e49ff8)
[ 86.306603] 9fa0: 00000000 00000000 00000000 00000000
[ 86.316674] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 86.326730] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 86.334304] Code: e5943014 e1a01005 e1a00004 e12fff33 (e5860000)
[ 86.341347] ---[ end trace 0000000000000000 ]---
[ 86.346886] note: kworker/1:2[91] exited with preempt_count 1
[ 96.650207] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 96.650237] mmc1: Timeout waiting for hardware interrupt.
[ 96.656135] rcu: 0-....: (1 ticks this GP) idle=391/0/0x1 softirq=3296/3296 fqs=946
[ 96.661528] mmc1: sdhci: ============ SDHCI REGISTER DUMP ===========
[ 96.669352] rcu: 1-....: (8 ticks this GP) idle=105/1/0x40000002 softirq=3689/3691 fqs=946
[ 96.675786] mmc1: sdhci: Sys addr: 0x00000008 | Version: 0x00001002
[ 96.684218] (detected by 3, t=2926 jiffies, g=1229, q=5 ncpus=4)
[ 96.690650] mmc1: sdhci: Blk size: 0x00007200 | Blk cnt: 0x00000000
[ 96.696738] Sending NMI from CPU 3 to CPUs 0:
[ 96.703170] mmc1: sdhci: Argument: 0x000965a0 | Trn mode: 0x0000002b
[ 96.723533] mmc1: sdhci: Present: 0x1fff0000 | Host ctl: 0x00000017
[ 96.730805] mmc1: sdhci: Power: 0x0000000f | Blk gap: 0x00000080
[ 96.738074] mmc1: sdhci: Wake-up: 0x00000000 | Clock: 0x00000107
[ 96.745328] mmc1: sdhci: Timeout: 0x00000005 | Int stat: 0x00000003
[ 96.752569] mmc1: sdhci: Int enab: 0x03ff100b | Sig enab: 0x03ff100b
[ 96.759799] mmc1: sdhci: ACmd stat: 0x00000000 | Slot int: 0x00000001
[ 96.767022] mmc1: sdhci: Caps: 0x45ee6432 | Caps_1: 0x0000a525
[ 96.774238] mmc1: sdhci: Cmd: 0x0000193a | Max curr: 0x00080008
[ 96.781448] mmc1: sdhci: Resp[0]: 0x00000900 | Resp[1]: 0x00edc87f
[ 96.788656] mmc1: sdhci: Resp[2]: 0x325b5900 | Resp[3]: 0x00000900
[ 96.795855] mmc1: sdhci: Host ctl2: 0x0000808c
[ 96.801032] mmc1: sdhci: ADMA Err: 0x00000000 | ADMA Ptr: 0xf7064208
[ 96.808219] mmc1: sdhci: ============================================
[ 96.815443] NMI backtrace for cpu 0
[ 96.815453] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 96.815465] Hardware name: BCM2711
[ 96.815470] PC is at arch_cpu_idle+0x40/0x44
[ 96.815490] LR is at arch_cpu_idle+0x3c/0x44
[ 96.815502] pc : [<c020894c>] lr : [<c0208948>] psr: 60000013
[ 96.815509] sp : c1801f20 ip : 00000001 fp : efffca40
[ 96.815515] r10: 00000000 r9 : 00000000 r8 : c180d500
[ 96.815520] r7 : c16b0368 r6 : c180d500 r5 : c1808f18 r4 : c1974740
[ 96.815526] r3 : c021ca40 r2 : 00000001 r1 : ffffffff r0 : ffffffff
[ 96.815533] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 96.815543] Control: 30c5383d Table: 04d68580 DAC: fffffffd
[ 96.815549] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 96.815559] Hardware name: BCM2711
[ 96.815566] unwind_backtrace from show_stack+0x18/0x1c
[ 96.815589] show_stack from dump_stack_lvl+0x58/0x70
[ 96.815606] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 96.815621] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 96.815635] do_handle_IPI from ipi_handler+0x20/0x28
[ 96.815651] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 96.815674] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 96.815689] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 96.815702] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 96.815723] generic_handle_arch_irq from __irq_svc+0x78/0x9c
[ 96.815739] Exception stack(0xc1801ed0 to 0xc1801f18)
[ 96.815749] 1ec0: ffffffff ffffffff 00000001 c021ca40
[ 96.815758] 1ee0: c1974740 c1808f18 c180d500 c16b0368 c180d500 00000000 00000000 efffca40
[ 96.815766] 1f00: 00000001 c1801f20 c0208948 c020894c 60000013 ffffffff
[ 96.815772] __irq_svc from arch_cpu_idle+0x40/0x44
[ 96.815788] arch_cpu_idle from default_idle_call+0x74/0x24c
[ 96.815812] default_idle_call from do_idle+0x218/0x280
[ 96.815836] do_idle from cpu_startup_entry+0x20/0x24
[ 96.815854] cpu_startup_entry from rest_init+0x150/0x1e4
[ 96.815874] rest_init from arch_post_acpi_subsys_init+0x0/0x18
[ 96.816542] Sending NMI from CPU 3 to CPUs 1:
[ 107.048340] rcu: rcu_sched kthread timer wakeup didn't happen for 1030 jiffies! g1229 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 107.061004] rcu: Possible timer handling issue on cpu=3 timer-softirq=1381
[ 107.068751] rcu: rcu_sched kthread starved for 1031 jiffies! g1229 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3
[ 107.080473] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 107.091031] rcu: RCU grace-period kthread stack dump:
[ 107.096904] task:rcu_sched state:I stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 107.106932] __schedule from schedule+0x60/0xd4
[ 107.112321] schedule from schedule_timeout+0x214/0x408
[ 107.118405] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 107.125096] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 107.131601] rcu_gp_kthread from kthread+0xf4/0x110
[ 107.137313] kthread from ret_from_fork+0x14/0x34
[ 107.142840] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 107.148714] 5fa0: 00000000 00000000 00000000 00000000
[ 107.158510] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 107.168309] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 107.175755] rcu: Stack dump where RCU GP kthread last ran:
[ 107.182064] NMI backtrace for cpu 3
[ 107.186366] CPU: 3 PID: 143 Comm: systemd-journal Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 107.198654] Hardware name: BCM2711
[ 107.202887] unwind_backtrace from show_stack+0x18/0x1c
[ 107.208967] show_stack from dump_stack_lvl+0x58/0x70
[ 107.214865] dump_stack_lvl from nmi_cpu_backtrace+0xf4/0x134
[ 107.221448] nmi_cpu_backtrace from nmi_trigger_cpumask_backtrace+0xf4/0x14c
[ 107.229331] nmi_trigger_cpumask_backtrace from rcu_check_gp_kthread_starvation+0x148/0x164
[ 107.239309] rcu_check_gp_kthread_starvation from rcu_sched_clock_irq+0x1174/0x1330
[ 107.247809] rcu_sched_clock_irq from update_process_times+0x70/0x9c
[ 107.254995] update_process_times from tick_sched_timer+0x54/0xb4
[ 107.261904] tick_sched_timer from __hrtimer_run_queues+0x278/0x5a8
[ 107.268984] __hrtimer_run_queues from hrtimer_interrupt+0x130/0x2d4
[ 107.276142] hrtimer_interrupt from arch_timer_handler_phys+0x30/0x38
[ 107.283385] arch_timer_handler_phys from handle_percpu_devid_irq+0xc4/0x328
[ 107.291246] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 107.299197] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 107.306365] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 107.313367] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 107.320470] call_with_stack from __irq_svc+0x88/0x9c
[ 107.326343] Exception stack(0xf0f9de40 to 0xf0f9de88)
[ 107.332208] de40: efffd670 c021c9d8 90f00000 90f00000 ffece000 00c00000 efffd000 00000000
[ 107.342000] de60: fb85071f 000fb850 00000255 f0f9dfb0 00400000 f0f9de90 c03b22e8 c03b2314
[ 107.351801] de80: 00000113 ffffffff
[ 107.356088] __irq_svc from __kmap_local_pfn_prot+0x124/0x194
[ 107.362661] __kmap_local_pfn_prot from handle_mm_fault+0x19c/0xd68
[ 107.369756] handle_mm_fault from do_page_fault+0x154/0x404
[ 107.376146] do_page_fault from do_DataAbort+0x38/0xb0
[ 107.382083] do_DataAbort from __dabt_usr+0x58/0x60
[ 107.387759] Exception stack(0xf0f9dfb0 to 0xf0f9dff8)
[ 107.393605] dfa0: b57a7008 004e3b38 00000024 ffffffff
[ 107.403376] dfc0: 004c4658 00000024 00000000 004e3b18 7151a1c4 b46f4703 b57a6fc8 bed321f0
[ 107.413171] dfe0: 004e3b00 bed32198 20000000 b6f99f80 20000010 ffffffff
[ 65.295577] ------------[ cut here ]------------
[ 65.295686] WARNING: CPU: 2 PID: 810 at drivers/firmware/raspberrypi.c:63 rpi_firmware_property_list+0x204/0x270[ 183.050356] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 183.059194] rcu: 0-....: (1 ticks this GP) idle=391/0/0x1 softirq=3296/3296 fqs=948
[ 183.067874] (detected by 3, t=11566 jiffies, g=1229, q=18 ncpus=4)
[ 183.074981] Sending NMI from CPU 3 to CPUs 0:
[ 193.082078] rcu: rcu_sched kthread starved for 4320 jiffies! g1229 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=3
[ 193.093755] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 193.104420] rcu: RCU grace-period kthread stack dump:
[ 193.110333] task:rcu_sched state:R running task stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 193.122009] __schedule from schedule+0x60/0xd4
[ 193.127428] schedule from schedule_timeout+0x214/0x408
[ 193.133538] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 193.140253] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 193.146771] rcu_gp_kthread from kthread+0xf4/0x110
[ 193.152485] kthread from ret_from_fork+0x14/0x34
[ 193.158003] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 193.163870] 5fa0: 00000000 00000000 00000000 00000000
[ 193.173678] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 193.183523] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 193.191011] rcu: Stack dump where RCU GP kthread last ran:
[ 193.197368] NMI backtrace for cpu 3
[ 193.201703] CPU: 3 PID: 1 Comm: systemd Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 193.213164] Hardware name: BCM2711
[ 193.217397] unwind_backtrace from show_stack+0x18/0x1c
[ 193.223472] show_stack from dump_stack_lvl+0x58/0x70
[ 193.229358] dump_stack_lvl from nmi_cpu_backtrace+0xf4/0x134
[ 193.235934] nmi_cpu_backtrace from nmi_trigger_cpumask_backtrace+0xf4/0x14c
[ 193.243814] nmi_trigger_cpumask_backtrace from rcu_check_gp_kthread_starvation+0x148/0x164
[ 193.253790] rcu_check_gp_kthread_starvation from rcu_sched_clock_irq+0x1174/0x1330
[ 193.262291] rcu_sched_clock_irq from update_process_times+0x70/0x9c
[ 193.269477] update_process_times from tick_sched_timer+0x54/0xb4
[ 193.276385] tick_sched_timer from __hrtimer_run_queues+0x278/0x5a8
[ 193.283465] __hrtimer_run_queues from hrtimer_interrupt+0x130/0x2d4
[ 193.290623] hrtimer_interrupt from arch_timer_handler_phys+0x30/0x38
[ 193.297866] arch_timer_handler_phys from handle_percpu_devid_irq+0xc4/0x328
[ 193.305733] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 193.313687] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 193.320860] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 193.327865] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 193.334968] call_with_stack from __irq_svc+0x88/0x9c
[ 193.340841] Exception stack(0xf081ddd8 to 0xf081de20)
[ 193.346706] ddc0: efffd670 c021c9d8
[ 193.356468] dde0: 90f00000 90f00000 ffece000 00c00000 efffd000 00000000 fa66271f 000fa662
[ 193.366225] de00: 00000255 f081dfb0 00400000 f081de28 c03b22e8 c03b2314 00000113 ffffffff
[ 193.376000] __irq_svc from __kmap_local_pfn_prot+0x124/0x194
[ 193.382585] __kmap_local_pfn_prot from v6_copy_user_highpage_nonaliasing+0x48/0xc8
[ 193.391096] v6_copy_user_highpage_nonaliasing from wp_page_copy+0xac/0x834
[ 193.398901] wp_page_copy from handle_mm_fault+0x924/0xd68
[ 193.405226] handle_mm_fault from do_page_fault+0x154/0x404
[ 193.411641] do_page_fault from do_DataAbort+0x38/0xb0
[ 193.417616] do_DataAbort from __dabt_usr+0x58/0x60
[ 193.423326] Exception stack(0xf081dfb0 to 0xf081dff8)
[ 193.429198] dfa0: 0062e7f8 000ed7e0 00000080 00000000
[ 193.438989] dfc0: 0066ce28 00700370 00000000 00700370 0066ce28 befdbe98 0066ce28 00000000
[ 193.448781] dfe0: 0062e7f8 befdbe10 befdbe98 00517788 80000010 ffffffff
[ 65.295730] Firmware transaction timeout
[ 65.295747] Modules linked in:
Pulled the plug.
####################################################################################################
$ dmesg -w
[65425.371460] ------------[ cut here ]------------
Starts printing 24 characters every 10 seconds:
[65425.371557] WARNING: CPU: 1 PID: 8121 at drivers/firmware/raspberrypi.c:63 rpi_firmware_property_list+0x204/0x270
[65425.371600] Firmware transaction timeout
[65425.371617] Modules linked in: brcmfmac brcmutil cfg80211 vc4 crc32_arm_ce raspberrypi_hwmon snd_soc_core snd_pcm_dmaengine snd_pcm snd_timer snd bcm2711_thermal genet soundcore drm_dma_helper cec mdio_bcm_unimac nvmem_rmem
[65425.371948] CPU: 1 PID: 8121 Comm: modetest Not tainted 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[65425.371971] Hardware name: BCM2711
[65425.371988] unwind_backtrace from show_stack+0x18/0x1c
[65425.372021] show_stack from dump_stack_lvl+0x58/0x70
[65425.372047] dump_stack_lvl from __warn+0xd4/0x200
[65425.372071] __warn from warn_slowpath_fmt+0xa0/0xd0
[65425.372097] warn_slowpath_fmt from rpi_firmware_property_list+0x204/0x270
[65425.372123] rpi_firmware_property_list from rpi_firmware_property+0x68/0x94
[65425.372146] rpi_firmware_property from raspberrypi_clock_property+0x50/0x84
[65425.372172] raspberrypi_clock_property from raspberrypi_fw_set_rate+0x4c/0xc4
[65425.372195] raspberrypi_fw_set_rate from clk_change_rate+0x16c/0x6f8
[65425.372219] clk_change_rate from clk_core_set_rate_nolock+0x1c4/0x2a4
[65425.372241] clk_core_set_rate_nolock from clk_set_rate_range.part.0+0x128/0x2ac
[65425.372265] clk_set_rate_range.part.0 from vc4_atomic_commit_tail+0x2b4/0x854 [vc4]
[65425.372519] vc4_atomic_commit_tail [vc4] from commit_tail+0xa4/0x19c
[65425.372706] commit_tail from drm_atomic_helper_commit+0x16c/0x194
[65425.372733] drm_atomic_helper_commit from drm_atomic_commit+0xb4/0xec
[65425.372761] drm_atomic_commit from drm_mode_atomic_ioctl+0x8f0/0xb6c
[65425.372788] drm_mode_atomic_ioctl from drm_ioctl_kernel+0xcc/0x170
[65425.372815] drm_ioctl_kernel from drm_ioctl+0x1d8/0x374
[65425.372841] drm_ioctl from sys_ioctl+0xe4/0xbac
[65425.372869] sys_ioctl from ret_fast_syscall+0x0/0x1c
This came all in one go:
[65425.3728[66504.293455] 8<--- cut here ---
[66504.297473] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[66504.305639] [00000000] *pgd=80000000004003, *pmd=00000000
[66504.311881] Internal error: : 1211 [#1] SMP ARM
[66504.317081] Modules linked in: brcmfmac brcmutil cfg80211 vc4 crc32_arm_ce raspberrypi_hwmon snd_soc_core snd_pcm_dmaengine snd_pcm snd_timer snd bcm2711_thermal genet soundcore drm_dma_helper cec mdio_bcm_unimac nvmem_rmem
[66504.339146] CPU: 0 PID: 8090 Comm: kworker/0:1 Tainted: G W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[66504.350986] Hardware name: BCM2711
[66504.355131] Workqueue: events_freezable_power_ thermal_zone_device_check
[66504.362625] PC is at regmap_mmio_read+0x40/0x5c
[66504.367938] LR is at regmap_mmio_read+0x40/0x5c
[66504.373227] pc : [<c0953cb8>] lr : [<c0953cb8>] psr: 20000093
[66504.380266] sp : f09d9e40 ip : 00000000 fp : effa2905
[66504.386264] r10: c1808f18 r9 : 00000000 r8 : c1fd7e50
[66504.392263] r7 : f09d9e90 r6 : f09d9e90 r5 : 00000200 r4 : c512cc80
[66504.399585] r3 : f081a200 r2 : f09d9e90 r1 : 00000200 r0 : 00000000
[66504.406906] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[66504.414943] Control: 30c5383d Table: 03eb2c00 DAC: fffffffd
[66504.421480] Register r0 information: NULL pointer
[66504.426965] Register r1 information: non-paged memory
[66504.432803] Register r2 information: 2-page vmalloc region starting at 0xf09d8000 allocated at kernel_clone+0x84/0x75c
[66504.445077] Register r3 information: 0-page vmalloc region starting at 0xf081a000 allocated at of_iomap+0x54/0x7c
[66504.456952] Register r4 information: slab kmalloc-64 start c512cc80 pointer offset 0 size 64
[66504.467047] Register r5 information: non-paged memory
[66504.472925] Register r6 information: 2-page vmalloc region starting at 0xf09d8000 allocated at kernel_clone+0x84/0x75c
[66504.485269] Register r7 information: 2-page vmalloc region starting at 0xf09d8000 allocated at kernel_clone+0x84/0x75c
[66504.497644] Register r8 information: non-slab/vmalloc memory
[66504.504145] Register r9 information: NULL pointer
[66504.509666] Register r10 information: non-slab/vmalloc memory
[66504.516222] Register r11 information: non-slab/vmalloc memory
[66504.522753] Register r12 information: NULL pointer
[66504.528305] Process kworker/0:1 (pid: 8090, stack limit = 0xcafb9d8a)
[66504.535575] Stack: (0xf09d9e40 to 0xf09da000)
[66504.540700] 9e40: c2b27c00 00000200 c2b27c00 c094cb80 c2b27c00 c0f04c00 00000001 c2b27c00
[66504.550440] 9e60: 00000200 f09d9e90 00000001 c1fd7e50 00000000 c1808f18 effa2905 c094cd8c
[66504.560243] 9e80: 000641b8 f09d9ee0 fffffe19 bf01f058 effa2905 c1808ec8 c29b8000 f09d9ee0
[66504.570102] 9ea0: c29b8358 c0bed780 c29b8000 00000000 c29b8358 c0bea6bc c5079040 00000000
[66504.580018] 9ec0: eff9ecd0 60000093 c024723c c0296cfc c024734c eff9ecc0 00000001 c0ef4eb4
[66504.589965] 9ee0: c29b83ac c1808ec8 eff9ecc0 c29b83ac c2932100 eff9ecc0 effa2900 c1973a60
[66504.599983] 9f00: 00000000 c1808f18 effa2905 c02472d4 00000001 00000000 c0247228 c1808ec8
[66504.610012] 9f20: c024782c eff9ecc0 c1fd7e80 c1dff7c4 00000000 c144f7bc 00000000 c1808ec8
[66504.620037] 9f40: eff9ecc0 c2932100 eff9ecc0 c2932118 eff9ecfc c1805d40 c5079040 00000008
[66504.630069] 9f60: eff9ecc0 c02477b8 00000000 c4cd3ac0 c5079040 c0247784 c2932100 c2932000
[66504.640134] 9f80: f0a0dea4 00000000 00000000 c0250c54 c4cd3ac0 c0250b60 00000000 00000000
[66504.650197] 9fa0: 00000000 00000000 00000000 c0200100 00000000 00000000 00000000 00000000
[66504.660301] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[66504.670489] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[66504.680757] regmap_mmio_read from _regmap_read+0x6c/0x234
[66504.687321] _regmap_read from regmap_read+0x44/0x64
[66504.693344] regmap_read from bcm2711_get_temp+0x58/0xa0 [bcm2711_thermal]
[66504.701294] bcm2711_get_temp [bcm2711_thermal] from thermal_zone_get_temp+0x54/0x74
[66504.710109] thermal_zone_get_temp from thermal_zone_device_update+0x80/0x568
[66504.718301] thermal_zone_device_update from process_one_work+0x29c/0x74c
[66504.726131] process_one_work from worker_thread+0x34/0x4d8
[66504.732728] worker_thread from kthread+0xf4/0x110
[66504.738523] kthread from ret_from_fork+0x14/0x34
[66504.744210] Exception stack(0xf09d9fb0 to 0xf09d9ff8)
[66504.750228] 9fa0: 00000000 00000000 00000000 00000000
[66504.760299] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[66504.770349] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[66504.777919] Code: e5943014 e1a01005 e1a00004 e12fff33 (e5860000)
[66504.784960] ---[ end trace 0000000000000000 ]---
[66504.790496] note: kworker/0:1[8090] exited with preempt_count 1
Slow again:
93] Exception stack(0xf09a1fa8 to 0xf09a1ff0)
This came in one go:
[65425.372916] 1fa0[66515.093457] NMI backtrace for cpu 2
[66515.093465] CPU: 2 PID: 7864 Comm: kworker/u8:0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[66515.093478] Hardware name: BCM2711
[66515.093483] Workqueue: writeback wb_workfn (flush-179:0)
[66515.093500] PC is at kunmap_local_indexed+0xe8/0x1a4
[66515.093514] LR is at kunmap_local_indexed+0xbc/0x1a4
[66515.093523] pc : [<c03b1f84>] lr : [<c03b1f58>] psr: 00000013
[66515.093530] sp : f0a39aa8 ip : fffff000 fp : ffede000
[66515.093535] r10: 00000000 r9 : 00000000 r8 : eef0fd40
[66515.093540] r7 : 00000000 r6 : 00000000 r5 : 00000000 r4 : ffede000
[66515.093545] r3 : 90f00000 r2 : 90f00000 r1 : c021c9d8 r0 : efffd6f0
[66515.093552] Flags: nzcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[66515.093562] Control: 30c5383d Table: 03f47340 DAC: 55555555
[66515.093567] CPU: 2 PID: 7864 Comm: kworker/u8:0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[66515.093577] Hardware name: BCM2711
[66525.893473] Workqueue: writeback wb_workfn (flush-179:0)
[66525.893488] unwind_backtrace from show_stack+0x18/0x1c
[66525.893506] show_stack from dump_stack_lvl+0x58/0x70
[66525.893519] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[66525.893531] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[66525.893544] do_handle_IPI from ipi_handler+0x20/0x28
[66525.893558] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[66525.893575] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[66525.893590] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[66525.893603] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[66525.893620] generic_handle_arch_irq from call_with_stack+0x18/0x20
[66525.893642] call_with_stack from __irq_svc+0x88/0x9c
[66525.893656] Exception stack(0xf0a39a58 to 0xf0a39aa0)
[66525.893664] 9a40: efffd6f0 c021c9d8
[66525.893674] 9a60: 90f00000 90f00000 ffede000 00000000 00000000 00000000 eef0fd40 00000000
[66525.893683] 9a80: 00000000 ffede000 fffff000 f0a39aa8 c03b1f58 c03b1f84 00000013 ffffffff
[66525.893689] __irq_svc from kunmap_local_indexed+0xe8/0x1a4
[66525.893704] kunmap_local_indexed from zero_user_segments+0x148/0x278
[66525.893719] zero_user_segments from ext4_bio_write_page+0x284/0x360
[66525.893735] ext4_bio_write_page from mpage_submit_page+0x118/0x17c
[66525.893750] mpage_submit_page from mpage_map_and_submit_extent+0x2c8/0x9d8
[66525.893767] mpage_map_and_submit_extent from ext4_writepages+0x7e0/0xaf4
[66525.893785] ext4_writepages from do_writepages+0x84/0x198
[66525.893804] do_writepages from __writeback_single_inode+0x74/0x744
[66525.893819] __writeback_single_inode from writeback_sb_inodes+0x204/0x570
[66525.893830] writeback_sb_inodes from __writeback_inodes_wb+0x40/0xe4
[66525.893841] __writeback_inodes_wb from wb_writeback+0x310/0x538
[66525.893852] wb_writeback from wb_workfn+0x508/0x720
[66525.893862] wb_workfn from process_one_work+0x29c/0x74c
[66525.893876] process_one_work from worker_thread+0x34/0x4d8
[66525.893889] worker_thread from kthread+0xf4/0x110
[66525.893902] kthread from ret_from_fork+0x14/0x34
[66525.893912] Exception stack(0xf0a39fb0 to 0xf0a39ff8)
[66525.893920] 9fa0: 00000000 00000000 00000000 00000000
[66525.893928] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[66525.893936] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
:
Pulled the plug
####################################################################################################
$ echo 0xffff | sudo tee /sys/module/drm/parameters/debug
$ dmesg -w
This time some is at full speed and some is slow. I didn't register which was which.
[ 95.663027] [drm:drm_ioctl] comm="modetest" pid=837, dev=0xe200, auth=1, DRM_IOCTL_MODE_ATOMIC
[ 95.663097] vc4-drm gpu: [drm:drm_atomic_state_init] Allocated atomic state bfd72ae8
[ 95.663158] [drm:drm_mode_object_get] OBJ ID: 45 (4)
[ 95.663190] [drm:drm_mode_object_get] OBJ ID: 45 (5)
[ 95.663215] vc4-drm gpu: [drm:drm_atomic_g[ 203.688423] 8<--- cut here ---
[ 203.694404] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 203.702574] [00000000] *pgd=80000000004003, *pmd=00000000
[ 203.708821] Internal error: : 1211 [#1] SMP ARM
[ 203.714022] Modules linked in: brcmfmac brcmutil raspberrypi_hwmon cfg80211 vc4 crc32_arm_ce snd_soc_core snd_pcm_dmaengine snd_pcm snd_timer bcm2711_thermal snd genet soundcore drm_dma_helper cec mdio_bcm_unimac nvmem_rmem
[ 203.736091] CPU: 1 PID: 85 Comm: kworker/1:4 Tainted: G W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 203.747764] Hardware name: BCM2711
[ 203.751912] Workqueue: events_freezable_power_ thermal_zone_device_check
[ 203.759414] PC is at regmap_mmio_read+0x40/0x5c
[ 203.764731] LR is at regmap_mmio_read+0x40/0x5c
[ 203.770020] pc : [<c0953cb8>] lr : [<c0953cb8>] psr: 20000093
[ 203.777058] sp : f0de5e40 ip : 00000000 fp : effb2905
[ 203.783054] r10: c1808f18 r9 : 00000000 r8 : c1fd7e50
[ 203.789050] r7 : f0de5e90 r6 : f0de5e90 r5 : 00000200 r4 : c4fd0d80
[ 203.796370] r3 : f0817200 r2 : f0de5e90 r1 : 00000200 r0 : 00000000
[ 203.803691] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[ 203.811730] Control: 30c5383d Table: 04d000c0 DAC: 55555555
[ 203.818265] Register r0 information: NULL pointer
[ 203.823745] Register r1 information: non-paged memory
[ 203.829581] Register r2 information: 2-page vmalloc region starting at 0xf0de4000 allocated at kernel_clone+0x84/0x75c
[ 203.841855] Register r3 information: 0-page vmalloc region starting at 0xf0817000 allocated at of_iomap+0x54/0x7c
[ 203.853724] Register r4 information: slab kmalloc-64 start c4fd0d80 pointer offset 0 size 64
[ 203.863817] Register r5 information: non-paged memory
[ 203.869701] Register r6 information: 2-page vmalloc region starting at 0xf0de4000 allocated at kernel_clone+0x84/0x75c
[ 203.882068] Register r7 information: 2-page vmalloc region starting at 0xf0de4000 allocated at kernel_clone+0x84/0x75c
[ 203.894466] Register r8 information: non-slab/vmalloc memory
[ 203.900980] Register r9 information: NULL pointer
[ 203.906511] Register r10 information: non-slab/vmalloc memory
[ 203.913076] Register r11 information: non-slab/vmalloc memory
[ 203.919617] Register r12 information: NULL pointer
[ 203.925176] Process kworker/1:4 (pid: 85, stack limit = 0xcc5e873f)
[ 203.932231] Stack: (0xf0de5e40 to 0xf0de6000)
[ 203.937366] 5e40: c4db0800 00000200 c4db0800 c094cb80 c4db0800 c0f04c00 00000001 c4db0800
[ 203.947124] 5e60: 00000200 f0de5e90 00000001 c1fd7e50 00000000 c1808f18 effb2905 c094cd8c
[ 203.956949] 5e80: 000641b8 f0de5ee0 fffffe19 bf069058 effb2905 c1808ec8 c29b8000 f0de5ee0
[ 203.966833] 5ea0: c29b8358 c0bed780 c29b8000 00000000 c29b8358 c0bea6bc c3a0c100 00000000
[ 203.976776] 5ec0: effaecd0 60000093 c024723c c0296cfc 00000000 c0297088 00000001 c0ef4eb4
[ 203.986756] 5ee0: c29b83ac c1808ec8 effaecc0 c29b83ac c39d4880 effaecc0 effb2900 c1973a60
[ 203.996813] 5f00: 00000000 c1808f18 effb2905 c02472d4 00000001 00000000 c0247228 c1808ec8
[ 204.006885] 5f20: c024782c effaecc0 c1fd7e80 c1dffff8 00000000 c144f7bc 00000000 c1808ec8
[ 204.016958] 5f40: effaecc0 c39d4880 effaecc0 c39d4898 effaecfc c1805d40 c3a0c100 00000008
[ 204.027035] 5f60: effaecc0 c02477b8 00000000 c39e0400 c3a0c100 c0247784 c39d4880 c39d4900
[ 204.037152] 5f80: f0de1ea4 00000000 00000000 c0250c54 c39e0400 c0250b60 00000000 00000000
[ 204.047272] 5fa0: 00000000 00000000 00000000 c0200100 00000000 00000000 00000000 00000000
[ 204.057436] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 204.067684] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 204.078017] regmap_mmio_read from _regmap_read+0x6c/0x234
[ 204.084620] _regmap_read from regmap_read+0x44/0x64
[ 204.090675] regmap_read from bcm2711_get_temp+0x58/0xa0 [bcm2711_thermal]
[ 204.098655] bcm2711_get_temp [bcm2711_thermal] from thermal_zone_get_temp+0x54/0x74
[ 204.107500] thermal_zone_get_temp from thermal_zone_device_update+0x80/0x568
[ 204.115726] thermal_zone_device_update from process_one_work+0x29c/0x74c
[ 204.123592] process_one_work from worker_thread+0x34/0x4d8
[ 204.130215] worker_thread from kthread+0xf4/0x110
[ 204.136037] kthread from ret_from_fork+0x14/0x34
[ 204.141748] Exception stack(0xf0de5fb0 to 0xf0de5ff8)
[ 204.147789] 5fa0: 00000000 00000000 00000000 00000000
[ 204.157903] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 204.168002] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 204.175598] Code: e5943014 e1a01005 e1a00004 e12fff33 (e5860000)
[ 204.182660] ---[ end trace 0000000000000000 ]---
[ 204.188217] note: kworker/1:4[85] exited with preempt_count 1
et_connector_state] Adde[ 214.488451] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 214.497390] rcu: 0-....: (9 ticks this GP) idle=abd/1/0x40000002 softirq=3047/3047 fqs=253
[ 214.507648] (detected by 1, t=11880 jiffies, g=1413, q=121 ncpus=4)
[ 214.514925] Sending NMI from CPU 1 to CPUs 0:
[ 224.522096] rcu: rcu_sched kthread starved for 4320 jiffies! g1413 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[ 224.533884] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 224.544622] rcu: RCU grace-period kthread stack dump:
[ 224.550560] task:rcu_sched state:R running task stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 224.562255] __schedule from schedule+0x60/0xd4
[ 224.567688] schedule from schedule_timeout+0x214/0x408
[ 224.573809] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 224.580533] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 224.587066] rcu_gp_kthread from kthread+0xf4/0x110
[ 224.592805] kthread from ret_from_fork+0x14/0x34
[ 224.598360] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 224.604260] 5fa0: 00000000 00000000 00000000 00000000
[ 224.614145] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 224.624049] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 224.631548] rcu: Stack dump where RCU GP kthread last ran:
[ 224.637899] NMI backtrace for cpu 1
[ 224.642233] CPU: 1 PID: 1 Comm: systemd Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 224.653686] Hardware name: BCM2711
[ 224.657934] unwind_backtrace from show_stack+0x18/0x1c
[ 224.664031] show_stack from dump_stack_lvl+0x58/0x70
[ 224.669935] dump_stack_lvl from nmi_cpu_backtrace+0xf4/0x134
[ 224.676524] nmi_cpu_backtrace from nmi_trigger_cpumask_backtrace+0xf4/0x14c
[ 224.684418] nmi_trigger_cpumask_backtrace from rcu_check_gp_kthread_starvation+0x148/0x164
[ 224.694422] rcu_check_gp_kthread_starvation from rcu_sched_clock_irq+0x1174/0x1330
[ 224.702936] rcu_sched_clock_irq from update_process_times+0x70/0x9c
[ 224.710136] update_process_times from tick_sched_timer+0x54/0xb4
[ 224.717058] tick_sched_timer from __hrtimer_run_queues+0x278/0x5a8
[ 224.724148] __hrtimer_run_queues from hrtimer_interrupt+0x130/0x2d4
[ 224.731317] hrtimer_interrupt from arch_timer_handler_phys+0x30/0x38
[ 224.738568] arch_timer_handler_phys from handle_percpu_devid_irq+0xc4/0x328
[ 224.746440] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 224.754400] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 224.761581] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 224.768593] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 224.775703] call_with_stack from __irq_svc+0x88/0x9c
[ 224.781586] Exception stack(0xf081de40 to 0xf081de88)
[ 224.787461] de40: efffd770 c021c9d8 90f00000 90f00000 ffeee000 00c00000 efffd000 00000000
[ 224.797273] de60: fb85a71f 000fb85a 00000255 f081dfb0 00400000 f081de90 c03b22e8 c03b2314
[ 224.807091] de80: 00000113 ffffffff
[ 224.811387] __irq_svc from __kmap_local_pfn_prot+0x124/0x194
[ 224.817968] __kmap_local_pfn_prot from handle_mm_fault+0x19c/0xd68
[ 224.825072] handle_mm_fault from do_page_fault+0x154/0x404
[ 224.831473] do_page_fault from do_DataAbort+0x38/0xb0
[ 224.837418] do_DataAbort from __dabt_usr+0x58/0x60
[ 224.843101] Exception stack(0xf081dfb0 to 0xf081dff8)
[ 224.848956] dfa0: 0065e7f8 000ed7e0 00000081 00000000
[ 224.858743] dfc0: 0069ce28 007ce018 00000000 007ce018 0069ce28 beacae98 0069ce28 00000000
[ 224.868557] dfe0: 0065e7f8 beacae10 beacae98 00547788 80000010 ffffffff
d [CONNECTOR:45:Composite-1] 1acfa93f state to bfd72ae8
[ 95.663258] [drm:drm_m[ 257.688649] vc4-drm gpu: [drm:commit_tail] Core clock actual rate: 4294967186 Hz
[ 257.698908] vc4-drm gpu: [drm:drm_atomic_state_default_clear] Clearing atomic state bfd72ae8
[ 257.709047] [drm:drm_mode_object_put.part.0] OBJ ID: 45 (4)
[ 257.715508] [drm:drm_mode_object_put.part.0] OBJ ID: 45 (3)
[ 257.721942] [drm:drm_mode_object_put.part.0] OBJ ID: 197 (2)
[ 257.728433] [drm:drm_mode_object_put.part.0] OBJ ID: 198 (2)
[ 257.734930] vc4-drm gpu: [drm:__drm_atomic_state_free] Freeing atomic state bfd72ae8
[ 257.744333] [drm:drm_ioctl] comm="modetest" pid=837, dev=0xe200, auth=1, DRM_IOCTL_MODE_RMFB
[ 257.754419] [drm:drm_mode_object_put.part.0] OBJ ID: 198 (2)
[ 257.760902] [drm:drm_mode_object_put.part.0] OBJ ID: 198 (1)
[ 257.767403] [drm:drm_ioctl] comm="modetest" pid=837, dev=0xe200, auth=1, DRM_IOCTL_MODE_RMFB
[ 257.777461] [drm:drm_ioctl] comm="modetest", pid=837, ret=-2
[ 257.784012] [drm:drm_ioctl] comm="modetest" pid=837, dev=0xe200, auth=1, DRM_IOCTL_MODE_DESTROY_DUMB
[ 257.795649] [drm:drm_release] open_count = 1
[ 257.800709] [drm:drm_file_free.part.0] comm="modetest", pid=837, dev=0xe200, open_count=1
[ 257.810485] [drm:drm_mode_object_put.part.0] OBJ ID: 197 (1)
[ 257.816987] [drm:_drm_lease_revoke] revoke leases for 62aa22de 0
[ 257.823836] [drm:drm_lease_destroy] drm_lease_destroy 0
[ 257.829874] [drm:drm_master_destroy] drm_lease_destroy done 0
[ 257.836482] [drm:drm_lastclose]
[ 257.840498] [drm:drm_lastclose] driver lastclose completed
[ 257.846812] vc4-drm gpu: [drm:drm_atomic_state_init] Allocated atomic state 8a065686
[ 257.855403] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:53:plane-0] dc81b41c state to 8a065686
[ 257.866893] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:61:plane-1] 64bac8f4 state to 8a065686
[ 257.878394] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:69:plane-2] 803053dd state to 8a065686
[ 257.889912] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:69:plane-2] state 803053dd
[ 257.901344] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:76:plane-3] 1dda3c41 state to 8a065686
[ 257.913062] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:76:plane-3] state 1dda3c41
[ 257.924598] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:83:plane-4] 24b5e80d state to 8a065686
[ 257.936378] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:83:plane-4] state 24b5e80d
[ 257.948003] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:90:plane-5] 13961be8 state to 8a065686
[ 257.959842] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:90:plane-5] state 13961be8
[ 257.971546] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:97:plane-6] cb1a7baf state to 8a065686
[ 257.983454] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:97:plane-6] state cb1a7baf
[ 257.995210] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:104:plane-7] 9a6e4601 state to 8a065686
[ 258.007285] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:104:plane-7] state 9a6e4601
[ 258.019243] vc4-drm gpu: [drm:drm_atomic_state_default_clear] Clearing atomic state 8a065686
[ 258.029870] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:53:plane-0] 9a6e4601 state to 8a065686
[ 258.042010] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:61:plane-1] cb1a7baf state to 8a065686
[ 258.054126] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:69:plane-2] 13961be8 state to 8a065686
[ 258.066239] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:69:plane-2] state 13961be8
[ 258.078169] vc4-drm gpu: [drm:drm_atomic_state_default_clear] Clearing atomic state 8a065686
[ 258.088817] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:53:plane-0] 13961be8 state to 8a065686
[ 258.100935] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:61:plane-1] cb1a7baf state to 8a065686
[ 258.113064] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:69:plane-2] 9a6e4601 state to 8a065686
[ 258.125175] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:69:plane-2] state 9a6e4601
[ 258.137112] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:76:plane-3] 24b5e80d state to 8a065686
[ 258.149225] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:76:plane-3] state 24b5e80d
[ 258.161157] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:83:plane-4] 7f68363c state to 8a065686
[ 258.173285] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:83:plane-4] state 7f68363c
[ 258.185226] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:90:plane-5] 10a8f322 state to 8a065686
[ 258.197341] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:90:plane-5] state 10a8f322
[ 258.209273] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:97:plane-6] 08a5b0bc state to 8a065686
[ 258.221399] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:97:plane-6] state 08a5b0bc
[ 258.233346] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:104:plane-7] d42c04ab state to 8a065686
[ 258.245549] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:104:plane-7] state d42c04ab
[ 258.257558] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:111:plane-8] 42ddd52a state to 8a065686
[ 258.269745] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:111:plane-8] state 42ddd52a
[ 258.281786] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:118:plane-9] f69460dd state to 8a065686
[ 258.293989] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:118:plane-9] state f69460dd
[ 258.306000] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:125:plane-10] b87e73df state to 8a065686
[ 258.318280] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:125:plane-10] state b87e73df
[ 258.330376] vc4-drm gpu: [drm:drm_atomic_state_default_clear] Clearing atomic state 8a065686
[ 258.341006] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:53:plane-0] b87e73df state to 8a065686
[ 258.353128] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:61:plane-1] f69460dd state to 8a065686
[ 258.365231] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:69:plane-2] 42ddd52a state to 8a065686
[ 258.377332] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:69:plane-2] state 42ddd52a
[ 258.389267] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:76:plane-3] d42c04ab state to 8a065686
[ 258.401370] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:76:plane-3] state d42c04ab
[ 258.413305] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:83:plane-4] 08a5b0bc state to 8a065686
[ 258.425407] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:83:plane-4] state 08a5b0bc
[ 258.437332] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:90:plane-5] 10a8f322 state to 8a065686
[ 258.449431] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:90:plane-5] state 10a8f322
[ 258.461350] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:97:plane-6] 7f68363c state to 8a065686
[ 258.473464] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:97:plane-6] state 7f68363c
[ 258.485385] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:104:plane-7] 24b5e80d state to 8a065686
[ 258.497572] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:104:plane-7] state 24b5e80d
[ 258.509578] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:111:plane-8] 9a6e4601 state to 8a065686
[ 258.521776] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:111:plane-8] state 9a6e4601
[ 258.533796] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:118:plane-9] cb1a7baf state to 8a065686
[ 258.545986] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:118:plane-9] state cb1a7baf
[ 258.557993] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:125:plane-10] 13961be8 state to 8a065686
[ 258.570266] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:125:plane-10] state 13961be8
[ 258.582376] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:132:plane-11] 4fb5909e state to 8a065686
[ 258.594646] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:132:plane-11] state 4fb5909e
[ 258.606735] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:139:plane-12] d3759628 state to 8a065686
[ 258.619004] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:139:plane-12] state d3759628
[ 258.631090] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:146:plane-13] 555f46c5 state to 8a065686
[ 258.643374] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:146:plane-13] state 555f46c5
[ 258.655457] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:153:plane-14] 7bb1f2e5 state to 8a065686
[ 258.667722] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:153:plane-14] state 7bb1f2e5
[ 258.679804] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:160:plane-15] 0db43f12 state to 8a065686
[ 258.692098] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:160:plane-15] state 0db43f12
[ 258.704184] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:167:plane-16] 1dda3c41 state to 8a065686
[ 258.716447] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:167:plane-16] state 1dda3c41
[ 258.728525] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:174:plane-17] 803053dd state to 8a065686
[ 258.740789] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:174:plane-17] state 803053dd
[ 258.752881] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:181:plane-18] 64bac8f4 state to 8a065686
[ 258.765138] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:181:plane-18] state 64bac8f4
[ 258.777218] vc4-drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:188:plane-19] dc81b41c state to 8a065686
[ 258.789485] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:188:plane-19] state dc81b41c
[ 258.801581] vc4-drm gpu: [drm:drm_atomic_get_crtc_state] Added [CRTC:60:crtc-0] 573fdfe3 state to 8a065686
[ 258.813404] vc4-drm gpu: [drm:drm_atomic_set_mode_for_crtc] Set [NOMODE] for [CRTC:60:crtc-0] state 573fdfe3
[ 258.825400] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [NOFB] for [PLANE:53:plane-0] state b87e73df
[ 258.837324] vc4-drm gpu: [drm:drm_atomic_add_affected_connectors] Adding all current connectors for [CRTC:60:crtc-0] to 8a065686
[ 258.851085] vc4-drm gpu: [drm:drm_atomic_get_crtc_state] Added [CRTC:68:crtc-1] 260e4e5d state to 8a065686
[ 258.862933] vc4-drm gpu: [drm:drm_atomic_set_mode_for_crtc] Set [MODE:720x480i] for [CRTC:68:crtc-1] state 260e4e5d
[ 258.875550] vc4-drm gpu: [drm:drm_atomic_set_crtc_for_plane] Link [PLANE:61:plane-1] state f69460dd to [CRTC:68:crtc-1]
[ 258.888515] vc4-drm gpu: [drm:drm_atomic_set_fb_for_plane] Set [FB:195] for [PLANE:61:plane-1] state f69460dd
[ 258.900595] [drm:drm_mode_object_get] OBJ ID: 195 (1)
[ 258.906742] vc4-drm gpu: [drm:drm_atomic_add_affected_connectors] Adding all current connectors for [CRTC:68:crtc-1] to 8a065686
[ 258.920468] [drm:drm_mode_object_get] OBJ ID: 45 (2)
[ 258.926511] vc4-drm gpu: [drm:drm_atomic_get_connector_state] Added [CONNECTOR:45:Composite-1] ef31bdd2 state to 8a065686
[ 258.939591] [drm:drm_mode_object_get] OBJ ID: 45 (3)
[ 258.945616] vc4-drm gpu: [drm:drm_atomic_set_crtc_for_connector] Link [CONNECTOR:45:Composite-1] state ef31bdd2 to [CRTC:68:crtc-1]
[ 258.959533] vc4-drm gpu: [drm:drm_atomic_print_new_state] checking 8a065686
[ 258.967562] vc4-drm gpu: [drm] plane[53]: plane-0
[ 258.973295] vc4-drm gpu: [drm] crtc=(null)
[ 258.978459] vc4-drm gpu: [drm] fb=0
[ 258.983021] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 258.988576] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 258.996502] vc4-drm gpu: [drm] rotation=1
[ 259.001517] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.007107] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.014095] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.020866] vc4-drm gpu: [drm] plane[61]: plane-1
[ 259.026414] vc4-drm gpu: [drm] crtc=crtc-1
[ 259.031415] vc4-drm gpu: [drm] fb=195
[ 259.035935] vc4-drm gpu: [drm] allocated by = [fbcon]
[ 259.041938] vc4-drm gpu: [drm] refcount=2
[ 259.046854] vc4-drm gpu: [drm] format=RG16 little-endian (0x36314752)
[ 259.054221] vc4-drm gpu: [drm] modifier=0x0
[ 259.059276] vc4-drm gpu: [drm] size=720x480
[ 259.064323] vc4-drm gpu: [drm] layers:
[ 259.068887] vc4-drm gpu: [drm] size[0]=720x480
[ 259.074237] vc4-drm gpu: [drm] pitch[0]=1440
[ 259.079377] vc4-drm gpu: [drm] offset[0]=0
[ 259.084340] vc4-drm gpu: [drm] obj[0]:
[ 259.088904] vc4-drm gpu: [drm] name=0
[ 259.093473] vc4-drm gpu: [drm] refcount=3
[ 259.098347] vc4-drm gpu: [drm] start=00010000
[ 259.103568] vc4-drm gpu: [drm] size=692224
[ 259.108494] vc4-drm gpu: [drm] imported=no
[ 259.113415] vc4-drm gpu: [drm] dma_addr=0x00000000f7100000
[ 259.119698] vc4-drm gpu: [drm] vaddr=445c8e96
[ 259.124850] vc4-drm gpu: [drm] crtc-pos=720x480+0+0
[ 259.130235] vc4-drm gpu: [drm] src-pos=720.000000x480.000000+0.000000+0.000000
[ 259.138031] vc4-drm gpu: [drm] rotation=1
[ 259.142585] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.147728] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.154289] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.160647] vc4-drm gpu: [drm] plane[69]: plane-2
[ 259.165805] vc4-drm gpu: [drm] crtc=(null)
[ 259.170412] vc4-drm gpu: [drm] fb=0
[ 259.174422] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.179458] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.186893] vc4-drm gpu: [drm] rotation=1
[ 259.191439] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.196581] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.203143] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.209505] vc4-drm gpu: [drm] plane[76]: plane-3
[ 259.214663] vc4-drm gpu: [drm] crtc=(null)
[ 259.219276] vc4-drm gpu: [drm] fb=0
[ 259.223296] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.228349] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.235801] vc4-drm gpu: [drm] rotation=1
[ 259.240349] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.245531] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.252122] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.258522] vc4-drm gpu: [drm] plane[83]: plane-4
[ 259.263727] vc4-drm gpu: [drm] crtc=(null)
[ 259.268387] vc4-drm gpu: [drm] fb=0
[ 259.272455] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.277549] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.285052] vc4-drm gpu: [drm] rotation=1
[ 259.289634] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.294837] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.301436] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.307846] vc4-drm gpu: [drm] plane[90]: plane-5
[ 259.313049] vc4-drm gpu: [drm] crtc=(null)
[ 259.317703] vc4-drm gpu: [drm] fb=0
[ 259.321755] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.326846] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.334335] vc4-drm gpu: [drm] rotation=1
[ 259.338917] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.344119] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.350699] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.357127] vc4-drm gpu: [drm] plane[97]: plane-6
[ 259.362331] vc4-drm gpu: [drm] crtc=(null)
[ 259.366985] vc4-drm gpu: [drm] fb=0
[ 259.371020] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.376126] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.383614] vc4-drm gpu: [drm] rotation=1
[ 259.388197] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.393399] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.399980] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.406408] vc4-drm gpu: [drm] plane[104]: plane-7
[ 259.411698] vc4-drm gpu: [drm] crtc=(null)
[ 259.416355] vc4-drm gpu: [drm] fb=0
[ 259.420390] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.425497] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.432997] vc4-drm gpu: [drm] rotation=1
[ 259.437580] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.442785] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.449366] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.455797] vc4-drm gpu: [drm] plane[111]: plane-8
[ 259.461068] vc4-drm gpu: [drm] crtc=(null)
[ 259.465743] vc4-drm gpu: [drm] fb=0
[ 259.469779] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.474887] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.482374] vc4-drm gpu: [drm] rotation=1
[ 259.486955] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.492158] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.498739] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.505168] vc4-drm gpu: [drm] plane[118]: plane-9
[ 259.510437] vc4-drm gpu: [drm] crtc=(null)
[ 259.515112] vc4-drm gpu: [drm] fb=0
[ 259.519148] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.524256] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.531740] vc4-drm gpu: [drm] rotation=1
[ 259.536324] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.541525] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.548109] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.554537] vc4-drm gpu: [drm] plane[125]: plane-10
[ 259.559895] vc4-drm gpu: [drm] crtc=(null)
[ 259.564570] vc4-drm gpu: [drm] fb=0
[ 259.568605] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.573710] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.581173] vc4-drm gpu: [drm] rotation=1
[ 259.585790] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.590971] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.597572] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.604000] vc4-drm gpu: [drm] plane[132]: plane-11
[ 259.609358] vc4-drm gpu: [drm] crtc=(null)
[ 259.614033] vc4-drm gpu: [drm] fb=0
[ 259.618069] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.623175] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.630637] vc4-drm gpu: [drm] rotation=1
[ 259.635244] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.640426] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.647025] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.653454] vc4-drm gpu: [drm] plane[139]: plane-12
[ 259.658814] vc4-drm gpu: [drm] crtc=(null)
[ 259.663488] vc4-drm gpu: [drm] fb=0
[ 259.667523] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.672628] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.680090] vc4-drm gpu: [drm] rotation=1
[ 259.684696] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.689879] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.696477] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.702906] vc4-drm gpu: [drm] plane[146]: plane-13
[ 259.708265] vc4-drm gpu: [drm] crtc=(null)
[ 259.712941] vc4-drm gpu: [drm] fb=0
[ 259.716977] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.722087] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.729550] vc4-drm gpu: [drm] rotation=1
[ 259.734168] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.739351] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.745953] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.752381] vc4-drm gpu: [drm] plane[153]: plane-14
[ 259.757740] vc4-drm gpu: [drm] crtc=(null)
[ 259.762416] vc4-drm gpu: [drm] fb=0
[ 259.766452] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.771558] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.779025] vc4-drm gpu: [drm] rotation=1
[ 259.783630] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.788814] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.795415] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.801843] vc4-drm gpu: [drm] plane[160]: plane-15
[ 259.807207] vc4-drm gpu: [drm] crtc=(null)
[ 259.811883] vc4-drm gpu: [drm] fb=0
[ 259.815920] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.821007] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.828491] vc4-drm gpu: [drm] rotation=1
[ 259.833098] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.838282] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.844883] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.851293] vc4-drm gpu: [drm] plane[167]: plane-16
[ 259.856671] vc4-drm gpu: [drm] crtc=(null)
[ 259.861327] vc4-drm gpu: [drm] fb=0
[ 259.865382] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.870470] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.877953] vc4-drm gpu: [drm] rotation=1
[ 259.882571] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.887754] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.894355] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.900764] vc4-drm gpu: [drm] plane[174]: plane-17
[ 259.906145] vc4-drm gpu: [drm] crtc=(null)
[ 259.910802] vc4-drm gpu: [drm] fb=0
[ 259.914859] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.919947] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.927431] vc4-drm gpu: [drm] rotation=1
[ 259.932039] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.937223] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.943825] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.950234] vc4-drm gpu: [drm] plane[181]: plane-18
[ 259.955613] vc4-drm gpu: [drm] crtc=(null)
[ 259.960270] vc4-drm gpu: [drm] fb=0
[ 259.964326] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 259.969413] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 259.976896] vc4-drm gpu: [drm] rotation=1
[ 259.981501] vc4-drm gpu: [drm] normalized-zpos=0
[ 259.986688] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 259.993289] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 259.999696] vc4-drm gpu: [drm] plane[188]: plane-19
[ 260.005074] vc4-drm gpu: [drm] crtc=(null)
[ 260.009731] vc4-drm gpu: [drm] fb=0
[ 260.013790] vc4-drm gpu: [drm] crtc-pos=0x0+0+0
[ 260.018880] vc4-drm gpu: [drm] src-pos=0.000000x0.000000+0.000000+0.000000
[ 260.026365] vc4-drm gpu: [drm] rotation=1
[ 260.030949] vc4-drm gpu: [drm] normalized-zpos=0
[ 260.036169] vc4-drm gpu: [drm] color-encoding=ITU-R BT.709 YCbCr
[ 260.042775] vc4-drm gpu: [drm] color-range=YCbCr limited range
[ 260.049185] vc4-drm gpu: [drm] crtc[60]: crtc-0
[ 260.054215] vc4-drm gpu: [drm] enable=0
[ 260.058608] vc4-drm gpu: [drm] active=0
[ 260.063010] vc4-drm gpu: [drm] self_refresh_active=0
[ 260.068532] vc4-drm gpu: [drm] planes_changed=0
[ 260.073638] vc4-drm gpu: [drm] mode_changed=0
[ 260.078549] vc4-drm gpu: [drm] active_changed=0
[ 260.083651] vc4-drm gpu: [drm] connectors_changed=0
[ 260.089069] vc4-drm gpu: [drm] color_mgmt_changed=0
[ 260.094503] vc4-drm gpu: [drm] plane_mask=0
[ 260.099211] vc4-drm gpu: [drm] connector_mask=0
[ 260.104285] vc4-drm gpu: [drm] encoder_mask=0
[ 260.109159] vc4-drm gpu: [drm] mode: "": 0 0 0 0 0 0 0 0 0 0 0x0 0x0
[ 260.116085] vc4-drm gpu: [drm] crtc[68]: crtc-1
[ 260.121072] vc4-drm gpu: [drm] enable=1
[ 260.125467] vc4-drm gpu: [drm] active=1
[ 260.129826] vc4-drm gpu: [drm] self_refresh_active=0
[ 260.135340] vc4-drm gpu: [drm] planes_changed=0
[ 260.140392] vc4-drm gpu: [drm] mode_changed=0
[ 260.145283] vc4-drm gpu: [drm] active_changed=0
[ 260.150323] vc4-drm gpu: [drm] connectors_changed=0
[ 260.155731] vc4-drm gpu: [drm] color_mgmt_changed=0
[ 260.161111] vc4-drm gpu: [drm] plane_mask=2
[ 260.165817] vc4-drm gpu: [drm] connector_mask=1
[ 260.170852] vc4-drm gpu: [drm] encoder_mask=0
[ 260.175722] vc4-drm gpu: [drm] mode: "720x480i": 60 13500 720 739 801 858 480 488 494 525 0x60 0x10
[ 260.185746] vc4-drm gpu: [drm] connector[45]: Composite-1
[ 260.191623] vc4-drm gpu: [drm] crtc=crtc-1
[ 260.196259] vc4-drm gpu: [drm] self_refresh_aware=0
[ 260.201691] vc4-drm gpu: [drm:drm_atomic_check_only] checking 8a065686
[ 260.208714] vc4-drm gpu: [drm:drm_atomic_get_private_obj_state] Added new private object 1964d9f6 state 93dcdcf6 to 8a065686
[ 260.220937] vc4-drm gpu: [drm:vc4_atomic_check [vc4]] crtc-0: Trying to find a channel.
[ 260.229680] vc4-drm gpu: [drm:vc4_atomic_check [vc4]] crtc-0: Disabled, ignoring.
[ 260.237884] vc4-drm gpu: [drm:vc4_atomic_check [vc4]] crtc-1: Trying to find a channel.
[ 260.246606] vc4-drm gpu: [drm:vc4_atomic_check [vc4]] Assigned HVS channel 1 to CRTC crtc-1
[ 260.256206] vc4-drm gpu: [drm:drm_atomic_helper_check_modeset] [CRTC:68:crtc-1] mode changed
[ 260.265865] vc4-drm gpu: [drm:drm_atomic_helper_check_modeset] [CRTC:68:crtc-1] enable changed
[ 260.275775] vc4-drm gpu: [drm:drm_atomic_helper_check_modeset] [CRTC:68:crtc-1] active changed
[ 260.285760] vc4-drm gpu: [drm:drm_atomic_helper_check_modeset] Updating routing for [CONNECTOR:45:Composite-1]
[ 260.297243] vc4-drm gpu: [drm:drm_atomic_helper_check_modeset] [CONNECTOR:45:Composite-1] using [ENCODER:44:TV-44] on [CRTC:68:crtc-1]
[ 260.364618] vc4-drm gpu: [drm:drm_atomic_helper_check_modeset] [CRTC:68:crtc-1] needs all connectors, enable: y, active: y
[ 260.377468] vc4-drm gpu: [drm:drm_atomic_add_affected_connectors] Adding all current connectors for [CRTC:68:crtc-1] to 8a065686
[ 260.390929] vc4-drm gpu: [drm:drm_atomic_add_affected_planes] Adding all current planes for [CRTC:68:crtc-1] to 8a065686
[ 260.403691] vc4-drm gpu: [drm:drm_atomic_add_encoder_bridges] Adding all bridges for [encoder:44:TV-44] to 8a065686
[ 260.416111] vc4-drm gpu: [drm:drm_atomic_get_private_obj_state] Added new private object 2ad2417d state 0c1149e8 to 8a065686
[ 260.429347] vc4-drm gpu: [drm:drm_atomic_commit] committing 8a065686
[ 260.436831] vc4-drm gpu: [drm:vc4_atomic_commit_tail [vc4]] Raising the core clock at 500000000 Hz
ode_object_get] OBJ ID: 197 (2)
[ 95[ 279.288818] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-arm frequency: -110
.663284] vc4-drm gpu: [drm:drm_atom[ 300.888593] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 300.897579] rcu: 0-....: (17 ticks this GP) idle=abd/1/0x40000002 softirq=3047/3047 fqs=257
[ 300.908013] (detected by 1, t=20520 jiffies, g=1413, q=137 ncpus=4)
[ 300.915337] Sending NMI from CPU 1 to CPUs 0:
[ 310.922560] rcu: rcu_sched kthread starved for 4044 jiffies! g1413 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[ 310.934499] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 310.945426] rcu: RCU grace-period kthread stack dump:
[ 310.951467] task:rcu_sched state:R running task stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 310.963406] __schedule from schedule+0x60/0xd4
[ 310.968945] schedule from schedule_timeout+0x214/0x408
[ 310.975179] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 310.982014] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 310.988654] rcu_gp_kthread from kthread+0xf4/0x110
[ 310.994486] kthread from ret_from_fork+0x14/0x34
[ 311.000125] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 311.006097] 5fa0: 00000000 00000000 00000000 00000000
[ 311.016074] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 311.026042] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 311.033567] rcu: Stack dump where RCU GP kthread last ran:
[ 311.039951] NMI backtrace for cpu 1
[ 311.044325] CPU: 1 PID: 329 Comm: avahi-daemon Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 311.056441] Hardware name: BCM2711
[ 311.060693] unwind_backtrace from show_stack+0x18/0x1c
[ 311.066790] show_stack from dump_stack_lvl+0x58/0x70
[ 311.072694] dump_stack_lvl from nmi_cpu_backtrace+0xf4/0x134
[ 311.079283] nmi_cpu_backtrace from nmi_trigger_cpumask_backtrace+0xf4/0x14c
[ 311.087174] nmi_trigger_cpumask_backtrace from rcu_check_gp_kthread_starvation+0x148/0x164
[ 311.097175] rcu_check_gp_kthread_starvation from rcu_sched_clock_irq+0x1174/0x1330
[ 311.105688] rcu_sched_clock_irq from update_process_times+0x70/0x9c
[ 311.112887] update_process_times from tick_sched_timer+0x54/0xb4
[ 311.119807] tick_sched_timer from __hrtimer_run_queues+0x278/0x5a8
[ 311.126896] __hrtimer_run_queues from hrtimer_interrupt+0x130/0x2d4
[ 311.134065] hrtimer_interrupt from arch_timer_handler_phys+0x30/0x38
[ 311.141319] arch_timer_handler_phys from handle_percpu_devid_irq+0xc4/0x328
[ 311.149193] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 311.157154] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 311.164336] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 311.171350] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 311.178466] call_with_stack from __irq_svc+0x88/0x9c
[ 311.184351] Exception stack(0xf09b1df8 to 0xf09b1e40)
[ 311.190225] 1de0: efffd770 c021c9d8
[ 311.200005] 1e00: 90f00000 90f00000 ffeee000 00000001 f09b1f08 ffeee002 eeff4e80 00000001
[ 311.209779] 1e20: f09b1f00 bec9cb77 fffff000 f09b1e48 c03b1f58 c03b1f84 00000013 ffffffff
[ 311.219570] __irq_svc from kunmap_local_indexed+0xe8/0x1a4
[ 311.225987] kunmap_local_indexed from copy_page_from_iter+0x25c/0x504
[ 311.233362] copy_page_from_iter from pipe_write+0x580/0x794
[ 311.239862] pipe_write from vfs_write+0x450/0x4b8
[ 311.245494] vfs_write from ksys_write+0xc4/0xf8
[ 311.250940] ksys_write from ret_fast_syscall+0x0/0x1c
[ 311.256904] Exception stack(0xf09b1fa8 to 0xf09b1ff0)
[ 311.262771] 1fa0: 00000007 b6f59fc0 00000007 bec9cb77 00000001 00000000
[ 311.272573] 1fc0: 00000007 b6f59fc0 bec9cba8 00000004 00041ca8 0003f028 0003c008 00000000
[ 311.282381] 1fe0: b6f03f70 bec9cb58 b6dc7e6c b6dc7e88
ic_get_crtc_state] Added [CRTC:68:crtc-1] 18dec360 state to bfd72ae8
[ 95.663321] [drm:drm_mode_object_put.part.0] OBJ ID: [ 354.888692] sched: RT throttling activated
45 (6)
[ 95.663347] vc4-drm gpu[ 387.288749] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 387.297592] rcu: 0-....: (25 ticks this GP) idle=abd/1/0x40000002 softirq=3047/3047 fqs=260
[ 387.307783] (detected by 2, t=29160 jiffies, g=1413, q=204 ncpus=4)
[ 387.315001] Sending NMI from CPU 2 to CPUs 0:
[ 397.322121] rcu: rcu_sched kthread starved for 2160 jiffies! g1413 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=3
[ 397.333831] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 397.344538] rcu: RCU grace-period kthread stack dump:
[ 397.350484] task:rcu_sched state:R running task stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 397.362226] __schedule from schedule+0x60/0xd4
[ 397.367672] schedule from schedule_timeout+0x214/0x408
[ 397.373795] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 397.380517] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 397.387040] rcu_gp_kthread from kthread+0xf4/0x110
[ 397.392770] kthread from ret_from_fork+0x14/0x34
[ 397.398315] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 397.404203] 5fa0: 00000000 00000000 00000000 00000000
[ 397.414056] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 397.423968] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 397.431477] rcu: Stack dump where RCU GP kthread last ran:
[ 397.437840] Sending NMI from CPU 2 to CPUs 3:
: [drm:drm_atomic_se[ 398.088754] NMI backtrace for cpu 3
[ 398.088764] CPU: 3 PID: 47 Comm: kworker/u8:2 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 398.088777] Hardware name: BCM2711
[ 398.088783] Workqueue: writeback wb_workfn (flush-179:0)
[ 398.088801] PC is at kunmap_local_indexed+0xe8/0x1a4
[ 398.088815] LR is at kunmap_local_indexed+0xbc/0x1a4
[ 398.088824] pc : [<c03b1f84>] lr : [<c03b1f58>] psr: 00000013
[ 398.088831] sp : f092d9d8 ip : fffff000 fp : c1810190
[ 398.088837] r10: c1fbd100 r9 : 001ff000 r8 : c3b8c840
[ 398.088843] r7 : 00800000 r6 : 00000000 r5 : b5433000 r4 : ffece000
[ 398.088849] r3 : 90f00000 r2 : 90f00000 r1 : c021c9d8 r0 : efffd670
[ 398.088856] Flags: nzcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 398.088866] Control: 30c5383d Table: 058ac580 DAC: 55555555
[ 398.088872] CPU: 3 PID: 47 Comm: kworker/u8:2 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 398.088883] Hardware name: BCM2711
[ 398.088887] Workqueue: writeback wb_workfn (flush-179:0)
[ 398.088903] unwind_backtrace from show_stack+0x18/0x1c
[ 398.088923] show_stack from dump_stack_lvl+0x58/0x70
[ 398.088938] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 398.088953] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 398.088966] do_handle_IPI from ipi_handler+0x20/0x28
[ 398.088981] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 398.089001] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 398.089017] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 398.089030] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 398.089048] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 398.089071] call_with_stack from __irq_svc+0x88/0x9c
[ 398.089086] Exception stack(0xf092d988 to 0xf092d9d0)
[ 398.089095] d980: efffd670 c021c9d8 90f00000 90f00000 ffece000 b5433000
[ 398.089105] d9a0: 00000000 00800000 c3b8c840 001ff000 c1fbd100 c1810190 fffff000 f092d9d8
[ 398.089113] d9c0: c03b1f58 c03b1f84 00000013 ffffffff
[ 398.089118] __irq_svc from kunmap_local_indexed+0xe8/0x1a4
[ 398.089134] kunmap_local_indexed from page_vma_mapped_walk+0x3d0/0x480
[ 398.089151] page_vma_mapped_walk from page_vma_mkclean_one+0x3c/0x11c
[ 398.089165] page_vma_mkclean_one from page_mkclean_one+0x9c/0xe4
[ 398.089179] page_mkclean_one from rmap_walk_file+0x104/0x208
[ 398.089193] rmap_walk_file from folio_mkclean+0xb4/0xc4
[ 398.089208] folio_mkclean from folio_clear_dirty_for_io+0x60/0x13c
[ 398.089227] folio_clear_dirty_for_io from mpage_submit_page+0x38/0x17c
[ 398.089246] mpage_submit_page from mpage_process_page_bufs+0x264/0x270
[ 398.089262] mpage_process_page_bufs from mpage_prepare_extent_to_map+0x1b0/0x32c
[ 398.089278] mpage_prepare_extent_to_map from ext4_writepages+0x3d8/0xaf4
[ 398.089295] ext4_writepages from do_writepages+0x84/0x198
[ 398.089313] do_writepages from __writeback_single_inode+0x74/0x744
[ 398.089329] __writeback_single_inode from writeback_sb_inodes+0x204/0x570
[ 398.089340] writeback_sb_inodes from __writeback_inodes_wb+0x40/0xe4
[ 398.089351] __writeback_inodes_wb from wb_writeback+0x310/0x538
[ 398.089363] wb_writeback from wb_workfn+0x508/0x720
[ 398.089373] wb_workfn from process_one_work+0x29c/0x74c
[ 398.089387] process_one_work from worker_thread+0x34/0x4d8
[ 398.089402] worker_thread from kthread+0xf4/0x110
[ 398.089414] kthread from ret_from_fork+0x14/0x34
[ 398.089424] Exception stack(0xf092dfb0 to 0xf092dff8)
[ 398.089433] dfa0: 00000000 00000000 00000000 00000000
[ 398.089442] dfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 398.089449] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000
t_crtc_for_connector] Link [CONNECTOR:45:Composite-1] state 1acfa93f to [NOCRTC]
[ 95.663377] [drm:drm_[ 452.088943] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-core frequency: -110
mode_object_put.part.0] OBJ ID: 45 (5)
[ 95.663417] [drm:drm[ 473.688889] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 473.689020] systemd[1]: systemd-journald.service: State 'stop-watchdog' timed out. Killing.
[ 473.696888] rcu: 0-....: (33 ticks this GP) idle=abd/1/0x40000002 softirq=3047/3047 fqs=262
[ 473.696911] (detected by 1, t=37801 jiffies, g=1413, q=228 ncpus=4)
[ 473.724965] Sending NMI from CPU 1 to CPUs 0:
[ 484.488903] NMI backtrace for cpu 0
[ 484.488915] CPU: 0 PID: 31 Comm: kworker/0:1 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 484.488930] Hardware name: BCM2711
[ 484.488936] Workqueue: events_power_efficient phy_state_machine
[ 484.488963] PC is at v7_dma_inv_range+0x24/0x54
[ 484.488981] LR is at __dma_page_cpu_to_dev+0x30/0xa0
[ 484.488991] pc : [<c021c1ec>] lr : [<c0217fac>] psr: 40000113
[ 484.488999] sp : f0801dd0 ip : ed076400 fp : 00000000
[ 484.489004] r10: 0663c740 r9 : 00000740 r8 : 00000800
[ 484.489011] r7 : 00000002 r6 : ed142b80 r5 : 00000800 r4 : c2972010
[ 484.489017] r3 : 0000003f r2 : 00000040 r1 : c663cf40 r0 : c663c740
[ 484.489002] vc4-drm gpu: [drm:drm_calc_timestamping_constants] crtc 68: hwmode: htotal 858, vtotal 262, vdisplay 240
[ 484.489025] Flags: nZcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 484.489036] Control: 30c5383d Table: 05a8a6c0 DAC: fffffffd
[ 484.489042] CPU: 0 PID: 31 Comm: kworker/0:1 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 484.489053] Hardware name: BCM2711
[ 484.489057] Workqueue: events_power_efficient phy_state_machine
[ 484.489077] unwind_backtrace from show_stack+0x18/0x1c
[ 484.489098] show_stack from dump_stack_lvl+0x58/0x70
[ 484.489115] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 484.489130] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 484.489145] do_handle_IPI from ipi_handler+0x20/0x28
[ 484.489160] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 484.489181] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 484.489197] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 484.489211] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 484.489230] generic_handle_arch_irq from __irq_svc+0x78/0x9c
[ 484.489245] Exception stack(0xf0801d80 to 0xf0801dc8)
[ 484.489258] 1d80: c663c740 c663cf40 00000040 0000003f c2972010 00000800 ed142b80 00000002
[ 484.489268] 1da0: 00000800 00000740 0663c740 00000000 ed076400 f0801dd0 c0217fac c021c1ec
[ 484.489274] 1dc0: 40000113 ffffffff
[ 484.489279] __irq_svc from v7_dma_inv_range+0x24/0x54
[ 484.489298] v7_dma_inv_range from __dma_page_cpu_to_dev+0x30/0xa0
[ 484.489315] __dma_page_cpu_to_dev from dma_map_page_attrs+0x1fc/0x330
[ 484.489335] dma_map_page_attrs from bcmgenet_rx_refill+0x9c/0x204 [genet]
[ 484.489385] bcmgenet_rx_refill [genet] from bcmgenet_rx_poll+0x1fc/0x454 [genet]
[ 484.489436] bcmgenet_rx_poll [genet] from __napi_poll+0x34/0x298
[ 484.489471] __napi_poll from net_rx_action+0x15c/0x2c0
[ 484.489490] net_rx_action from __do_softirq+0x128/0x534
[ 484.489507] __do_softirq from irq_exit+0x170/0x1a0
[ 484.489524] irq_exit from call_with_stack+0x18/0x20
[ 484.489546] call_with_stack from __irq_svc+0x88/0x9c
[ 484.489561] Exception stack(0xf08a9de8 to 0xf08a9e30)
[ 484.489571] 9de0: c4ff86c0 00000001 28200000 bf040ee4 00000001 c4ff86c0
[ 484.489581] 9e00: c3a4acc0 00000000 c4ff8000 00000000 c1808f18 effa2805 00040000 f08a9e38
[ 484.489588] 9e20: bf009044 bf03dd04 20000013 ffffffff
[ 484.489593] __irq_svc from bcmgenet_mii_wait+0x1c/0xd8 [genet]
[ 484.489625] bcmgenet_mii_wait [genet] from unimac_mdio_read+0x44/0x7c [mdio_bcm_unimac]
[ 484.489662] unimac_mdio_read [mdio_bcm_unimac] from __mdiobus_read+0x44/0x22c
[ 484.489684] __mdiobus_read from mdiobus_read+0x3c/0x50
[ 484.489699] mdiobus_read from genphy_update_link+0x20/0xec
[ 484.489712] genphy_update_link from genphy_read_status+0x1c/0xd8
[ 484.489725] genphy_read_status from phy_check_link_status+0xf8/0x108
[ 484.489743] phy_check_link_status from phy_state_machine+0x74/0x234
[ 484.489762] phy_state_machine from process_one_work+0x29c/0x74c
[ 484.489781] process_one_work from worker_thread+0x34/0x4d8
[ 484.489795] worker_thread from kthread+0xf4/0x110
[ 484.489808] kthread from ret_from_fork+0x14/0x34
[ 484.489819] Exception stack(0xf08a9fb0 to 0xf08a9ff8)
[ 484.489828] 9fa0: 00000000 00000000 00000000 00000000
[ 484.489837] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 484.489845] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 484.935654] vc4-drm gpu: [drm:drm_calc_timestamping_constants] crtc 68: clock 13500 kHz framedur 8325777 linedur 63555
[ 484.948367] vc4-drm gpu: [drm:drm_atomic_helper_commit_modeset_disables] modeset on [ENCODER:44:TV-44]
[ 484.959775] vc4-drm gpu: [drm:drm_atomic_helper_commit_modeset_enables] enabling [CRTC:68:crtc-1]
[ 484.970783] vc4-drm gpu: [drm:vc4_crtc_atomic_enable [vc4]] Enabling CRTC crtc-1 (68) connected to Encoder TV-44 (44)
[ 484.983697] vc4-drm gpu: [drm:drm_crtc_vblank_on] crtc 1, vblank enabled 0, inmodeset 1
[ 484.992791] vc4-drm gpu: [drm:drm_crtc_vblank_helper_get_vblank_timestamp_internal] crtc 1 : v p(0,125)@ 484.981413 -> 484.973469 [e 0 us, 0 rep]
[ 485.007974] vc4-drm gpu: [drm:drm_vblank_enable] enabling vblank on crtc 1, ret: 0
[ 485.016641] vc4-drm gpu: [drm:drm_crtc_vblank_helper_get_vblank_timestamp_internal] crtc 1 : v p(0,125)@ 485.005266 -> 484.997321 [e 0 us, 0 rep]
[ 485.031781] vc4-drm gpu: [drm:drm_update_vblank_count] crtc 1: Calculating number of vblanks. diff_ns = 23852407, framedur_ns = 8325777)
[ 485.046162] vc4-drm gpu: [drm:drm_update_vblank_count] updating vblank count on crtc 1: current=6995, diff=3, hw=0 hw_last=0
[ 485.059640] vc4-drm gpu: [drm:drm_atomic_helper_commit_modeset_enables] enabling [ENCODER:44:TV-44]
[ 485.072140] systemd[1]: systemd-journald.service: Killing process 145 (systemd-journal) with signal SIGKILL.
_mode_object_get] OBJ ID: 198 (2)
[ 95.663445] vc4-[ 516.889059] [drm:vc4_vec_encoder_enable [vc4]] *ERROR* Failed to retain power domain: -110
drm gpu: [drm:drm_atomic_get_plane_state] Added [PLANE:61:plane-1] 1[ 549.289586] vc4-drm gpu: [drm] *ERROR* [CRTC:68:crtc-1] flip_done timed out
[ 549.299192] vc4-drm gpu: [drm:vc4_atomic_commit_tail [vc4]] Running the core clock at 13500000 Hz
543c228 state to bfd72ae[ 560.089055] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 560.098095] rcu: 0-....: (41 ticks this GP) idle=abd/1/0x40000002 softirq=3047/3047 fqs=266
[ 560.108684] (detected by 2, t=46440 jiffies, g=1413, q=285 ncpus=4)
[ 560.116088] Sending NMI from CPU 2 to CPUs 0:
[ 570.889050] NMI backtrace for cpu 0
[ 570.889059] CPU: 0 PID: 31 Comm: kworker/0:1 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 570.889071] Hardware name: BCM2711
[ 570.889077] Workqueue: events_power_efficient phy_state_machine
[ 570.889097] PC is at v7_dma_inv_range+0x24/0x54
[ 570.889112] LR is at __dma_page_cpu_to_dev+0x30/0xa0
[ 570.889122] pc : [<c021c1ec>] lr : [<c0217fac>] psr: 40000113
[ 570.889128] sp : f0801dd0 ip : ed076400 fp : 00000000
[ 570.889134] r10: 066384c0 r9 : 000004c0 r8 : 00000800
[ 570.889140] r7 : 00000002 r6 : ed142b00 r5 : 00000800 r4 : c2972010
[ 570.889147] r3 : 0000003f r2 : 00000040 r1 : c6638cc0 r0 : c66384c0
[ 570.889157] Flags: nZcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 570.889170] Control: 30c5383d Table: 05a8a6c0 DAC: fffffffd
[ 570.889176] CPU: 0 PID: 31 Comm: kworker/0:1 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 570.889186] Hardware name: BCM2711
[ 570.889191] Workqueue: events_power_efficient phy_state_machine
[ 570.889212] unwind_backtrace from show_stack+0x18/0x1c
[ 570.889232] show_stack from dump_stack_lvl+0x58/0x70
[ 570.889248] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 570.889263] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 570.889276] do_handle_IPI from ipi_handler+0x20/0x28
[ 570.889291] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 570.889311] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 570.889327] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 570.889340] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 570.889359] generic_handle_arch_irq from __irq_svc+0x78/0x9c
[ 570.889375] Exception stack(0xf0801d80 to 0xf0801dc8)
[ 570.889385] 1d80: c66384c0 c6638cc0 00000040 0000003f c2972010 00000800 ed142b00 00000002
[ 570.889395] 1da0: 00000800 000004c0 066384c0 00000000 ed076400 f0801dd0 c0217fac c021c1ec
[ 570.889400] 1dc0: 40000113 ffffffff
[ 570.889406] __irq_svc from v7_dma_inv_range+0x24/0x54
[ 570.889423] v7_dma_inv_range from __dma_page_cpu_to_dev+0x30/0xa0
[ 570.889441] __dma_page_cpu_to_dev from dma_map_page_attrs+0x1fc/0x330
[ 570.889460] dma_map_page_attrs from bcmgenet_rx_refill+0x9c/0x204 [genet]
[ 570.889500] bcmgenet_rx_refill [genet] from bcmgenet_rx_poll+0x1fc/0x454 [genet]
[ 570.889543] bcmgenet_rx_poll [genet] from __napi_poll+0x34/0x298
[ 570.889581] __napi_poll from net_rx_action+0x15c/0x2c0
[ 570.889599] net_rx_action from __do_softirq+0x128/0x534
[ 570.889616] __do_softirq from irq_exit+0x170/0x1a0
[ 570.889636] irq_exit from call_with_stack+0x18/0x20
[ 570.889659] call_with_stack from __irq_svc+0x88/0x9c
[ 570.889674] Exception stack(0xf08a9de8 to 0xf08a9e30)
[ 570.889683] 9de0: c4ff86c0 00000001 28200000 bf040ee4 00000001 c4ff86c0
[ 570.889692] 9e00: c3a4acc0 00000000 c4ff8000 00000000 c1808f18 effa2805 00040000 f08a9e38
[ 570.889700] 9e20: bf009044 bf03dd04 20000013 ffffffff
[ 570.889705] __irq_svc from bcmgenet_mii_wait+0x1c/0xd8 [genet]
[ 570.889734] bcmgenet_mii_wait [genet] from unimac_mdio_read+0x44/0x7c [mdio_bcm_unimac]
[ 570.889771] unimac_mdio_read [mdio_bcm_unimac] from __mdiobus_read+0x44/0x22c
[ 570.889795] __mdiobus_read from mdiobus_read+0x3c/0x50
[ 570.889810] mdiobus_read from genphy_update_link+0x20/0xec
[ 570.889823] genphy_update_link from genphy_read_status+0x1c/0xd8
[ 570.889836] genphy_read_status from phy_check_link_status+0xf8/0x108
[ 570.889853] phy_check_link_status from phy_state_machine+0x74/0x234
[ 570.889871] phy_state_machine from process_one_work+0x29c/0x74c
[ 570.889892] process_one_work from worker_thread+0x34/0x4d8
[ 570.889906] worker_thread from kthread+0xf4/0x110
[ 570.889919] kthread from ret_from_fork+0x14/0x34
[ 570.889929] Exception stack(0xf08a9fb0 to 0xf08a9ff8)
[ 570.889938] 9fa0: 00000000 00000000 00000000 00000000
[ 570.889946] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 570.889954] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
8
[ 95.663486] vc4-drm gpu: [drm:drm_atomic_set_fb_[ 592.489231] systemd[1]: systemd-journald.service: Processes still around after SIGKILL. Ignoring.
for_plane] Set [NOFB] for [PLANE:61:plane-1] state 1543c228
[ 95.663514] [drm:drm_mode_object_put.part.[ 646.489182] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 646.498084] rcu: 0-....: (50 ticks this GP) idle=abd/1/0x40000002 softirq=3047/3047 fqs=271
[ 646.508374] (detected by 1, t=55080 jiffies, g=1413, q=305 ncpus=4)
[ 646.515637] Sending NMI from CPU 1 to CPUs 0:
[ 657.289197] NMI backtrace for cpu 0
[ 657.289208] CPU: 0 PID: 31 Comm: kworker/0:1 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
0] OBJ ID: 198 (3)
[ 657.289220] Hardware name: BCM2711
[ 657.289227] Workqueue: events_power_efficient phy_state_machine
[ 657.289248] PC is at ___slab_alloc.constprop.0+0xa4c/0x12b8
[ 657.289261] LR is at ___slab_alloc.constprop.0+0xe84/0x12b8
[ 657.289268] pc : [<c03ebe80>] lr : [<c03ec2b8>] psr: 60000113
[ 657.289274] sp : f0801d78 ip : 00000000 fp : c1809744
[ 657.289280] r10: c3f21c00 r9 : c290ec00 r8 : ed0f4820
[ 657.289285] r7 : c1f917e8 r6 : c3f21c00 r5 : effa3d08 r4 : effa3d18
[ 657.289292] r3 : 60000113 r2 : 2e8ee000 r1 : 00000000 r0 : c03ec2b8
[ 657.289298] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 657.289308] Control: 30c5383d Table: 05a8a6c0 DAC: fffffffd
[ 657.289314] CPU: 0 PID: 31 Comm: kworker/0:1 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 657.289324] Hardware name: BCM2711
[ 657.289328] Workqueue: events_power_efficient phy_state_machine
[ 657.289348] unwind_backtrace from show_stack+0x18/0x1c
[ 657.289368] show_stack from dump_stack_lvl+0x58/0x70
[ 657.289383] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 657.289399] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 657.289412] do_handle_IPI from ipi_handler+0x20/0x28
[ 657.289427] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 657.289447] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 657.289462] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 657.289475] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 657.289494] generic_handle_arch_irq from __irq_svc+0x78/0x9c
[ 657.289510] Exception stack(0xf0801d28 to 0xf0801d70)
[ 657.289519] 1d20: c03ec2b8 00000000 2e8ee000 60000113 effa3d18 effa3d08
[ 657.289529] 1d40: c3f21c00 c1f917e8 ed0f4820 c290ec00 c3f21c00 c1809744 00000000 f0801d78
[ 657.289536] 1d60: c03ec2b8 c03ebe80 60000113 ffffffff
[ 657.289541] __irq_svc from ___slab_alloc.constprop.0+0xa4c/0x12b8
[ 657.289556] ___slab_alloc.constprop.0 from __slab_alloc.constprop.0+0x2c/0x3c
[ 657.289568] __slab_alloc.constprop.0 from kmem_cache_alloc+0x1e8/0x334
[ 657.289581] kmem_cache_alloc from __build_skb+0x28/0x54
[ 657.289595] __build_skb from __netdev_alloc_skb+0xec/0x188
[ 657.289607] __netdev_alloc_skb from bcmgenet_rx_refill+0x38/0x204 [genet]
[ 657.289647] bcmgenet_rx_refill [genet] from bcmgenet_rx_poll+0x1fc/0x454 [genet]
[ 657.289690] bcmgenet_rx_poll [genet] from __napi_poll+0x34/0x298
[ 657.289724] __napi_poll from net_rx_action+0x15c/0x2c0
[ 657.289744] net_rx_action from __do_softirq+0x128/0x534
[ 657.289760] __do_softirq from irq_exit+0x170/0x1a0
[ 657.289777] irq_exit from call_with_stack+0x18/0x20
[ 657.289799] call_with_stack from __irq_svc+0x88/0x9c
[ 657.289813] Exception stack(0xf08a9de8 to 0xf08a9e30)
[ 657.289823] 9de0: c4ff86c0 00000001 28200000 bf040ee4 00000001 c4ff86c0
[ 657.289832] 9e00: c3a4acc0 00000000 c4ff8000 00000000 c1808f18 effa2805 00040000 f08a9e38
[ 657.289839] 9e20: bf009044 bf03dd04 20000013 ffffffff
[ 657.289845] __irq_svc from bcmgenet_mii_wait+0x1c/0xd8 [genet]
[ 657.289874] bcmgenet_mii_wait [genet] from unimac_mdio_read+0x44/0x7c [mdio_bcm_unimac]
[ 657.289910] unimac_mdio_read [mdio_bcm_unimac] from __mdiobus_read+0x44/0x22c
[ 657.289932] __mdiobus_read from mdiobus_read+0x3c/0x50
[ 657.289946] mdiobus_read from genphy_update_link+0x20/0xec
[ 657.289960] genphy_update_link from genphy_read_status+0x1c/0xd8
[ 657.289972] genphy_read_status from phy_check_link_status+0xf8/0x108
[ 657.289990] phy_check_link_status from phy_state_machine+0x74/0x234
[ 657.290008] phy_state_machine from process_one_work+0x29c/0x74c
[ 657.290027] process_one_work from worker_thread+0x34/0x4d8
[ 657.290041] worker_thread from kthread+0xf4/0x110
[ 657.290055] kthread from ret_from_fork+0x14/0x34
[ 657.290065] Exception stack(0xf08a9fb0 to 0xf08a9ff8)
[ 657.290073] 9fa0: 00000000 00000000 00000000 00000000
[ 657.290082] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 657.290089] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 657.295343] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
Pulled the plug
####################################################################################################
No "dmesg -w" this time.
The [2777.*] comes out slow after the first dump, the rest at normal speed.
...
[ OK ] Finished Permit User Sessions.
Starting Hold until boot process finishes up...
Starting Terminate Plymouth Boot Screen...
Raspbian GNU/Linux 11 pi4t ttyAMA0
pi4t login: pi (automatic login)
Linux pi4t 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7 SMP Fri Aug 26 17:01:11 CEST 2022 armv7l
The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.
Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Sat Aug 27 15:37:04 CEST 2022 from 192.168.10.94 on pts/0
pi@pi4t:~ $
pi@pi4t:~ $ [ 2777.298368] 8<--- cut here ---
[ 2777.302374] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 2777.310547] [00000000] *pgd=80000000004003, *pmd=00000000
[ 2777.316794] Internal error: : 1211 [#1] SMP ARM
[ 2777.322000] Modules linked in: brcmfmac brcmutil cfg80211 vc4 crc32_arm_ce snd_soc_core snd_pcm_dmaengine raspberrypi_hwmon snd_pcm genet snd_timer mdio_bcm_unimac bcm2711_thermal snd nvmem_rmem soundcore drm_dma_helper cec
[ 2777.344082] CPU: 2 PID: 1028 Comm: kworker/2:2 Not tainted 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 2777.354553] Hardware name: BCM2711
[ 2777.358713] Workqueue: events_freezable_power_ thermal_zone_device_check
[ 2777.366228] PC is at regmap_mmio_read+0x40/0x5c
[ 2777.371551] LR is at regmap_mmio_read+0x40/0x5c
[ 2777.376853] pc : [<c0953cb8>] lr : [<c0953cb8>] psr: 20000093
[ 2777.383903] sp : f09c5e40 ip : 00000000 fp : effc2905
[ 2777.389911] r10: c1808f18 r9 : 00000000 r8 : c1fd7e50
[ 2777.395921] r7 : f09c5e90 r6 : f09c5e90 r5 : 00000200 r4 : c3ba6f00
[ 2777.403258] r3 : f0817200 r2 : f09c5e90 r1 : 00000200 r0 : 00000000
[ 2777.410591] Flags: nzCv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[ 2777.418639] Control: 30c5383d Table: 05bfc8c0 DAC: 55555555
[ 2777.425187] Register r0 information: NULL pointer
[ 2777.430682] Register r1 information: non-paged memory
[ 2777.436531] Register r2 information: 2-page vmalloc region starting at 0xf09c4000 allocated at kernel_clone+0x84/0x75c
[ 2777.448824] Register r3 information: 0-page vmalloc region starting at 0xf0817000 allocated at of_iomap+0x54/0x7c
[ 2777.460719] Register r4 information: slab kmalloc-64 start c3ba6f00 pointer offset 0 size 64
[ 2777.470835] Register r5 information: non-paged memory
[ 2777.476723] Register r6 information: 2-page vmalloc region starting at 0xf09c4000 allocated at kernel_clone+0x84/0x75c
[ 2777.489085] Register r7 information: 2-page vmalloc region starting at 0xf09c4000 allocated at kernel_clone+0x84/0x75c
[ 2777.501480] Register r8 information: non-slab/vmalloc memory
[ 2777.507994] Register r9 information: NULL pointer
[ 2777.513523] Register r10 information: non-slab/vmalloc memory
[ 2777.520086] Register r11 information: non-slab/vmalloc memory
[ 2777.526621] Register r12 information: NULL pointer
[ 2777.532171] Process kworker/2:2 (pid: 1028, stack limit = 0x7c13d5b6)
[ 2777.539405] Stack: (0xf09c5e40 to 0xf09c6000)
[ 2777.544528] 5e40: c4995800 00000200 c4995800 c094cb80 c4995800 c0f04c00 00000001 c4995800
[ 2777.554266] 5e60: 00000200 f09c5e90 00000001 c1fd7e50 00000000 c1808f18 effc2905 c094cd8c
[ 2777.564067] 5e80: 000641b8 f09c5ee0 fffffe19 bf04b058 effc2905 c1808ec8 c29b8000 f09c5ee0
[ 2777.573923] 5ea0: c29b8358 c0bed780 c29b8000 00000000 c29b8358 c0bea6bc c58ee180 00000000
[ 2777.583837] 5ec0: effbecd0 60000093 c024723c c0296cfc 00000000 c0297088 00000001 c0ef4eb4
[ 2777.593785] 5ee0: c29b83ac c1808ec8 effbecc0 c29b83ac c3f04900 effbecc0 effc2900 c1973a60
[ 2777.603802] 5f00: 00000000 c1808f18 effc2905 c02472d4 00000001 00000000 c0247228 c1808ec8
[ 2777.613828] 5f20: c024782c effbecc0 c1fd7e80 c1dff954 00000000 c144f7bc 00000000 c1808ec8
[ 2777.623852] 5f40: effbecc0 c3f04900 effbecc0 c3f04918 effbecfc c1805d40 c58ee180 00000008
[ 2777.633884] 5f60: effbecc0 c02477b8 00000000 c4f5aa80 c58ee180 c0247784 c3f04900 c597bb80
[ 2777.643948] 5f80: f0999ea4 00000000 00000000 c0250c54 c4f5aa80 c0250b60 00000000 00000000
[ 2777.654009] 5fa0: 00000000 00000000 00000000 c0200100 00000000 00000000 00000000 00000000
[ 2777.664112] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2777.674298] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
[ 2777.684564] regmap_mmio_read from _regmap_read+0x6c/0x234
[ 2777.691129] _regmap_read from regmap_read+0x44/0x64
[ 2777.697151] regmap_read from bcm2711_get_temp+0x58/0xa0 [bcm2711_thermal]
[ 2777.705098] bcm2711_get_temp [bcm2711_thermal] from thermal_zone_get_temp+0x54/0x74
[ 2777.713914] thermal_zone_get_temp from thermal_zone_device_update+0x80/0x568
[ 2777.722107] thermal_zone_device_update from process_one_work+0x29c/0x74c
[ 2777.729939] process_one_work from worker_thread+0x34/0x4d8
[ 2777.736533] worker_thread from kthread+0xf4/0x110
[ 2777.742324] kthread from ret_from_fork+0x14/0x34
[ 2777.748009] Exception stack(0xf09c5fb0 to 0xf09c5ff8)
[ 2777.754025] 5fa0: 00000000 00000000 00000000 00000000
[ 2777.764093] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2777.774145] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 2777.781716] Code: e5943014 e1a01005 e1a00004 e12fff33 (e5860000)
[ 2777.788755] ---[ end trace 0000000000000000 ]---
[ 2777.794290] note: kworker/2:2[1028] exited with preempt_count 1
[ 2814.109925] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 2814.116809] rcu: 0-...0: (2 ticks this GP) idle=3d3/0/0x1 softirq=8699/8699 fqs=222
[ 2814.125569] (detected by 2, t=2602 jiffies, g=5681, q=30 ncpus=4)
[ 2814.132654] Sending NMI from CPU 2 to CPUs 0:
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.316794] Internal error: : 1211 [#1] SMP ARM
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.532171] Process kworker/2:2 (pid: 1028, stack limit = 0x7c13d5b6)
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.539405] Stack: (0xf09c5e40 to 0xf09c6000)
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.544528] 5e40: c4995800 00000200 c4995800 c094cb80 c4995800 c0f04c00 00000001 c4995800
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.554266] 5e60: 00000200 f09c5e90 00000001 c1fd7e50 00000000 c1808f18 effc2905 c094cd8c
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.564067] 5e80: 000641b8 f09c5ee0 fffffe19 bf04b058 effc2905 c1808ec8 c29b8000 f09c5ee0
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.573923] 5ea0: c29b8358 c0bed780 c29b8000 00000000 c29b8358 c0bea6bc c58ee180 00000000
Message from syslog[ 2820.616927] ------------[ cut here ]------------
[ 2820.622375] WARNING: CPU: 3 PID: 1119 at drivers/firmware/raspberrypi.c:63 rpi_firmware_property_list+0x204/0x270
[ 2820.634238] Firmware transaction timeout
[ 2820.634247] Modules linked in: brcmfmac brcmutil cfg80211 vc4 crc32_arm_ce snd_soc_core snd_pcm_dmaengine raspberrypi_hwmon snd_pcm genet snd_timer mdio_bcm_unimac bcm2711_thermal snd nvmem_rmem soundcore drm_dma_helper cec
[ 2820.661299] CPU: 3 PID: 1119 Comm: modetest Tainted: G D 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 2820.672995] Hardware name: BCM2711
[ 2820.677188] unwind_backtrace from show_stack+0x18/0x1c
[ 2820.683232] show_stack from dump_stack_lvl+0x58/0x70
[ 2820.689089] dump_stack_lvl from __warn+0xd4/0x200
[ 2820.694674] __warn from warn_slowpath_fmt+0xa0/0xd0
[ 2820.700436] warn_slowpath_fmt from rpi_firmware_property_list+0x204/0x270
[ 2820.708123] rpi_firmware_property_list from rpi_firmware_property+0x68/0x94
[ 2820.715982] rpi_firmware_property from raspberrypi_clock_property+0x50/0x84
[ 2820.723837] raspberrypi_clock_property from raspberrypi_fw_set_rate+0x4c/0xc4
[ 2820.731862] raspberrypi_fw_set_rate from clk_change_rate+0x16c/0x6f8
[ 2820.739105] clk_change_rate from clk_core_set_rate_nolock+0x1c4/0x2a4
[ 2820.746453] clk_core_set_rate_nolock from clk_set_rate_range.part.0+0x128/0x2ac
[ 2820.754681] clk_set_rate_range.part.0 from vc4_atomic_commit_tail+0x2b4/0x854 [vc4]
[ 2820.763415] vc4_atomic_commit_tail [vc4] from commit_tail+0xa4/0x19c
[ 2820.770832] commit_tail from drm_atomic_helper_commit+0x16c/0x194
[ 2820.777847] drm_atomic_helper_commit from drm_atomic_commit+0xb4/0xec
[ 2820.785217] drm_atomic_commit from drm_mode_atomic_ioctl+0x8f0/0xb6c
[ 2820.792487] drm_mode_atomic_ioctl from drm_ioctl_kernel+0xcc/0x170
[ 2820.799575] drm_ioctl_kernel from drm_ioctl+0x1d8/0x374
[ 2820.805698] drm_ioctl from sys_ioctl+0xe4/0xbac
[ 2820.811112] sys_ioctl from ret_fast_syscall+0x0/0x1c
[ 2820.816947] Exception stack(0xf0a01fa8 to 0xf0a01ff0)
[ 2820.822767] 1fa0: 00040530 bead2338 00000003 c03864bc bead2338 00000000
[ 2820.832459] 1fc0: 00040530 bead2338 c03864bc 00000036 bead2338 00042120 00042180 00042118
[ 2820.842166] 1fe0: b6ebd09c bead230c b6ea463c b6df61ac
[ 2820.848000] irq event stamp: 4866
[ 2820.852101] hardirqs last enabled at (4865): [<c0f04e80>] _raw_spin_unlock_irqrestore+0x4c/0x50
[ 2820.862434] hardirqs last disabled at (4866): [<c0ef8c20>] __schedule+0x4e0/0x964
[ 2820.870749] softirqs last enabled at (4834): [<c0201808>] __do_softirq+0x308/0x534
[ 2820.879224] softirqs last disabled at (4829): [<c022ecec>] irq_exit+0x170/0x1a0
[ 2820.887368] ---[ end trace 0000000000000000 ]---
[ 2820.892829] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-core frequency: -110
[ 2821.900122] hwmon hwmon1: Failed to get throttled (-110)
[ 2823.991278] drm_atomic_helper_connector_tv_check: IN
[ 2823.997079] drm_atomic_helper_connector_tv_check: tv.norm: old=0x4 -> new=0x4
[ 2824.005069] mode:
[ 2824.008137] "720x480i": 60 13500 720 739 801 858 480 488 494 525 0x40 0x10
[ 2824.016486] picture_aspect_ratio: 1
[ 2824.021504] &crtc_state->mode:
[ 2824.025525] "720x480i": 60 13500 720 739 801 858 480 488 494 525 0x60 0x10
[ 2824.033867] picture_aspect_ratio: 1
[ 2824.038861] drm_atomic_helper_connector_tv_check: OUT
[ 2824.139809] rcu: rcu_sched kthread timer wakeup didn't happen for 1000 jiffies! g5681 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 2824.139818] NMI backtrace for cpu 0
[ 2824.139828] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 2824.139841] Hardware name: BCM2711
[ 2824.139845] PC is at v7_dma_inv_range+0x24/0x54
[ 2824.139866] LR is at __dma_page_cpu_to_dev+0x30/0xa0
[ 2824.139877] pc : [<c021c1ec>] lr : [<c0217fac>] psr: 40000113
[ 2824.139884] sp : c1801ca0 ip : ed076400 fp : 00000000
[ 2824.139890] r10: 06718e40 r9 : 00000e40 r8 : 00000800
[ 2824.139896] r7 : 00000002 r6 : ed144700 r5 : 00000800 r4 : c2972010
[ 2824.139902] r3 : 0000003f r2 : 00000040 r1 : c6719640 r0 : c6718e40
[ 2824.139909] Flags: nZcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 2824.139919] Control: 30c5383d Table: 05daac80 DAC: fffffffd
[ 2824.139925] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 2824.139935] Hardware name: BCM2711
[ 2824.139943] unwind_backtrace from show_stack+0x18/0x1c
[ 2824.139964] show_stack from dump_stack_lvl+0x58/0x70
[ 2824.139979] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 2824.139994] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 2824.140008] do_handle_IPI from ipi_handler+0x20/0x28
[ 2824.140023] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 2824.140042] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 2824.140057] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 2824.140070] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 2824.140089] generic_handle_arch_irq from __irq_svc+0x78/0x9c
[ 2824.140104] Exception stack(0xc1801c50 to 0xc1801c98)
[ 2824.140114] 1c40: c6718e40 c6719640 00000040 0000003f
[ 2824.140124] 1c60: c2972010 00000800 ed144700 00000002 00000800 00000e40 06718e40 00000000
[ 2824.140132] 1c80: ed076400 c1801ca0 c0217fac c021c1ec 40000113 ffffffff
[ 2824.140138] __irq_svc from v7_dma_inv_range+0x24/0x54
[ 2824.140155] v7_dma_inv_range from __dma_page_cpu_to_dev+0x30/0xa0
[ 2824.140173] __dma_page_cpu_to_dev from dma_map_page_attrs+0x1fc/0x330
[ 2824.140191] dma_map_page_attrs from bcmgenet_rx_refill+0x9c/0x204 [genet]
[ 2824.140239] bcmgenet_rx_refill [genet] from bcmgenet_rx_poll+0x1fc/0x454 [genet]
[ 2824.140289] bcmgenet_rx_poll [genet] from __napi_poll+0x34/0x298
[ 2824.140323] __napi_poll from net_rx_action+0x15c/0x2c0
[ 2824.140342] net_rx_action from __do_softirq+0x128/0x534
[ 2824.140358] __do_softirq from irq_exit+0x170/0x1a0
[ 2824.140374] irq_exit from __irq_svc+0x78/0x9c
[ 2824.140387] Exception stack(0xc1801ed0 to 0xc1801f18)
[ 2824.140396] 1ec0: ffffffff ffffffff 00000001 c021ca40
[ 2824.140405] 1ee0: c1974740 c1808f18 c180d500 c16b0368 c180d500 00000000 00000000 efffca40
[ 2824.140413] 1f00: 00000001 c1801f20 c0208948 c020894c 60000013 ffffffff
[ 2824.140418] __irq_svc from arch_cpu_idle+0x40/0x44
[ 2824.140435] arch_cpu_idle from default_idle_call+0x74/0x24c
[ 2824.140455] default_idle_call from do_idle+0x218/0x280
[ 2824.140475] do_idle from cpu_startup_entry+0x20/0x24
[ 2824.140494] cpu_startup_entry from rest_init+0x150/0x1e4
[ 2824.140515] rest_init from arch_post_acpi_subsys_init+0x0/0x18
[ 2824.482211] rcu: Possible timer handling issue on cpu=2 timer-softirq=3388
[ 2824.489999] rcu: rcu_sched kthread starved for 1004 jiffies! g5681 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=2
[ 2824.501816] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 2824.512445] rcu: RCU grace-period kthread stack dump:
[ 2824.518333] task:rcu_sched state:I stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 2824.528357] __schedule from schedule+0x60/0xd4
[ 2824.533740] schedule from schedule_timeout+0x214/0x408
[ 2824.539811] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 2824.546491] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 2824.552983] rcu_gp_kthread from kthread+0xf4/0x110
[ 2824.558686] kthread from ret_from_fork+0x14/0x34
[ 2824.564206] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 2824.570076] 5fa0: 00000000 00000000 00000000 00000000
[ 2824.579896] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2824.589755] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 2824.597246] rcu: Stack dump where RCU GP kthread last ran:
[ 2824.603580] NMI backtrace for cpu 2
[ 2824.607895] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 2824.619484] Hardware name: BCM2711
[ 2824.623715] unwind_backtrace from show_stack+0x18/0x1c
[ 2824.629800] show_stack from dump_stack_lvl+0x58/0x70
[ 2824.635703] dump_stack_lvl from nmi_cpu_backtrace+0xf4/0x134
[ 2824.642310] nmi_cpu_backtrace from nmi_trigger_cpumask_backtrace+0xf4/0x14c
[ 2824.650230] nmi_trigger_cpumask_backtrace from rcu_check_gp_kthread_starvation+0x148/0x164
[ 2824.660283] rcu_check_gp_kthread_starvation from rcu_sched_clock_irq+0x1174/0x1330
[ 2824.668822] rcu_sched_clock_irq from update_process_times+0x70/0x9c
[ 2824.676050] update_process_times from tick_sched_timer+0x54/0xb4
[ 2824.682994] tick_sched_timer from __hrtimer_run_queues+0x278/0x5a8
[ 2824.690107] __hrtimer_run_queues from hrtimer_interrupt+0x130/0x2d4
[ 2824.697301] hrtimer_interrupt from arch_timer_handler_phys+0x30/0x38
[ 2824.704575] arch_timer_handler_phys from handle_percpu_devid_irq+0xc4/0x328
[ 2824.712469] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 2824.720453] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 2824.727657] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 2824.734691] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 2824.741829] call_with_stack from __irq_svc+0x88/0x9c
[ 2824.747735] Exception stack(0xf0851f40 to 0xf0851f88)
[ 2824.753640] 1f40: c0f047f0 00000000 00000001 c021ca40 c1974740 c1808f18 c2996180 c16b0368
[ 2824.763508] 1f60: c2996180 00000000 00000000 00000000 00000001 f0851f90 c0208948 c020894c
[ 2824.773384] 1f80: 60000013 ffffffff
[ 2824.777707] __irq_svc from arch_cpu_idle+0x40/0x44
[ 2824.783432] arch_cpu_idle from default_idle_call+0x74/0x24c
[ 2824.789950] default_idle_call from do_idle+0x218/0x280
[ 2824.796017] do_idle from cpu_startup_entry+0x20/0x24
[ 2824.801897] cpu_startup_entry from secondary_start_kernel+0x160/0x168
[ 2824.809270] secondary_start_kernel from 0x201ad4
d@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.583837] 5ec0: effbecd0 60000093 c024723c c0296cfc 00000000 c0297088 00000001 c0ef4eb4
Message from syslogd@pi4t at [ 2885.298564] sched: RT throttling activated
[ 2896.098669] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-arm frequency: -110
Aug 27 16:39:03 ...
k[ 2906.898588] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 2906.907413] rcu: 0-....: (2 ticks this GP) idle=3d3/0/0x1 softirq=8699/8699 fqs=224
[ 2906.916092] (detected by 3, t=11880 jiffies, g=5681, q=224 ncpus=4)
[ 2906.923276] Sending NMI from CPU 3 to CPUs 0:
[ 2916.930362] rcu: rcu_sched kthread timer wakeup didn't happen for 1078 jiffies! g5681 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 2916.943152] rcu: Possible timer handling issue on cpu=3 timer-softirq=15356
[ 2916.951056] rcu: rcu_sched kthread starved for 1079 jiffies! g5681 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3
[ 2916.962924] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 2916.973604] rcu: RCU grace-period kthread stack dump:
[ 2916.979529] task:rcu_sched state:I stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 2916.989651] __schedule from schedule+0x60/0xd4
[ 2916.995087] schedule from schedule_timeout+0x214/0x408
[ 2917.001203] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 2917.007921] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 2917.014443] rcu_gp_kthread from kthread+0xf4/0x110
[ 2917.020161] kthread from ret_from_fork+0x14/0x34
[ 2917.025702] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 2917.031592] 5fa0: 00000000 00000000 00000000 00000000
[ 2917.041441] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2917.051336] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 2917.058840] rcu: Stack dump where RCU GP kthread last ran:
[ 2917.065212] NMI backtrace for cpu 3
[ 2917.069561] CPU: 3 PID: 330 Comm: avahi-daemon Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 2917.081639] Hardware name: BCM2711
[ 2917.085883] unwind_backtrace from show_stack+0x18/0x1c
[ 2917.091969] show_stack from dump_stack_lvl+0x58/0x70
[ 2917.097867] dump_stack_lvl from nmi_cpu_backtrace+0xf4/0x134
[ 2917.104451] nmi_cpu_backtrace from nmi_trigger_cpumask_backtrace+0xf4/0x14c
[ 2917.112335] nmi_trigger_cpumask_backtrace from rcu_check_gp_kthread_starvation+0x148/0x164
[ 2917.122311] rcu_check_gp_kthread_starvation from rcu_sched_clock_irq+0x1174/0x1330
[ 2917.130814] rcu_sched_clock_irq from update_process_times+0x70/0x9c
[ 2917.137999] update_process_times from tick_sched_timer+0x54/0xb4
[ 2917.144910] tick_sched_timer from __hrtimer_run_queues+0x278/0x5a8
[ 2917.151988] __hrtimer_run_queues from hrtimer_interrupt+0x130/0x2d4
[ 2917.159146] hrtimer_interrupt from arch_timer_handler_phys+0x30/0x38
[ 2917.166389] arch_timer_handler_phys from handle_percpu_devid_irq+0xc4/0x328
[ 2917.174255] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 2917.182207] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 2917.189376] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 2917.196377] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 2917.203479] call_with_stack from __irq_svc+0x88/0x9c
[ 2917.209352] Exception stack(0xf0f59dd8 to 0xf0f59e20)
[ 2917.215214] 9dc0: efffd670 c021c9d8
[ 2917.224975] 9de0: 90f00000 90f00000 ffece000 00c00000 efffd000 00000000 f89d571f 000f89d5
[ 2917.234733] 9e00: f0f59f00 bed22b8f 00400000 f0f59e28 c03b22e8 c03b2314 00000013 ffffffff
[ 2917.244506] __irq_svc from __kmap_local_pfn_prot+0x124/0x194
[ 2917.251089] __kmap_local_pfn_prot from copy_page_from_iter+0x1ec/0x504
[ 2917.258543] copy_page_from_iter from pipe_write+0x580/0x794
[ 2917.265035] pipe_write from vfs_write+0x450/0x4b8
[ 2917.270654] vfs_write from ksys_write+0xc4/0xf8
[ 2917.276090] ksys_write from ret_fast_syscall+0x0/0x1c
[ 2917.282045] Exception stack(0xf0f59fa8 to 0xf0f59ff0)
[ 2917.287906] 9fa0: 00000007 b6f92fc0 00000007 bed22b8f 00000001 00000000
[ 2917.297688] 9fc0: 00000007 b6f92fc0 bed22ba8 00000004 00041ca8 0003f028 0003c008 00000000
[ 2917.307474] 9fe0: b6f3cf70 bed22b70 b6e00e6c b6e00e88
ernel:[ 2777.593785] 5ee0: c29b83ac c1808ec8 effbecc0 c29b83ac c3f04900 effbecc0 effc2900 c1973a60
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.603802] 5f00: 0000000[ 2993.298733] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 2993.307570] rcu: 0-....: (2 ticks this GP) idle=3d3/0/0x1 softirq=8699/8699 fqs=227
[ 2993.316251] (detected by 3, t=20520 jiffies, g=5681, q=253 ncpus=4)
[ 2993.323442] Sending NMI from CPU 3 to CPUs 0:
[ 3004.098755] NMI backtrace for cpu 0
[ 3004.098766] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 3004.098778] Hardware name: BCM2711
[ 3004.098782] PC is at v7_dma_inv_range+0x24/0x54
[ 3004.098805] LR is at __dma_page_cpu_to_dev+0x30/0xa0
[ 3004.098816] pc : [<c021c1ec>] lr : [<c0217fac>] psr: 40000113
[ 3004.098823] sp : c1801ca0 ip : ed076400 fp : 00000000
[ 3004.098829] r10: 067304c0 r9 : 000004c0 r8 : 00000800
[ 3004.098835] r7 : 00000002 r6 : ed144a00 r5 : 00000800 r4 : c2972010
[ 3004.098834] raspberrypi-clk soc:firmware:clocks: Failed to change fw-clk-core frequency: -110
[ 3004.098841] r3 : 0000003f r2 : 00000040 r1 : c6730cc0 r0 : c67304c0
[ 3004.098848] Flags: nZcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 3004.098858] Control: 30c5383d Table: 05daac80 DAC: fffffffd
[ 3004.098864] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 3004.098874] Hardware name: BCM2711
[ 3004.098882] unwind_backtrace from show_stack+0x18/0x1c
[ 3004.098902] show_stack from dump_stack_lvl+0x58/0x70
[ 3004.098918] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 3004.098933] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 3004.098946] do_handle_IPI from ipi_handler+0x20/0x28
[ 3004.098960] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 3004.098980] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 3004.098995] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 3004.099008] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 3004.099026] generic_handle_arch_irq from __irq_svc+0x78/0x9c
[ 3004.099042] Exception stack(0xc1801c50 to 0xc1801c98)
[ 3004.099051] 1c40: c67304c0 c6730cc0 00000040 0000003f
[ 3004.099060] 1c60: c2972010 00000800 ed144a00 00000002 00000800 000004c0 067304c0 00000000
[ 3004.099068] 1c80: ed076400 c1801ca0 c0217fac c021c1ec 40000113 ffffffff
[ 3004.099073] __irq_svc from v7_dma_inv_range+0x24/0x54
[ 3004.099091] v7_dma_inv_range from __dma_page_cpu_to_dev+0x30/0xa0
[ 3004.099108] __dma_page_cpu_to_dev from dma_map_page_attrs+0x1fc/0x330
[ 3004.099126] dma_map_page_attrs from bcmgenet_rx_refill+0x9c/0x204 [genet]
[ 3004.099166] bcmgenet_rx_refill [genet] from bcmgenet_rx_poll+0x1fc/0x454 [genet]
[ 3004.099210] bcmgenet_rx_poll [genet] from __napi_poll+0x34/0x298
[ 3004.099245] __napi_poll from net_rx_action+0x15c/0x2c0
[ 3004.099263] net_rx_action from __do_softirq+0x128/0x534
[ 3004.099280] __do_softirq from irq_exit+0x170/0x1a0
[ 3004.099296] irq_exit from __irq_svc+0x78/0x9c
[ 3004.099309] Exception stack(0xc1801ed0 to 0xc1801f18)
[ 3004.099317] 1ec0: ffffffff ffffffff 00000001 c021ca40
[ 3004.099326] 1ee0: c1974740 c1808f18 c180d500 c16b0368 c180d500 00000000 00000000 efffca40
[ 3004.099334] 1f00: 00000001 c1801f20 c0208948 c020894c 60000013 ffffffff
[ 3004.099339] __irq_svc from arch_cpu_idle+0x40/0x44
[ 3004.099355] arch_cpu_idle from default_idle_call+0x74/0x24c
[ 3004.099375] default_idle_call from do_idle+0x218/0x280
[ 3004.099397] do_idle from cpu_startup_entry+0x20/0x24
[ 3004.099415] cpu_startup_entry from rest_init+0x150/0x1e4
[ 3004.099435] rest_init from arch_post_acpi_subsys_init+0x0/0x18
0 c1808f18 effc2905 c02472d4 00000001 00000000 c0247228 c1808ec8
Message from syslogd@pi4t at Aug 27 16:39:03 ...
kernel:[ 2777.613828] 5f20: c024782c effbecc0[ 3079.698881] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 3079.707683] rcu: 0-....: (2 ticks this GP) idle=3d3/0/0x1 softirq=8699/8699 fqs=229
[ 3079.716330] (detected by 3, t=29160 jiffies, g=5681, q=287 ncpus=4)
[ 3079.723483] Sending NMI from CPU 3 to CPUs 0:
[ 3089.730545] rcu: rcu_sched kthread starved for 1080 jiffies! g5681 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[ 3089.742122] rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[ 3089.752670] rcu: RCU grace-period kthread stack dump:
[ 3089.758531] task:rcu_sched state:R running task stack: 0 pid: 11 ppid: 2 flags:0x00000000
[ 3089.770096] __schedule from schedule+0x60/0xd4
[ 3089.775452] schedule from schedule_timeout+0x214/0x408
[ 3089.781498] schedule_timeout from rcu_gp_fqs_loop+0x16c/0x7e0
[ 3089.788156] rcu_gp_fqs_loop from rcu_gp_kthread+0x184/0x34c
[ 3089.794640] rcu_gp_kthread from kthread+0xf4/0x110
[ 3089.800337] kthread from ret_from_fork+0x14/0x34
[ 3089.805855] Exception stack(0xf0845fb0 to 0xf0845ff8)
[ 3089.811721] 5fa0: 00000000 00000000 00000000 00000000
[ 3089.821500] 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 3089.831278] 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 3089.838717] rcu: Stack dump where RCU GP kthread last ran:
[ 3089.845016] Sending NMI from CPU 3 to CPUs 1:
c1fd7e80 c1dff954 00000[ 3090.498892] NMI backtrace for cpu 1
[ 3090.498902] CPU: 1 PID: 146 Comm: systemd-journal Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 3090.498915] Hardware name: BCM2711
[ 3090.498919] PC is at kunmap_local_indexed+0xe8/0x1a4
[ 3090.498938] LR is at kunmap_local_indexed+0xbc/0x1a4
[ 3090.498948] pc : [<c03b1f84>] lr : [<c03b1f58>] psr: 00000013
[ 3090.498955] sp : f0ea9d20 ip : fffff000 fp : f0ea9e2c
[ 3090.498960] r10: 00460000 r9 : c3e95140 r8 : 00000004
[ 3090.498966] r7 : c1975200 r6 : c3e95140 r5 : c3c7edc0 r4 : ffeee000
[ 3090.498972] r3 : 90f00000 r2 : 90f00000 r1 : c021c9d8 r0 : efffd770
[ 3090.498979] Flags: nzcv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 3090.498989] Control: 30c5383d Table: 05c89440 DAC: 55555555
[ 3090.498995] CPU: 1 PID: 146 Comm: systemd-journal Tainted: G D W 5.19.0-rc6-00648-g9a2fc02f49d1-dirty #7
[ 3090.499005] Hardware name: BCM2711
[ 3090.499012] unwind_backtrace from show_stack+0x18/0x1c
[ 3090.499036] show_stack from dump_stack_lvl+0x58/0x70
[ 3090.499051] dump_stack_lvl from nmi_cpu_backtrace+0xdc/0x134
[ 3090.499066] nmi_cpu_backtrace from do_handle_IPI+0x40/0x350
[ 3090.499080] do_handle_IPI from ipi_handler+0x20/0x28
[ 3090.499094] ipi_handler from handle_percpu_devid_irq+0xc4/0x328
[ 3090.499116] handle_percpu_devid_irq from generic_handle_domain_irq+0x2c/0x3c
[ 3090.499132] generic_handle_domain_irq from gic_handle_irq+0x7c/0x90
[ 3090.499146] gic_handle_irq from generic_handle_arch_irq+0x34/0x44
[ 3090.499164] generic_handle_arch_irq from call_with_stack+0x18/0x20
[ 3090.499191] call_with_stack from __irq_svc+0x88/0x9c
[ 3090.499206] Exception stack(0xf0ea9cd0 to 0xf0ea9d18)
[ 3090.499215] 9cc0: efffd770 c021c9d8 90f00000 90f00000
[ 3090.499225] 9ce0: ffeee000 c3c7edc0 c3e95140 c1975200 00000004 c3e95140 00460000 f0ea9e2c
[ 3090.499233] 9d00: fffff000 f0ea9d20 c03b1f58 c03b1f84 00000013 ffffffff
[ 3090.499238] __irq_svc from kunmap_local_indexed+0xe8/0x1a4
[ 3090.499254] kunmap_local_indexed from unmap_page_range+0x5bc/0xa04
[ 3090.499270] unmap_page_range from unmap_vmas+0x70/0xb0
[ 3090.499286] unmap_vmas from exit_mmap+0xa4/0x1d0
[ 3090.499300] exit_mmap from mmput+0x50/0xe8
[ 3090.499319] mmput from do_exit+0x2d4/0xaf0
[ 3090.499338] do_exit from do_group_exit+0x40/0xa0
[ 3090.499352] do_group_exit from get_signal+0xd28/0xd8c
[ 3090.499371] get_signal from do_work_pending+0x13c/0x560
[ 3090.499385] do_work_pending from slow_work_pending+0xc/0x20
[ 3090.499395] Exception stack(0xf0ea9fb0 to 0xf0ea9ff8)
[ 3090.499404] 9fa0: b53565f0 b54b81b0 000161bc 00000000
[ 3090.499414] 9fc0: 004a5ed0 00000026 0043ba08 004b8460 00000000 00161bc0 00000001 00000000
[ 3090.499421] 9fe0: 00000000 be94c1b0 00000008 b6ee0e3c 60000010 ffffffff
Pulled the plug.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment