Skip to content

Instantly share code, notes, and snippets.

@rb2k
Created May 21, 2023 15:22
Show Gist options
  • Save rb2k/3e09ff3e9d622eca52e24fc69a2c367b to your computer and use it in GitHub Desktop.
Save rb2k/3e09ff3e9d622eca52e24fc69a2c367b to your computer and use it in GitHub Desktop.
frigate ffmpeg oom killed
[Sun May 21 09:27:27 2023] Memory cgroup out of memory: Killed process 20370 (ffmpeg) total-vm:8533984kB, anon-rss:6989448kB, file-rss:64852kB, shmem-rss:0kB, UID:0 pgtables:14260kB oom_score_adj:0
[Sun May 21 09:28:36 2023] ffmpeg invoked oom-killer: gfp_mask=0xcc0(GFP_KERNEL), order=0, oom_score_adj=0
[Sun May 21 09:28:36 2023] CPU: 1 PID: 30270 Comm: ffmpeg Not tainted 6.1.29-Unraid #1
[Sun May 21 09:28:36 2023] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U, BIOS L4.24 02/23/2022
[Sun May 21 09:28:36 2023] Call Trace:
[Sun May 21 09:28:36 2023] <TASK>
[Sun May 21 09:28:36 2023] dump_stack_lvl+0x44/0x5c
[Sun May 21 09:28:36 2023] dump_header+0x4a/0x211
[Sun May 21 09:28:36 2023] oom_kill_process+0x80/0x111
[Sun May 21 09:28:36 2023] out_of_memory+0x3b3/0x3e5
[Sun May 21 09:28:36 2023] mem_cgroup_out_of_memory+0x7c/0xb2
[Sun May 21 09:28:36 2023] try_charge_memcg+0x44a/0x5aa
[Sun May 21 09:28:36 2023] charge_memcg+0x31/0x79
[Sun May 21 09:28:36 2023] __mem_cgroup_charge+0x29/0x41
[Sun May 21 09:28:36 2023] __handle_mm_fault+0x881/0xcf9
[Sun May 21 09:28:36 2023] ? amdgpu_cs_report_moved_bytes+0x5e/0x5e [amdgpu]
[Sun May 21 09:28:36 2023] handle_mm_fault+0x13d/0x20f
[Sun May 21 09:28:36 2023] do_user_addr_fault+0x36a/0x530
[Sun May 21 09:28:36 2023] exc_page_fault+0xfb/0x11d
[Sun May 21 09:28:36 2023] asm_exc_page_fault+0x22/0x30
[Sun May 21 09:28:36 2023] RIP: 0033:0x149cfef177f7
[Sun May 21 09:28:36 2023] Code: 48 ff c7 48 01 fe 48 8d 54 11 80 0f 1f 84 00 00 00 00 00 c5 fe 6f 0e c5 fe 6f 56 20 c5 fe 6f 5e 40 c5 fe 6f 66 60 48 83 ee 80 <c5> fd 7f 0f c5 fd 7f 57 20 c5 fd 7f 5f 40 c5 fd 7f 67 60 48 83 ef
[Sun May 21 09:28:36 2023] RSP: 002b:00007fff035f40c8 EFLAGS: 00010203
[Sun May 21 09:28:36 2023] RAX: 000056453b9d6d70 RBX: 0000149cfd3db000 RCX: 000056453b9d6d70
[Sun May 21 09:28:36 2023] RDX: 000056453b9d7470 RSI: 0000149cfd3dab10 RDI: 000056453b9d7000
[Sun May 21 09:28:36 2023] RBP: 0000000000000780 R08: 0000000000000000 R09: 0000000000000000
[Sun May 21 09:28:36 2023] R10: 0000000000000000 R11: 000000000000021b R12: 0000000000000800
[Sun May 21 09:28:36 2023] R13: 000000000000021c R14: 0000000000000f00 R15: 00000000000001d2
[Sun May 21 09:28:36 2023] </TASK>
[Sun May 21 09:28:36 2023] memory: usage 8388620kB, limit 8388608kB, failcnt 2630427
[Sun May 21 09:28:36 2023] swap: usage 0kB, limit 9007199254740988kB, failcnt 0
[Sun May 21 09:28:36 2023] Memory cgroup stats for /docker/b35794782bf98ad36763d5f31884735bc86f0d249e69acea3f1ea5f755f45ef9:
[Sun May 21 09:28:36 2023] anon 8476979200
file 43388928
kernel 66375680
kernel_stack 13893632
pagetables 36347904
sec_pagetables 0
percpu 0
sock 3092480
vmalloc 0
shmem 43241472
file_mapped 6717440
file_dirty 0
file_writeback 0
swapcached 0
anon_thp 1837105152
file_thp 0
shmem_thp 0
inactive_anon 8507670528
active_anon 12517376
inactive_file 147456
active_file 0
unevictable 0
slab_reclaimable 1824800
slab_unreclaimable 12517712
slab 14342512
workingset_refault_anon 0
workingset_refault_file 2598118
workingset_activate_anon 0
workingset_activate_file 28967
workingset_restore_anon 0
workingset_restore_file 1430
workingset_nodereclaim 0
pgscan 5888787
pgsteal 2656606
pgscan_kswapd 42527
pgscan_direct 5846260
pgsteal_kswapd 42034
pgsteal_direct 2614572
pgfault 1136736473
pgmajfault 4121
pgrefill 209683
pgactivate 454907412
pgdeactivate 205279
pglazyfree 0
pglazyfreed 0
thp_fault_alloc 255236
thp_collapse_alloc 731
[Sun May 21 09:28:36 2023] Tasks state (memory values in pages):
[Sun May 21 09:28:36 2023] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[Sun May 21 09:28:36 2023] [ 23072] 0 23072 53 19 24576 0 0 s6-svscan
[Sun May 21 09:28:36 2023] [ 23095] 0 23095 53 17 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23096] 0 23096 50 1 24576 0 0 s6-linux-init-s
[Sun May 21 09:28:36 2023] [ 23104] 0 23104 53 15 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23105] 0 23105 53 17 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23106] 0 23106 53 17 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23107] 0 23107 53 16 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23108] 0 23108 53 16 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23109] 0 23109 53 16 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23110] 0 23110 53 16 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23111] 0 23111 53 16 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23112] 0 23112 53 17 24576 0 0 s6-supervise
[Sun May 21 09:28:36 2023] [ 23121] 0 23121 131 43 24576 0 0 s6-fdholderd
[Sun May 21 09:28:36 2023] [ 23122] 0 23122 47 1 24576 0 0 s6-ipcserverd
[Sun May 21 09:28:36 2023] [ 23160] 65534 23160 69 28 36864 0 0 s6-log
[Sun May 21 09:28:36 2023] [ 23161] 65534 23161 70 34 36864 0 0 s6-log
[Sun May 21 09:28:36 2023] [ 23162] 65534 23162 69 28 36864 0 0 s6-log
[Sun May 21 09:28:36 2023] [ 23170] 0 23170 182113 7115 151552 0 0 go2rtc
[Sun May 21 09:28:36 2023] [ 23178] 0 23178 973 709 45056 0 0 bash
[Sun May 21 09:28:36 2023] [ 23179] 0 23179 786609 44660 983040 0 0 python3
[Sun May 21 09:28:36 2023] [ 23198] 0 23198 145420 3292 106496 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23215] 0 23215 161947 1473 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23216] 0 23216 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23217] 0 23217 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23219] 0 23219 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23234] 0 23234 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23266] 0 23266 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23308] 0 23308 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23353] 0 23353 161947 1214 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23391] 0 23391 161947 1215 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23418] 0 23418 161947 1215 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23443] 0 23443 161947 1215 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23485] 0 23485 161947 1215 217088 0 0 nginx
[Sun May 21 09:28:36 2023] [ 23694] 0 23694 280918 19603 409600 0 0 frigate.logger
[Sun May 21 09:28:36 2023] [ 23700] 0 23700 3564 2559 65536 0 0 python3
[Sun May 21 09:28:36 2023] [ 23701] 0 23701 370730 26905 503808 0 0 frigate.detecto
[Sun May 21 09:28:36 2023] [ 23703] 0 23703 468118 24482 565248 0 0 frigate.output
[Sun May 21 09:28:36 2023] [ 23707] 0 23707 502120 27021 598016 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23706] 0 23706 31705 5523 167936 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23711] 0 23711 500854 25599 585728 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23712] 0 23712 501896 26819 598016 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23713] 0 23713 31705 5002 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23714] 0 23714 501225 26221 589824 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23715] 0 23715 31705 5333 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23716] 0 23716 501286 26354 593920 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23717] 0 23717 501329 26334 589824 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23718] 0 23718 31705 5333 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23720] 0 23720 501962 26979 598016 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23721] 0 23721 31705 5546 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23722] 0 23722 506012 31069 634880 0 0 frigate.process
[Sun May 21 09:28:36 2023] [ 23723] 0 23723 385665 23875 507904 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23724] 0 23724 31705 4668 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23727] 0 23727 386204 25232 516096 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23731] 0 23731 385665 24020 507904 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23732] 0 23732 31705 4942 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23738] 0 23738 385557 23658 507904 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23742] 0 23742 31705 5485 163840 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23745] 0 23745 385557 23647 507904 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23749] 0 23749 31705 5117 167936 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 23752] 0 23752 385557 23659 507904 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23769] 0 23769 386204 25233 520192 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 23777] 0 23777 386204 26761 528384 0 0 frigate.capture
[Sun May 21 09:28:36 2023] [ 4691] 0 4691 411728 33390 716800 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4693] 0 4693 426564 31424 696320 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4692] 0 4692 426569 30643 704512 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4694] 0 4694 409703 31891 692224 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4699] 0 4699 32813 7820 188416 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4701] 0 4701 32599 7530 188416 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4702] 0 4702 32738 7931 188416 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 4958] 0 4958 32621 7910 184320 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 8244] 0 8244 464733 47004 860160 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 31063] 0 31063 415250 50012 839680 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 12553] 0 12553 32550 8397 196608 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 26744] 0 26744 426664 31512 696320 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 30270] 0 30270 2277085 1771435 14696448 0 0 ffmpeg
[Sun May 21 09:28:36 2023] [ 32067] 0 32067 622 211 40960 0 0 sleep
[Sun May 21 09:28:36 2023] [ 32612] 0 32612 1776 551 49152 0 0 top
[Sun May 21 09:28:36 2023] [ 32674] 0 32674 1776 538 49152 0 0 top
[Sun May 21 09:28:36 2023] oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=b35794782bf98ad36763d5f31884735bc86f0d249e69acea3f1ea5f755f45ef9,mems_allowed=0,oom_memcg=/docker/b35794782bf98ad36763d5f31884735bc86f0d249e69acea3f1ea5f755f45ef9,task_memcg=/docker/b35794782bf98ad36763d5f31884735bc86f0d249e69acea3f1ea5f755f45ef9,task=ffmpeg,pid=30270,uid=0
[Sun May 21 09:28:36 2023] Memory cgroup out of memory: Killed process 30270 (ffmpeg) total-vm:9108340kB, anon-rss:7020712kB, file-rss:65028kB, shmem-rss:0kB, UID:0 pgtables:14352kB oom_score_adj:0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment