Skip to content

Instantly share code, notes, and snippets.

@williamtu
Last active August 15, 2018 23:14
Show Gist options
  • Save williamtu/b9ac87419a48ba6d793e490b49b967e7 to your computer and use it in GitHub Desktop.
Save williamtu/b9ac87419a48ba6d793e490b49b967e7 to your computer and use it in GitHub Desktop.
OOM kill ovs with af-xdp
[64701.441424] xsk_generic_xmit call direct xmit to ovs-p0
[64701.441440] xsk_generic_xmit done
[64717.199367] ovs-vswitchd invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null), order=0, oom_score_adj=0
[64717.199369] ovs-vswitchd cpuset=/ mems_allowed=0
[64717.199373] CPU: 2 PID: 1412 Comm: ovs-vswitchd Tainted: G L 4.18.0-rc6+ #156
[64717.199373] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
[64717.199374] Call Trace:
[64717.200092] dump_stack+0x5c/0x7b
[64717.200228] dump_header+0x6b/0x27c
[64717.200830] oom_kill_process+0x239/0x440
[64717.200833] ? oom_badness+0x23/0x120
[64717.200835] out_of_memory+0x10f/0x480
[64717.200836] __alloc_pages_slowpath+0xcb9/0xd90
[64717.200876] __alloc_pages_nodemask+0x24a/0x290
[64717.200877] filemap_fault+0x2da/0x640
[64717.200915] ? filemap_map_pages+0x188/0x370
[64717.200998] ext4_filemap_fault+0x2c/0x3b
[64717.201105] __do_fault+0x1f/0xc0
[64717.202167] __handle_mm_fault+0xc06/0x1130
[64717.202170] handle_mm_fault+0xfa/0x200
[64717.202253] __do_page_fault+0x257/0x4f0
[64717.202309] ? page_fault+0x8/0x30
[64717.202310] page_fault+0x1e/0x30
[64717.202365] RIP: 0033:0x513c2e
[64717.202365] Code: Bad RIP value.
[64717.202405] RSP: 002b:00007fff5f527150 EFLAGS: 00010206
[64717.202406] RAX: 00000000007c1500 RBX: 0000000000000000 RCX: 00007f629d540980
[64717.202407] RDX: 00007fff5f5271a0 RSI: 00007fff5f5271a0 RDI: 0000000001bb3340
[64717.202407] RBP: 00007fff5f527170 R08: 0000000000000000 R09: 0000000000000000
[64717.202408] R10: 00000000007e4fc0 R11: 00000000007e4ff7 R12: 0000000000406c00
[64717.202408] R13: 00007fff5f5274d0 R14: 0000000000000000 R15: 0000000000000000
[64717.202457] Mem-Info:
[64717.202541] active_anon:569005 inactive_anon:142278 isolated_anon:0
active_file:57 inactive_file:0 isolated_file:0
unevictable:8 dirty:0 writeback:0 unstable:0
slab_reclaimable:9373 slab_unreclaimable:14782
mapped:257 shmem:1550 pagetables:10110 bounce:0
free:25781 free_pcp:798 free_cma:0
[64717.202544] Node 0 active_anon:2276020kB inactive_anon:569112kB active_file:228kB inactive_file:0kB unevictable:32kB isolated(anon):0kB isolated(file):0kB mapped:1028kB dirty:0kB writeback:0kB shmem:6200kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 122880kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[64717.202545] Node 0 DMA free:15904kB min:136kB low:168kB high:200kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15988kB managed:15904kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[64717.202547] lowmem_reserve[]: 0 2614 7582 7582
[64717.202549] Node 0 DMA32 free:43128kB min:23256kB low:29068kB high:34880kB active_anon:1713660kB inactive_anon:545496kB active_file:276kB inactive_file:84kB unevictable:0kB writepending:0kB present:3129152kB managed:3040680kB mlocked:0kB kernel_stack:2736kB pagetables:24676kB bounce:0kB free_pcp:2036kB local_pcp:652kB free_cma:0kB
[64717.202551] lowmem_reserve[]: 0 0 4968 4968
[64717.202553] Node 0 Normal free:44092kB min:44188kB low:55232kB high:66276kB active_anon:562360kB inactive_anon:23616kB active_file:88kB inactive_file:236kB unevictable:32kB writepending:0kB present:5242880kB managed:5087232kB mlocked:32kB kernel_stack:6448kB pagetables:15764kB bounce:0kB free_pcp:1156kB local_pcp:436kB free_cma:0kB
[64717.202555] lowmem_reserve[]: 0 0 0 0
[64717.202557] Node 0 DMA: 0*4kB 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB
[64717.202569] Node 0 DMA32: 165*4kB (UME) 176*8kB (UME) 121*16kB (UME) 176*32kB (UME) 148*64kB (UME) 79*128kB (UE) 32*256kB (UE) 11*512kB (UE) 1*1024kB (M) 0*2048kB 0*4096kB = 44068kB
[64717.202575] Node 0 Normal: 421*4kB (UME) 486*8kB (UME) 333*16kB (UME) 344*32kB (UME) 125*64kB (UME) 51*128kB (UME) 26*256kB (UME) 1*512kB (M) 1*1024kB (M) 0*2048kB 0*4096kB = 44628kB
[64717.202582] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[64717.202611] Node 0 hugepages_total=2048 hugepages_free=2048 hugepages_surp=0 hugepages_size=2048kB
[64717.202612] 5344 total pagecache pages
[64717.202613] 3626 pages in swap cache
[64717.202614] Swap cache stats: add 745933, delete 742305, find 2457/4743
[64717.202614] Free swap = 0kB
[64717.202614] Total swap = 2962428kB
[64717.202615] 2097005 pages RAM
[64717.202615] 0 pages HighMem/MovableOnly
[64717.202616] 61051 pages reserved
[64717.202616] 0 pages cma reserved
[64717.202616] 0 pages hwpoisoned
[64717.202617] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[64717.202867] [ 1412] 0 1412 1375713 667780 10223616 588766 0 ovs-vswitchd
[64717.202626] [ 274] 0 274 10997 198 122880 754 0 systemd-journal
[64717.202628] [ 286] 0 286 39656 0 77824 74 0 vmware-vmblock-
[64717.202629] [ 291] 0 291 11311 1 110592 361 -1000 systemd-udevd
[64717.202631] [ 865] 104 865 64098 1083 135168 899 0 rsyslogd
[64717.202632] [ 867] 106 867 11051 1 139264 392 -900 dbus-daemon
[64717.202634] [ 878] 0 878 7164 1 98304 96 0 systemd-logind
[64717.202635] [ 879] 109 879 130364 0 364544 961 0 whoopsie
[64717.202636] [ 880] 111 880 11244 28 131072 100 0 avahi-daemon
[64717.202638] [ 883] 0 883 7469 0 102400 62 0 cgmanager
[64717.202639] [ 887] 0 887 7252 0 106496 70 0 cron
[64717.202640] [ 894] 0 894 53996 0 155648 1762 0 snapd
[64717.202642] [ 904] 111 904 11196 0 122880 80 0 avahi-daemon
[64717.202643] [ 914] 0 914 68974 19 180224 161 0 accounts-daemon
[64717.202645] [ 916] 0 916 112782 1 319488 1352 0 NetworkManager
[64717.202646] [ 918] 0 918 84338 0 294912 423 0 ModemManager
[64717.202647] [ 920] 0 920 6511 0 94208 51 0 atd
[64717.202648] [ 921] 0 921 1099 6 57344 38 0 acpid
[64717.202650] [ 925] 0 925 46479 73 221184 285 0 vmtoolsd
[64717.202651] [ 970] 0 970 4868 21 77824 38 0 irqbalance
[64717.202652] [ 1006] 0 1006 204341 0 716800 3677 0 libvirtd
[64717.202654] [ 1008] 0 1008 70602 1 188416 752 0 polkitd
[64717.202655] [ 1009] 0 1009 68731 1 303104 368 0 cups-browsed
[64717.202656] [ 1022] 0 1022 87602 6 196608 204 0 lightdm
[64717.202658] [ 1060] 0 1060 164015 5805 1212416 16701 0 Xorg
[64717.202660] [ 1154] 0 1154 58649 1 229376 203 0 lightdm
[64717.202661] [ 1222] 118 1222 45886 0 135168 78 0 rtkit-daemon
[64717.202662] [ 1236] 0 1236 84709 0 237568 318 0 upowerd
[64717.202664] [ 1249] 65534 1249 13217 21 147456 74 0 dnsmasq
[64717.202665] [ 1290] 113 1290 75290 1 229376 647 0 colord
[64717.202667] [ 1480] 0 1480 18695 1479 192512 1955 0 google_instance
[64717.202669] [ 1492] 0 1492 3984 0 73728 38 0 agetty
[64717.202670] [ 1627] 0 1627 16352 1 126976 119 0 master
[64717.202671] [ 1929] 123 1929 12495 0 131072 98 0 dnsmasq
[64717.202673] [ 1930] 0 1930 12488 0 131072 94 0 dnsmasq
[64717.202674] [ 2069] 0 2069 23316 1 225280 286 0 cupsd
[64717.202676] [ 2071] 7 2071 20311 0 196608 196 0 dbus
[64717.202701] [ 3815] 1000 3815 11312 0 126976 206 0 systemd
[64717.202703] [ 3816] 1000 3816 53860 7 188416 609 0 (sd-pam)
[64717.202704] [ 3821] 1000 3821 141431 0 192512 265 0 gnome-keyring-d
[64717.202705] [ 3823] 1000 3823 11621 1 135168 280 0 upstart
[64717.202707] [ 3908] 1000 3908 8216 0 106496 75 0 upstart-udev-br
[64717.202708] [ 3915] 1000 3915 10934 150 126976 201 0 dbus-daemon
[64717.202709] [ 3927] 1000 3927 21586 48 159744 140 0 window-stack-br
[64717.202710] [ 3954] 1000 3954 1126 0 57344 24 0 sh
[64717.202712] [ 3972] 1000 3972 10323 0 114688 100 0 upstart-file-br
[64717.202713] [ 3974] 1000 3974 8199 0 98304 80 0 upstart-dbus-br
[64717.202714] [ 3976] 1000 3976 8221 27 98304 69 0 upstart-dbus-br
[64717.202715] [ 3978] 1000 3978 131185 1054 524288 580 0 bamfdaemon
[64717.202717] [ 3980] 1000 3980 87429 1202 172032 341 0 ibus-daemon
[64717.202718] [ 3986] 1000 3986 68614 1 167936 187 0 gvfsd
[64717.202720] [ 3993] 1000 3993 84495 0 163840 161 0 at-spi-bus-laun
[64717.202721] [ 3999] 1000 3999 101715 0 167936 691 0 gvfsd-fuse
[64717.202722] [ 4006] 1000 4006 66068 0 147456 160 0 ibus-dconf
[64717.202723] [ 4008] 1000 4008 10756 1 126976 142 0 dbus-daemon
[64717.202724] [ 4011] 1000 4011 119947 376 512000 1381 0 ibus-ui-gtk3
[64717.202726] [ 4015] 1000 4015 106986 28 471040 822 0 ibus-x11
[64717.202727] [ 4020] 1000 4020 51741 25 176128 133 0 at-spi2-registr
[64717.202728] [ 4032] 1000 4032 118507 37 499712 1107 0 system-crash-no
[64717.202730] [ 4038] 1000 4038 47099 100 139264 71 0 ibus-engine-sim
[64717.202732] [ 4045] 1000 4045 41638 7 94208 64 0 gpg-agent
[64717.202733] [ 4055] 1000 4055 170478 476 643072 1015 0 hud-service
[64717.202734] [ 4057] 1000 4057 239132 4073 770048 809 0 unity-settings-
[64717.202735] [ 4064] 1000 4064 176472 1 450560 559 0 gnome-session-b
[64717.202736] [ 4070] 1000 4070 159936 722 569344 1216 0 unity-panel-ser
[64717.202738] [ 4091] 1000 4091 44697 1 114688 692 0 dconf-service
[64717.202739] [ 4098] 1000 4098 88738 1 200704 288 0 indicator-messa
[64717.202740] [ 4099] 1000 4099 101791 0 155648 163 0 indicator-bluet
[64717.202742] [ 4100] 1000 4100 142052 0 204800 403 0 indicator-power
[64717.202743] [ 4102] 1000 4102 308442 0 421888 1435 0 indicator-datet
[64717.202744] [ 4104] 1000 4104 162343 160 561152 1160 0 indicator-keybo
[64717.202745] [ 4105] 1000 4105 184258 1 307200 384 0 indicator-sound
[64717.202746] [ 4118] 1000 4118 155298 35 573440 967 0 indicator-print
[64717.202747] [ 4122] 1000 4122 189080 0 204800 762 0 indicator-sessi
[64717.202748] [ 4149] 1000 4149 100787 1 397312 409 0 indicator-appli
[64717.202750] [ 4152] 1000 4152 245199 0 688128 987 0 evolution-sourc
[64717.202751] [ 4173] 1000 4173 88615 43 364544 306 0 pulseaudio
[64717.202753] [ 4182] 1000 4182 372145 8569 1323008 15008 0 compiz
[64717.202775] [ 4192] 1000 4192 215756 0 835584 9525 0 evolution-calen
[64717.202777] [ 4209] 1000 4209 195441 1053 733184 1240 0 nautilus
[64717.202778] [ 4210] 1000 4210 107387 54 483328 810 0 polkit-gnome-au
[64717.202780] [ 4211] 1000 4211 144329 23 491520 885 0 unity-fallback-
[64717.202781] [ 4212] 1000 4212 328457 3628 966656 13585 0 gnome-software
[64717.202782] [ 4214] 1000 4214 186829 530 630784 1140 0 nm-applet
[64717.202784] [ 4235] 1000 4235 123673 42 548864 919 0 vmtoolsd
[64717.202785] [ 4236] 1000 4236 71372 0 188416 298 0 gvfs-udisks2-vo
[64717.202786] [ 4242] 0 4242 91671 1 200704 395 0 udisksd
[64717.202788] [ 4253] 1000 4253 64392 0 139264 134 0 gvfs-goa-volume
[64717.202789] [ 4258] 1000 4258 100912 0 233472 275 0 gvfs-afc-volume
[64717.202791] [ 4264] 1000 4264 67924 0 159744 165 0 gvfs-gphoto2-vo
[64717.202792] [ 4272] 1000 4272 64875 0 143360 138 0 gvfs-mtp-volume
[64717.202794] [ 4288] 1000 4288 222444 0 487424 11083 0 evolution-calen
[64717.202796] [ 4302] 1000 4302 87652 11 180224 208 0 gvfsd-trash
[64717.202797] [ 4303] 1000 4303 172655 0 503808 734 0 evolution-addre
[64717.202799] [ 4305] 1000 4305 200074 0 475136 10007 0 evolution-calen
[64717.202800] [ 4320] 1000 4320 209962 0 434176 2038 0 evolution-addre
[64717.202801] [ 4380] 1000 4380 169716 4041 643072 2025 0 gnome-terminal-
[64717.202803] [ 4386] 1000 4386 14636 0 159744 114 0 su
[64717.202804] [ 4394] 0 4394 5360 1 86016 178 0 bash
[64717.202805] [ 4404] 1000 4404 129636 0 442368 603 0 zeitgeist-datah
[64717.202806] [ 4411] 1000 4411 1126 0 57344 22 0 sh
[64717.202808] [ 4415] 1000 4415 101460 1 159744 330 0 zeitgeist-daemo
[64717.202809] [ 4422] 1000 4422 77709 0 192512 285 0 zeitgeist-fts
[64717.202810] [ 4449] 1000 4449 14636 0 159744 114 0 su
[64717.202811] [ 4454] 0 4454 5360 1 86016 179 0 bash
[64717.202813] [ 4532] 1000 4532 141895 95 561152 1619 0 update-notifier
[64717.202814] [ 4963] 1000 4963 108874 0 217088 1087 0 deja-dup-monito
[64717.202816] [ 5590] 1000 5590 14636 0 163840 115 0 su
[64717.202817] [ 5591] 0 5591 5360 84 81920 95 0 bash
[64717.202819] [ 5918] 1000 5918 14636 0 163840 114 0 su
[64717.202820] [ 5919] 0 5919 5360 85 86016 94 0 bash
[64717.202821] [ 6243] 1000 6243 14636 0 159744 113 0 su
[64717.202822] [ 6244] 0 6244 5360 1 90112 178 0 bash
[64717.202824] [ 6523] 1000 6523 122808 61 532480 2005 0 notify-osd
[64717.202825] [ 7954] 1000 7954 14636 0 163840 114 0 su
[64717.202827] [ 7955] 0 7955 5360 1 81920 179 0 bash
[64717.202828] [ 9225] 1000 9225 161258 0 311296 1048 0 unity-scope-hom
[64717.202830] [ 9236] 1000 9236 145710 466 311296 1439 0 unity-scope-loa
[64717.202831] [ 9238] 1000 9238 161787 1 274432 1143 0 unity-files-dae
[64717.202833] [20006] 0 20006 4699 1 90112 261 0 man
[64717.202854] [20016] 0 20016 2421 0 61440 65 0 pager
[64717.202856] [22653] 0 22653 4032 1 77824 220 0 dhclient
[64717.202858] [22736] 124 22736 16881 1 118784 114 0 qmgr
[64717.202861] [102282] 124 102282 16869 1 126976 116 0 pickup
[64717.202863] [117537] 0 117537 5356 90 77824 206 0 ovsdb-server
[64717.202865] [ 1400] 0 1400 5322 114 86016 167 0 ovsdb-server
[64717.202867] [ 1412] 0 1412 1375713 667780 10223616 588766 0 ovs-vswitchd
[64717.202869] [ 1611] 0 1611 13726 977 151552 0 0 vim
[64717.202870] [ 1612] 0 1612 3019 28 65536 0 0 cscope
[64717.202871] Out of memory: Kill process 1412 (ovs-vswitchd) score 453 or sacrifice child
[64717.202904] Killed process 1412 (ovs-vswitchd) total-vm:5502852kB, anon-rss:2671120kB, file-rss:0kB, shmem-rss:0kB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment