Skip to content

Instantly share code, notes, and snippets.

@brb
Last active March 8, 2019 20:00
Show Gist options
  • Save brb/2d7ac323d2e14cb7a38bacba301fe3af to your computer and use it in GitHub Desktop.
Save brb/2d7ac323d2e14cb7a38bacba301fe3af to your computer and use it in GitHub Desktop.
vmalloc two failures
2019-03-08T19:36:39,224208+0000 tc: vmalloc: allocation failure, allocated 59392000 of 75501568 bytes, mode:0x6090c0(GFP_KERNEL|__GFP_NORETRY|__GFP_ZERO), nodemask=(null),cpuset=b389e318420d891300ad9658f8e056b59972fda9547dd566245a922c34bb9e42,mems_allowed=0
2019-03-08T19:36:39,224215+0000 CPU: 0 PID: 17378 Comm: tc Tainted: G C OE 5.0.0+ #1
2019-03-08T19:36:39,224216+0000 Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
2019-03-08T19:36:39,224217+0000 Call Trace:
2019-03-08T19:36:39,224233+0000 dump_stack+0x63/0x85
2019-03-08T19:36:39,224240+0000 warn_alloc+0x10b/0x190
2019-03-08T19:36:39,224242+0000 __vmalloc_node_range+0x173/0x270
2019-03-08T19:36:39,224244+0000 __vmalloc_node_flags_caller+0x47/0x50
2019-03-08T19:36:39,224246+0000 ? htab_map_alloc+0x2e4/0x4e0
2019-03-08T19:36:39,224247+0000 bpf_map_area_alloc+0x45/0x50
2019-03-08T19:36:39,224249+0000 htab_map_alloc+0x2e4/0x4e0
2019-03-08T19:36:39,224250+0000 __do_sys_bpf+0x1c9/0x19f0
2019-03-08T19:36:39,224253+0000 ? call_rcu+0x10/0x20
2019-03-08T19:36:39,224254+0000 __x64_sys_bpf+0x1a/0x20
2019-03-08T19:36:39,224257+0000 do_syscall_64+0x5a/0x120
2019-03-08T19:36:39,224258+0000 entry_SYSCALL_64_after_hwframe+0x44/0xa9
2019-03-08T19:36:39,224261+0000 RIP: 0033:0x7ffff713d839
2019-03-08T19:36:39,224263+0000 Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 1f f6 2c 00 f7 d8 64 89 01 48
2019-03-08T19:36:39,224264+0000 RSP: 002b:00007fffffff21d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000141
2019-03-08T19:36:39,224266+0000 RAX: ffffffffffffffda RBX: 00005555557d6c5c RCX: 00007ffff713d839
2019-03-08T19:36:39,224266+0000 RDX: 0000000000000048 RSI: 00007fffffff21f0 RDI: 0000000000000000
2019-03-08T19:36:39,224267+0000 RBP: 00005555557dc3fd R08: 0000000000000004 R09: 00007ffff7fed6b8
2019-03-08T19:36:39,224268+0000 R10: 0000000000080000 R11: 0000000000000246 R12: 00005555557d7408
2019-03-08T19:36:39,224269+0000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
2019-03-08T19:36:39,224270+0000 Mem-Info:
2019-03-08T19:36:39,224274+0000 active_anon:153810 inactive_anon:210 isolated_anon:0
active_file:253448 inactive_file:439761 isolated_file:0
unevictable:0 dirty:121 writeback:0 unstable:0
slab_reclaimable:48779 slab_unreclaimable:15222
mapped:108887 shmem:541 pagetables:2615 bounce:0
free:27986 free_pcp:0 free_cma:0
2019-03-08T19:36:39,224276+0000 Node 0 active_anon:615240kB inactive_anon:840kB active_file:1013792kB inactive_file:1759044kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:435548kB dirty:484kB writeback:0kB shmem:2164kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
2019-03-08T19:36:39,224277+0000 Node 0 DMA free:15728kB min:268kB low:332kB high:396kB active_anon:0kB inactive_anon:0kB active_file:44kB inactive_file:48kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2019-03-08T19:36:39,224280+0000 lowmem_reserve[]: 0 3419 3866 3866 3866
2019-03-08T19:36:39,224282+0000 Node 0 DMA32 free:88012kB min:88204kB low:103084kB high:117964kB active_anon:521912kB inactive_anon:612kB active_file:852444kB inactive_file:1656172kB unevictable:0kB writepending:224kB present:3653568kB managed:3563596kB mlocked:0kB kernel_stack:7600kB pagetables:6688kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2019-03-08T19:36:39,224285+0000 lowmem_reserve[]: 0 0 446 446 446
2019-03-08T19:36:39,224290+0000 Node 0 Normal free:8204kB min:9824kB low:11768kB high:13712kB active_anon:93244kB inactive_anon:228kB active_file:161672kB inactive_file:103212kB unevictable:0kB writepending:260kB present:524288kB managed:457544kB mlocked:0kB kernel_stack:2224kB pagetables:3772kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2019-03-08T19:36:39,224294+0000 lowmem_reserve[]: 0 0 0 0 0
2019-03-08T19:36:39,224295+0000 Node 0 DMA: 2*4kB (UM) 1*8kB (U) 2*16kB (UE) 2*32kB (ME) 2*64kB (UE) 3*128kB (UME) 3*256kB (UME) 2*512kB (ME) 3*1024kB (UME) 1*2048kB (E) 2*4096kB (M) = 15728kB
2019-03-08T19:36:39,224304+0000 Node 0 DMA32: 1543*4kB (UME) 327*8kB (UME) 285*16kB (ME) 594*32kB (UME) 287*64kB (UME) 154*128kB (UME) 58*256kB (UME) 5*512kB (M) 1*1024kB (U) 0*2048kB 0*4096kB = 88868kB
2019-03-08T19:36:39,224312+0000 Node 0 Normal: 254*4kB (ME) 94*8kB (UME) 26*16kB (UME) 22*32kB (UME) 9*64kB (UE) 9*128kB (ME) 2*256kB (UM) 2*512kB (UM) 2*1024kB (UM) 0*2048kB 0*4096kB = 8200kB
2019-03-08T19:36:39,224321+0000 Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2019-03-08T19:36:39,224322+0000 693777 total pagecache pages
2019-03-08T19:36:39,224322+0000 0 pages in swap cache
2019-03-08T19:36:39,224323+0000 Swap cache stats: add 0, delete 0, find 0/0
2019-03-08T19:36:39,224324+0000 Free swap = 0kB
2019-03-08T19:36:39,224325+0000 Total swap = 0kB
2019-03-08T19:36:39,224325+0000 1048462 pages RAM
2019-03-08T19:36:39,224326+0000 0 pages HighMem/MovableOnly
2019-03-08T19:36:39,224326+0000 39200 pages reserved
2019-03-08T19:36:39,224327+0000 0 pages cma reserved
2019-03-08T19:36:39,224327+0000 0 pages hwpoisoned
2019-03-08T19:36:40,348476+0000 IPv6: ADDRCONF(NETDEV_CHANGE): cilium_health: link becomes ready
2019-03-08T19:36:42,680366+0000 cilium_health: Caught tx_queue_len zero misconfig
2019-03-08T19:36:42,762965+0000 tc: vmalloc: allocation failure, allocated 15609856 of 62918656 bytes, mode:0x6090c0(GFP_KERNEL|__GFP_NORETRY|__GFP_ZERO), nodemask=(null),cpuset=b389e318420d891300ad9658f8e056b59972fda9547dd566245a922c34bb9e42,mems_allowed=0
2019-03-08T19:36:42,762971+0000 CPU: 0 PID: 17643 Comm: tc Tainted: G C OE 5.0.0+ #1
2019-03-08T19:36:42,762973+0000 Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
2019-03-08T19:36:42,762974+0000 Call Trace:
2019-03-08T19:36:42,762979+0000 dump_stack+0x63/0x85
2019-03-08T19:36:42,762982+0000 warn_alloc+0x10b/0x190
2019-03-08T19:36:42,762985+0000 __vmalloc_node_range+0x173/0x270
2019-03-08T19:36:42,762987+0000 __vmalloc_node_flags_caller+0x47/0x50
2019-03-08T19:36:42,762988+0000 ? htab_map_alloc+0x2e4/0x4e0
2019-03-08T19:36:42,762990+0000 bpf_map_area_alloc+0x45/0x50
2019-03-08T19:36:42,762991+0000 htab_map_alloc+0x2e4/0x4e0
2019-03-08T19:36:42,762992+0000 __do_sys_bpf+0x1c9/0x19f0
2019-03-08T19:36:42,762994+0000 ? call_rcu+0x10/0x20
2019-03-08T19:36:42,762996+0000 __x64_sys_bpf+0x1a/0x20
2019-03-08T19:36:42,762998+0000 do_syscall_64+0x5a/0x120
2019-03-08T19:36:42,762999+0000 entry_SYSCALL_64_after_hwframe+0x44/0xa9
2019-03-08T19:36:42,763001+0000 RIP: 0033:0x7ffff713d839
2019-03-08T19:36:42,763003+0000 Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 1f f6 2c 00 f7 d8 64 89 01 48
2019-03-08T19:36:42,763004+0000 RSP: 002b:00007fffffff21d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000141
2019-03-08T19:36:42,763005+0000 RAX: ffffffffffffffda RBX: 00005555557d6ca4 RCX: 00007ffff713d839
2019-03-08T19:36:42,763005+0000 RDX: 0000000000000048 RSI: 00007fffffff21f0 RDI: 0000000000000000
2019-03-08T19:36:42,763006+0000 RBP: 00005555557dc425 R08: 0000000000000004 R09: 00007ffff7fed6b8
2019-03-08T19:36:42,763007+0000 R10: 0000000000080000 R11: 0000000000000246 R12: 00005555557d7428
2019-03-08T19:36:42,763007+0000 R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
2019-03-08T19:36:42,763008+0000 Mem-Info:
2019-03-08T19:36:42,763011+0000 active_anon:154832 inactive_anon:210 isolated_anon:12
active_file:255560 inactive_file:408679 isolated_file:0
unevictable:0 dirty:2 writeback:0 unstable:0
slab_reclaimable:47748 slab_unreclaimable:15256
mapped:107363 shmem:572 pagetables:2603 bounce:0
free:35894 free_pcp:478 free_cma:0
2019-03-08T19:36:42,763013+0000 Node 0 active_anon:619328kB inactive_anon:840kB active_file:1022240kB inactive_file:1634716kB unevictable:0kB isolated(anon):48kB isolated(file):0kB mapped:429452kB dirty:8kB writeback:0kB shmem:2288kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
2019-03-08T19:36:42,763014+0000 Node 0 DMA free:15728kB min:268kB low:332kB high:396kB active_anon:0kB inactive_anon:0kB active_file:44kB inactive_file:12kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2019-03-08T19:36:42,763016+0000 lowmem_reserve[]: 0 3419 3866 3866 3866
2019-03-08T19:36:42,763018+0000 Node 0 DMA32 free:105004kB min:104588kB low:119468kB high:134348kB active_anon:526128kB inactive_anon:612kB active_file:862524kB inactive_file:1552884kB unevictable:0kB writepending:0kB present:3653568kB managed:3563596kB mlocked:0kB kernel_stack:7592kB pagetables:6636kB bounce:0kB free_pcp:916kB local_pcp:736kB free_cma:0kB
2019-03-08T19:36:42,763021+0000 lowmem_reserve[]: 0 0 446 446 446
2019-03-08T19:36:42,763022+0000 Node 0 Normal free:22844kB min:24160kB low:26104kB high:28048kB active_anon:92340kB inactive_anon:228kB active_file:160072kB inactive_file:82480kB unevictable:0kB writepending:0kB present:524288kB managed:457544kB mlocked:0kB kernel_stack:2224kB pagetables:3776kB bounce:0kB free_pcp:996kB local_pcp:672kB free_cma:0kB
2019-03-08T19:36:42,763024+0000 lowmem_reserve[]: 0 0 0 0 0
2019-03-08T19:36:42,763025+0000 Node 0 DMA: 2*4kB (M) 3*8kB (UM) 3*16kB (UME) 3*32kB (UME) 1*64kB (E) 3*128kB (UME) 3*256kB (UME) 2*512kB (ME) 3*1024kB (UME) 1*2048kB (E) 2*4096kB (M) = 15728kB
2019-03-08T19:36:42,763032+0000 Node 0 DMA32: 5494*4kB (UME) 1227*8kB (UME) 660*16kB (UME) 700*32kB (UME) 296*64kB (UME) 112*128kB (UME) 28*256kB (UM) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 105200kB
2019-03-08T19:36:42,763037+0000 Node 0 Normal: 1911*4kB (UME) 747*8kB (UME) 290*16kB (UME) 94*32kB (UME) 34*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 23444kB
2019-03-08T19:36:42,763042+0000 Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2019-03-08T19:36:42,763043+0000 664778 total pagecache pages
2019-03-08T19:36:42,763043+0000 0 pages in swap cache
2019-03-08T19:36:42,763044+0000 Swap cache stats: add 0, delete 0, find 0/0
2019-03-08T19:36:42,763045+0000 Free swap = 0kB
2019-03-08T19:36:42,763045+0000 Total swap = 0kB
2019-03-08T19:36:42,763045+0000 1048462 pages RAM
2019-03-08T19:36:42,763046+0000 0 pages HighMem/MovableOnly
2019-03-08T19:36:42,763046+0000 39200 pages reserved
2019-03-08T19:36:42,763046+0000 0 pages cma reserved
2019-03-08T19:36:42,763047+0000 0 pages hwpoisoned
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment