Skip to content

Instantly share code, notes, and snippets.

@akshaymaniyar
Created October 29, 2019 14:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save akshaymaniyar/e1a257beb4e9cdb7e29268b1eed30d4a to your computer and use it in GitHub Desktop.
Save akshaymaniyar/e1a257beb4e9cdb7e29268b1eed30d4a to your computer and use it in GitHub Desktop.
Kernel Logs for ES Process getting killed
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852004] java: page allocation failure: order:0, mode:0x2080120(GFP_ATOMIC|__GFP_COLD)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852012] CPU: 18 PID: 19021 Comm: java Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852013] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852015] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff89c6ca483bf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852019] ffffffff8db8c43a 02080120ffffc010 ffffffff8e4020f8 ffff89c6ca483b90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852021] ffff89c600000010 ffff89c6ca483c00 ffff89c6ca483bb0 0fe84e26c33f3055
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852024] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852026] <IRQ>
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852033] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852037] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852039] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852042] [<ffffffff8db8c641>] ? __alloc_pages_slowpath+0x171/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852045] [<ffffffff8df52feb>] ? ip_local_deliver+0x6b/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852049] [<ffffffff8df4d0c0>] ? rt_cpu_seq_stop+0x10/0x10
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852052] [<ffffffff8df79866>] ? tcp_v4_early_demux+0x136/0x140
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852054] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852057] [<ffffffff8dbdec71>] ? alloc_pages_current+0x91/0x140
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852059] [<ffffffff8def748e>] ? skb_page_frag_refill+0xae/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852064] [<ffffffffc02dff30>] ? try_fill_recv+0x260/0x6c0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852067] [<ffffffffc02e0f2c>] ? virtnet_receive+0x72c/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852071] [<ffffffff8dab0000>] ? task_numa_migrate+0x4f0/0x8b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852074] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852077] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852081] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852085] [<ffffffff8da80b92>] ? irq_exit+0xc2/0xd0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852087] [<ffffffff8e01d3e7>] ? do_IRQ+0x57/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852089] [<ffffffff8e01b156>] ? common_interrupt+0x96/0x96
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852090] <EOI>
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852092] [<ffffffff8db9b942>] ? shrink_inactive_list+0x262/0x540
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852094] [<ffffffff8db9b931>] ? shrink_inactive_list+0x251/0x540
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852096] [<ffffffff8db9c56b>] ? shrink_node_memcg+0x5fb/0x7d0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852099] [<ffffffff8db9c822>] ? shrink_node+0xe2/0x340
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852101] [<ffffffff8db9cb71>] ? do_try_to_free_pages+0xf1/0x310
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852103] [<ffffffff8db9ce79>] ? try_to_free_pages+0xe9/0x1a0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852105] [<ffffffff8db8c7fa>] ? __alloc_pages_slowpath+0x32a/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852110] [<ffffffff8dae7ad4>] ? lock_timer_base+0x74/0x90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852112] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852114] [<ffffffff8dbdec71>] ? alloc_pages_current+0x91/0x140
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852116] [<ffffffff8def748e>] ? skb_page_frag_refill+0xae/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852117] [<ffffffff8def7d89>] ? sk_page_frag_refill+0x19/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852120] [<ffffffff8df63c54>] ? tcp_sendmsg+0x224/0xc40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852124] [<ffffffff8def3976>] ? sock_sendmsg+0x36/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852126] [<ffffffff8def3a07>] ? sock_write_iter+0x87/0x100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852129] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852131] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852134] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852136] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852138] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852139] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852146] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852146] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852146] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852146] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852146] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852146] free:61551 free_pcp:1891 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852150] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:429941 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852151] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852155] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852159] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852163] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852167] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6360kB local_pcp:312kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852171] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852174] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852186] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852199] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852209] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852210] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852211] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852212] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852213] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852214] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852214] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852215] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852216] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852216] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852217] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852264] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852268] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852268] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852270] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852272] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852275] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852277] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852280] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852282] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852285] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852287] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852289] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852292] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852295] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852298] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852300] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852303] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852305] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852306] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852309] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852311] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852314] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852317] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852319] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852321] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852324] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852327] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852329] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852329] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852334] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852334] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852334] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852334] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852334] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852334] free:61551 free_pcp:1891 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852338] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:430837 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852339] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852343] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852346] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852350] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852353] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6360kB local_pcp:312kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852357] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852360] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852373] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852385] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852395] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852396] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852396] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852397] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852398] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852399] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852399] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852400] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852400] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852401] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852402] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852403] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852406] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852407] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852408] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852410] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852413] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852415] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852418] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852420] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852422] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852424] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852427] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852429] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852431] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852434] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852436] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852438] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852440] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852442] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852444] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852447] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852449] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852451] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852453] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852455] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852457] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852459] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852461] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852462] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852466] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852466] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852466] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852466] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852466] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852466] free:61551 free_pcp:1891 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852469] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:431605 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852470] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852474] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852477] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852481] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852484] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6360kB local_pcp:312kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852488] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852491] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852502] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852514] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852524] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852525] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852526] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852526] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852527] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852528] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852529] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852529] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852530] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852530] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852531] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852532] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852535] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852536] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852537] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852539] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852542] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852545] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852548] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852550] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852552] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852554] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852556] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852558] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852561] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852564] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852566] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852568] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852570] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852571] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852574] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852576] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852579] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852581] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852582] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852584] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852586] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852589] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852590] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852591] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852595] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852595] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852595] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852595] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852595] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852595] free:61551 free_pcp:1892 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852599] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:432501 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852600] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852604] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852607] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852611] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852614] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6364kB local_pcp:316kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852618] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852621] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852632] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852644] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852654] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852655] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852656] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852656] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852657] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852658] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852658] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852659] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852659] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852660] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852660] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852662] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852665] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852665] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852666] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852668] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852671] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852673] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852675] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852678] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852680] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852682] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852684] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852686] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852688] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852690] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852692] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852694] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852696] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852698] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852700] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852703] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852705] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852707] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852709] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852711] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852713] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852715] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852717] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852718] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852722] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852722] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852722] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852722] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852722] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852722] free:61551 free_pcp:1892 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852725] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:433269 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852726] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852730] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852733] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852737] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852740] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6364kB local_pcp:316kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852744] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852746] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852758] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852772] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852782] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852783] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852783] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852784] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852785] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852786] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852786] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852787] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852787] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852788] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852789] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852790] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852793] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852794] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852795] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852797] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852800] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852802] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852804] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852806] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852808] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852811] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852813] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852815] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852817] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852819] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852822] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852824] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852826] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852827] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852830] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852832] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852834] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852836] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852838] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852840] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852842] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852844] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852846] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852847] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852851] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852851] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852851] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852851] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852851] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852851] free:61551 free_pcp:1893 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852854] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:433909 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852855] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852858] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852861] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852866] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852869] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6368kB local_pcp:320kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852873] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852875] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852886] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852898] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852907] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852908] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852909] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852910] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852911] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852911] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852912] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852912] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852913] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852914] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852914] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852915] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852918] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852919] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852919] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852922] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852924] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852926] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852928] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852930] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852932] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852935] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852937] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852939] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852941] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852943] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852945] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852947] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852949] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852951] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852953] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852955] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852958] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852960] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852962] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852963] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852969] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852971] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852973] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852985] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852990] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852990] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852990] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852990] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852990] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852990] free:61551 free_pcp:1893 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852993] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:434805 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852994] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.852999] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853002] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853006] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853009] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6368kB local_pcp:320kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853013] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853016] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853027] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853040] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853049] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853050] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853051] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853052] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853053] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853053] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853054] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853054] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853055] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853055] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853056] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853057] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853060] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853061] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853062] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853064] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853067] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853069] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853072] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853074] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853076] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853078] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853080] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853083] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853085] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853088] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853090] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853092] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853094] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853096] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853098] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853101] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853103] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853105] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853107] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853109] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853111] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853113] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853115] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853116] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853120] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853120] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853120] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853120] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853120] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853120] free:61551 free_pcp:1894 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853123] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:435317 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853124] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853128] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853131] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853135] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853138] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6372kB local_pcp:324kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853142] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853145] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853156] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853168] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853177] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853178] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853179] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853180] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853181] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853181] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853182] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853183] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853183] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853184] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853184] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853186] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853189] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853189] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853190] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853192] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853195] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853197] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853199] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853202] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853204] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853206] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853208] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853210] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853212] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853214] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853217] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853219] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853220] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853222] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853224] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853227] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853229] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853231] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853233] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853235] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853237] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853240] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853242] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853242] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853253] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853253] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853253] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853253] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853253] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853253] free:61551 free_pcp:1894 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853257] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:436341 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853258] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853262] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853265] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853269] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853272] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6372kB local_pcp:324kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853276] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853279] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853295] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853307] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853317] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853318] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853319] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853319] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853320] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853321] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853321] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853322] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853322] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853323] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853323] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853325] ksoftirqd/18: page allocation failure: order:0, mode:0x2080020(GFP_ATOMIC)
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853328] CPU: 18 PID: 118 Comm: ksoftirqd/18 Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853328] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853329] 0000000000000000 ffffffff8dd35284 ffffffff8e4020f8 ffff9d2286687af0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853331] ffffffff8db8c43a 02080020b627be00 ffffffff8e4020f8 ffff9d2286687a90
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853334] ffff89c600000010 ffff9d2286687b00 ffff9d2286687ab0 62a0008941130ae8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853336] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853338] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853340] [<ffffffff8db8c43a>] ? warn_alloc+0x13a/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853343] [<ffffffff8db8c71b>] ? __alloc_pages_slowpath+0x24b/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853345] [<ffffffff8df52a0a>] ? ip_rcv_finish+0x17a/0x400
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853347] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853349] [<ffffffff8db8d3b3>] ? __alloc_page_frag+0x153/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853351] [<ffffffff8df024e8>] ? __napi_alloc_skb+0x88/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853353] [<ffffffffc02de70d>] ? page_to_skb.isra.31+0x5d/0x2e0 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853356] [<ffffffffc02e0b17>] ? virtnet_receive+0x317/0x930 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853358] [<ffffffff8e010001>] ? add_memory+0x51/0xe0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853359] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853361] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853363] [<ffffffffc02e1148>] ? virtnet_poll+0x18/0x70 [virtio_net]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853365] [<ffffffff8df12226>] ? net_rx_action+0x246/0x380
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853368] [<ffffffff8e01e35d>] ? __do_softirq+0x10d/0x2b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853370] [<ffffffff8da9dff0>] ? sort_range+0x20/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853372] [<ffffffff8da80a3e>] ? run_ksoftirqd+0x1e/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853374] [<ffffffff8da9e0fe>] ? smpboot_thread_fn+0x10e/0x160
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853376] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853378] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853380] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853381] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853385] active_anon:236345 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853385] active_file:8061201 inactive_file:582578 isolated_file:1056
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853385] unevictable:4392526 dirty:583918 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853385] slab_reclaimable:174464 slab_unreclaimable:15010
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853385] mapped:6708660 shmem:3059 pagetables:77563 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853385] free:61551 free_pcp:1895 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853388] Node 0 active_anon:945380kB inactive_anon:11972kB active_file:32244804kB inactive_file:2330312kB unevictable:17570104kB isolated(anon):0kB isolated(file):4224kB mapped:26834640kB dirty:2335672kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:436981 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853389] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853393] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853396] Node 0 DMA32 free:206280kB min:2472kB low:4468kB high:6464kB active_anon:3132kB inactive_anon:4kB active_file:1682464kB inactive_file:73316kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:24524kB slab_unreclaimable:236kB kernel_stack:48kB pagetables:13868kB bounce:0kB free_pcp:1204kB local_pcp:172kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853400] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853404] Node 0 Normal free:24016kB min:65088kB low:117676kB high:170264kB active_anon:942248kB inactive_anon:11968kB active_file:30562340kB inactive_file:2255828kB unevictable:17569964kB writepending:2261024kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:673332kB slab_unreclaimable:59804kB kernel_stack:13328kB pagetables:296384kB bounce:0kB free_pcp:6376kB local_pcp:328kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853408] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853411] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853423] Node 0 DMA32: 3112*4kB (UMEH) 2375*8kB (UMEH) 887*16kB (UMEH) 133*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 206312kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853436] Node 0 Normal: 3823*4kB (UMEH) 760*8kB (UMEH) 233*16kB (UMH) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 25100kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853445] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853446] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853447] 8652902 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853448] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853448] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853449] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853450] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853450] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853451] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853451] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103134.853452] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.848948] INFO: task jbd2/vdb-8:3023 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.849710] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.850273] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851017] jbd2/vdb-8 D 0 3023 2 0x00000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851021] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c0ab8100 ffff89c6ca1d8980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851023] ffff89c696012040 ffff9d22898bfca0 ffffffff8e015a99 ffff89c6c1863088
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851025] 0000000000000246 ffff89c6ca1d8980 ffff9d22898bfd80 ffff89c6c0ab8100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851027] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851034] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851037] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851039] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851047] [<ffffffffc03162ef>] ? jbd2_journal_commit_transaction+0x25f/0x17c0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851050] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851052] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851053] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851054] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851056] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851057] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851059] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851060] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851062] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851064] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851065] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851067] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851069] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851070] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851074] [<ffffffffc031bc72>] ? kjournald2+0xc2/0x260 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851076] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851080] [<ffffffffc031bbb0>] ? commit_timeout+0x10/0x10 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851083] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851084] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851086] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851088] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851132] INFO: task java:28327 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.851752] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.852337] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853091] java D 0 28327 1 0x00000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853094] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c1351100 ffff89c6ca0d8980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853096] ffff89c69f378000 ffff9d228d2ebb30 ffffffff8e015a99 ffffffff8e01a964
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853098] 00ffffff8e01a970 ffff89c6ca0d8980 ffff9d228d2ebb50 ffff89c6c1351100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853100] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853103] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853105] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853107] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853111] [<ffffffffc0313086>] ? wait_transaction_locked+0x86/0xc0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853113] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853116] [<ffffffffc03132a8>] ? add_transaction_credits+0x1b8/0x290 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853118] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853121] [<ffffffffc03134d5>] ? start_this_handle+0x105/0x400 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853124] [<ffffffffc03139f9>] ? jbd2__journal_start+0xd9/0x1e0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853137] [<ffffffffc04f735d>] ? ext4_dirty_inode+0x2d/0x60 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853140] [<ffffffff8dc3aecb>] ? __mark_inode_dirty+0x16b/0x360
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853143] [<ffffffff8dc28379>] ? generic_update_time+0x79/0xd0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853144] [<ffffffff8dc28586>] ? current_time+0x36/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853145] [<ffffffff8dc2867f>] ? file_update_time+0xbf/0x110
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853148] [<ffffffff8dafb344>] ? futex_wake+0x94/0x170
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853150] [<ffffffff8db84d99>] ? __generic_file_write_iter+0x99/0x1b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853157] [<ffffffffc04e9200>] ? ext4_file_write_iter+0x90/0x380 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853160] [<ffffffff8dc148cb>] ? pipe_write+0x29b/0x3e0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853162] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853164] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853166] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853168] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853170] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853172] INFO: task java:29057 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.853786] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.854355] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855100] java D 0 29057 1 0x00000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855102] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c12ad140 ffff89c6ca358980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855104] ffff89c6c0f2d000 ffff9d228dafbe48 ffffffff8e015a99 ffff89c6c18630a0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855106] 0000000000000246 ffff89c6ca358980 ffff89c6c1863088 ffff89c6c12ad140
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855108] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855111] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855113] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855118] [<ffffffffc031b733>] ? jbd2_log_wait_commit+0x93/0x110 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855120] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855128] [<ffffffffc04e9d6b>] ? ext4_sync_file+0x1ab/0x380 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855130] [<ffffffff8dc40658>] ? do_fsync+0x38/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855131] [<ffffffff8dc4089f>] ? SyS_fdatasync+0xf/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855133] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855135] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855137] INFO: task java:29062 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.855750] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.856327] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857072] java D 0 29062 1 0x00000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857074] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c03610c0 ffff89c6ca098980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857076] ffff89c69601f0c0 ffff9d228dbdbb30 ffffffff8e015a99 ffffffff8e01a964
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857078] 00ffffff8e01a970 ffff89c6ca098980 ffff9d228dbdbb50 ffff89c6c03610c0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857080] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857083] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857085] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857087] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857091] [<ffffffffc0313086>] ? wait_transaction_locked+0x86/0xc0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857093] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857096] [<ffffffffc03132a8>] ? add_transaction_credits+0x1b8/0x290 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857097] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857100] [<ffffffffc03134d5>] ? start_this_handle+0x105/0x400 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857103] [<ffffffffc03139f9>] ? jbd2__journal_start+0xd9/0x1e0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857112] [<ffffffffc04f735d>] ? ext4_dirty_inode+0x2d/0x60 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857115] [<ffffffff8dc3aecb>] ? __mark_inode_dirty+0x16b/0x360
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857117] [<ffffffff8dc28379>] ? generic_update_time+0x79/0xd0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857118] [<ffffffff8dc28586>] ? current_time+0x36/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857120] [<ffffffff8dc2867f>] ? file_update_time+0xbf/0x110
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857122] [<ffffffff8dafb344>] ? futex_wake+0x94/0x170
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857123] [<ffffffff8db84d99>] ? __generic_file_write_iter+0x99/0x1b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857130] [<ffffffffc04e9200>] ? ext4_file_write_iter+0x90/0x380 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857132] [<ffffffff8dc148cb>] ? pipe_write+0x29b/0x3e0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857134] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857136] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857138] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857140] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103314.857141] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629699] java invoked oom-killer: gfp_mask=0x26142c0(GFP_KERNEL|__GFP_NOWARN|__GFP_COMP|__GFP_NOMEMALLOC|__GFP_NOTRACK), nodemask=0, order=0, oom_score_adj=0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629701] java cpuset=/ mems_allowed=0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629705] CPU: 1 PID: 19041 Comm: java Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629706] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629707] 0000000000000000 ffffffff8dd35284 ffff9d228debba58 ffff89c6bed8f100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629710] ffffffff8dc07c90 0000000000000000 0000000000000000 ffffffff8e01a964
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629712] ffffffff8da2568f ffffffff8db8ba07 ffffffffc033e6b5 00000000ffffffff
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629714] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629721] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629724] [<ffffffff8dc07c90>] ? dump_header+0x78/0x1fd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629727] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629730] [<ffffffff8da2568f>] ? __switch_to+0x1ef/0x660
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629733] [<ffffffff8db8ba07>] ? get_page_from_freelist+0x3f7/0xb20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629737] [<ffffffffc033e6b5>] ? virtballoon_oom_notify+0x25/0x70 [virtio_balloon]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629739] [<ffffffff8db8797a>] ? oom_kill_process+0x22a/0x3f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629740] [<ffffffff8db875ed>] ? oom_badness+0xed/0x170
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629741] [<ffffffff8db87e11>] ? out_of_memory+0x111/0x470
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629743] [<ffffffff8db8ceef>] ? __alloc_pages_slowpath+0xa1f/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629745] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629749] [<ffffffff8dbe719a>] ? cache_grow_begin+0x9a/0x560
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629751] [<ffffffff8dbe719a>] ? cache_grow_begin+0x9a/0x560
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629753] [<ffffffff8dbe7911>] ? fallback_alloc+0x161/0x200
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629755] [<ffffffff8dbe8051>] ? kmem_cache_alloc_node_trace+0xb1/0x5a0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629756] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629758] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629761] [<ffffffff8defae0e>] ? __kmalloc_reserve.isra.35+0x2e/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629762] [<ffffffff8defbd82>] ? __alloc_skb+0x82/0x1c0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629765] [<ffffffff8df70593>] ? tcp_current_mss+0x63/0xa0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629768] [<ffffffff8df63219>] ? sk_stream_alloc_skb+0x49/0x1e0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629769] [<ffffffff8df63f4e>] ? tcp_sendmsg+0x51e/0xc40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629772] [<ffffffff8dc553bb>] ? ep_poll_callback+0x6b/0x210
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629775] [<ffffffff8def3976>] ? sock_sendmsg+0x36/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629776] [<ffffffff8def3a07>] ? sock_write_iter+0x87/0x100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629779] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629781] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629783] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629785] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629787] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629787] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629792] active_anon:236147 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629792] active_file:8061202 inactive_file:581244 isolated_file:2208
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629792] unevictable:4392526 dirty:583923 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629792] slab_reclaimable:172160 slab_unreclaimable:14295
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629792] mapped:6708656 shmem:3059 pagetables:77510 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629792] free:66638 free_pcp:282 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629795] Node 0 active_anon:944588kB inactive_anon:11972kB active_file:32244808kB inactive_file:2324976kB unevictable:17570104kB isolated(anon):0kB isolated(file):8832kB mapped:26834624kB dirty:2335692kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:230620215 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629796] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629799] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629802] Node 0 DMA32 free:207812kB min:2472kB low:4468kB high:6464kB active_anon:2928kB inactive_anon:4kB active_file:1682468kB inactive_file:74264kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:23920kB slab_unreclaimable:152kB kernel_stack:32kB pagetables:13784kB bounce:0kB free_pcp:484kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629806] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629808] Node 0 Normal free:42832kB min:65088kB low:117676kB high:170264kB active_anon:941660kB inactive_anon:11968kB active_file:30562340kB inactive_file:2251432kB unevictable:17569964kB writepending:2261044kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:664720kB slab_unreclaimable:57028kB kernel_stack:13232kB pagetables:296256kB bounce:0kB free_pcp:644kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629812] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629814] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629823] Node 0 DMA32: 3386*4kB (UMEH) 2378*8kB (UMEH) 900*16kB (UMEH) 139*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 207832kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629834] Node 0 Normal: 6584*4kB (UMEH) 848*8kB (UMEH) 242*16kB (UMEH) 18*32kB (UME) 10*64kB (UME) 9*128kB (UME) 2*256kB (M) 4*512kB (UME) 1*1024kB (E) 0*2048kB 0*4096kB = 42944kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629844] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629845] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629846] 8652903 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629847] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629848] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629848] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629849] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629849] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629850] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629850] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629851] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629851] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629857] [ 329] 0 329 11523 1742 24 3 0 0 systemd-journal
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629859] [ 341] 0 341 11348 830 22 3 0 -1000 systemd-udevd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629861] [ 402] 0 402 1069 170 8 3 0 0 svscanboot
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629862] [ 414] 0 414 11618 1146 27 3 0 0 systemd-logind
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629864] [ 420] 106 420 11282 855 26 3 0 -900 dbus-daemon
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629865] [ 443] 0 443 1053 271 8 3 0 0 svscan
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629867] [ 444] 0 444 1007 146 7 3 0 0 readproctitle
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629869] [ 457] 0 457 6998 603 19 3 0 0 cron
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629870] [ 459] 0 459 8977 690 22 3 0 0 irqbalance
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629872] [ 517] 0 517 5088 671 12 3 0 0 dhclient
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629874] [ 540] 0 540 3164 397 12 3 0 0 agetty
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629875] [ 542] 0 542 3220 387 12 3 0 0 agetty
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629877] [ 567] 105 567 24473 819 22 3 0 0 ntpd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629879] [ 3962] 0 3962 1010 150 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629880] [ 3963] 0 3963 1010 164 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629882] [ 3964] 0 3964 1047 304 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629883] [ 7439] 0 7439 1010 272 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629885] [ 7440] 0 7440 1010 170 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629886] [ 7441] 0 7441 1010 263 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629888] [ 7443] 0 7443 1010 172 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629890] [ 7444] 0 7444 1010 285 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629891] [ 7446] 0 7446 1010 161 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629893] [ 7447] 0 7447 1010 272 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629894] [ 7448] 0 7448 1010 162 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629896] [ 7450] 0 7450 1010 263 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629897] [ 7451] 0 7451 1010 160 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629899] [ 7452] 0 7452 1014 163 6 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629901] [ 7454] 0 7454 1010 171 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629902] [ 7455] 0 7455 1010 172 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629904] [ 7456] 0 7456 1014 167 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629905] [ 7458] 0 7458 1010 242 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629907] [ 7459] 0 7459 1047 265 8 4 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629908] [ 7460] 0 7460 1010 170 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629910] [ 7462] 0 7462 1010 170 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629911] [ 7463] 0 7463 1014 161 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629913] [ 7464] 0 7464 1014 175 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629914] [ 7465] 0 7465 1010 163 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629916] [ 7467] 0 7467 1010 184 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629917] [ 7468] 0 7468 1010 162 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629919] [ 7469] 0 7469 194561 628 44 4 0 0 collectd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629920] [ 7470] 0 7470 1010 299 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629922] [ 7472] 1040 7472 1014 163 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629923] [ 7473] 0 7473 1014 170 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629925] [ 7474] 0 7474 1134258 14570 124 8 0 0 java
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629926] [ 7475] 0 7475 1010 172 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629928] [ 7476] 0 7476 1014 160 8 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629929] [ 7478] 0 7478 1014 166 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629931] [ 7482] 0 7482 1014 152 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629932] [ 9212] 0 9212 379945 1858 78 6 0 0 confd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629934] [11648] 0 11648 53900 2370 80 4 0 0 rsyslogd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629936] [18823] 108 18823 60480174 11267939 76485 237 0 0 java
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629937] [18943] 108 18943 32826 422 34 3 0 0 controller
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629939] [24140] 0 24140 17488 1342 39 3 0 -1000 sshd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629941] [24187] 0 24187 1010 185 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629942] [24188] 0 24188 1010 164 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629944] [24189] 0 24189 1047 262 8 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629946] [24190] 0 24190 68272 2783 26 5 0 0 agent-bastion
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629947] [29431] 0 29431 4486 714 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629949] [29438] 0 29438 4489 711 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629951] [29442] 0 29442 4489 711 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629952] [29443] 0 29443 4489 712 13 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629953] [29445] 0 29445 4489 714 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629955] [29446] 0 29446 4489 686 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629956] [29451] 0 29451 4489 713 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.629958] Out of memory: Kill process 18823 (java) score 830 or sacrifice child
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103317.630832] Killed process 18943 (controller) total-vm:131304kB, anon-rss:592kB, file-rss:1096kB, shmem-rss:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931126] java invoked oom-killer: gfp_mask=0x26142c0(GFP_KERNEL|__GFP_NOWARN|__GFP_COMP|__GFP_NOMEMALLOC|__GFP_NOTRACK), nodemask=0, order=0, oom_score_adj=0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931127] java cpuset=/ mems_allowed=0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931132] CPU: 0 PID: 19023 Comm: java Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931133] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.7.5-20140531_171129-lamiak 04/01/2014
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931135] 0000000000000000 ffffffff8dd35284 ffff9d228e213a58 ffff89c6bed8f100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931137] ffffffff8dc07c90 0000000000000000 0000000000000000 0000000c8e01a964
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931139] ffff89c69547a0c0 ffffffff8db8ba07 ffffffffc033e6b5 00000000ffffffff
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931142] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931149] [<ffffffff8dd35284>] ? dump_stack+0x5c/0x78
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931151] [<ffffffff8dc07c90>] ? dump_header+0x78/0x1fd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931155] [<ffffffff8db8ba07>] ? get_page_from_freelist+0x3f7/0xb20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931159] [<ffffffffc033e6b5>] ? virtballoon_oom_notify+0x25/0x70 [virtio_balloon]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931161] [<ffffffff8db8797a>] ? oom_kill_process+0x22a/0x3f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931162] [<ffffffff8db875ed>] ? oom_badness+0xed/0x170
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931164] [<ffffffff8db87e11>] ? out_of_memory+0x111/0x470
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931165] [<ffffffff8db8ceef>] ? __alloc_pages_slowpath+0xa1f/0xb30
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931168] [<ffffffff8db8d201>] ? __alloc_pages_nodemask+0x201/0x260
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931171] [<ffffffff8dbe719a>] ? cache_grow_begin+0x9a/0x560
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931173] [<ffffffff8dbe719a>] ? cache_grow_begin+0x9a/0x560
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931175] [<ffffffff8dbe7911>] ? fallback_alloc+0x161/0x200
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931177] [<ffffffff8dbe8051>] ? kmem_cache_alloc_node_trace+0xb1/0x5a0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931179] [<ffffffff8da5af0a>] ? kvm_clock_read+0x1a/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931182] [<ffffffff8defae0e>] ? __kmalloc_reserve.isra.35+0x2e/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931184] [<ffffffff8defbd82>] ? __alloc_skb+0x82/0x1c0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931186] [<ffffffff8df70593>] ? tcp_current_mss+0x63/0xa0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931189] [<ffffffff8df63219>] ? sk_stream_alloc_skb+0x49/0x1e0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931191] [<ffffffff8df63f4e>] ? tcp_sendmsg+0x51e/0xc40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931193] [<ffffffff8def3976>] ? sock_sendmsg+0x36/0x40
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931195] [<ffffffff8def3a07>] ? sock_write_iter+0x87/0x100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931197] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931199] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931201] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931204] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931207] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931208] Mem-Info:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931212] active_anon:235984 inactive_anon:2993 isolated_anon:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931212] active_file:8061202 inactive_file:581109 isolated_file:2368
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931212] unevictable:4392526 dirty:583923 writeback:0 unstable:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931212] slab_reclaimable:172160 slab_unreclaimable:14291
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931212] mapped:6708640 shmem:3059 pagetables:77476 bounce:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931212] free:66671 free_pcp:462 free_cma:0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931215] Node 0 active_anon:943936kB inactive_anon:11972kB active_file:32244808kB inactive_file:2324436kB unevictable:17570104kB isolated(anon):0kB isolated(file):9472kB mapped:26834560kB dirty:2335692kB writeback:0kB shmem:12236kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:69097751 all_unreclaimable? no
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931216] Node 0 DMA free:15908kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931220] lowmem_reserve[]: 0 1950 53308 53308 53308
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931222] Node 0 DMA32 free:207812kB min:2472kB low:4468kB high:6464kB active_anon:2928kB inactive_anon:4kB active_file:1682468kB inactive_file:74352kB unevictable:140kB writepending:74648kB present:2080640kB managed:2015072kB mlocked:140kB slab_reclaimable:23920kB slab_unreclaimable:152kB kernel_stack:32kB pagetables:13784kB bounce:0kB free_pcp:484kB local_pcp:120kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931226] lowmem_reserve[]: 0 0 51357 51357 51357
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931228] Node 0 Normal free:42964kB min:65088kB low:117676kB high:170264kB active_anon:941008kB inactive_anon:11968kB active_file:30562340kB inactive_file:2250372kB unevictable:17569964kB writepending:2261044kB present:53477376kB managed:52594408kB mlocked:17569964kB slab_reclaimable:664720kB slab_unreclaimable:57012kB kernel_stack:13200kB pagetables:296120kB bounce:0kB free_pcp:1364kB local_pcp:96kB free_cma:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931232] lowmem_reserve[]: 0 0 0 0 0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931234] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15908kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931244] Node 0 DMA32: 3386*4kB (UMEH) 2378*8kB (UMEH) 900*16kB (UMEH) 139*32kB (UME) 110*64kB (UME) 17*128kB (UM) 9*256kB (UMH) 3*512kB (UH) 2*1024kB (ME) 1*2048kB (M) 34*4096kB (UMH) = 207832kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931254] Node 0 Normal: 6597*4kB (UMEH) 852*8kB (UMEH) 243*16kB (UMEH) 19*32kB (UME) 10*64kB (UME) 9*128kB (UME) 2*256kB (M) 4*512kB (UME) 1*1024kB (E) 0*2048kB 0*4096kB = 43076kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931265] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931266] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931266] 8652903 total pagecache pages
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931267] 0 pages in swap cache
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931268] Swap cache stats: add 0, delete 0, find 0/0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931269] Free swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931269] Total swap = 0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931270] 13893502 pages RAM
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931270] 0 pages HighMem/MovableOnly
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931271] 237155 pages reserved
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931271] 0 pages hwpoisoned
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931272] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931277] [ 329] 0 329 11523 1742 24 3 0 0 systemd-journal
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931279] [ 341] 0 341 11348 830 22 3 0 -1000 systemd-udevd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931281] [ 402] 0 402 1069 170 8 3 0 0 svscanboot
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931282] [ 414] 0 414 11618 1146 27 3 0 0 systemd-logind
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931284] [ 420] 106 420 11282 855 26 3 0 -900 dbus-daemon
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931285] [ 443] 0 443 1053 271 8 3 0 0 svscan
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931287] [ 444] 0 444 1007 146 7 3 0 0 readproctitle
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931289] [ 457] 0 457 6998 603 19 3 0 0 cron
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931290] [ 459] 0 459 8977 690 22 3 0 0 irqbalance
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931292] [ 517] 0 517 5088 671 12 3 0 0 dhclient
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931294] [ 540] 0 540 3164 397 12 3 0 0 agetty
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931295] [ 542] 0 542 3220 387 12 3 0 0 agetty
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931297] [ 567] 105 567 24473 819 22 3 0 0 ntpd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931299] [ 3962] 0 3962 1010 150 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931301] [ 3963] 0 3963 1010 164 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931302] [ 3964] 0 3964 1047 304 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931304] [ 7439] 0 7439 1010 272 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931305] [ 7440] 0 7440 1010 170 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931307] [ 7441] 0 7441 1010 263 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931308] [ 7443] 0 7443 1010 172 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931310] [ 7444] 0 7444 1010 285 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931311] [ 7446] 0 7446 1010 161 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931313] [ 7447] 0 7447 1010 272 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931314] [ 7448] 0 7448 1010 162 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931316] [ 7450] 0 7450 1010 263 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931317] [ 7451] 0 7451 1010 160 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931319] [ 7452] 0 7452 1014 163 6 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931320] [ 7454] 0 7454 1010 171 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931322] [ 7455] 0 7455 1010 172 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931323] [ 7456] 0 7456 1014 167 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931325] [ 7458] 0 7458 1010 242 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931326] [ 7459] 0 7459 1047 265 8 4 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931328] [ 7460] 0 7460 1010 170 6 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931329] [ 7462] 0 7462 1010 170 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931331] [ 7463] 0 7463 1014 161 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931332] [ 7464] 0 7464 1014 175 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931334] [ 7465] 0 7465 1010 163 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931335] [ 7467] 0 7467 1010 184 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931337] [ 7468] 0 7468 1010 162 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931338] [ 7469] 0 7469 194561 628 44 4 0 0 collectd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931340] [ 7470] 0 7470 1010 299 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931342] [ 7472] 1040 7472 1014 163 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931343] [ 7473] 0 7473 1014 170 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931345] [ 7474] 0 7474 1134258 14570 124 8 0 0 java
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931346] [ 7475] 0 7475 1010 172 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931348] [ 7476] 0 7476 1014 160 8 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931349] [ 7478] 0 7478 1014 166 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931351] [ 7482] 0 7482 1014 152 7 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931352] [ 9212] 0 9212 379945 1858 78 6 0 0 confd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931354] [11648] 0 11648 53900 2370 80 4 0 0 rsyslogd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931356] [18823] 108 18823 60480174 11267939 76485 237 0 0 java
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931358] [24140] 0 24140 17488 1342 39 3 0 -1000 sshd
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931359] [24187] 0 24187 1010 185 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931361] [24188] 0 24188 1010 164 7 3 0 0 supervise
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931362] [24189] 0 24189 1047 262 8 3 0 0 multilog
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931364] [24190] 0 24190 68272 2783 26 5 0 0 agent-bastion
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931365] [29431] 0 29431 4486 714 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931367] [29438] 0 29438 4489 711 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931368] [29442] 0 29442 4489 711 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931370] [29443] 0 29443 4489 712 13 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931371] [29445] 0 29445 4489 714 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931373] [29446] 0 29446 4489 686 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931374] [29451] 0 29451 4489 713 14 3 0 0 run
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.931375] Out of memory: Kill process 18823 (java) score 830 or sacrifice child
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103329.932556] Killed process 18823 (java) total-vm:241920696kB, anon-rss:18411644kB, file-rss:26660112kB, shmem-rss:0kB
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.680917] INFO: task jbd2/vdb-8:3023 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.681681] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.682251] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.682998] jbd2/vdb-8 D 0 3023 2 0x00000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683001] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c0ab8100 ffff89c6ca1d8980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683004] ffff89c696012040 ffff9d22898bfca0 ffffffff8e015a99 ffff89c6c1863088
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683006] 0000000000000246 ffff89c6ca1d8980 ffff9d22898bfd80 ffff89c6c0ab8100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683008] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683015] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683018] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683020] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683027] [<ffffffffc03162ef>] ? jbd2_journal_commit_transaction+0x25f/0x17c0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683030] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683031] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683033] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683034] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683035] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683037] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683038] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683039] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683041] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683042] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683044] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683045] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683047] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683048] [<ffffffff8e01a970>] ? __switch_to_asm+0x40/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683052] [<ffffffffc031bc72>] ? kjournald2+0xc2/0x260 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683054] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683057] [<ffffffffc031bbb0>] ? commit_timeout+0x10/0x10 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683060] [<ffffffff8da9a869>] ? kthread+0xd9/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683061] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683063] [<ffffffff8da9a790>] ? kthread_park+0x60/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683064] [<ffffffff8e01a9f7>] ? ret_from_fork+0x57/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683092] INFO: task java:28327 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.683718] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.684289] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685044] java D 0 28327 1 0x00000004
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685046] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c1351100 ffff89c6ca0d8980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685048] ffff89c69f378000 ffff9d228d2ebb30 ffffffff8e015a99 ffffffff8e01a964
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685050] 00ffffff8e01a970 ffff89c6ca0d8980 ffff9d228d2ebb50 ffff89c6c1351100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685052] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685055] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685057] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685059] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685063] [<ffffffffc0313086>] ? wait_transaction_locked+0x86/0xc0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685065] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685068] [<ffffffffc03132a8>] ? add_transaction_credits+0x1b8/0x290 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685069] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685072] [<ffffffffc03134d5>] ? start_this_handle+0x105/0x400 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685075] [<ffffffffc03139f9>] ? jbd2__journal_start+0xd9/0x1e0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685088] [<ffffffffc04f735d>] ? ext4_dirty_inode+0x2d/0x60 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685091] [<ffffffff8dc3aecb>] ? __mark_inode_dirty+0x16b/0x360
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685093] [<ffffffff8dc28379>] ? generic_update_time+0x79/0xd0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685095] [<ffffffff8dc28586>] ? current_time+0x36/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685096] [<ffffffff8dc2867f>] ? file_update_time+0xbf/0x110
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685098] [<ffffffff8dafb344>] ? futex_wake+0x94/0x170
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685100] [<ffffffff8db84d99>] ? __generic_file_write_iter+0x99/0x1b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685107] [<ffffffffc04e9200>] ? ext4_file_write_iter+0x90/0x380 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685109] [<ffffffff8dc148cb>] ? pipe_write+0x29b/0x3e0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685111] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685113] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685115] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685118] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685120] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685121] INFO: task java:29057 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.685734] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.686304] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687052] java D 0 29057 1 0x00000004
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687054] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c12ad140 ffff89c6ca358980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687056] ffff89c6c0f2d000 ffff9d228dafbe48 ffffffff8e015a99 ffff89c6c18630a0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687058] 0000000000000246 ffff89c6ca358980 ffff89c6c1863088 ffff89c6c12ad140
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687060] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687063] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687064] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687068] [<ffffffffc031b733>] ? jbd2_log_wait_commit+0x93/0x110 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687070] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687079] [<ffffffffc04e9d6b>] ? ext4_sync_file+0x1ab/0x380 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687080] [<ffffffff8dc40658>] ? do_fsync+0x38/0x60
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687082] [<ffffffff8dc4089f>] ? SyS_fdatasync+0xf/0x20
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687083] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687085] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687086] INFO: task java:29062 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.687709] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.688279] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689035] java D 0 29062 1 0x00000004
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689037] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c03610c0 ffff89c6ca098980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689039] ffff89c69601f0c0 ffff9d228dbdbb30 ffffffff8e015a99 ffffffff8e01a964
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689041] 00ffffff8e01a970 ffff89c6ca098980 ffff9d228dbdbb50 ffff89c6c03610c0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689042] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689045] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689047] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689049] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689052] [<ffffffffc0313086>] ? wait_transaction_locked+0x86/0xc0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689054] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689057] [<ffffffffc03132a8>] ? add_transaction_credits+0x1b8/0x290 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689059] [<ffffffff8e01a964>] ? __switch_to_asm+0x34/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689061] [<ffffffffc03134d5>] ? start_this_handle+0x105/0x400 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689064] [<ffffffffc03139f9>] ? jbd2__journal_start+0xd9/0x1e0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689073] [<ffffffffc04f735d>] ? ext4_dirty_inode+0x2d/0x60 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689075] [<ffffffff8dc3aecb>] ? __mark_inode_dirty+0x16b/0x360
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689077] [<ffffffff8dc28379>] ? generic_update_time+0x79/0xd0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689079] [<ffffffff8dc28586>] ? current_time+0x36/0x70
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689080] [<ffffffff8dc2867f>] ? file_update_time+0xbf/0x110
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689082] [<ffffffff8dafb344>] ? futex_wake+0x94/0x170
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689083] [<ffffffff8db84d99>] ? __generic_file_write_iter+0x99/0x1b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689090] [<ffffffffc04e9200>] ? ext4_file_write_iter+0x90/0x380 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689092] [<ffffffff8dc148cb>] ? pipe_write+0x29b/0x3e0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689094] [<ffffffff8dc0b2f0>] ? new_sync_write+0xe0/0x130
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689096] [<ffffffff8dc0bae0>] ? vfs_write+0xb0/0x190
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689098] [<ffffffff8dc0cf22>] ? SyS_write+0x52/0xc0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689099] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689101] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689102] INFO: task java:29071 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.689716] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.690289] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691036] java D 0 29071 1 0x00000004
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691038] ffff89c6be71d400 ffff89c6be71d400 ffff89c6c01ac000 ffff89c6ca0d8980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691040] ffff89c69f378000 ffff9d228dbeba38 ffffffff8e015a99 0000000000000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691042] 0000000000000000 ffff89c6ca0d8980 ffff9d228dbeba58 ffff89c6c01ac000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691043] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691046] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691048] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691052] [<ffffffffc0313086>] ? wait_transaction_locked+0x86/0xc0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691054] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691056] [<ffffffffc03132a8>] ? add_transaction_credits+0x1b8/0x290 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691059] [<ffffffffc03134d5>] ? start_this_handle+0x105/0x400 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691062] [<ffffffffc03139f9>] ? jbd2__journal_start+0xd9/0x1e0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691071] [<ffffffffc04eb871>] ? __ext4_new_inode+0x701/0x1680 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691079] [<ffffffffc04ff29b>] ? ext4_create+0xcb/0x1c0 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691080] [<ffffffff8dc1bb12>] ? path_openat+0x14e2/0x15b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691082] [<ffffffff8dc1cea1>] ? do_filp_open+0x91/0x100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691084] [<ffffffff8dc07b3a>] ? __check_object_size+0xfa/0x1d8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691086] [<ffffffff8dc0a3ae>] ? do_sys_open+0x12e/0x210
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691087] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691089] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691092] INFO: task java:19397 blocked for more than 120 seconds.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.691712] Not tainted 4.9.0-9-amd64 #1 Debian 4.9.168-1
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.692277] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693026] java D 0 19397 1 0x00000004
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693028] ffff89c6be71d400 ffff89c6be71d400 ffff89bb56e40080 ffff89c6ca098980
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693030] ffff89c6c10ab100 ffff9d228d6b3a38 ffffffff8e015a99 0000000000000000
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693032] 0000000000000000 ffff89c6ca098980 ffff9d228d6b3a58 ffff89bb56e40080
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693034] Call Trace:
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693037] [<ffffffff8e015a99>] ? __schedule+0x239/0x6f0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693039] [<ffffffff8e015f82>] ? schedule+0x32/0x80
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693043] [<ffffffffc0313086>] ? wait_transaction_locked+0x86/0xc0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693045] [<ffffffff8dabd5e0>] ? prepare_to_wait_event+0xf0/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693048] [<ffffffffc03132a8>] ? add_transaction_credits+0x1b8/0x290 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693057] [<ffffffffc04fa930>] ? __ext4_read_dirblock+0x30/0x370 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693064] [<ffffffffc04fc768>] ? ext4_search_dir+0x68/0x140 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693068] [<ffffffffc01c2ee7>] ? fscrypt_setup_filename+0x57/0x2c0 [fscrypto]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693071] [<ffffffffc03134d5>] ? start_this_handle+0x105/0x400 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693074] [<ffffffffc03139f9>] ? jbd2__journal_start+0xd9/0x1e0 [jbd2]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693080] [<ffffffffc04eb871>] ? __ext4_new_inode+0x701/0x1680 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693087] [<ffffffffc04ff29b>] ? ext4_create+0xcb/0x1c0 [ext4]
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693089] [<ffffffff8dc1bb12>] ? path_openat+0x14e2/0x15b0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693091] [<ffffffff8dc1cea1>] ? do_filp_open+0x91/0x100
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693092] [<ffffffff8dc07b3a>] ? __check_object_size+0xfa/0x1d8
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693094] [<ffffffff8dc0a3ae>] ? do_sys_open+0x12e/0x210
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693096] [<ffffffff8da03b7d>] ? do_syscall_64+0x8d/0xf0
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [103435.693097] [<ffffffff8e01a84e>] ? entry_SYSCALL_64_after_swapgs+0x58/0xc6
Oct 29 16:25:48 cms-zulu-datastore-none-1551817 kernel: [104648.952977] oom_reaper: reaped process 18823 (java), now anon-rss:17549928kB, file-rss:8288kB, shmem-rss:0kB
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment