Skip to content

Instantly share code, notes, and snippets.

@brstgt

brstgt/kern.log Secret

Created January 26, 2017 05:33
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save brstgt/0f1aa6afb558a56d1cadce958db46cf9 to your computer and use it in GitHub Desktop.
Save brstgt/0f1aa6afb558a56d1cadce958db46cf9 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
kern.log
2017-01-26T03:10:45.678391+00:00 cas10 kernel: [52226.449866] java invoked oom-killer: gfp_mask=0x26000c0, order=2, oom_score_adj=0
2017-01-26T03:10:45.679210+00:00 cas10 kernel: [52226.449871] java cpuset=/ mems_allowed=0-1
2017-01-26T03:10:45.679217+00:00 cas10 kernel: [52226.449876] CPU: 0 PID: 27587 Comm: java Not tainted 4.4.0-59-generic #80-Ubuntu
2017-01-26T03:10:45.679219+00:00 cas10 kernel: [52226.449878] Hardware name: Supermicro SYS-6018R-MT/X10DRL-i, BIOS 2.0a 08/25/2016
2017-01-26T03:10:45.679221+00:00 cas10 kernel: [52226.449879] 0000000000000286 00000000ae97b9e9 ffff880af9733af0 ffffffff813f7583
2017-01-26T03:10:45.679233+00:00 cas10 kernel: [52226.449881] ffff880af9733cc8 ffff88108bc7e200 ffff880af9733b60 ffffffff8120ad5e
2017-01-26T03:10:45.679236+00:00 cas10 kernel: [52226.449883] ffff88108bc7e550 ffff88108bc7e200 ffff880af9733cc8 ffff880af9733bb8
2017-01-26T03:10:45.679238+00:00 cas10 kernel: [52226.449885] Call Trace:
2017-01-26T03:10:45.679240+00:00 cas10 kernel: [52226.449891] [<ffffffff813f7583>] dump_stack+0x63/0x90
2017-01-26T03:10:45.679242+00:00 cas10 kernel: [52226.449895] [<ffffffff8120ad5e>] dump_header+0x5a/0x1c5
2017-01-26T03:10:45.679244+00:00 cas10 kernel: [52226.449898] [<ffffffff81192722>] oom_kill_process+0x202/0x3c0
2017-01-26T03:10:45.679260+00:00 cas10 kernel: [52226.449900] [<ffffffff81192b49>] out_of_memory+0x219/0x460
2017-01-26T03:10:45.679263+00:00 cas10 kernel: [52226.449903] [<ffffffff81198abd>] __alloc_pages_slowpath.constprop.88+0x8fd/0xa70
2017-01-26T03:10:45.679265+00:00 cas10 kernel: [52226.449906] [<ffffffff81198eb6>] __alloc_pages_nodemask+0x286/0x2a0
2017-01-26T03:10:45.679267+00:00 cas10 kernel: [52226.449908] [<ffffffff81198f6b>] alloc_kmem_pages_node+0x4b/0xc0
2017-01-26T03:10:45.679270+00:00 cas10 kernel: [52226.449911] [<ffffffff8107ea5e>] copy_process+0x1be/0x1b70
2017-01-26T03:10:45.679273+00:00 cas10 kernel: [52226.449915] [<ffffffff811c1553>] ? handle_mm_fault+0xbc3/0x1820
2017-01-26T03:10:45.679284+00:00 cas10 kernel: [52226.449919] [<ffffffff8170f874>] ? SYSC_recvfrom+0x144/0x160
2017-01-26T03:10:45.679286+00:00 cas10 kernel: [52226.449921] [<ffffffff810805a0>] _do_fork+0x80/0x360
2017-01-26T03:10:45.679288+00:00 cas10 kernel: [52226.449923] [<ffffffff81080929>] SyS_clone+0x19/0x20
2017-01-26T03:10:45.679297+00:00 cas10 kernel: [52226.449927] [<ffffffff818384f2>] entry_SYSCALL_64_fastpath+0x16/0x71
2017-01-26T03:10:45.679299+00:00 cas10 kernel: [52226.449930] Mem-Info:
2017-01-26T03:10:45.679310+00:00 cas10 kernel: [52226.449935] active_anon:519732 inactive_anon:6475 isolated_anon:0
2017-01-26T03:10:45.679313+00:00 cas10 kernel: [52226.449935] active_file:13656973 inactive_file:13656937 isolated_file:0
2017-01-26T03:10:45.679315+00:00 cas10 kernel: [52226.449935] unevictable:4414514 dirty:1844 writeback:0 unstable:0
2017-01-26T03:10:45.679317+00:00 cas10 kernel: [52226.449935] slab_reclaimable:303574 slab_unreclaimable:59167
2017-01-26T03:10:45.679320+00:00 cas10 kernel: [52226.449935] mapped:11152901 shmem:8519 pagetables:128128 bounce:0
2017-01-26T03:10:45.679322+00:00 cas10 kernel: [52226.449935] free:133623 free_pcp:104 free_cma:0
2017-01-26T03:10:45.679355+00:00 cas10 kernel: [52226.449942] Node 0 DMA free:15796kB min:8kB low:8kB high:12kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15968kB managed:15796kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
2017-01-26T03:10:45.679358+00:00 cas10 kernel: [52226.449946] lowmem_reserve[]: 0 1840 64301 64301 64301
2017-01-26T03:10:45.679361+00:00 cas10 kernel: [52226.449949] Node 0 DMA32 free:250324kB min:1260kB low:1572kB high:1888kB active_anon:94460kB inactive_anon:1368kB active_file:0kB inactive_file:0kB unevictable:1426660kB isolated(anon):0kB isolated(file):0kB present:1965192kB managed:1884572kB mlocked:1426660kB dirty:0kB writeback:0kB mapped:1424kB shmem:1464kB slab_reclaimable:42336kB slab_unreclaimable:37984kB kernel_stack:7008kB pagetables:6056kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
2017-01-26T03:10:45.679363+00:00 cas10 kernel: [52226.449953] lowmem_reserve[]: 0 0 62461 62461 62461
2017-01-26T03:10:45.679366+00:00 cas10 kernel: [52226.449956] Node 0 Normal free:132928kB min:43700kB low:54624kB high:65548kB active_anon:1284056kB inactive_anon:20208kB active_file:28336604kB inactive_file:28336500kB unevictable:4750328kB isolated(anon):0kB isolated(file):0kB present:65011712kB managed:63960148kB mlocked:4750328kB dirty:0kB
writeback:0kB mapped:24761648kB shmem:23808kB slab_reclaimable:525420kB slab_unreclaimable:148872kB kernel_stack:16880kB pagetables:228296kB unstable:0kB bounce:0kB free_pcp:236kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
2017-01-26T03:10:45.679401+00:00 cas10 kernel: [52226.449960] lowmem_reserve[]: 0 0 0 0 0
2017-01-26T03:10:45.679438+00:00 cas10 kernel: [52226.449962] Node 1 Normal free:135444kB min:45132kB low:56412kB high:67696kB active_anon:700412kB inactive_anon:4324kB active_file:26291288kB inactive_file:26291248kB unevictable:11481068kB isolated(anon):0kB isolated(file):0kB present:67108864kB managed:66056556kB mlocked:11481068kB dirty:7376kB writeback:0kB mapped:19848532kB shmem:8804kB slab_reclaimable:646540kB slab_unreclaimable:49812kB kernel_stack:8496kB pagetables:278160kB unstable:0kB bounce:0kB free_pcp:180kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
2017-01-26T03:10:45.679441+00:00 cas10 kernel: [52226.449966] lowmem_reserve[]: 0 0 0 0 0
2017-01-26T03:10:45.679443+00:00 cas10 kernel: [52226.449968] Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 1*32kB (U) 2*64kB (U) 2*128kB (U) 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15796kB
2017-01-26T03:10:45.679455+00:00 cas10 kernel: [52226.449977] Node 0 DMA32: 4680*4kB (UMEH) 3608*8kB (UMEH) 2208*16kB (UMEH) 862*32kB (UMEH) 331*64kB (UME) 159*128kB (UMEH) 86*256kB (UMEH) 53*512kB (UM) 42*1024kB (UM) 1*2048kB (M) 1*4096kB (M) = 250336kB
2017-01-26T03:10:45.679458+00:00 cas10 kernel: [52226.449989] Node 0 Normal: 33850*4kB (UMEH) 8*8kB (UMH) 1*16kB (H) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 135480kB
2017-01-26T03:10:45.679460+00:00 cas10 kernel: [52226.449995] Node 1 Normal: 34213*4kB (UME) 176*8kB (UME) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 138260kB
2017-01-26T03:10:45.679462+00:00 cas10 kernel: [52226.450003] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2017-01-26T03:10:45.679464+00:00 cas10 kernel: [52226.450004] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2017-01-26T03:10:45.679473+00:00 cas10 kernel: [52226.450005] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2017-01-26T03:10:45.679475+00:00 cas10 kernel: [52226.450009] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2017-01-26T03:10:45.679477+00:00 cas10 kernel: [52226.450010] 27339121 total pagecache pages
2017-01-26T03:10:45.679479+00:00 cas10 kernel: [52226.450011] 0 pages in swap cache
2017-01-26T03:10:45.679481+00:00 cas10 kernel: [52226.450012] Swap cache stats: add 0, delete 0, find 0/0
2017-01-26T03:10:45.679494+00:00 cas10 kernel: [52226.450013] Free swap = 0kB
2017-01-26T03:10:45.679497+00:00 cas10 kernel: [52226.450014] Total swap = 0kB
2017-01-26T03:10:45.679499+00:00 cas10 kernel: [52226.450015] 33525434 pages RAM
2017-01-26T03:10:45.679501+00:00 cas10 kernel: [52226.450016] 0 pages HighMem/MovableOnly
2017-01-26T03:10:45.679502+00:00 cas10 kernel: [52226.450017] 546166 pages reserved
2017-01-26T03:10:45.679550+00:00 cas10 kernel: [52226.450017] 0 pages cma reserved
2017-01-26T03:10:45.679559+00:00 cas10 kernel: [52226.450018] 0 pages hwpoisoned
2017-01-26T03:10:45.679561+00:00 cas10 kernel: [52226.450019] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
2017-01-26T03:10:45.679563+00:00 cas10 kernel: [52226.450028] [ 519] 0 519 23253 13440 48 3 0 0 systemd-journal
2017-01-26T03:10:45.679566+00:00 cas10 kernel: [52226.450032] [ 582] 0 582 62608 306 21 3 0 0 lvmetad
2017-01-26T03:10:42017-01-26T03:10:45.679595+00:00 cas10 kernel: [52226.450047] [ 1355] 0 1355 4031 230 11 3 0 0 dhclient
2017-01-26T03:10:45.679597+00:00 cas10 kernel: [52226.450048] [ 1391] 0 1391 16380 1487 37 3 0 -1000 sshd
2017-01-26T03:10:45.679599+00:00 cas10 kernel: [52226.450050] [ 1393] 999 1393 404018 8796 88 7 0 0 telegraf
2017-01-26T03:10:45.679601+00:00 cas10 kernel: [52226.450052] [ 1417] 0 1417 14003 412 13 3 0 0 agetty
2017-01-26T03:10:45.679603+00:00 cas10 kernel: [52226.450053] [ 1427] 110 1427 10067 990 22 3 0 0 ntpd
2017-01-26T03:10:45.679605+00:00 cas10 kernel: [52226.450055] [ 1459] 0 1459 23365 1544 26 3 0 0 snmpd
2017-01-26T03:10:45.679613+00:00 cas10 kernel: [52226.450057] [ 1604] 0 1604 16352 1135 24 3 0 0 master
2017-01-26T03:10:45.679616+00:00 cas10 kernel: [52226.450059] [ 1634] 112 1634 16881 1123 25 3 0 0 qmgr
2017-01-26T03:10:45.679627+00:00 cas10 kernel: [52226.450062] [ 2903] 0 2903 46100 9306 70 3 0 0 puppet
2017-01-26T03:10:45.679629+00:00 cas10 kernel: [52226.450064] [39456] 1000 39456 86618422 16027492 127504 437 0 0 java
2017-01-26T03:10:45.679631+00:00 cas10 kernel: [52226.450067] [37741] 112 37741 16869 1133 25 3 0 0 pickup
2017-01-26T03:10:45.679633+00:00 cas10 kernel: [52226.450069] Out of memory: Kill process 39456 (java) score 489 or sacrifice child
2017-01-26T03:10:45.679641+00:00 cas10 kernel: [52226.452828] Killed process 39456 (java) total-vm:346473688kB, anon-rss:19563528kB, file-rss:44546976kB5.679568+00:00 cas10 kernel: [52226.450034] [ 604] 0 604 11171 909 24 3 0 -1000 systemd-udevd
2017-01-26T03:10:45.679570+00:00 cas10 kernel: [52226.450036] [ 952] 0 952 78960 762 38 3 0 0 accounts-daemon
2017-01-26T03:10:45.679578+00:00 cas10 kernel: [52226.450038] [ 955] 104 955 120990 929 37 3 0 0 rsyslogd
2017-01-26T03:10:45.679580+00:00 cas10 kernel: [52226.450039] [ 961] 0 961 17270 748 23 4 0 0 cron
2017-01-26T03:10:45.679583+00:00 cas10 kernel: [52226.450041] [ 964] 107 964 10726 452 27 3 0 -900 dbus-daemon
2017-01-26T03:10:45.679585+00:00 cas10 kernel: [52226.450043] [ 981] 0 981 5025 452 14 3 0 0 systemd-logind
2017-01-26T03:10:45.679587+00:00 cas10 kernel: [52226.450045] [ 1030] 0 1030 23544 3566 30 3 0 0 munin-node
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment