Skip to content

Instantly share code, notes, and snippets.

@blufor

blufor/oom killer Secret

Last active November 9, 2018 20:22
Show Gist options
  • Save blufor/db4544de3fa21946711509d9a6d6dd9b to your computer and use it in GitHub Desktop.
Save blufor/db4544de3fa21946711509d9a6d6dd9b to your computer and use it in GitHub Desktop.
Download ZIP
sensu go memory leak
Raw
oom killer
[104741.972803] Mem-Info:
[104741.972810] active_anon:1666929 inactive_anon:327503 isolated_anon:64
active_file:752 inactive_file:3710 isolated_file:0
unevictable:0 dirty:10 writeback:0 unstable:0
slab_reclaimable:3041 slab_unreclaimable:2789
mapped:3697 shmem:48 pagetables:5197 bounce:0
free:26318 free_pcp:350 free_cma:0
[104741.972817] Node 0 DMA free:15904kB min:132kB low:164kB high:196kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15904kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
[104741.972831] lowmem_reserve[]: 0 2938 7929 7929 7929
[104741.972837] Node 0 DMA32 free:44884kB min:24996kB low:31244kB high:37492kB active_anon:2383788kB inactive_anon:596032kB active_file:428kB inactive_file:4048kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3129216kB managed:3048400kB mlocked:0kB dirty:12kB writeback:0kB mapped:3112kB shmem:0kB slab_reclaimable:3116kB slab_unreclaimable:2424kB kernel_stack:608kB pagetables:7944kB unstable:0kB bounce:0kB
free_pcp:320kB local_pcp:312kB free_cma:0kB writeback_tmp:0kB pages_scanned:311620 all_unreclaimable? yes
[104741.972847] lowmem_reserve[]: 0 0 4990 4990 4990
[104741.972851] Node 0 Normal free:44484kB min:42452kB low:53064kB high:63676kB active_anon:4283928kB inactive_anon:714108kB active_file:2580kB inactive_file:10792kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:5242880kB managed:5110732kB mlocked:0kB dirty:28kB writeback:0kB mapped:11676kB shmem:192kB slab_reclaimable:9048kB slab_unreclaimable:8732kB kernel_stack:1712kB pagetables:12844kB unstable:0kB bounce:0kB free_pcp:1080kB local_pcp:352kB free_cma:0kB writeback_tmp:0kB pages_scanned:362208 all_unreclaimable? yes
[104741.972860] lowmem_reserve[]: 0 0 0 0 0
[104741.972865] Node 0 DMA: 0*4kB 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15904kB
[104741.972910] Node 0 DMA32: 7*4kB (UE) 15*8kB (UE) 56*16kB (UME) 48*32kB (UME) 25*64kB (UME) 18*128kB (UE) 16*256kB (UME) 11*512kB (UE) 4*1024kB (UE) 2*2048kB (UM) 5*4096kB (U) = 44884kB
[104741.972929] Node 0 Normal: 7*4kB (UME) 8*8kB (UEH) 45*16kB (UEH) 41*32kB (UEH) 18*64kB (UME) 12*128kB (UE) 11*256kB (UEH) 6*512kB (UMEH) 3*1024kB (EH) 1*2048kB (E) 7*4096kB (ME) = 44492kB
[104741.972946] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[104741.972948] 16511 total pagecache pages
[104741.972950] 11978 pages in swap cache
[104741.972956] Swap cache stats: add 16395561, delete 16383583, find 5414210/8905291
[104741.972957] Free swap = 0kB
[104741.972958] Total swap = 998396kB
[104741.972960] 2097022 pages RAM
[104741.972961] 0 pages HighMem/MovableOnly
[104741.972962] 53263 pages reserved
[104741.972964] 0 pages cma reserved
[104741.972965] 0 pages hwpoisoned
[104741.972966] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
[104741.972973] [ 197] 0 197 8917 38 22 3 564 0 systemd-journal
[104741.972977] [ 240] 0 240 25742 0 17 3 63 0 lvmetad
[104741.972980] [ 270] 0 270 9469 0 19 3 168 -1000 systemd-udevd
[104741.972983] [ 357] 0 357 5736 7 16 3 46 0 cron
[104741.972986] [ 358] 104 358 62514 78 25 3 358 0 rsyslogd
[104741.972988] [ 362] 0 362 67453 21 33 3 158 0 accounts-daemon
[104741.972991] [ 378] 0 378 5024 20 14 3 47 0 systemd-logind
[104741.972994] [ 379] 106 379 9142 16 21 3 87 -900 dbus-daemon
[104741.972997] [ 441] 0 441 192191 0 40 3 178 0 nscd
[104741.973000] [ 563] 100 563 22017 10 13 3 33 0 systemd-timesyn
[104741.973003] [ 566] 0 566 3522 0 13 3 220 0 dhclient
[104741.973006] [ 594] 999 594 74721 1567 28 5 440 0 node_exporter
[104741.973009] [ 606] 0 606 1998 0 9 3 24 0 agetty
[104741.973012] [ 616] 0 616 14855 28 34 3 143 -1000 sshd
[104741.973015] [16657] 998 16657 6091 1745 17 5 189 0 sensu-agent
[104741.973019] [21720] 998 21720 3691940 1979624 4683 16 244531 0 sensu-backend
[104741.973021] [25968] 0 25968 21725 157 45 3 62 0 sshd
[104741.973024] [25983] 1000 25983 21792 173 44 3 124 0 sshd
[104741.973027] [25984] 1000 25984 3603 311 13 3 88 0 bash
[104741.973030] [26032] 0 26032 11258 95 27 3 0 0 sudo
[104741.973033] [26033] 0 26033 3614 409 11 3 8 0 bash
[104741.973035] [26462] 0 26462 9660 48 22 3 0 0 journalctl
[104741.973038] [26463] 0 26463 1897 16 9 3 0 0 tee
[104741.973041] Out of memory: Kill process 21720 (sensu-backend) score 971 or sacrifice child
[104741.973089] Killed process 21720 (sensu-backend) total-vm:14767760kB, anon-rss:7908512kB, file-rss:9984kB
Raw
sensuctl create
{"type":"Organization","spec":{"name":"atc","description":"Ataccama internal resources"}}
{"type":"Environment","spec":{"name":"ai","description":"Artificial Intelligence","organization":"atc"}}
{"type":"Environment","spec":{"name":"build","description":"Software building","organization":"atc"}}
{"type":"Environment","spec":{"name":"dev1","description":"Development 1","organization":"atc"}}
{"type":"Environment","spec":{"name":"dev2","description":"Development 2","organization":"atc"}}
{"type":"Environment","spec":{"name":"dev3","description":"Development 3","organization":"atc"}}
{"type":"Environment","spec":{"name":"do","description":"DevOps","organization":"atc"}}
{"type":"Environment","spec":{"name":"hdp","description":"Hadoop/Spark","organization":"atc"}}
{"type":"Environment","spec":{"name":"prod","description":"PRODUCTION","organization":"atc"}}
{"type":"Environment","spec":{"name":"shr","description":"Shared resources","organization":"atc"}}
{"type":"Environment","spec":{"name":"tech","description":"Technical dpt resources","organization":"atc"}}
{"type":"Environment","spec":{"name":"test","description":"TESTING","organization":"atc"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"ai"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"build"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev1"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev2"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev3"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"do"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"hdp"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"prod"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"shr"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"tech"}}
{"type":"CheckConfig","spec":{"name":"filesystem","command":"check-fs","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"test"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"ai"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"build"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev1"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev2"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev3"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"do"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"hdp"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"prod"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"shr"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"tech"}}
{"type":"CheckConfig","spec":{"name":"loadavg","command":"check-load","interval":60,"timeout":120,"ttl":120,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"test"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"ai"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"build"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev1"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev2"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev3"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"do"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"hdp"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"prod"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"shr"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"tech"}}
{"type":"CheckConfig","spec":{"name":"memory","command":"check-memory","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"test"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"ai"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"build"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev1"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev2"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev3"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"do"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"hdp"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"prod"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"shr"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"tech"}}
{"type":"CheckConfig","spec":{"name":"puppet-agent-service","command":"check-ps -f '/opt/puppetlabs/puppet/bin/ruby /opt/puppetlabs/puppet/bin/puppet agent'","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"test"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"ai"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"build"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev1"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev2"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev3"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"do"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"hdp"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"prod"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"shr"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"tech"}}
{"type":"CheckConfig","spec":{"name":"sshd-listen","command":"check-tcp -p 22","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"test"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"ai"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"build"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev1"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev2"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"dev3"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"do"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"hdp"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"prod"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"shr"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"tech"}}
{"type":"CheckConfig","spec":{"name":"ssh-service","command":"check-ps -f /usr/bin/sshd","interval":30,"timeout":60,"ttl":60,"runtime_assets":["sensu-atc-assets"],"subscriptions":["system"],"publish":true,"organization":"atc","environment":"test"}}
Raw
trace1
```
Fetching profile over HTTP from http://localhost:6060/debug/pprof/heap
Saved profile in /home/blufor/pprof/pprof.sensu-backend.alloc_objects.alloc_space.inuse_objects.inuse_space.009.pb.gz
File: sensu-backend
Type: inuse_space
Time: Nov 9, 2018 at 8:03pm (UTC)
Entering interactive mode (type "help" for commands, "o" for options)
(pprof) top20
Showing nodes accounting for 1027.95MB, 92.31% of 1113.58MB total
Dropped 329 nodes (cum <= 5.57MB)
Showing top 20 nodes out of 117
flat flat% sum% cum cum%
281.53MB 25.28% 25.28% 281.53MB 25.28% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/clientv3.(*watchGrpcStream).dispatchEvent
202.03MB 18.14% 43.42% 202.03MB 18.14% regexp.(*bitState).reset
188.51MB 16.93% 60.35% 313.02MB 28.11% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/mvcc/mvccpb.(*Event).Unmarshal
127.01MB 11.41% 71.76% 127.01MB 11.41% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/mvcc/mvccpb.(*KeyValue).Unmarshal
63MB 5.66% 77.42% 376.02MB 33.77% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/etcdserverpb.(*WatchResponse).Unmarshal
51.61MB 4.63% 82.05% 51.61MB 4.63% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/etcdserverpb.(*InternalRaftRequest).Marshal
47.11MB 4.23% 86.28% 47.11MB 4.23% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/raft/raftpb.(*Entry).Unmarshal
24.08MB 2.16% 88.44% 24.08MB 2.16% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/clientv3.(*watchGrpcStream).serveSubstream
7.67MB 0.69% 89.13% 289.70MB 26.02% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/clientv3.(*watchGrpcStream).run
7.50MB 0.67% 89.81% 7.50MB 0.67% runtime.malg
6.45MB 0.58% 90.38% 6.45MB 0.58% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/raft.(*MemoryStorage).Append
5.24MB 0.47% 90.85% 7.86MB 0.71% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/rafthttp.startPeer
3.31MB 0.3% 91.15% 5.93MB 0.53% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/rafthttp.(*streamWriter).run
3MB 0.27% 91.42% 6MB 0.54% github.com/sensu/sensu-go/vendor/google.golang.org/grpc.(*serverStream).SendMsg
3MB 0.27% 91.69% 380.02MB 34.13% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv
2.50MB 0.22% 91.92% 54.61MB 4.90% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver.(*EtcdServer).processInternalRaftRequestOnce
2.31MB 0.21% 92.12% 49.92MB 4.48% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/rafthttp.(*streamReader).decodeLoop
1.09MB 0.098% 92.22% 7.09MB 0.64% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/api/v3rpc.(*serverWatchStream).sendLoop
0.50MB 0.045% 92.27% 8.60MB 0.77% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver.(*raftNode).start.func1
0.50MB 0.045% 92.31% 204.53MB 18.37% regexp.(*Regexp).doExecute
Raw
trace2
Fetching profile over HTTP from http://localhost:6060/debug/pprof/heap?seconds=60
Please wait... (1m0s)
Saved profile in /home/blufor/pprof/pprof.sensu-backend.alloc_objects.alloc_space.inuse_objects.inuse_space.017.pb.gz
File: sensu-backend
Type: inuse_space
Time: Nov 9, 2018 at 8:21pm (UTC)
Entering interactive mode (type "help" for commands, "o" for options)
(pprof) top20
Showing nodes accounting for 2180.13MB, 91.51% of 2382.48MB total
Dropped 467 nodes (cum <= 11.91MB)
Showing top 20 nodes out of 103
flat flat% sum% cum cum%
631.06MB 26.49% 26.49% 631.06MB 26.49% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/clientv3.(*watchGrpcStream).dispatchEvent
436.53MB 18.32% 44.81% 735.55MB 30.87% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/mvcc/mvccpb.(*Event).Unmarshal
411.45MB 17.27% 62.08% 411.45MB 17.27% regexp.(*bitState).reset
303.52MB 12.74% 74.82% 303.52MB 12.74% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/mvcc/mvccpb.(*KeyValue).Unmarshal
164.50MB 6.90% 81.72% 900.05MB 37.78% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/etcdserverpb.(*WatchResponse).Unmarshal
58.78MB 2.47% 84.19% 58.78MB 2.47% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/clientv3.(*watchGrpcStream).serveSubstream
40.10MB 1.68% 85.87% 40.10MB 1.68% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/etcdserverpb.(*InternalRaftRequest).Marshal
34.58MB 1.45% 87.33% 34.58MB 1.45% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/raft/raftpb.(*Entry).Unmarshal
16.38MB 0.69% 88.01% 16.38MB 0.69% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/mvcc/backend.(*txWriteBuffer).putSeq
14.51MB 0.61% 88.62% 14.51MB 0.61% runtime.malg
14.15MB 0.59% 89.22% 14.65MB 0.61% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/mvcc.(*watchableStore).moveVictims
9.36MB 0.39% 89.61% 640.42MB 26.88% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/clientv3.(*watchGrpcStream).run
9.02MB 0.38% 89.99% 20.18MB 0.85% github.com/sensu/sensu-go/vendor/google.golang.org/grpc/transport.(*http2Client).handleData
7.50MB 0.31% 90.30% 18.52MB 0.78% github.com/sensu/sensu-go/vendor/google.golang.org/grpc/transport.(*http2Server).Write
7.19MB 0.3% 90.60% 38.71MB 1.62% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/api/v3rpc.(*serverWatchStream).sendLoop
6MB 0.25% 90.86% 911.55MB 38.26% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv
5MB 0.21% 91.07% 46.60MB 1.96% github.com/sensu/sensu-go/vendor/github.com/coreos/etcd/etcdserver.(*EtcdServer).processInternalRaftRequestOnce
4.50MB 0.19% 91.25% 422.46MB 17.73% regexp.(*Regexp).replaceAll
3.50MB 0.15% 91.40% 30.02MB 1.26% github.com/sensu/sensu-go/vendor/google.golang.org/grpc.(*serverStream).SendMsg
2.50MB 0.1% 91.51% 424.96MB 17.84% regexp.(*Regexp).ReplaceAllString
Raw
version
sensu-backend version 2.0.0-beta.7-7#0ad392d, build 0ad392d15948e7cc38fdb93a9ada56aa05f42970, built 2018-10-26T17:07:52+0000
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment