cgroup OOM

gistfile1.md

Jul  3 16:26:47 users999 kernel: Memory cgroup out of memory: Kill process 1822 (perl) score 1000 or sacrifice child
Jul  3 16:26:47 users999 kernel: Killed process 1822, UID 0, (perl) total-vm:153088kB, anon-rss:32596kB, file-rss:52kB
Jul  3 16:27:24 users999 kernel: perl invoked oom-killer: gfp_mask=0xd0, order=0, oom_adj=0, oom_score_adj=0
Jul  3 16:27:24 users999 kernel: perl cpuset=ruby-namahage-1 mems_allowed=0
Jul  3 16:27:24 users999 kernel: Pid: 1837, comm: perl Not tainted 2.6.32-220.13.1.el6.x86_64 #1
Jul  3 16:27:24 users999 kernel: Call Trace:
Jul  3 16:27:24 users999 kernel: [<ffffffff810c2e21>] ? cpuset_print_task_mems_allowed+0x91/0xb0
Jul  3 16:27:24 users999 kernel: [<ffffffff81113b80>] ? dump_header+0x90/0x1b0
Jul  3 16:27:24 users999 kernel: [<ffffffff8120db0c>] ? security_real_capable_noaudit+0x3c/0x70
Jul  3 16:27:24 users999 kernel: [<ffffffff8111400a>] ? oom_kill_process+0x8a/0x2c0
Jul  3 16:27:24 users999 kernel: [<ffffffff81113f41>] ? select_bad_process+0xe1/0x120
Jul  3 16:27:24 users999 kernel: [<ffffffff811147a2>] ? mem_cgroup_out_of_memory+0x92/0xb0
Jul  3 16:27:24 users999 kernel: [<ffffffff811695e7>] ? mem_cgroup_handle_oom+0x147/0x170
Jul  3 16:27:24 users999 kernel: [<ffffffff81090c30>] ? autoremove_wake_function+0x0/0x40
Jul  3 16:27:24 users999 kernel: [<ffffffff8116a8ab>] ? __mem_cgroup_try_charge+0x3bb/0x420
Jul  3 16:27:24 users999 kernel: [<ffffffff811133c3>] ? mempool_alloc+0x63/0x140
Jul  3 16:27:24 users999 kernel: [<ffffffff8116bba7>] ? mem_cgroup_charge_common+0x87/0xd0
Jul  3 16:27:24 users999 kernel: [<ffffffff8116bd18>] ? mem_cgroup_cache_charge+0x128/0x140
Jul  3 16:27:24 users999 kernel: [<ffffffff81110ffa>] ? add_to_page_cache_locked+0x4a/0x140
Jul  3 16:27:24 users999 kernel: [<ffffffff8111111c>] ? add_to_page_cache_lru+0x2c/0x80
Jul  3 16:27:24 users999 kernel: [<ffffffff811b2b66>] ? mpage_readpages+0xb6/0x130
Jul  3 16:27:24 users999 kernel: [<ffffffffa00bacf0>] ? ext4_get_block+0x0/0x120 [ext4]
Jul  3 16:27:24 users999 kernel: [<ffffffff81038488>] ? pvclock_clocksource_read+0x58/0xd0
Jul  3 16:27:24 users999 kernel: [<ffffffffa00bacf0>] ? ext4_get_block+0x0/0x120 [ext4]
Jul  3 16:27:24 users999 kernel: [<ffffffff8115847a>] ? alloc_pages_current+0xaa/0x110
Jul  3 16:27:24 users999 kernel: [<ffffffffa00b677d>] ? ext4_readpages+0x1d/0x20 [ext4]
Jul  3 16:27:24 users999 kernel: [<ffffffff81126c75>] ? __do_page_cache_readahead+0x185/0x210Jul  3 16:27:24 users999 kernel: [<ffffffff81126d21>] ? ra_submit+0x21/0x30
Jul  3 16:27:24 users999 kernel: [<ffffffff81127095>] ? ondemand_readahead+0x115/0x240
Jul  3 16:27:24 users999 kernel: [<ffffffff811272b3>] ? page_cache_sync_readahead+0x33/0x50
Jul  3 16:27:24 users999 kernel: [<ffffffff811122a1>] ? filemap_fault+0x4f1/0x500Jul  3 16:27:24 users999 kernel: [<ffffffff8113b414>] ? __do_fault+0x54/0x510
Jul  3 16:27:24 users999 kernel: [<ffffffff8113b9c7>] ? handle_pte_fault+0xf7/0xb50
Jul  3 16:27:24 users999 kernel: [<ffffffff81051ab3>] ? __wake_up+0x53/0x70
Jul  3 16:27:24 users999 kernel: [<ffffffff8130d3ad>] ? tty_wakeup+0x3d/0x80
Jul  3 16:27:24 users999 kernel: [<ffffffff81316233>] ? pty_write+0x73/0x80
Jul  3 16:27:24 users999 kernel: [<ffffffff8113c604>] ? handle_mm_fault+0x1e4/0x2b0
Jul  3 16:27:24 users999 kernel: [<ffffffff81090fec>] ? remove_wait_queue+0x3c/0x50
Jul  3 16:27:24 users999 kernel: [<ffffffff81042b79>] ? __do_page_fault+0x139/0x480
Jul  3 16:27:24 users999 kernel: [<ffffffff813142ae>] ? tty_ldisc_deref+0xe/0x10
Jul  3 16:27:24 users999 kernel: [<ffffffff8130d173>] ? tty_write+0x233/0x2a0
Jul  3 16:27:24 users999 kernel: [<ffffffff814f298e>] ? do_page_fault+0x3e/0xa0
Jul  3 16:27:24 users999 kernel: [<ffffffff814efd45>] ? page_fault+0x25/0x30
Jul  3 16:27:24 users999 kernel: Task in /ruby-namahage-1 killed as a result of limit of /ruby-namahage-1
Jul  3 16:27:24 users999 kernel: memory: usage 65536kB, limit 65536kB, failcnt 20245
Jul  3 16:27:24 users999 kernel: memory+swap: usage 1063272kB, limit 9007199254740991kB, failcnt 0
Jul  3 16:27:24 users999 kernel: Mem-Info:
Jul  3 16:27:24 users999 kernel: Node 0 DMA per-cpu:
Jul  3 16:27:24 users999 kernel: CPU    0: hi:    0, btch:   1 usd:   0
Jul  3 16:27:24 users999 kernel: Node 0 DMA32 per-cpu:
Jul  3 16:27:24 users999 kernel: CPU    0: hi:  186, btch:  31 usd: 141
Jul  3 16:27:24 users999 kernel: active_anon:12927 inactive_anon:10082 isolated_anon:0
Jul  3 16:27:24 users999 kernel: active_file:6369 inactive_file:12149 isolated_file:0
Jul  3 16:27:24 users999 kernel: unevictable:0 dirty:0 writeback:0 unstable:0
Jul  3 16:27:24 users999 kernel: free:71637 slab_reclaimable:2856 slab_unreclaimable:5268
Jul  3 16:27:24 users999 kernel: mapped:3299 shmem:41 pagetables:1668 bounce:0
Jul  3 16:27:24 users999 kernel: Node 0 DMA free:15756kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15368kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul  3 16:27:24 users999 kernel: lowmem_reserve[]: 0 489 489 489
Jul  3 16:27:24 users999 kernel: Node 0 DMA32 free:270792kB min:2784kB low:3480kB high:4176kB active_anon:51708kB inactive_anon:40328kB active_file:25476kB inactive_file:48596kB unevictable:0kB isolated(ano