Skip to content

Instantly share code, notes, and snippets.

@MilesPong
Created July 13, 2016 02:41
Show Gist options
  • Save MilesPong/173611a702660f9e7cb1da6154efe63a to your computer and use it in GitHub Desktop.
Save MilesPong/173611a702660f9e7cb1da6154efe63a to your computer and use it in GitHub Desktop.
OOM Error of Centos 6.8
➜ ~ $ cat /proc/meminfo
MemTotal: 1030360 kB
MemFree: 372588 kB
Buffers: 192752 kB
Cached: 189092 kB
SwapCached: 0 kB
Active: 241744 kB
Inactive: 249276 kB
Active(anon): 109356 kB
Inactive(anon): 31316 kB
Active(file): 132388 kB
Inactive(file): 217960 kB
Unevictable: 0 kB
Mlocked: 0 kB
HighTotal: 141312 kB
HighFree: 252 kB
LowTotal: 889048 kB
LowFree: 372336 kB
SwapTotal: 2064380 kB
SwapFree: 2064380 kB
Dirty: 40 kB
Writeback: 0 kB
AnonPages: 109176 kB
Mapped: 50304 kB
Shmem: 31496 kB
Slab: 83820 kB
SReclaimable: 74988 kB
SUnreclaim: 8832 kB
KernelStack: 1168 kB
PageTables: 2824 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 2579560 kB
Committed_AS: 548652 kB
VmallocTotal: 122880 kB
VmallocUsed: 72248 kB
VmallocChunk: 44876 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 8184 kB
DirectMap2M: 899072 kB
Jul 13 00:17:25 mercury kernel: __ratelimit: 28 callbacks suppressed
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c07ede56>] ? nf_iterate+0x66/0x80
Jul 13 00:17:25 mercury kernel: [<c07f6690>] ? ip_rcv_finish+0x0/0x390
Jul 13 00:17:25 mercury kernel: [<c07f6690>] ? ip_rcv_finish+0x0/0x390
Jul 13 00:17:25 mercury kernel: [<f809585d>] ? get_a_page+0x3d/0x50 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8095e53>] ? try_fill_recv+0x2d3/0x400 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096114>] ? virtnet_poll+0x194/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<f837712f>] ? appexEngineHash+0x2ef/0x3b0 [appex0]
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:25 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:25 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:25 mercury kernel: Call Trace:
Jul 13 00:17:25 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:25 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:25 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:25 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:25 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:25 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:25 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:25 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:25 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:25 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:25 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:25 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:25 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:25 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:25 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:25 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:25 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:25 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:25 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:25 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:25 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:25 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:25 mercury kernel: Mem-Info:
Jul 13 00:17:25 mercury kernel: DMA per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:25 mercury kernel: Normal per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 33
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 197
Jul 13 00:17:25 mercury kernel: HighMem per-cpu:
Jul 13 00:17:25 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 0
Jul 13 00:17:25 mercury kernel: active_anon:15414 inactive_anon:24320 isolated_anon:0
Jul 13 00:17:25 mercury kernel: active_file:11074 inactive_file:12486 isolated_file:0
Jul 13 00:17:25 mercury kernel: unevictable:0 dirty:16 writeback:0 unstable:0
Jul 13 00:17:25 mercury kernel: free:3663 slab_reclaimable:3814 slab_unreclaimable:66487
Jul 13 00:17:25 mercury kernel: mapped:10788 shmem:6086 pagetables:910 bounce:0
Jul 13 00:17:25 mercury kernel: DMA free:3484kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:224kB slab_unreclaimable:956kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:25 mercury kernel: Normal free:1320kB min:3724kB low:4652kB high:5584kB active_anon:54472kB inactive_anon:76704kB active_file:31800kB inactive_file:29496kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:60kB writeback:0kB mapped:23464kB shmem:20884kB slab_reclaimable:15032kB slab_unreclaimable:264992kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:25 mercury kernel: HighMem free:9848kB min:136kB low:280kB high:428kB active_anon:7184kB inactive_anon:20576kB active_file:12488kB inactive_file:20432kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:4kB writeback:0kB mapped:19684kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:25 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:25 mercury kernel: DMA: 46*4kB 29*8kB 24*16kB 8*32kB 4*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3488kB
Jul 13 00:17:25 mercury kernel: Normal: 0*4kB 1*8kB 0*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1320kB
Jul 13 00:17:25 mercury kernel: HighMem: 1134*4kB 450*8kB 105*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 9848kB
Jul 13 00:17:25 mercury kernel: 33204 total pagecache pages
Jul 13 00:17:25 mercury kernel: 3551 pages in swap cache
Jul 13 00:17:25 mercury kernel: Swap cache stats: add 44579, delete 41028, find 32756/34780
Jul 13 00:17:25 mercury kernel: Free swap = 2001376kB
Jul 13 00:17:25 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:25 mercury kernel: 262141 pages RAM
Jul 13 00:17:25 mercury kernel: 35328 pages HighMem
Jul 13 00:17:25 mercury kernel: 4551 pages reserved
Jul 13 00:17:25 mercury kernel: 69292 pages shared
Jul 13 00:17:25 mercury kernel: 228474 pages non-shared
Jul 13 00:17:32 mercury kernel: __ratelimit: 14 callbacks suppressed
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c07ede56>] ? nf_iterate+0x66/0x80
Jul 13 00:17:32 mercury kernel: [<c07f6690>] ? ip_rcv_finish+0x0/0x390
Jul 13 00:17:32 mercury kernel: [<c07f6690>] ? ip_rcv_finish+0x0/0x390
Jul 13 00:17:32 mercury kernel: [<f809585d>] ? get_a_page+0x3d/0x50 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8095e53>] ? try_fill_recv+0x2d3/0x400 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096114>] ? virtnet_poll+0x194/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<f837712f>] ? appexEngineHash+0x2ef/0x3b0 [appex0]
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:32 mercury kernel: swapper: page allocation failure. order:0, mode:0x20
Jul 13 00:17:32 mercury kernel: Pid: 0, comm: swapper Tainted: P -- ------------ 2.6.32-642.1.1.el6.i686 #1
Jul 13 00:17:32 mercury kernel: Call Trace:
Jul 13 00:17:32 mercury kernel: [<c0877c33>] ? printk+0x18/0x1d
Jul 13 00:17:32 mercury kernel: [<c0502973>] ? __alloc_pages_nodemask+0x733/0x8a0
Jul 13 00:17:32 mercury kernel: [<c0496f00>] ? tick_program_event+0x30/0x40
Jul 13 00:17:32 mercury kernel: [<c053493c>] ? cache_alloc_refill+0x2bc/0x510
Jul 13 00:17:32 mercury kernel: [<c087b6e5>] ? apic_timer_interrupt+0x31/0x38
Jul 13 00:17:32 mercury kernel: [<c0534cd2>] ? __kmalloc+0x142/0x180
Jul 13 00:17:32 mercury kernel: [<c07f6c4e>] ? ip_rcv+0x22e/0x300
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb2af>] ? __alloc_skb+0x4f/0x140
Jul 13 00:17:32 mercury kernel: [<c07bb7ab>] ? __netdev_alloc_skb+0x1b/0x40
Jul 13 00:17:32 mercury kernel: [<f8095138>] ? page_to_skb+0x38/0x190 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<f8096160>] ? virtnet_poll+0x1e0/0x780 [virtio_net]
Jul 13 00:17:32 mercury kernel: [<c043ee25>] ? pvclock_clocksource_read+0x65/0x190
Jul 13 00:17:32 mercury kernel: [<c07cae5e>] ? net_rx_action+0xde/0x2a0
Jul 13 00:17:32 mercury kernel: [<c048c704>] ? sched_clock_local+0xa4/0x180
Jul 13 00:17:32 mercury kernel: [<c0469b36>] ? __do_softirq+0xa6/0x1f0
Jul 13 00:17:32 mercury kernel: [<c04cacb1>] ? move_native_irq+0x11/0x50
Jul 13 00:17:32 mercury kernel: [<c0469cbd>] ? do_softirq+0x3d/0x50
Jul 13 00:17:32 mercury kernel: [<c0469e15>] ? irq_exit+0x65/0x70
Jul 13 00:17:32 mercury kernel: [<c040c490>] ? do_IRQ+0x50/0xc0
Jul 13 00:17:32 mercury kernel: [<c040a110>] ? common_interrupt+0x30/0x38
Jul 13 00:17:32 mercury kernel: [<c043e0e2>] ? native_safe_halt+0x2/0x10
Jul 13 00:17:32 mercury kernel: [<c041299d>] ? default_idle+0x4d/0xc0
Jul 13 00:17:32 mercury kernel: [<c0408a44>] ? cpu_idle+0x94/0xd0
Jul 13 00:17:32 mercury kernel: [<c0873f55>] ? start_secondary+0x2bb/0x318
Jul 13 00:17:32 mercury kernel: Mem-Info:
Jul 13 00:17:32 mercury kernel: DMA per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 0, btch: 1 usd: 0
Jul 13 00:17:32 mercury kernel: Normal per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 186, btch: 31 usd: 172
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 186, btch: 31 usd: 185
Jul 13 00:17:32 mercury kernel: HighMem per-cpu:
Jul 13 00:17:32 mercury kernel: CPU 0: hi: 42, btch: 7 usd: 5
Jul 13 00:17:32 mercury kernel: CPU 1: hi: 42, btch: 7 usd: 25
Jul 13 00:17:32 mercury kernel: active_anon:10387 inactive_anon:13850 isolated_anon:0
Jul 13 00:17:32 mercury kernel: active_file:2965 inactive_file:4894 isolated_file:0
Jul 13 00:17:32 mercury kernel: unevictable:0 dirty:3 writeback:0 unstable:0
Jul 13 00:17:32 mercury kernel: free:4119 slab_reclaimable:1771 slab_unreclaimable:70957
Jul 13 00:17:32 mercury kernel: mapped:5315 shmem:4209 pagetables:910 bounce:0
Jul 13 00:17:32 mercury kernel: DMA free:3476kB min:64kB low:80kB high:96kB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15864kB mlocked:0kB dirty:0kB writeback:0kB mapped:4kB shmem:0kB slab_reclaimable:28kB slab_unreclaimable:1080kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 863 1000 1000
Jul 13 00:17:32 mercury kernel: Normal free:1392kB min:3724kB low:4652kB high:5584kB active_anon:34360kB inactive_anon:34544kB active_file:588kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:883912kB mlocked:0kB dirty:12kB writeback:0kB mapped:1556kB shmem:13376kB slab_reclaimable:7056kB slab_unreclaimable:282748kB kernel_stack:1464kB pagetables:2676kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 68 68
Jul 13 00:17:32 mercury kernel: HighMem free:11608kB min:136kB low:280kB high:428kB active_anon:7188kB inactive_anon:20856kB active_file:11264kB inactive_file:19468kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:140208kB mlocked:0kB dirty:0kB writeback:0kB mapped:19700kB shmem:3460kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:964kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Jul 13 00:17:32 mercury kernel: lowmem_reserve[]: 0 0 0 0
Jul 13 00:17:32 mercury kernel: DMA: 23*4kB 48*8kB 20*16kB 6*32kB 3*64kB 2*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 3484kB
Jul 13 00:17:32 mercury kernel: Normal: 18*4kB 5*8kB 0*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1392kB
Jul 13 00:17:32 mercury kernel: HighMem: 1204*4kB 523*8kB 155*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11608kB
Jul 13 00:17:32 mercury kernel: 13985 total pagecache pages
Jul 13 00:17:32 mercury kernel: 1887 pages in swap cache
Jul 13 00:17:32 mercury kernel: Swap cache stats: add 58492, delete 56605, find 32768/34802
Jul 13 00:17:32 mercury kernel: Free swap = 1946064kB
Jul 13 00:17:32 mercury kernel: Total swap = 2064380kB
Jul 13 00:17:32 mercury kernel: 262141 pages RAM
Jul 13 00:17:32 mercury kernel: 35328 pages HighMem
Jul 13 00:17:32 mercury kernel: 4551 pages reserved
Jul 13 00:17:32 mercury kernel: 28977 pages shared
Jul 13 00:17:32 mercury kernel: 245626 pages non-shared
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 2816 (mysqld) score 15 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 2816, UID 504, (mysqld) total-vm:217816kB, anon-rss:2536kB, file-rss:3888kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 2356 (php-fpm) score 7 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 2356, UID 505, (php-fpm) total-vm:204244kB, anon-rss:1416kB, file-rss:9640kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 3048 (php-fpm) score 7 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 3048, UID 505, (php-fpm) total-vm:203916kB, anon-rss:1272kB, file-rss:9800kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 2355 (php-fpm) score 6 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 2355, UID 505, (php-fpm) total-vm:203088kB, anon-rss:8120kB, file-rss:9760kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 11627 (php-fpm) score 6 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 11627, UID 505, (php-fpm) total-vm:201760kB, anon-rss:1112kB, file-rss:9712kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 16794 (php-fpm) score 6 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 16794, UID 505, (php-fpm) total-vm:203512kB, anon-rss:1128kB, file-rss:9048kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 16795 (php-fpm) score 5 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 16795, UID 505, (php-fpm) total-vm:199684kB, anon-rss:1116kB, file-rss:9868kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 836 (google-drive-oc) score 4 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 836, UID 500, (google-drive-oc) total-vm:28968kB, anon-rss:3796kB, file-rss:3340kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 2366 (nginx) score 4 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 2366, UID 505, (nginx) total-vm:30408kB, anon-rss:640kB, file-rss:1844kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 2367 (nginx) score 4 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 2367, UID 505, (nginx) total-vm:30372kB, anon-rss:192kB, file-rss:1812kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 10276 (gogs) score 4 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 10276, UID 506, (gogs) total-vm:1098840kB, anon-rss:112kB, file-rss:3284kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 1192 (dhclient) score 1 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 1192, UID 0, (dhclient) total-vm:2836kB, anon-rss:92kB, file-rss:544kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 1310 (dhclient) score 1 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 1310, UID 0, (dhclient) total-vm:2836kB, anon-rss:132kB, file-rss:568kB
Jul 13 00:17:37 mercury kernel: Out of memory: Kill process 1388 (rsyslogd) score 1 or sacrifice child
Jul 13 00:17:37 mercury kernel: Killed process 1388, UID 0, (rsyslogd) total-vm:37000kB, anon-rss:516kB, file-rss:828kB
➜ ~ # free -lmh
total used free shared buffers cached
Mem: 1.0G 639M 366M 30M 187M 184M
Low: 868M 501M 366M
High: 138M 137M 252K
-/+ buffers/cache: 267M 739M
Swap: 2.0G 0B 2.0G
serverSpeeder version 3.10.66.29
➜ ~ $ uname -ri
2.6.32-642.1.1.el6.i686 i386
➜ ~ $ cat /etc/centos-release
CentOS release 6.8 (Final)
vm.lowmem_reserve_ratio = 256 512 32
Part of installed services or processes:
google-drive-ocamlfuse
bpcs_uploader
LNMP
gogs
ss-python
➜ ~ $ cat /proc/zoneinfo
Node 0, zone DMA
pages free 1863
min 16
low 20
high 24
scanned 0
spanned 4095
present 3966
nr_free_pages 1863
nr_inactive_anon 0
nr_active_anon 0
nr_inactive_file 0
nr_active_file 0
nr_unevictable 0
nr_mlock 0
nr_anon_pages 0
nr_mapped 0
nr_file_pages 0
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 0
nr_slab_unreclaimable 0
nr_page_table_pages 0
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 0
nr_anon_transparent_hugepages 0
protection: (0, 863, 1000, 1000)
pagesets
cpu: 0
count: 0
high: 0
batch: 1
vm stats threshold: 4
cpu: 1
count: 0
high: 0
batch: 1
vm stats threshold: 4
all_unreclaimable: 0
prev_priority: 12
start_pfn: 1
inactive_ratio: 1
Node 0, zone Normal
pages free 91190
min 931
low 1163
high 1396
scanned 0
spanned 222718
present 220978
nr_free_pages 91190
nr_inactive_anon 7784
nr_active_anon 24139
nr_inactive_file 44208
nr_active_file 29084
nr_unevictable 0
nr_mlock 0
nr_anon_pages 24139
nr_mapped 8230
nr_file_pages 81076
nr_dirty 9
nr_writeback 0
nr_slab_reclaimable 18748
nr_slab_unreclaimable 2212
nr_page_table_pages 514
nr_kernel_stack 146
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 7784
nr_anon_transparent_hugepages 0
protection: (0, 0, 68, 68)
pagesets
cpu: 0
count: 168
high: 186
batch: 31
vm stats threshold: 16
cpu: 1
count: 51
high: 186
batch: 31
vm stats threshold: 16
all_unreclaimable: 0
prev_priority: 12
start_pfn: 4096
inactive_ratio: 1
Node 0, zone HighMem
pages free 63
min 34
low 70
high 107
scanned 0
spanned 35328
present 35052
nr_free_pages 63
nr_inactive_anon 45
nr_active_anon 3200
nr_inactive_file 10284
nr_active_file 4013
nr_unevictable 0
nr_mlock 0
nr_anon_pages 3155
nr_mapped 4346
nr_file_pages 14387
nr_dirty 0
nr_writeback 0
nr_slab_reclaimable 0
nr_slab_unreclaimable 0
nr_page_table_pages 192
nr_kernel_stack 0
nr_unstable 0
nr_bounce 0
nr_vmscan_write 0
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 90
nr_anon_transparent_hugepages 0
protection: (0, 0, 0, 0)
pagesets
cpu: 0
count: 41
high: 42
batch: 7
vm stats threshold: 8
cpu: 1
count: 35
high: 42
batch: 7
vm stats threshold: 8
all_unreclaimable: 0
prev_priority: 12
start_pfn: 226814
inactive_ratio: 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment