Page allocation error on Linux + LVM + XFS + rsync

dmesg-T.txt

[Thu Mar 17 05:54:02 2016] kworker/3:1H: page allocation failure: order:0, mode:0x2204020
[Thu Mar 17 05:54:02 2016] CPU: 3 PID: 649 Comm: kworker/3:1H Tainted: G           O    4.4.0-1-amd64 #1 Debian
4.4.4-2
[Thu Mar 17 05:54:02 2016] Hardware name: HP ProLiant ML110 G6/ProLiant ML110 G6, BIOS O27    12/15/2010
[Thu Mar 17 05:54:02 2016] Workqueue: kblockd cfq_kick_queue
[Thu Mar 17 05:54:02 2016]  0000000000000086 000000005e844957 ffffffff812ea6b5 0000000002204020
[Thu Mar 17 05:54:02 2016]  ffff88043fd83ab0 ffffffff8116d1aa 000000005e844957 0000000000000000
[Thu Mar 17 05:54:02 2016]  ffff88043fff0b20 0000000000000100 0000000000000000 000000005e844957
[Thu Mar 17 05:54:02 2016] Call Trace:
[Thu Mar 17 05:54:02 2016]  <IRQ>  [<ffffffff812ea6b5>] ? dump_stack+0x5c/0x77
[Thu Mar 17 05:54:02 2016]  [<ffffffff8116d1aa>] ? warn_alloc_failed+0xfa/0x150
[Thu Mar 17 05:54:02 2016]  [<ffffffff811707e8>] ? __alloc_pages_nodemask+0x338/0xb80
[Thu Mar 17 05:54:02 2016]  [<ffffffff811bc761>] ? kmem_getpages+0x51/0xf0
[Thu Mar 17 05:54:02 2016]  [<ffffffff811be415>] ? fallback_alloc+0x145/0x1f0
[Thu Mar 17 05:54:02 2016]  [<ffffffff811bf5ac>] ? kmem_cache_alloc+0x17c/0x1c0
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00cfcb8>] ? scsi_host_alloc_command+0x28/0xb0 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00d08dd>] ? scsi_get_command+0x1d/0x170 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00d7ab6>] ? scsi_prep_fn+0x156/0x170 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffff812bfa67>] ? blk_peek_request+0x157/0x270
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00d915d>] ? scsi_request_fn+0x3d/0x5e0 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffff812bb0ff>] ? __blk_run_queue+0x2f/0x40
[Thu Mar 17 05:54:02 2016]  [<ffffffff812bb131>] ? blk_run_queue+0x21/0x40
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00d65e5>] ? scsi_run_queue+0x235/0x2b0 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00d73fe>] ? scsi_end_request+0x12e/0x1d0 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffffa00d982a>] ? scsi_io_completion+0xba/0x630 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffff812c5d14>] ? blk_done_softirq+0x84/0xb0
[Thu Mar 17 05:54:02 2016]  [<ffffffff8107bd44>] ? __do_softirq+0x104/0x2a0
[Thu Mar 17 05:54:02 2016]  [<ffffffff8107c02b>] ? irq_exit+0x9b/0xa0
[Thu Mar 17 05:54:02 2016]  [<ffffffff815913af>] ? do_IRQ+0x4f/0xd0
[Thu Mar 17 05:54:02 2016]  [<ffffffff8158f4c2>] ? common_interrupt+0x82/0x82
[Thu Mar 17 05:54:02 2016]  <EOI>  [<ffffffffa00d9238>] ? scsi_request_fn+0x118/0x5e0 [scsi_mod]
[Thu Mar 17 05:54:02 2016]  [<ffffffff810b1010>] ? pick_next_task_fair+0x3c0/0x4a0
[Thu Mar 17 05:54:02 2016]  [<ffffffff8101564f>] ? __switch_to+0x1bf/0x570
[Thu Mar 17 05:54:02 2016]  [<ffffffff812bb0ff>] ? __blk_run_queue+0x2f/0x40
[Thu Mar 17 05:54:02 2016]  [<ffffffff812e0d69>] ? cfq_kick_queue+0x29/0x50
[Thu Mar 17 05:54:02 2016]  [<ffffffff8108ed67>] ? process_one_work+0x157/0x410
[Thu Mar 17 05:54:02 2016]  [<ffffffff8108f06d>] ? worker_thread+0x4d/0x450
[Thu Mar 17 05:54:02 2016]  [<ffffffff8108f020>] ? process_one_work+0x410/0x410
[Thu Mar 17 05:54:02 2016]  [<ffffffff81094dfd>] ? kthread+0xcd/0xf0
[Thu Mar 17 05:54:02 2016]  [<ffffffff81094d30>] ? kthread_create_on_node+0x190/0x190
[Thu Mar 17 05:54:02 2016]  [<ffffffff8158ed8f>] ? ret_from_fork+0x3f/0x70
[Thu Mar 17 05:54:02 2016]  [<ffffffff81094d30>] ? kthread_create_on_node+0x190/0x190
[Thu Mar 17 05:54:02 2016] Mem-Info:
[Thu Mar 17 05:54:02 2016] active_anon:281264 inactive_anon:24105 isolated_anon:0
                            active_file:1054441 inactive_file:1315688 isolated_file:0
                            unevictable:0 dirty:34 writeback:0 unstable:0
                            slab_reclaimable:860744 slab_unreclaimable:226757
                            mapped:14291 shmem:41561 pagetables:3901 bounce:0
                            free:7773 free_pcp:613 free_cma:0
[Thu Mar 17 05:54:02 2016] Node 0 DMA32 free:31168kB min:3008kB low:3760kB high:4512kB active_anon:221284kB inactive_anon:18796kB active_file:817204kB inactive_file:904316kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3136748kB managed:3060596kB mlocked:0kB dirty:36kB writeback:0kB mapped:10112kB shmem:31552kB slab_reclaimable:657848kB slab_unreclaimable:171012kB kernel_stack:1408kB pagetables:3480kB unstable:0kB bounce:0kB free_pcp:980kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[Thu Mar 17 05:54:02 2016] lowmem_reserve[]: 0 13054 13054 13054
[Thu Mar 17 05:54:02 2016] Node 0 Normal free:0kB min:13164kB low:16452kB high:19744kB active_anon:903772kB inactive_anon:77624kB active_file:3400560kB inactive_file:4358436kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:13631488kB managed:13368124kB mlocked:0kB dirty:100kB writeback:0kB mapped:47052kB shmem:134692kB slab_reclaimable:2785128kB slab_unreclaimable:736016kB kernel_stack:4480kB pagetables:12124kB unstable:0kB bounce:0kB free_pcp:1472kB local_pcp:696kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[Thu Mar 17 05:54:02 2016] lowmem_reserve[]: 0 0 0 0
[Thu Mar 17 05:54:02 2016] Node 0 DMA32: 6408*4kB (ME) 661*8kB (ME) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 30920kB
[Thu Mar 17 05:54:02 2016] Node 0 Normal: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 0kB
[Thu Mar 17 05:54:02 2016] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[Thu Mar 17 05:54:02 2016] 2411727 total pagecache pages
[Thu Mar 17 05:54:02 2016] 0 pages in swap cache
[Thu Mar 17 05:54:02 2016] Swap cache stats: add 0, delete 0, find 0/0
[Thu Mar 17 05:54:02 2016] Free swap  = 0kB
[Thu Mar 17 05:54:02 2016] Total swap = 0kB
[Thu Mar 17 05:54:02 2016] 4192059 pages RAM
[Thu Mar 17 05:54:02 2016] 0 pages HighMem/MovableOnly
[Thu Mar 17 05:54:02 2016] 84879 pages reserved
[Thu Mar 17 05:54:02 2016] 0 pages hwpoisoned

sar-r.txt

00:00:01    kbmemfree kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
05:05:01       125488  16303232     99.24    477196   8282372   2915128     17.74   5460456   4378972       152
05:15:01       147976  16280744     99.10    477392   8282476   2879380     17.53   5438360   4378920       144
05:25:01       151408  16277312     99.08    474924   8261476   2900804     17.66   5525384   4290032        28
05:35:01        99168  16329552     99.40    459632   7970788   3087692     18.79   5341044   4229060       480
05:45:01        88736  16339984     99.46    396572   9526804   3201860     19.49   5292884   5895524       164
05:55:01       105596  16323124     99.36    390852   9065668   2922948     17.79   5340804   5168684        52
06:05:01       121652  16307068     99.26    392020   9057600   2922976     17.79   5353632   5160644        56