Created
February 6, 2013 15:29
-
-
Save davewhittaker/4723285 to your computer and use it in GitHub Desktop.
Postgres soft lockup
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Feb 4 14:09:36 h2dba kernel: BUG: soft lockup - CPU#6 stuck for 70s! [postmaster:22077] | |
| Feb 4 14:09:36 h2dba kernel: Modules linked in: ipmi_si dell_rbu ipmi_devintf ipmi_msghandler mpt2sas scsi_transport_sas raid_class mptctl mptbase ipt_REJECT nf | |
| _conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 dm_mod | |
| ses enclosure bnx2 sg dcdbas shpchp serio_raw iTCO_wdt iTCO_vendor_support ext4 mbcache jbd2 sd_mod crc_t10dif sr_mod cdrom megaraid_sas pata_acpi ata_generic a | |
| ta_piix radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core [last unloaded: ipmi_si] | |
| Feb 4 14:09:36 h2dba kernel: CPU 6 | |
| Feb 4 14:09:36 h2dba kernel: Modules linked in: ipmi_si dell_rbu ipmi_devintf ipmi_msghandler mpt2sas scsi_transport_sas raid_class mptctl mptbase ipt_REJECT nf | |
| _conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 dm_mod | |
| ses enclosure bnx2 sg dcdbas shpchp serio_raw iTCO_wdt iTCO_vendor_support ext4 mbcache jbd2 sd_mod crc_t10dif sr_mod cdrom megaraid_sas pata_acpi ata_generic a | |
| ta_piix radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core [last unloaded: ipmi_si] | |
| Feb 4 14:09:36 h2dba kernel: | |
| Feb 4 14:09:36 h2dba kernel: Pid: 22077, comm: postmaster Not tainted 2.6.32-279.19.1.el6.x86_64 #1 Dell Inc. PowerEdge R900/0X947H | |
| Feb 4 14:09:36 h2dba kernel: RIP: 0010:[<ffffffff814ec587>] [<ffffffff814ec587>] _spin_unlock_irqrestore+0x17/0x20 | |
| Feb 4 14:09:36 h2dba kernel: RSP: 0000:ffff88017807d878 EFLAGS: 00000246 | |
| Feb 4 14:09:36 h2dba kernel: RAX: 0000000000000000 RBX: ffff88017807d878 RCX: ffffea00251e8000 | |
| Feb 4 14:09:36 h2dba kernel: RDX: ffff880000050dd8 RSI: 0000000000000246 RDI: 0000000000000246 | |
| Feb 4 14:09:36 h2dba kernel: RBP: ffffffff8100bb8e R08: 0000000000000006 R09: 0000000000000000 | |
| Feb 4 14:09:36 h2dba kernel: R10: ffff8800284092c0 R11: 0000000000000000 R12: ffffffff81144d40 | |
| Feb 4 14:09:36 h2dba kernel: R13: ffff88017807d7e8 R14: ffffea0004379610 R15: ffffea00277d5000 | |
| Feb 4 14:09:36 h2dba kernel: FS: 00007f330fb237c0(0000) GS:ffff8800534c0000(0000) knlGS:0000000000000000 | |
| Feb 4 14:09:36 h2dba kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 | |
| Feb 4 14:09:36 h2dba kernel: CR2: 0000000002906008 CR3: 00000001a27a1000 CR4: 00000000000006e0 | |
| Feb 4 14:09:36 h2dba kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 | |
| Feb 4 14:09:36 h2dba kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 | |
| Feb 4 14:09:36 h2dba kernel: Process postmaster (pid: 22077, threadinfo ffff88017807c000, task ffff88016e91f500) | |
| Feb 4 14:09:36 h2dba kernel: Stack: | |
| Feb 4 14:09:36 h2dba kernel: ffff88017807d928 ffffffff811591ef ffff88017807d8b8 0000000000000000 | |
| Feb 4 14:09:36 h2dba kernel: <d> 0000000000a9b000 0000000000102a00 ffffea00251e8000 ffff8800534d2f00 | |
| Feb 4 14:09:36 h2dba kernel: <d> 0000000000000246 ffffffff00000000 0000000000a9b200 ffff880000050dd8 | |
| Feb 4 14:09:36 h2dba kernel: Call Trace: | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811591ef>] ? compaction_alloc+0x39f/0x3e0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81163533>] ? migrate_pages+0xb3/0x4b0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81158e50>] ? compaction_alloc+0x0/0x3e0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159747>] ? compact_zone+0x517/0x820 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159cd1>] ? compact_zone_order+0xa1/0xe0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159e2c>] ? try_to_compact_pages+0x11c/0x190 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81123075>] ? __alloc_pages_nodemask+0x5f5/0x940 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81127100>] ? ____pagevec_lru_add+0x170/0x180 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811575ea>] ? alloc_pages_vma+0x9a/0x150 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81171a35>] ? do_huge_pmd_anonymous_page+0x145/0x380 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113b9e0>] ? handle_mm_fault+0x280/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113f5aa>] ? vma_adjust+0x4fa/0x590 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff810432d9>] ? __do_page_fault+0x139/0x480 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8126f58c>] ? rb_erase+0x1bc/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8100988e>] ? __switch_to+0x26e/0x320 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814e9c50>] ? thread_return+0x4e/0x76e | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814ef68e>] ? do_page_fault+0x3e/0xa0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814eca45>] ? page_fault+0x25/0x30 | |
| Feb 4 14:09:36 h2dba kernel: Code: 00 00 00 01 74 05 e8 29 8c d8 ff c9 c3 0f 1f 80 00 00 00 00 55 48 89 e5 0f 1f 44 00 00 48 89 fa 66 ff 02 66 66 90 48 89 f7 57 | |
| 9d <0f> 1f 44 00 00 c9 c3 66 90 55 48 89 e5 0f 1f 44 00 00 f0 ff 07 | |
| Feb 4 14:09:36 h2dba kernel: Call Trace: | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811591ef>] ? compaction_alloc+0x39f/0x3e0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81163533>] ? migrate_pages+0xb3/0x4b0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81158e50>] ? compaction_alloc+0x0/0x3e0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159747>] ? compact_zone+0x517/0x820 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159cd1>] ? compact_zone_order+0xa1/0xe0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159e2c>] ? try_to_compact_pages+0x11c/0x190 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81123075>] ? __alloc_pages_nodemask+0x5f5/0x940 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81127100>] ? ____pagevec_lru_add+0x170/0x180 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811575ea>] ? alloc_pages_vma+0x9a/0x150 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81171a35>] ? do_huge_pmd_anonymous_page+0x145/0x380 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113b9e0>] ? handle_mm_fault+0x280/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113f5aa>] ? vma_adjust+0x4fa/0x590 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff810432d9>] ? __do_page_fault+0x139/0x480 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8126f58c>] ? rb_erase+0x1bc/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8100988e>] ? __switch_to+0x26e/0x320 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814e9c50>] ? thread_return+0x4e/0x76e | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159cd1>] ? compact_zone_order+0xa1/0xe0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159e2c>] ? try_to_compact_pages+0x11c/0x190 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81123075>] ? __alloc_pages_nodemask+0x5f5/0x940 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81127100>] ? ____pagevec_lru_add+0x170/0x180 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811575ea>] ? alloc_pages_vma+0x9a/0x150 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81171a35>] ? do_huge_pmd_anonymous_page+0x145/0x380 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113b9e0>] ? handle_mm_fault+0x280/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113f5aa>] ? vma_adjust+0x4fa/0x590 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff810432d9>] ? __do_page_fault+0x139/0x480 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8126f58c>] ? rb_erase+0x1bc/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8100988e>] ? __switch_to+0x26e/0x320 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814e9c50>] ? thread_return+0x4e/0x76e | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814ef68e>] ? do_page_fault+0x3e/0xa0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814eca45>] ? page_fault+0x25/0x30 | |
| Feb 4 14:09:36 h2dba kernel: Code: 00 00 00 01 74 05 e8 29 8c d8 ff c9 c3 0f 1f 80 00 00 00 00 55 48 89 e5 0f 1f 44 00 00 48 89 fa 66 ff 02 66 66 90 48 89 f7 57 | |
| 9d <0f> 1f 44 00 00 c9 c3 66 90 55 48 89 e5 0f 1f 44 00 00 f0 ff 07 | |
| Feb 4 14:09:36 h2dba kernel: Call Trace: | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811591ef>] ? compaction_alloc+0x39f/0x3e0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81163533>] ? migrate_pages+0xb3/0x4b0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81158e50>] ? compaction_alloc+0x0/0x3e0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159747>] ? compact_zone+0x517/0x820 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159cd1>] ? compact_zone_order+0xa1/0xe0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81159e2c>] ? try_to_compact_pages+0x11c/0x190 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81123075>] ? __alloc_pages_nodemask+0x5f5/0x940 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81127100>] ? ____pagevec_lru_add+0x170/0x180 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff811575ea>] ? alloc_pages_vma+0x9a/0x150 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff81171a35>] ? do_huge_pmd_anonymous_page+0x145/0x380 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113b9e0>] ? handle_mm_fault+0x280/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8113f5aa>] ? vma_adjust+0x4fa/0x590 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff810432d9>] ? __do_page_fault+0x139/0x480 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8126f58c>] ? rb_erase+0x1bc/0x310 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff8100988e>] ? __switch_to+0x26e/0x320 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814e9c50>] ? thread_return+0x4e/0x76e | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814ef68e>] ? do_page_fault+0x3e/0xa0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814eca45>] ? page_fault+0x25/0x30 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814ef68e>] ? do_page_fault+0x3e/0xa0 | |
| Feb 4 14:09:36 h2dba kernel: [<ffffffff814eca45>] ? page_fault+0x25/0x30 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment