Skip to content

Instantly share code, notes, and snippets.

@dmonakhov
Created February 14, 2013 09:03
Show Gist options
  • Save dmonakhov/4951456 to your computer and use it in GitHub Desktop.
Save dmonakhov/4951456 to your computer and use it in GitHub Desktop.
XFS (dm-1): Mounting Filesystem
XFS (dm-1): Ending clean mount
XFS (dm-3): Mounting Filesystem
XFS (dm-3): Ending clean mount
Buffer I/O error on device dm-3, logical block 12645
lost page write due to I/O error on dm-3
XFS (dm-3): metadata I/O error: block 0x0 ("xfs_buf_iodone_callbacks") error 5 numblks 1
Buffer I/O error on device dm-3, logical block 1313320
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1313321
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1313322
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1313323
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1313324
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1332195
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1314694
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1319924
lost page write due to I/O error on dm-3
Buffer I/O error on device dm-3, logical block 1319925
lost page write due to I/O error on dm-3
XFS (dm-3): metadata I/O error: block 0xa0282f ("xlog_iodone") error 5 numblks 64
XFS (dm-3): xfs_do_force_shutdown(0x2) called from line 1115 of file fs/xfs/xfs_log.c. Return address = 0xffffffffa0304735
XFS (dm-3): metadata I/O error: block 0x40 ("xfs_trans_read_buf_map") error 5 numblks 16
XFS (dm-3): Log I/O Error Detected. Shutting down filesystem
XFS (dm-3): Please umount the filesystem and rectify the problem(s)
XFS (dm-3): xfs_log_force: error 5 returned.
------------[ cut here ]------------
WARNING: at lib/debugobjects.c:261 debug_print_object+0xb1/0xe0()
Hardware name:
ODEBUG: free active (active state 0) object type: work_struct hint: xfs_buf_iodone_work+0x0/0xf0 [xfs]
Modules linked in: xfs exportfs libcrc32c cpufreq_ondemand acpi_cpufreq freq_table mperf coretemp kvm_intel kvm crc32c_intel microcode sg button sd_mod crc_t10dif ahci libahci pata_acpi ata_generic dm_mirror dm_region_hash dm_log dm_mod
Pid: 3060, comm: fsstress Not tainted 3.8.0-rc7+ #3
Call Trace:
[<ffffffff8106fd13>] warn_slowpath_common+0xc3/0xf0
[<ffffffff8106fdf6>] warn_slowpath_fmt+0x46/0x50
[<ffffffff8147f481>] debug_print_object+0xb1/0xe0
[<ffffffffa0286010>] ? xfs_bioerror_relse+0x90/0x90 [xfs]
[<ffffffff8147fcf6>] __debug_check_no_obj_freed+0xb6/0x2d0
[<ffffffff8147ff39>] debug_check_no_obj_freed+0x29/0x30
[<ffffffff812218b8>] kmem_cache_free+0x148/0x7f0
[<ffffffffa0285410>] ? xfs_buf_rele+0x1b0/0x1c0 [xfs]
[<ffffffffa030cc99>] ? xfs_buf_relse+0x19/0x20 [xfs]
[<ffffffffa0285226>] xfs_buf_free+0x1c6/0x200 [xfs]
[<ffffffffa0285410>] xfs_buf_rele+0x1b0/0x1c0 [xfs]
[<ffffffffa030cc99>] xfs_buf_relse+0x19/0x20 [xfs]
[<ffffffffa030dee1>] xfs_trans_read_buf_map+0x561/0x780 [xfs]
[<ffffffffa02eea99>] xfs_imap_to_bp+0x69/0x130 [xfs]
[<ffffffffa02eec5b>] xfs_iunlink_remove+0xfb/0x4b0 [xfs]
[<ffffffffa02a888b>] ? kmem_zone_alloc+0xbb/0x190 [xfs]
[<ffffffffa02ef783>] ? xfs_ilock+0x153/0x1b0 [xfs]
[<ffffffffa02f1197>] xfs_ifree+0x27/0x150 [xfs]
[<ffffffffa030e371>] ? xfs_trans_ijoin+0x61/0x70 [xfs]
[<ffffffffa02a4534>] xfs_inactive+0x484/0x640 [xfs]
[<ffffffff8126813f>] ? clear_inode+0x11f/0x150
[<ffffffffa029ee66>] xfs_fs_evict_inode+0x136/0x150 [xfs]
[<ffffffff81268634>] evict+0x154/0x2b0
[<ffffffff81268993>] iput_final+0x203/0x250
[<ffffffff81268a81>] iput+0xa1/0xb0
[<ffffffff8125885c>] do_unlinkat+0x2ec/0x430
[<ffffffff810eda77>] ? current_kernel_time+0x97/0xb0
[<ffffffff8114492f>] ? __audit_syscall_entry+0x16f/0x1c0
[<ffffffff812589b6>] sys_unlink+0x16/0x20
[<ffffffff818e80d9>] system_call_fastpath+0x16/0x1b
---[ end trace 0a55aa3529add48c ]---
BUG: sleeping function called from invalid context at kernel/workqueue.c:2828
in_atomic(): 0, irqs_disabled(): 1, pid: 3060, name: fsstress
3 locks held by fsstress/3060:
#0: (sb_writers#8){.+.+.+}, at: [<ffffffff81270174>] mnt_want_write+0x24/0x70
#1: (sb_internal){.+.+.+}, at: [<ffffffffa02ff8de>] xfs_trans_alloc+0x2e/0x50 [xfs]
#2: (&(&ip->i_lock)->mr_lock){++++..}, at: [<ffffffffa02ef783>] xfs_ilock+0x153/0x1b0 [xfs]
irq event stamp: 4334
hardirqs last enabled at (4333): [<ffffffff811ae028>] free_hot_cold_page+0x298/0x2f0
hardirqs last disabled at (4334): [<ffffffff8122187e>] kmem_cache_free+0x10e/0x7f0
softirqs last enabled at (4316): [<ffffffff8107ef2d>] __do_softirq+0x39d/0x410
softirqs last disabled at (4309): [<ffffffff818e947c>] call_softirq+0x1c/0x30
Pid: 3060, comm: fsstress Tainted: G W 3.8.0-rc7+ #3
Call Trace:
[<ffffffff810c9a1c>] __might_sleep+0xbc/0x1b0
[<ffffffff8109ebba>] start_flush_work+0x3a/0x3b0
[<ffffffff8109ef9e>] flush_work+0x6e/0xc0
[<ffffffff8109ef30>] ? start_flush_work+0x3b0/0x3b0
[<ffffffff8109ff5e>] ? try_to_grab_pending+0x23e/0x2d0
[<ffffffff811069aa>] ? __lock_release+0x1da/0x1f0
[<ffffffff8109ff5e>] ? try_to_grab_pending+0x23e/0x2d0
[<ffffffff8147e45a>] ? do_raw_spin_unlock+0x1ba/0x1d0
[<ffffffff818dae9b>] ? _raw_spin_unlock+0x2b/0x50
[<ffffffff8109ff5e>] ? try_to_grab_pending+0x23e/0x2d0
[<ffffffff810a01ba>] __cancel_work_timer+0x1ca/0x230
[<ffffffff810a0250>] cancel_work_sync+0x10/0x20
[<ffffffff810a027d>] work_fixup_free+0x1d/0x40
[<ffffffff8147ef3f>] debug_object_fixup+0x2f/0x40
[<ffffffff8147fd2f>] __debug_check_no_obj_freed+0xef/0x2d0
[<ffffffff8147ff39>] debug_check_no_obj_freed+0x29/0x30
[<ffffffff812218b8>] kmem_cache_free+0x148/0x7f0
[<ffffffffa0285410>] ? xfs_buf_rele+0x1b0/0x1c0 [xfs]
[<ffffffffa030cc99>] ? xfs_buf_relse+0x19/0x20 [xfs]
[<ffffffffa0285226>] xfs_buf_free+0x1c6/0x200 [xfs]
[<ffffffffa0285410>] xfs_buf_rele+0x1b0/0x1c0 [xfs]
[<ffffffffa030cc99>] xfs_buf_relse+0x19/0x20 [xfs]
[<ffffffffa030dee1>] xfs_trans_read_buf_map+0x561/0x780 [xfs]
[<ffffffffa02eea99>] xfs_imap_to_bp+0x69/0x130 [xfs]
[<ffffffffa02eec5b>] xfs_iunlink_remove+0xfb/0x4b0 [xfs]
[<ffffffffa02a888b>] ? kmem_zone_alloc+0xbb/0x190 [xfs]
[<ffffffffa02ef783>] ? xfs_ilock+0x153/0x1b0 [xfs]
[<ffffffffa02f1197>] xfs_ifree+0x27/0x150 [xfs]
[<ffffffffa030e371>] ? xfs_trans_ijoin+0x61/0x70 [xfs]
[<ffffffffa02a4534>] xfs_inactive+0x484/0x640 [xfs]
[<ffffffff8126813f>] ? clear_inode+0x11f/0x150
[<ffffffffa029ee66>] xfs_fs_evict_inode+0x136/0x150 [xfs]
[<ffffffff81268634>] evict+0x154/0x2b0
[<ffffffff81268993>] iput_final+0x203/0x250
[<ffffffff81268a81>] iput+0xa1/0xb0
[<ffffffff8125885c>] do_unlinkat+0x2ec/0x430
[<ffffffff810eda77>] ? current_kernel_time+0x97/0xb0
[<ffffffff8114492f>] ? __audit_syscall_entry+0x16f/0x1c0
[<ffffffff812589b6>] sys_unlink+0x16/0x20
[<ffffffff818e80d9>] system_call_fastpath+0x16/0x1b
------------[ cut here ]------------
kernel BUG at mm/slab.c:2536!
invalid opcode: 0000 [#1] SMP
Modules linked in: xfs exportfs libcrc32c cpufreq_ondemand acpi_cpufreq freq_table mperf coretemp kvm_intel kvm crc32c_intel microcode sg button sd_mod crc_t10dif ahci libahci pata_acpi ata_generic dm_mirror dm_region_hash dm_log dm_mod
CPU 0
Pid: 3060, comm: fsstress Tainted: G W 3.8.0-rc7+ #3 /DH55TC
RIP: 0010:[<ffffffff81220c8e>] [<ffffffff81220c8e>] check_irq_off+0x7e/0x90
RSP: 0018:ffff8801184a5a78 EFLAGS: 00010202
RAX: 0000000000000003 RBX: 0000000000000001 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffffffff82128368
RBP: ffff8801184a5a88 R08: 0000000000000000 R09: ffff880118ef4ad0
R10: 0000000000000003 R11: 0000000000000000 R12: ffff88011aa01300
R13: 0000000000000246 R14: ffffffffa0285226 R15: ffff88011834e200
FS: 00007fba90452700(0000) GS:ffff880121800000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fba8c17cea8 CR3: 0000000118d47000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process fsstress (pid: 3060, threadinfo ffff8801184a4000, task ffff880118ef41c0)
Stack:
ffff8801184a5a88 ffff8801180feb40 ffff8801184a5af8 ffffffff812218d3
ffff880100000000 0000000008c00000 ffff880127fd9000 0000000000000000
0000000000000002 ffff88011aa01300 0000000000000002 ffff88011aa01300
Call Trace:
[<ffffffff812218d3>] kmem_cache_free+0x163/0x7f0
[<ffffffffa0285410>] ? xfs_buf_rele+0x1b0/0x1c0 [xfs]
[<ffffffffa030cc99>] ? xfs_buf_relse+0x19/0x20 [xfs]
[<ffffffffa0285226>] xfs_buf_free+0x1c6/0x200 [xfs]
[<ffffffffa0285410>] xfs_buf_rele+0x1b0/0x1c0 [xfs]
[<ffffffffa030cc99>] xfs_buf_relse+0x19/0x20 [xfs]
[<ffffffffa030dee1>] xfs_trans_read_buf_map+0x561/0x780 [xfs]
[<ffffffffa02eea99>] xfs_imap_to_bp+0x69/0x130 [xfs]
[<ffffffffa02eec5b>] xfs_iunlink_remove+0xfb/0x4b0 [xfs]
[<ffffffffa02a888b>] ? kmem_zone_alloc+0xbb/0x190 [xfs]
[<ffffffffa02ef783>] ? xfs_ilock+0x153/0x1b0 [xfs]
[<ffffffffa02f1197>] xfs_ifree+0x27/0x150 [xfs]
[<ffffffffa030e371>] ? xfs_trans_ijoin+0x61/0x70 [xfs]
[<ffffffffa02a4534>] xfs_inactive+0x484/0x640 [xfs]
[<ffffffff8126813f>] ? clear_inode+0x11f/0x150
[<ffffffffa029ee66>] xfs_fs_evict_inode+0x136/0x150 [xfs]
[<ffffffff81268634>] evict+0x154/0x2b0
[<ffffffff81268993>] iput_final+0x203/0x250
[<ffffffff81268a81>] iput+0xa1/0xb0
[<ffffffff8125885c>] do_unlinkat+0x2ec/0x430
[<ffffffff810eda77>] ? current_kernel_time+0x97/0xb0
[<ffffffff8114492f>] ? __audit_syscall_entry+0x16f/0x1c0
[<ffffffff812589b6>] sys_unlink+0x16/0x20
[<ffffffff818e80d9>] system_call_fastpath+0x16/0x1b
Code: e8 09 31 d2 48 c7 c7 68 83 12 82 89 c3 83 e3 01 89 de e8 46 b4 f5 ff 48 63 c3 48 83 c0 02 48 83 04 c5 c0 08 24 82 01 85 db 74 04 <0f> 0b eb fe 58 5b c9 c3 66 2e 0f 1f 84 00 00 00 00 00 55 48 89
RIP [<ffffffff81220c8e>] check_irq_off+0x7e/0x90
RSP <ffff8801184a5a78>
---[ end trace 0a55aa3529add48d ]---
XFS (dm-1): Mounting Filesystem
XFS (dm-1): Ending clean mount
quiet_error: 949 callbacks suppressed
Buffer I/O error on device dm-3, logical block 20971512
Buffer I/O error on device dm-3, logical block 20971513
Buffer I/O error on device dm-3, logical block 20971514
Buffer I/O error on device dm-3, logical block 20971515
Buffer I/O error on device dm-3, logical block 20971516
Buffer I/O error on device dm-3, logical block 20971517
Buffer I/O error on device dm-3, logical block 20971518
Buffer I/O error on device dm-3, logical block 20971519
Buffer I/O error on device dm-3, logical block 20971512
Buffer I/O error on device dm-3, logical block 20971513
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
nr_pdflush_threads exported in /proc is scheduled for removal
sysctl: The scan_unevictable_pages sysctl/node-interface has been disabled for lack of a legitimate use case. If you have one, please send an email to linux-mm@kvack.org.
quiet_error: 2662 callbacks suppressed
Buffer I/O error on device dm-3, logical block 20971392
Buffer I/O error on device dm-3, logical block 20971393
Buffer I/O error on device dm-3, logical block 20971394
Buffer I/O error on device dm-3, logical block 20971395
Buffer I/O error on device dm-3, logical block 20971396
Buffer I/O error on device dm-3, logical block 20971397
Buffer I/O error on device dm-3, logical block 20971398
Buffer I/O error on device dm-3, logical block 20971399
Buffer I/O error on device dm-3, logical block 20971392
Buffer I/O error on device dm-3, logical block 20971393
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
quiet_error: 3630 callbacks suppressed
Buffer I/O error on device dm-3, logical block 20971392
Buffer I/O error on device dm-3, logical block 20971393
Buffer I/O error on device dm-3, logical block 20971394
Buffer I/O error on device dm-3, logical block 20971395
Buffer I/O error on device dm-3, logical block 20971396
Buffer I/O error on device dm-3, logical block 20971397
Buffer I/O error on device dm-3, logical block 20971398
Buffer I/O error on device dm-3, logical block 20971399
Buffer I/O error on device dm-3, logical block 20971392
Buffer I/O error on device dm-3, logical block 20971393
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
XFS (dm-3): xfs_log_force: error 5 returned.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment