Last active
December 15, 2023 16:28
-
-
Save bendlas/a8b6cb3ec52ee70deb2b90cb355cbda0 to your computer and use it in GitHub Desktop.
bcachefs hung rebalance
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Filesystem: fea1b70c-5324-4471-94a1-cc43914003e4 | |
| Size: 7046143410176 | |
| Used: 4601222471680 | |
| Online reserved: 180224 | |
| Data type Required/total Durability Devices | |
| reserved: 1/1 [] 211623936 | |
| btree: 1/2 2 [sda nvme1n1p3] 6291456 | |
| btree: 1/1 1 [sdb] 47710208 | |
| btree: 1/2 2 [sdb nvme1n1p3] 6291456 | |
| btree: 1/1 1 [sda] 50855936 | |
| btree: 1/2 2 [sda sdb] 378535936 | |
| btree: 1/2 2 [nvme1n1p3 nvme0n1p2] 43198185472 | |
| user: 1/1 1 [sda] 215335305216 | |
| user: 1/2 2 [sdb nvme0n1p2] 24799223808 | |
| user: 1/2 2 [sda sdb] 3477694898176 | |
| user: 1/1 1 [nvme1n1p3] 21453746176 | |
| user: 1/2 2 [sda nvme0n1p2] 24294572032 | |
| user: 1/1 1 [sdb] 214586011648 | |
| user: 1/1 1 [nvme0n1p2] 21428371456 | |
| user: 1/2 2 [sda nvme1n1p3] 24372633600 | |
| user: 1/2 2 [sdb nvme1n1p3] 24950775808 | |
| user: 1/2 2 [nvme1n1p3 nvme0n1p2] 482618417152 | |
| cached: 1/1 1 [nvme1n1p3] 24217088000 | |
| cached: 1/1 1 [nvme0n1p2] 23935553536 | |
| hdd.sata1 (device 0): sda rw | |
| data buckets fragmented | |
| free: 0 32988 | |
| sb: 3149824 7 520192 | |
| journal: 4294967296 8192 | |
| btree: 243269632 464 | |
| user: 1978516357120 3773807 45367296 | |
| cached: 0 0 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 0 | |
| capacity: 2000398843904 3815458 | |
| hdd.sata2 (device 1): sdb rw | |
| data buckets fragmented | |
| free: 0 33388 | |
| sb: 3149824 7 520192 | |
| journal: 4294967296 8192 | |
| btree: 240123904 458 | |
| user: 1978308460544 3773413 46694400 | |
| cached: 0 0 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 0 | |
| capacity: 2000398843904 3815458 | |
| ssd.nvme1 (device 2): nvme1n1p3 rw | |
| data buckets fragmented | |
| free: 0 1394343 | |
| sb: 3149824 4 1044480 | |
| journal: 8589934592 8192 | |
| btree: 21605384192 20688 87556096 | |
| user: 287424659456 274407 311934976 | |
| cached: 24217088000 47065 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 5 | |
| capacity: 1829454741504 1744704 | |
| ssd.nvme2 (device 3): nvme0n1p2 rw | |
| data buckets fragmented | |
| free: 0 1394162 | |
| sb: 3149824 4 1044480 | |
| journal: 8589934592 8192 | |
| btree: 21599092736 20682 87556096 | |
| user: 287284477952 274253 290635776 | |
| cached: 23935553536 46589 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 6 | |
| capacity: 1828599103488 1743888 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Filesystem: fea1b70c-5324-4471-94a1-cc43914003e4 | |
| Size: 7046143410176 | |
| Used: 4750603920384 | |
| Online reserved: 32768 | |
| Data type Required/total Durability Devices | |
| reserved: 1/1 [] 223895552 | |
| btree: 1/2 2 [sdb nvme1n1p3] 6291456 | |
| btree: 1/2 2 [sda sdb] 370147328 | |
| btree: 1/2 2 [nvme1n1p3 nvme0n1p2] 42834853888 | |
| btree: 1/2 2 [sda nvme1n1p3] 6291456 | |
| user: 1/2 2 [sda sdb] 3490916466688 | |
| user: 1/1 1 [sda] 206463795200 | |
| user: 1/2 2 [sdb nvme0n1p2] 34916827136 | |
| user: 1/1 1 [nvme1n1p3] 15711522816 | |
| user: 1/2 2 [sda nvme0n1p2] 34446090240 | |
| user: 1/1 1 [sdb] 205834735616 | |
| user: 1/1 1 [nvme0n1p2] 15758991360 | |
| user: 1/2 2 [sda nvme1n1p3] 34515025920 | |
| user: 1/2 2 [sdb nvme1n1p3] 35045818368 | |
| user: 1/2 2 [nvme1n1p3 nvme0n1p2] 607764103168 | |
| cached: 1/1 1 [nvme1n1p3] 23702966272 | |
| cached: 1/1 1 [nvme0n1p2] 23328874496 | |
| hdd.sata1 (device 0): sda rw | |
| data buckets fragmented | |
| free: 0 17956 | |
| sb: 3149824 7 520192 | |
| journal: 4294967296 8192 | |
| btree: 188219392 359 | |
| user: 1986402586624 3788944 95285248 | |
| cached: 0 0 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 0 | |
| capacity: 2000398843904 3815458 | |
| hdd.sata2 (device 1): sdb rw | |
| data buckets fragmented | |
| free: 0 18205 | |
| sb: 3149824 7 520192 | |
| journal: 4294967296 8192 | |
| btree: 188219392 359 | |
| user: 1986274291712 3788695 93032448 | |
| cached: 0 0 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 0 | |
| capacity: 2000398843904 3815458 | |
| ssd.nvme1 (device 2): nvme1n1p3 rw | |
| data buckets fragmented | |
| free: 0 1324402 | |
| sb: 3149824 4 1044480 | |
| journal: 8589934592 8192 | |
| btree: 21423718400 20441 10223616 | |
| user: 354373996544 338117 167374848 | |
| cached: 23702966272 53548 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 0 | |
| capacity: 1829454741504 1744704 | |
| ssd.nvme2 (device 3): nvme0n1p2 rw | |
| data buckets fragmented | |
| free: 0 1324241 | |
| sb: 3149824 4 1044480 | |
| journal: 8589934592 8192 | |
| btree: 21417426944 20435 10223616 | |
| user: 354322501632 338070 169586688 | |
| cached: 23328874496 52945 | |
| parity: 0 0 | |
| stripe: 0 0 | |
| need_gc_gens: 0 0 | |
| need_discard: 0 1 | |
| capacity: 1828599103488 1743888 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| External UUID: fea1b70c-5324-4471-94a1-cc43914003e4 | |
| Internal UUID: 0b8211c8-88fd-4002-9255-2b058ab0edb5 | |
| Device index: 0 | |
| Label: | |
| Version: 1.3: rebalance_work | |
| Version upgrade complete: 1.3: rebalance_work | |
| Oldest version on disk: 0.29: snapshot_trees | |
| Created: Fri Sep 15 23:43:43 2023 | |
| Sequence number: 177 | |
| Superblock size: 6696 | |
| Clean: 0 | |
| Devices: 4 | |
| Sections: members_v1,replicas_v0,disk_groups,clean,journal_seq_blacklist,journal_v2,counters,members_v2,errors | |
| Features: journal_seq_blacklist_v3,reflink,new_siphash,inline_data,new_extent_overwrite,btree_ptr_v2,extents_above_btree_updates,btree_updates_journalled,reflink_inline_data,new_varint,journal_no_flush,alloc_v2,extents_across_btree_nodes | |
| Compat features: alloc_info,alloc_metadata,extents_above_btree_updates_done,bformat_overflow_done | |
| Options: | |
| block_size: 4.00 KiB | |
| btree_node_size: 256 KiB | |
| errors: continue [ro] panic | |
| metadata_replicas: 2 | |
| data_replicas: 2 | |
| metadata_replicas_required: 1 | |
| data_replicas_required: 1 | |
| encoded_extent_max: 64.0 KiB | |
| metadata_checksum: none [crc32c] crc64 xxhash | |
| data_checksum: none [crc32c] crc64 xxhash | |
| compression: none | |
| background_compression: none | |
| str_hash: crc32c crc64 [siphash] | |
| metadata_target: none | |
| foreground_target: ssd | |
| background_target: hdd | |
| promote_target: ssd | |
| erasure_code: 0 | |
| inodes_32bit: 1 | |
| shard_inode_numbers: 1 | |
| inodes_use_key_cache: 1 | |
| gc_reserve_percent: 8 | |
| gc_reserve_bytes: 0 B | |
| root_reserve_percent: 0 | |
| wide_macs: 0 | |
| acl: 1 | |
| usrquota: 0 | |
| grpquota: 0 | |
| prjquota: 0 | |
| journal_flush_delay: 1000 | |
| journal_flush_disabled: 0 | |
| journal_reclaim_delay: 100 | |
| journal_transaction_names: 1 | |
| version_upgrade: [compatible] incompatible none | |
| nocow: 0 | |
| replicas_v0 (size 112): | |
| user: 1 [0] journal: 2 [2 3] user: 2 [1 3] journal: 2 [0 2] btree: 2 [0 2] user: 2 [0 1] cached: 1 [2] journal: 1 [1] journal: 2 [1 2] btree: 1 [1] btree: 2 [1 2] user: 1 [2] user: 2 [0 3] cached: 1 [0] cached: 1 [3] journal: 1 [0] journal: 2 [0 1] journal: 2 [0 3] journal: 2 [1 3] btree: 1 [0] btree: 2 [0 1] btree: 2 [0 3] btree: 2 [2 3] user: 1 [1] user: 1 [3] user: 2 [0 2] user: 2 [1 2] user: 2 [2 3] cached: 1 [1] | |
| members_v2 (size 496): | |
| Device: 0 | |
| Label: sata1 (1) | |
| UUID: 845eb167-c1ed-4a5d-9a1b-728e3844868d | |
| Size: 1.82 TiB | |
| read errors: 0 | |
| write errors: 0 | |
| checksum errors: 0 | |
| seqread iops: 0 | |
| seqwrite iops: 0 | |
| randread iops: 0 | |
| randwrite iops: 0 | |
| Bucket size: 512 KiB | |
| First bucket: 0 | |
| Buckets: 3815458 | |
| Last mount: Sat Dec 9 00:21:39 2023 | |
| State: rw | |
| Data allowed: journal,btree,user | |
| Has data: journal,btree,user,cached | |
| Durability: 2 | |
| Discard: 0 | |
| Freespace initialized: 1 | |
| Device: 1 | |
| Label: sata2 (2) | |
| UUID: be5fc993-ba8f-498e-9979-6f341feff5b0 | |
| Size: 1.82 TiB | |
| read errors: 0 | |
| write errors: 0 | |
| checksum errors: 0 | |
| seqread iops: 0 | |
| seqwrite iops: 0 | |
| randread iops: 0 | |
| randwrite iops: 0 | |
| Bucket size: 512 KiB | |
| First bucket: 0 | |
| Buckets: 3815458 | |
| Last mount: Sat Dec 9 00:21:39 2023 | |
| State: rw | |
| Data allowed: journal,btree,user | |
| Has data: journal,btree,user,cached | |
| Durability: 2 | |
| Discard: 0 | |
| Freespace initialized: 1 | |
| Device: 2 | |
| Label: nvme1 (4) | |
| UUID: 55c77353-6146-45c8-ab01-c241c66158af | |
| Size: 1.66 TiB | |
| read errors: 0 | |
| write errors: 0 | |
| checksum errors: 0 | |
| seqread iops: 0 | |
| seqwrite iops: 0 | |
| randread iops: 0 | |
| randwrite iops: 0 | |
| Bucket size: 1.00 MiB | |
| First bucket: 0 | |
| Buckets: 1744704 | |
| Last mount: Sat Dec 9 00:21:39 2023 | |
| State: rw | |
| Data allowed: journal,btree,user | |
| Has data: journal,btree,user,cached | |
| Durability: 2 | |
| Discard: 0 | |
| Freespace initialized: 1 | |
| Device: 3 | |
| Label: nvme2 (5) | |
| UUID: f32502c6-065c-492c-a1c5-93db0f856328 | |
| Size: 1.66 TiB | |
| read errors: 0 | |
| write errors: 0 | |
| checksum errors: 0 | |
| seqread iops: 0 | |
| seqwrite iops: 0 | |
| randread iops: 0 | |
| randwrite iops: 0 | |
| Bucket size: 1.00 MiB | |
| First bucket: 0 | |
| Buckets: 1743888 | |
| Last mount: Sat Dec 9 00:21:39 2023 | |
| State: rw | |
| Data allowed: journal,btree,user | |
| Has data: journal,btree,user,cached | |
| Durability: 2 | |
| Discard: 0 | |
| Freespace initialized: 1 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Dec 10 11:16:12 scheltopusix kernel: INFO: task bch-copygc/fea1:624 blocked for more than 122 seconds. | |
| Dec 10 11:16:12 scheltopusix kernel: Not tainted 6.6.5-bcachefs-2023-10-30-483be0f #1-NixOS | |
| Dec 10 11:16:12 scheltopusix kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. | |
| Dec 10 11:16:12 scheltopusix kernel: task:bch-copygc/fea1 state:D stack:0 pid:624 ppid:2 flags:0x00004000 | |
| Dec 10 11:16:12 scheltopusix kernel: Call Trace: | |
| Dec 10 11:16:12 scheltopusix kernel: <TASK> | |
| Dec 10 11:16:12 scheltopusix kernel: __schedule+0x387/0x1390 | |
| Dec 10 11:16:12 scheltopusix kernel: ? srso_return_thunk+0x5/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: ? psi_task_switch+0xd6/0x230 | |
| Dec 10 11:16:12 scheltopusix kernel: schedule+0x5e/0xd0 | |
| Dec 10 11:16:12 scheltopusix kernel: __closure_sync+0x82/0x150 | |
| Dec 10 11:16:12 scheltopusix kernel: __bch2_bucket_nocow_lock+0xbe/0x120 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: bch2_data_update_init+0xbd7/0x1090 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_autoremove_wake_function+0x10/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: ? bch2_move_extent+0x459/0xa10 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: bch2_move_extent+0x459/0xa10 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: ? __bch2_evacuate_bucket+0x5d8/0xb80 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: __bch2_evacuate_bucket+0x5d8/0xb80 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: ? bch2_copygc+0x3ac/0x820 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: bch2_copygc+0x3ac/0x820 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: bch2_copygc_thread+0x147/0x370 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_rhashtable_jhash2+0x10/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_rht_deferred_worker+0x10/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: ? bch2_copygc_thread+0xd4/0x370 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_bch2_copygc_thread+0x10/0x10 [bcachefs] | |
| Dec 10 11:16:12 scheltopusix kernel: kthread+0xe8/0x120 | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: ret_from_fork+0x34/0x50 | |
| Dec 10 11:16:12 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 10 11:16:12 scheltopusix kernel: ret_from_fork_asm+0x1b/0x30 | |
| Dec 10 11:16:12 scheltopusix kernel: </TASK> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 0 bcachefs:write_super ◆ | |
| 0 bcachefs:read_promote ▒ | |
| 0 bcachefs:read_nopromote ▒ | |
| 0 bcachefs:read_bounce ▒ | |
| 0 bcachefs:read_split ▒ | |
| 0 bcachefs:read_retry ▒ | |
| 0 bcachefs:read_reuse_race ▒ | |
| 0 bcachefs:journal_full ▒ | |
| 0 bcachefs:journal_entry_full ▒ | |
| 178 bcachefs:journal_write ▒ | |
| 1K bcachefs:journal_reclaim_start ▒ | |
| 1K bcachefs:journal_reclaim_finish ▒ | |
| 0 bcachefs:bkey_pack_pos_fail ▒ | |
| 0 bcachefs:btree_cache_scan ▒ | |
| 0 bcachefs:btree_cache_reap ▒ | |
| 0 bcachefs:btree_cache_cannibalize_lock_fail ▒ | |
| 0 bcachefs:btree_cache_cannibalize_lock ▒ | |
| 0 bcachefs:btree_cache_cannibalize ▒ | |
| 0 bcachefs:btree_cache_cannibalize_unlock ▒ | |
| 0 bcachefs:btree_node_read ▒ | |
| 34 bcachefs:btree_node_write ▒ | |
| 0 bcachefs:btree_node_alloc ▒ | |
| 0 bcachefs:btree_node_free ▒ | |
| 0 bcachefs:btree_reserve_get_fail ▒ | |
| 0 bcachefs:btree_node_compact ▒ | |
| 0 bcachefs:btree_node_merge ▒ | |
| 0 bcachefs:btree_node_split ▒ | |
| 0 bcachefs:btree_node_rewrite ▒ | |
| 0 bcachefs:btree_node_set_root ▒ | |
| 0 bcachefs:btree_path_relock_fail ▒ | |
| 0 bcachefs:btree_path_upgrade_fail ▒ | |
| 0 bcachefs:gc_gens_start ▒ | |
| 0 bcachefs:gc_gens_end ▒ | |
| 69 bcachefs:bucket_alloc ▒ | |
| 0 bcachefs:bucket_alloc_fail ▒ | |
| 89 bcachefs:discard_buckets ▒ | |
| 0 bcachefs:bucket_invalidate ▒ | |
| 0 bcachefs:bucket_evacuate ▒ | |
| 0 bcachefs:move_extent ▒ | |
| 0 bcachefs:move_extent_read ▒ | |
| 0 bcachefs:move_extent_write ▒ | |
| 0 bcachefs:move_extent_finish ▒ | |
| 0 bcachefs:move_extent_fail ▒ | |
| 0 bcachefs:move_extent_start_fail ▒ | |
| 0 bcachefs:move_data ▒ | |
| 0 bcachefs:evacuate_bucket ▒ | |
| 0 bcachefs:copygc ▒ | |
| 0 bcachefs:copygc_wait ▒ | |
| 2K bcachefs:transaction_commit ▒ | |
| 0 bcachefs:trans_restart_injected ▒ | |
| 0 bcachefs:trans_restart_split_race ▒ | |
| 0 bcachefs:trans_blocked_journal_reclaim ▒ | |
| 0 bcachefs:trans_restart_journal_preres_get ▒ | |
| 0 bcachefs:trans_restart_fault_inject ▒ | |
| 2 bcachefs:trans_traverse_all ▒ | |
| 0 bcachefs:trans_restart_key_cache_raced ▒ | |
| 0 bcachefs:trans_restart_too_many_iters ▒ | |
| 0 bcachefs:trans_restart_btree_node_reused ▒ | |
| 0 bcachefs:trans_restart_btree_node_split ▒ | |
| 0 bcachefs:trans_restart_upgrade ▒ | |
| 0 bcachefs:trans_restart_relock ▒ | |
| 0 bcachefs:trans_restart_relock_next_node ▒ | |
| 0 bcachefs:trans_restart_relock_parent_for_fill ▒ | |
| 0 bcachefs:trans_restart_relock_after_fill ▒ | |
| 0 bcachefs:trans_restart_key_cache_upgrade ▒ | |
| 0 bcachefs:trans_restart_relock_key_cache_fill ▒ | |
| 0 bcachefs:trans_restart_relock_path ▒ | |
| 0 bcachefs:trans_restart_relock_path_intent ▒ | |
| 0 bcachefs:trans_restart_traverse ▒ | |
| 0 bcachefs:trans_restart_memory_allocation_failure ▒ | |
| 0 bcachefs:trans_restart_would_deadlock ▒ | |
| 0 bcachefs:trans_restart_would_deadlock_recursion_limit ▒ | |
| 0 bcachefs:trans_restart_would_deadlock_write ▒ | |
| 0 bcachefs:trans_restart_mem_realloced ▒ | |
| 0 bcachefs:trans_restart_key_cache_key_realloced ▒ | |
| 2K bcachefs:path_downgrade ▒ | |
| 2 bcachefs:trans_restart_write_buffer_flush ▒ | |
| 2 bcachefs:write_buffer_flush ▒ | |
| 0 bcachefs:write_buffer_flush_slowpath |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Dec 12 13:41:17 scheltopusix kernel: INFO: task bch-rebalance/f:616 blocked for more than 122 seconds. | |
| Dec 12 13:41:17 scheltopusix kernel: Not tainted 6.7.0-rc4-bcachefs-unstable-9eba583 #1-NixOS | |
| Dec 12 13:41:17 scheltopusix kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. | |
| Dec 12 13:41:17 scheltopusix kernel: task:bch-rebalance/f state:D stack:0 pid:616 tgid:616 ppid:2 flags:0x00004000 | |
| Dec 12 13:41:17 scheltopusix kernel: Call Trace: | |
| Dec 12 13:41:17 scheltopusix kernel: <TASK> | |
| Dec 12 13:41:17 scheltopusix kernel: __schedule+0x375/0x13d0 | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: schedule+0x32/0xd0 | |
| Dec 12 13:41:17 scheltopusix kernel: __closure_sync+0x83/0x210 | |
| Dec 12 13:41:17 scheltopusix kernel: __bch2_bucket_nocow_lock+0xb7/0x120 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 12 13:41:17 scheltopusix kernel: bch2_data_update_init+0xbdc/0x11a0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_autoremove_wake_function+0x10/0x10 | |
| Dec 12 13:41:17 scheltopusix kernel: ? bch2_move_extent+0x4ba/0xaa0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: bch2_move_extent+0x4ba/0xaa0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? bch2_dev_in_target+0x9a/0xb0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? bch2_trans_begin+0xf6/0x630 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? bch2_move_data_btree+0x424/0x570 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: bch2_move_data_btree+0x424/0x570 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_rebalance_pred+0x10/0x10 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? dpm_wait_for_superior+0xb0/0x140 | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? local_clock_noinstr+0xd/0xb0 | |
| Dec 12 13:41:17 scheltopusix kernel: ? __bch2_move_data+0xea/0x1e0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: __bch2_move_data+0xea/0x1e0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_rebalance_pred+0x10/0x10 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: do_rebalance+0x4a4/0x8f0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? local_clock_noinstr+0xd/0xb0 | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? mutex_lock+0x12/0x30 | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? __bch2_trans_get+0x341/0x390 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? mutex_lock+0x12/0x30 | |
| Dec 12 13:41:17 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_bch2_rebalance_thread+0x10/0x10 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: bch2_rebalance_thread+0x66/0xb0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? bch2_rebalance_thread+0x5c/0xb0 [bcachefs] | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 12 13:41:17 scheltopusix kernel: kthread+0xd7/0x100 | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 12 13:41:17 scheltopusix kernel: ret_from_fork+0x34/0x50 | |
| Dec 12 13:41:17 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 12 13:41:17 scheltopusix kernel: ret_from_fork_asm+0x1b/0x30 | |
| Dec 12 13:41:17 scheltopusix kernel: </TASK> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Dec 15 17:26:32 scheltopusix kernel: INFO: task bch-rebalance/f:642 blocked for more than 14008 seconds. | |
| Dec 15 17:26:32 scheltopusix kernel: Not tainted 6.7.0-rc4-bcachefs-unstable-f53b61b #1-NixOS | |
| Dec 15 17:26:32 scheltopusix kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. | |
| Dec 15 17:26:32 scheltopusix kernel: task:bch-rebalance/f state:D stack:0 pid:642 tgid:642 ppid:2 flags:0x00004000 | |
| Dec 15 17:26:32 scheltopusix kernel: Call Trace: | |
| Dec 15 17:26:32 scheltopusix kernel: <TASK> | |
| Dec 15 17:26:32 scheltopusix kernel: __schedule+0x375/0x13d0 | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: schedule+0x32/0xd0 | |
| Dec 15 17:26:32 scheltopusix kernel: __closure_sync+0x83/0x210 | |
| Dec 15 17:26:32 scheltopusix kernel: __bch2_bucket_nocow_lock+0xb7/0x120 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 15 17:26:32 scheltopusix kernel: bch2_data_update_init+0xbdc/0x11a0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_autoremove_wake_function+0x10/0x10 | |
| Dec 15 17:26:32 scheltopusix kernel: ? bch2_move_extent+0x4ba/0xaa0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: bch2_move_extent+0x4ba/0xaa0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? bch2_dev_in_target+0x9a/0xb0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? bch2_trans_begin+0x3ef/0x650 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? bch2_move_data_btree+0x424/0x570 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: bch2_move_data_btree+0x424/0x570 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_rebalance_pred+0x10/0x10 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? ZSTD_RowFindBestMatch_extDict_6_5.constprop.0+0x8f0/0x900 | |
| Dec 15 17:26:32 scheltopusix kernel: ? local_clock_noinstr+0xd/0xb0 | |
| Dec 15 17:26:32 scheltopusix kernel: ? __bch2_move_data+0xea/0x1e0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: __bch2_move_data+0xea/0x1e0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_rebalance_pred+0x10/0x10 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: do_rebalance+0x4a4/0x8f0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: ? local_clock_noinstr+0xd/0xb0 | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: ? __bch2_trans_get+0x18d/0x280 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: ? mutex_lock+0x12/0x30 | |
| Dec 15 17:26:32 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_bch2_rebalance_thread+0x10/0x10 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: bch2_rebalance_thread+0x66/0xb0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? bch2_rebalance_thread+0x5c/0xb0 [bcachefs] | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 15 17:26:32 scheltopusix kernel: kthread+0xd7/0x100 | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 15 17:26:32 scheltopusix kernel: ret_from_fork+0x34/0x50 | |
| Dec 15 17:26:32 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 15 17:26:32 scheltopusix kernel: ret_from_fork_asm+0x1b/0x30 | |
| Dec 15 17:26:32 scheltopusix kernel: </TASK> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Dec 09 01:20:57 scheltopusix kernel: INFO: task bch-rebalance/f:610 blocked for more than 2949 seconds. | |
| Dec 09 01:20:57 scheltopusix kernel: Not tainted 6.7.0-rc4 #1-NixOS | |
| Dec 09 01:20:57 scheltopusix kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. | |
| Dec 09 01:20:57 scheltopusix kernel: task:bch-rebalance/f state:D stack:0 pid:610 tgid:610 ppid:2 flags:0x00004000 | |
| Dec 09 01:20:57 scheltopusix kernel: Call Trace: | |
| Dec 09 01:20:57 scheltopusix kernel: <TASK> | |
| Dec 09 01:20:57 scheltopusix kernel: __schedule+0x375/0x13d0 | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: schedule+0x32/0xd0 | |
| Dec 09 01:20:57 scheltopusix kernel: __closure_sync+0x83/0x210 | |
| Dec 09 01:20:57 scheltopusix kernel: __bch2_bucket_nocow_lock+0xb7/0x120 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 09 01:20:57 scheltopusix kernel: bch2_data_update_init+0xbb2/0x11b0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_autoremove_wake_function+0x10/0x10 | |
| Dec 09 01:20:57 scheltopusix kernel: ? bch2_move_extent+0x4ba/0xaa0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: bch2_move_extent+0x4ba/0xaa0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? bch2_dev_in_target+0x9a/0xb0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: ? bch2_move_data_btree+0x427/0x570 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: bch2_move_data_btree+0x427/0x570 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_rebalance_pred+0x10/0x10 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? __bch2_move_data+0xea/0x1e0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: __bch2_move_data+0xea/0x1e0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_rebalance_pred+0x10/0x10 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: do_rebalance+0x40d/0x8c0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: ? local_clock_noinstr+0xd/0xb0 | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: ? __bch2_trans_get+0x1cb/0x240 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: ? mutex_lock+0x12/0x30 | |
| Dec 09 01:20:57 scheltopusix kernel: ? srso_return_thunk+0x5/0x5f | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_bch2_rebalance_thread+0x10/0x10 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: bch2_rebalance_thread+0x66/0xb0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? bch2_rebalance_thread+0x5c/0xb0 [bcachefs] | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_closure_sync_fn+0x10/0x10 | |
| Dec 09 01:20:57 scheltopusix kernel: kthread+0xd7/0x100 | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 09 01:20:57 scheltopusix kernel: ret_from_fork+0x34/0x50 | |
| Dec 09 01:20:57 scheltopusix kernel: ? __pfx_kthread+0x10/0x10 | |
| Dec 09 01:20:57 scheltopusix kernel: ret_from_fork_asm+0x1b/0x30 | |
| Dec 09 01:20:57 scheltopusix kernel: </TASK> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): mounting version 1.3: (unknown version) opts=metadata_replicas=2,data_replicas=2,foreground_target=ssd,background_target=hdd,promote_target=ssd | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): recovering from unclean shutdown | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): ja->sectors_free == ca->mi.bucket_size | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): cur_idx 0/8192 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): bucket_seq[8191] = 67619 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): bucket_seq[0] = 67620 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): bucket_seq[1] = 70441 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): ja->sectors_free == ca->mi.bucket_size | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): cur_idx 0/8192 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): bucket_seq[8191] = 67619 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): bucket_seq[0] = 67620 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): bucket_seq[1] = 70441 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): journal read done, replaying entries 5682049-5682049 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): dropped unflushed entries 5682050-5682050 | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): alloc_read... done | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): stripes_read... done | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): snapshots_read... done | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): journal_replay... | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): going read-write | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): delete_dead_snapshots... done | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): resume_logged_ops... done | |
| Dec 09 13:40:53 scheltopusix kernel: bcachefs (fea1b70c-5324-4471-94a1-cc43914003e4): delete_dead_inodes... done |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment