Skip to content

Instantly share code, notes, and snippets.

@pyh
Created June 3, 2011 18:25
Show Gist options
  • Save pyh/1006876 to your computer and use it in GitHub Desktop.
Save pyh/1006876 to your computer and use it in GitHub Desktop.
rebalance crash
May 27 08:18:46 storage1 mogilefsd[6920]: [monitor(6941)] Timeout contacting 10.1.26.130 dev 28 (http://10.1.26.130:47074/dev28/usage): took 2.00 seconds out of 2 allowed
May 27 08:19:06 storage1 mogilefsd[6943]: crash log: No answer in 4 seconds from parent to child MogileFS::Worker::Fsck=HASH(0x24cb038) [6943], dying at /usr/local/share/perl/5.10.0/MogileFS/Worker.pm line 186.
May 27 08:19:06 storage1 mogilefsd[6925]: crash log: No answer in 4 seconds from parent to child MogileFS::Worker::Replicate=HASH(0x24b8690) [6925], dying at /usr/local/share/perl/5.10.0/MogileFS/Worker.pm line 186.
May 27 08:19:06 storage1 mogilefsd[6928]: crash log: No answer in 4 seconds from parent to child MogileFS::Worker::Replicate=HASH(0x130c0c0) [6928], dying at /usr/local/share/perl/5.10.0/MogileFS/Worker.pm line 186.
May 27 08:19:06 storage1 mogilefsd[6942]: crash log: No answer in 4 seconds from parent to child MogileFS::Worker::JobMaster=HASH(0x24cae88) [6942], dying at /usr/local/share/perl/5.10.0/MogileFS/Worker.pm line 186.
May 27 08:19:07 storage1 mogilefsd[6920]: Child 6925 (replicate) died: 256 (UNEXPECTED)
May 27 08:19:07 storage1 mogilefsd[6920]: Child 6928 (replicate) died: 256 (UNEXPECTED)
May 27 08:19:07 storage1 mogilefsd[6920]: Child 6942 (job_master) died: 256 (UNEXPECTED)
May 27 08:19:07 storage1 mogilefsd[6920]: Child 6943 (fsck) died: 256 (UNEXPECTED)
May 27 08:19:07 storage1 mogilefsd[6920]: Job replicate has only 3, wants 5, making 2.
May 27 08:19:07 storage1 mogilefsd[6920]: Job job_master has only 0, wants 1, making 1.
May 27 08:19:07 storage1 mogilefsd[6920]: Job fsck has only 0, wants 1, making 1.
May 27 08:19:07 storage1 mogilefsd[9728]: crash log: rebalance cannot find suitable destination devices at /usr/local/share/perl/5.10.0/MogileFS/Worker/JobMaster.pm line 232
May 27 08:19:07 storage1 mogilefsd[6927]: crash log: No answer in 4 seconds from parent to child MogileFS::Worker::Replicate=HASH(0x24b8798) [6927], dying at /usr/local/share/perl/5.10.0/MogileFS/Worker.pm line 186.
May 27 08:19:08 storage1 mogilefsd[6920]: Child 6927 (replicate) died: 256 (UNEXPECTED)
May 27 08:19:08 storage1 mogilefsd[6920]: Child 9728 (job_master) died: 256 (UNEXPECTED)
May 27 08:19:08 storage1 mogilefsd[6920]: Job replicate has only 4, wants 5, making 1.
May 27 08:19:08 storage1 mogilefsd[6920]: Job job_master has only 0, wants 1, making 1.
May 27 08:19:08 storage1 mogilefsd[9732]: crash log: rebalance cannot find suitable destination devices at /usr/local/share/perl/5.10.0/MogileFS/Worker/JobMaster.pm line 232
May 27 08:19:09 storage1 mogilefsd[6920]: Child 9732 (job_master) died: 256 (UNEXPECTED)
May 27 08:19:09 storage1 mogilefsd[6920]: Job job_master has only 0, wants 1, making 1.
May 27 08:19:09 storage1 mogilefsd[9733]: crash log: rebalance cannot find suitable destination devices at /usr/local/share/perl/5.10.0/MogileFS/Worker/JobMaster.pm line 232
May 27 08:19:10 storage1 mogilefsd[6920]: Child 9733 (job_master) died: 256 (UNEXPECTED)
May 27 08:19:10 storage1 mogilefsd[6920]: Job job_master has only 0, wants 1, making 1.
May 27 08:19:10 storage1 mogilefsd[9734]: crash log: rebalance cannot find suitable destination devices at /usr/local/share/perl/5.10.0/MogileFS/Worker/JobMaster.pm line 232
May 27 08:19:11 storage1 mogilefsd[6920]: Child 9734 (job_master) died: 256 (UNEXPECTED)
May 27 08:19:11 storage1 mogilefsd[6920]: Job job_master has only 0, wants 1, making 1.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment