Skip to content

Instantly share code, notes, and snippets.

@scottburton11
Created March 10, 2012 22:12
Show Gist options
  • Save scottburton11/2013555 to your computer and use it in GitHub Desktop.
Save scottburton11/2013555 to your computer and use it in GitHub Desktop.
mongo slave replication failure
Sat Mar 10 22:11:06 [replslave] local.me Assertion failure fileNo != -1 db/rec.h 126
0x534a81 0x54163f 0x720b18 0x7290c1 0x72f52f 0x61f447 0x622b6c 0x6f8177 0x651c99 0x6530a6 0x65e1a0 0x65e6a8 0x65ee11 0x65f59a 0x83a4b0 0x7f9977e74971 0x7f997743192d
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xb1) [0x534a81]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo8assertedEPKcS1_j+0x10f) [0x54163f]
/opt/mongodb-1.6.5/bin/mongod() [0x720b18]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x1051) [0x7290c1]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x5f) [0x72f52f]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugEPNS_11RemoveSaverE+0xb77) [0x61f447]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugE+0x11c) [0x622b6c]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo7Helpers12putSingletonEPKcNS_7BSONObjE+0x107) [0x6f8177]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo13replHandshakeEPNS_18DBClientConnectionE+0x269) [0x651c99]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11OplogReader7connectESs+0x166) [0x6530a6]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo10ReplSource4syncERi+0x290) [0x65e1a0]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo9_replMainERSt6vectorIN5boost10shared_ptrINS_10ReplSourceEEESaIS4_EERi+0x218) [0x65e6a8]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo8replMainEv+0xd1) [0x65ee11]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo15replSlaveThreadEv+0x21a) [0x65f59a]
/opt/mongodb-1.6.5/bin/mongod(thread_proxy+0x80) [0x83a4b0]
/lib/libpthread.so.0(+0x7971) [0x7f9977e74971]
/lib/libc.so.6(clone+0x6d) [0x7f997743192d]
Sat Mar 10 22:11:06 [replslave] local.me Assertion failure fileNo != -1 db/rec.h 126
0x534a81 0x54163f 0x72228c 0x729c5e 0x72f52f 0x61f447 0x622b6c 0x6f8177 0x651c99 0x6530a6 0x65e1a0 0x65e6a8 0x65ee11 0x65f59a 0x83a4b0 0x7f9977e74971 0x7f997743192d
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xb1) [0x534a81]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo8assertedEPKcS1_j+0x10f) [0x54163f]
/opt/mongodb-1.6.5/bin/mongod() [0x72228c]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x1bee) [0x729c5e]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x5f) [0x72f52f]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugEPNS_11RemoveSaverE+0xb77) [0x61f447]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugE+0x11c) [0x622b6c]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo7Helpers12putSingletonEPKcNS_7BSONObjE+0x107) [0x6f8177]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo13replHandshakeEPNS_18DBClientConnectionE+0x269) [0x651c99]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11OplogReader7connectESs+0x166) [0x6530a6]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo10ReplSource4syncERi+0x290) [0x65e1a0]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo9_replMainERSt6vectorIN5boost10shared_ptrINS_10ReplSourceEEESaIS4_EERi+0x218) [0x65e6a8]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo8replMainEv+0xd1) [0x65ee11]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo15replSlaveThreadEv+0x21a) [0x65f59a]
/opt/mongodb-1.6.5/bin/mongod(thread_proxy+0x80) [0x83a4b0]
/lib/libpthread.so.0(+0x7971) [0x7f9977e74971]
/lib/libc.so.6(clone+0x6d) [0x7f997743192d]
Sat Mar 10 22:11:06 [replslave] local.me Assertion failure: _unindex failed local.me.$_id_
Sat Mar 10 22:11:06 [replslave] Assertion failure: _unindex failed: assertion db/rec.h:126
obj:{ _id: ObjectId('4f5bd17a42c8ce50bee06c50') }
key:{ : ObjectId('4f5bd17a42c8ce50bee06c50') }
dl:0:248b0
0x534a81 0x722785 0x729c5e 0x72f52f 0x61f447 0x622b6c 0x6f8177 0x651c99 0x6530a6 0x65e1a0 0x65e6a8 0x65ee11 0x65f59a 0x83a4b0 0x7f9977e74971 0x7f997743192d
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo12sayDbContextEPKc+0xb1) [0x534a81]
/opt/mongodb-1.6.5/bin/mongod() [0x722785]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0x1bee) [0x729c5e]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x5f) [0x72f52f]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugEPNS_11RemoveSaverE+0xb77) [0x61f447]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES2_bbbRNS_7OpDebugE+0x11c) [0x622b6c]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo7Helpers12putSingletonEPKcNS_7BSONObjE+0x107) [0x6f8177]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo13replHandshakeEPNS_18DBClientConnectionE+0x269) [0x651c99]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo11OplogReader7connectESs+0x166) [0x6530a6]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo10ReplSource4syncERi+0x290) [0x65e1a0]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo9_replMainERSt6vectorIN5boost10shared_ptrINS_10ReplSourceEEESaIS4_EERi+0x218) [0x65e6a8]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo8replMainEv+0xd1) [0x65ee11]
/opt/mongodb-1.6.5/bin/mongod(_ZN5mongo15replSlaveThreadEv+0x21a) [0x65f59a]
/opt/mongodb-1.6.5/bin/mongod(thread_proxy+0x80) [0x83a4b0]
/lib/libpthread.so.0(+0x7971) [0x7f9977e74971]
/lib/libc.so.6(clone+0x6d) [0x7f997743192d]
Sat Mar 10 22:11:06 [replslave] replMain AssertionException assertion db/rec.h:126
Sat Mar 10 22:11:06 [replslave] repl: sleep 60sec before next pass
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment