Skip to content

Instantly share code, notes, and snippets.

@noelbk
Created February 19, 2014 20:16
Show Gist options
  • Save noelbk/9100616 to your computer and use it in GitHub Desktop.
Save noelbk/9100616 to your computer and use it in GitHub Desktop.
[root@boot-172-19-0-2 ~]# less /var/log/cmessages
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.609] 873/MainThread savage.BarrierInitAgent[mkcephfs]/ERROR: exception while inside double barr
ier
Traceback (most recent call last):
File "/usr/lib64/python2.7/site-packages/savage/medic/one_time_agent.py", line 134, in run
File "/usr/lib64/python2.7/site-packages/savage/command/commands/ceph.py", line 993, in master_task
File "/usr/lib64/python2.7/site-packages/savage/command/utils/ssh.py", line 21, in connect
File "/usr/lib64/python2.7/site-packages/savage/command/utils/ssh.py", line 84, in __init__
File "/usr/lib64/python2.7/site-packages/savage/command/utils/ssh.py", line 92, in connect
File "/usr/lib64/python2.7/site-packages/savage/utils/retry_manager.py", line 131, in retry_command
File "/usr/lib64/python2.7/site-packages/paramiko/client.py", line 337, in connect
File "/usr/lib64/python2.7/site-packages/paramiko/client.py", line 528, in _auth
AuthenticationException: Authentication failed.
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.610] 873/MainThread savage.BarrierInitAgent[mkcephfs]/INFO: Leaving Barrier
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.610] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Sending request(xid=16): Delete(pa
th=u'/piston/onetimeagents/mkcephfs/barrier/ready', version=-1)
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.610] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Received response(xid=16): True
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.610] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Sending request(xid=17): GetChildr
en(path=u'/piston/onetimeagents/mkcephfs/barrier', watcher=None)
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.611] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Received response(xid=17): [u'48ca
060b3ad04e9cba9371e4515e65a7']
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.611] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Sending request(xid=18): Delete(pa
th=u'/piston/onetimeagents/mkcephfs/barrier/48ca060b3ad04e9cba9371e4515e65a7', version=-1)
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.611] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Received response(xid=18): True
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.612] 873/MainThread savage.BarrierInitAgent[mkcephfs]/INFO: Left Barrier
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.612] 873/MainThread savage.BarrierInitAgent[mkcephfs]/ERROR: exception while leaving critical s
ection
Traceback (most recent call last):
File "/usr/lib64/python2.7/site-packages/savage/medic/one_time_agent.py", line 134, in run
File "/usr/lib64/python2.7/site-packages/savage/command/commands/ceph.py", line 993, in master_task
File "/usr/lib64/python2.7/site-packages/savage/command/utils/ssh.py", line 21, in connect
File "/usr/lib64/python2.7/site-packages/savage/command/utils/ssh.py", line 84, in __init__
File "/usr/lib64/python2.7/site-packages/savage/command/utils/ssh.py", line 92, in connect
File "/usr/lib64/python2.7/site-packages/savage/utils/retry_manager.py", line 131, in retry_command
File "/usr/lib64/python2.7/site-packages/paramiko/client.py", line 337, in connect
File "/usr/lib64/python2.7/site-packages/paramiko/client.py", line 528, in _auth
AuthenticationException: Authentication failed.
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.612] 873/MainThread savage.BarrierInitAgent[mkcephfs]/INFO: Stopping Zookeeper Connection
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.612] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Sending request(xid=19): Close()
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.613] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Closing connection to 172.19.0.13:
2181
Feb 19 20:03:58 172.19.0.13 [2014-02-19 20:03:58.613] 873/Thread-7544 savage.BarrierInitAgent[mkcephfs]/INFO: Zookeeper session lost, state: CLO
SED
Feb 19 20:03:58 172.19.0.2 [2014-02-19 20:03:58.949] 591/MainThread savage.WSGI-API/INFO: 127.0.0.1 "GET /private/cluster-info HTTP/1.1" 200 300
7
Feb 19 20:03:58 172.19.0.2 [2014-02-19 20:03:58.957] 591/MainThread savage.WSGI-API/INFO: 127.0.0.1 "GET /private/cluster-info HTTP/1.1" 200 300
7
Feb 19 20:03:59 172.19.0.13 [2014-02-19 20:03:59.614] 873/MainThread savage.BarrierInitAgent[mkcephfs]/INFO: Before ZK Connection
Feb 19 20:03:59 172.19.0.13 [2014-02-19 20:03:59.616] 873/Thread-7548 savage.BarrierInitAgent[mkcephfs]/INFO: Connecting to 172.19.0.13:2181
Feb 19 20:03:59 172.19.0.13 [2014-02-19 20:03:59.617] 873/Thread-7548 savage.BarrierInitAgent[mkcephfs]/INFO: Sending request(xid=None): Connect
(protocol_version=0, last_zxid_seen=0, time_out=5000, session_id=0, passwd='\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', r
ead_only=None)
Feb 19 20:03:59 172.19.0.13 [2014-02-19 20:03:59.618] 873/Thread-7548 savage.BarrierInitAgent[mkcephfs]/INFO: Zookeeper connection established,
state: CONNECTED
Feb 19 20:03:59 172.19.0.13 [2014-02-19 20:03:59.618] 873/Thread-7548 savage.BarrierInitAgent[mkcephfs]/INFO: Sending request(xid=1): Exists(pat
h=u'/piston', watcher=None)
Feb 19 20:03:59 172.19.0.13 [2014-02-19 20:03:59.619] 873/Thread-7548 savage.BarrierInitAgent[mkcephfs]/INFO: Received response(xid=1): ZnodeSta
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment