Skip to content

Instantly share code, notes, and snippets.

@notmyname
Created January 9, 2013 20:14
Show Gist options
  • Save notmyname/2909fa42c97e50138e3c to your computer and use it in GitHub Desktop.
Save notmyname/2909fa42c97e50138e3c to your computer and use it in GitHub Desktop.
Last login: Tue Jan 8 15:48:02 on ttys003
john@europa:~$ cd Documents/swift
john@europa:~/Documents/swift(master)$ git fetch --all
Fetching origin
Fetching github
Fetching gerrit
Fetching swiftstack
john@europa:~/Documents/swift(master)$ git st
# On branch master
nothing to commit (working directory clean)
john@europa:~/Documents/swift(master)$ git merge origin/master
Already up-to-date.
john@europa:~/Documents/swift(master)$ git st
# On branch master
nothing to commit (working directory clean)
john@europa:~/Documents/swift(master)$ rd
rsyncing /Users/john/Documents/swift to s.not.mn:swift
john@europa:~/Documents/swift(master)$ ssh s.not.mn
Linux openslice 2.6.35.4-rscloud #8 SMP Mon Sep 20 15:54:33 UTC 2010 x86_64 GNU/Linux
Ubuntu 10.04.4 LTS
Welcome to Ubuntu!
* Documentation: https://help.ubuntu.com/
0 packages can be updated.
0 updates are security updates.
Last login: Tue Jan 8 23:49:47 2013 from 75-101-56-125.dsl.static.sonic.net
john@openslice:~$ swift-init all stop
No container-updater running
No account-auditor running
No object-replicator running
Signal proxy-server pid: 30226 signal: 15
No container-replicator running
No object-auditor running
No object-expirer running
No container-auditor running
Signal container-server pid: 30227 signal: 15
Signal container-server pid: 30228 signal: 15
Signal container-server pid: 30229 signal: 15
Signal container-server pid: 30230 signal: 15
Signal account-server pid: 30231 signal: 15
Signal account-server pid: 30232 signal: 15
Signal account-server pid: 30233 signal: 15
Signal account-server pid: 30234 signal: 15
No account-reaper running
No container-sync running
No account-replicator running
No object-updater running
Signal object-server pid: 30235 signal: 15
Signal object-server pid: 30236 signal: 15
Signal object-server pid: 30237 signal: 15
Signal object-server pid: 30238 signal: 15
container-server (30227) appears to have stopped
container-server (30228) appears to have stopped
account-server (30231) appears to have stopped
object-server (30235) appears to have stopped
proxy-server (30226) appears to have stopped
container-server (30229) appears to have stopped
container-server (30230) appears to have stopped
account-server (30232) appears to have stopped
account-server (30233) appears to have stopped
account-server (30234) appears to have stopped
object-server (30236) appears to have stopped
object-server (30237) appears to have stopped
object-server (30238) appears to have stopped
john@openslice:~$ startmain
WARNING: Unable to increase file descriptor limit. Running as non-root?
Starting proxy-server...(/etc/swift/proxy-server.conf)
Starting container-server...(/etc/swift/container-server/1.conf)
Starting container-server...(/etc/swift/container-server/2.conf)
Starting container-server...(/etc/swift/container-server/3.conf)
Starting container-server...(/etc/swift/container-server/4.conf)
Starting account-server...(/etc/swift/account-server/1.conf)
Starting account-server...(/etc/swift/account-server/2.conf)
Starting account-server...(/etc/swift/account-server/3.conf)
Starting account-server...(/etc/swift/account-server/4.conf)
Starting object-server...(/etc/swift/object-server/1.conf)
Starting object-server...(/etc/swift/object-server/2.conf)
Starting object-server...(/etc/swift/object-server/3.conf)
Starting object-server...(/etc/swift/object-server/4.conf)
john@openslice:~$ ps -ef | grep object
john 5011 1 4 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf
john 5012 1 4 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/2.conf
john 5013 1 4 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/3.conf
john 5014 1 3 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/4.conf
john 5063 5012 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/2.conf
john 5068 5011 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf
john 5076 5014 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/4.conf
john 5077 5013 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/3.conf
john 5084 4989 0 20:10 pts/0 00:00:00 grep --color=auto object
john@openslice:~$ kill -9 5011 5012
john@openslice:~$ ps -ef | grep object
john 5013 1 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/3.conf
john 5014 1 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/4.conf
john 5063 1 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/2.conf
john 5068 1 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/1.conf
john 5076 5014 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/4.conf
john 5077 5013 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/3.conf
john 5086 4989 0 20:11 pts/0 00:00:00 grep --color=auto object
john@openslice:~$ kill -9 5068 5063
john@openslice:~$ ps -ef | grep object
john 5013 1 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/3.conf
john 5014 1 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/4.conf
john 5076 5014 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/4.conf
john 5077 5013 0 20:09 ? 00:00:00 /usr/bin/python /usr/local/bin/swift-object-server /etc/swift/object-server/3.conf
john 5088 4989 0 20:11 pts/0 00:00:00 grep --color=auto object
john@openslice:~$ logout
Connection to s.not.mn closed.
john@europa:~/Documents/swift(master)$ curl -i -H "X-Auth-User: testing1" -H "X-Auth-Key: testing1" http://s.not.mn:8080/auth/v1.0/
HTTP/1.1 200 OK
X-Storage-Url: http://s.not.mn:8080/v1/AUTH_abc
Content-Type: text/html; charset=UTF-8
X-Auth-Token: AUTH_tk762a473ac16e46f1bb1d1c21683e388a
X-Trans-Id: tx9996e9eedb084ef4895852718a525638
Content-Length: 0
Date: Wed, 09 Jan 2013 20:12:16 GMT
john@europa:~/Documents/swift(master)$ curl -i -XPUT --data-binary 1234 -H "X-Auth-Token: AUTH_tk762a473ac16e46f1bb1d1c21683e388a" http://s.not.mn:8080/v1/AUTH_abc/c/o2
HTTP/1.1 201 Created
Last-Modified: Wed, 09 Jan 2013 20:12:53 GMT
Content-Length: 0
Etag: 81dc9bdb52d04dc20036dbd8313ed055
Content-Type: text/html; charset=UTF-8
X-Trans-Id: txf0a6ef8e270441f68b7a734da58159a6
Date: Wed, 09 Jan 2013 20:12:53 GMT
john@europa:~/Documents/swift(master)$
john@europa:~/Documents/swift(master)$
john@europa:~/Documents/swift(master)$ curl -i -XPUT --data-binary 1234 -H "X-Auth-Token: AUTH_tk762a473ac16e46f1bb1d1c21683e388a" http://s.not.mn:8080/v1/AUTH_abc/c/o
HTTP/1.1 500 Internal Error
Content-Length: 125
Content-Type: text/html; charset=UTF-8
X-Trans-Id: txb4001805d44d411095bc9495e1cd72c0
Date: Wed, 09 Jan 2013 20:12:57 GMT
<html><h1>Internal Error</h1><p>The server has either erred or is incapable of performing the requested operation.</p></html>john@europa:~/Documents/swift(master)$
john@europa:~/Documents/swift(master)$
john@europa:~/Documents/swift(master)$ ssh s.not.mn
Linux openslice 2.6.35.4-rscloud #8 SMP Mon Sep 20 15:54:33 UTC 2010 x86_64 GNU/Linux
Ubuntu 10.04.4 LTS
Welcome to Ubuntu!
* Documentation: https://help.ubuntu.com/
0 packages can be updated.
0 updates are security updates.
Last login: Wed Jan 9 20:08:56 2013 from 75-101-56-125.dsl.static.sonic.net
john@openslice:~$ sudo grep txb4001805d44d411095bc9495e1cd72c0 /var/log/syslog
[sudo] password for john:
Jan 9 20:12:57 openslice proxy-server ERROR with Object server 127.0.0.1:6010/sdb1 re: Expect: 100-continue on /AUTH_abc/c/o: Connection refused (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server ERROR with Object server 127.0.0.1:6020/sdb2 re: Expect: 100-continue on /AUTH_abc/c/o: Connection refused (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server Handoff requested (1) (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server ERROR Unhandled exception in request: #012Traceback (most recent call last):#012 File "/home/john/swift/swift/proxy/server.py", line 240, in handle_request#012 return handler(req)#012 File "/home/john/swift/swift/common/utils.py", line 1489, in wrapped#012 return func(*a, **kw)#012 File "/home/john/swift/swift/proxy/controllers/base.py", line 86, in wrapped#012 return func(*a, **kw)#012 File "/home/john/swift/swift/proxy/controllers/obj.py", line 733, in PUT#012 conns = [conn for conn in pile if conn]#012 File "/usr/lib/pymodules/python2.6/eventlet/greenpool.py", line 218, in next#012 return self.waiters.get().wait()#012 File "/usr/lib/pymodules/python2.6/eventlet/greenthread.py", line 166, in wait#012 return self._exit_event.wait()#012 File "/usr/lib/pymodules/python2.6/eventlet/event.py", line 120, in wait#012 current.throw(*self._exc)#012 File "/usr/lib/pymodules/python2.6/eventlet/greenthread.py", line 192, in main#012 result = function(*args, **kwargs)#012 File "/home/john/swift/swift/proxy/controllers/obj.py", line 521, in _connect_put_node#012 for node in nodes:#012ValueError: generator already executing (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server 75.101.56.125 75.101.56.125 09/Jan/2013/20/12/57 PUT /v1/AUTH_abc/c/o HTTP/1.0 500 - curl/7.24.0%20%28x86_64-apple-darwin12.0%29%20libcurl/7.24.0%20OpenSSL/0.9.8r%20zlib/1.2.5 testing1%2CAUTH_tk762a473ac16e46f1bb1d1c21683e388a - 125 - txb4001805d44d411095bc9495e1cd72c0 - 0.0084 -
Jan 9 20:12:57 openslice object-server 127.0.0.1 - - [09/Jan/2013:20:12:57 +0000] "PUT /sdb4/146656/AUTH_abc/c/o" 499 - "-" "txb4001805d44d411095bc9495e1cd72c0" "curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5" 0.0048
Jan 9 20:12:57 openslice object-server 127.0.0.1 - - [09/Jan/2013:20:12:57 +0000] "PUT /sdb3/146656/AUTH_abc/c/o" 499 - "-" "txb4001805d44d411095bc9495e1cd72c0" "curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5" 0.0016
john@openslice:~$ sudo tail -50 /var/log/syslog
Jan 9 20:09:51 openslice account-server Exited
Jan 9 20:09:51 openslice object-server SIGTERM received
Jan 9 20:09:51 openslice object-server Exited
Jan 9 20:09:51 openslice object-server SIGTERM received
Jan 9 20:09:51 openslice object-server Exited
Jan 9 20:09:58 openslice container-server Started child 5050
Jan 9 20:09:58 openslice container-server Started child 5048
Jan 9 20:09:58 openslice account-server Started child 5045
Jan 9 20:09:58 openslice container-server Started child 5056
Jan 9 20:09:58 openslice account-server Started child 5057
Jan 9 20:09:58 openslice account-server Started child 5060
Jan 9 20:09:58 openslice container-server Started child 5061
Jan 9 20:09:58 openslice object-server Started child 5063
Jan 9 20:09:58 openslice object-server Started child 5068
Jan 9 20:09:58 openslice proxy-server /etc/swift/passwd changed. Reloading.
Jan 9 20:09:58 openslice object-server Started child 5076
Jan 9 20:09:58 openslice object-server Started child 5077
Jan 9 20:09:58 openslice proxy-server Started child 5078
Jan 9 20:09:58 openslice account-server Started child 5079
Jan 9 20:09:59 openslice proxy-server /etc/swift/passwd changed. Reloading.
Jan 9 20:10:01 openslice CRON[5081]: (john) CMD (swift-log-uploader /etc/swift/log-processor.conf stats)
Jan 9 20:10:01 openslice postfix/sendmail[5082]: fatal: open /etc/postfix/main.cf: No such file or directory
Jan 9 20:10:01 openslice CRON[5080]: (john) MAIL (mailed 39 bytes of output but got status 0x004b#012)
Jan 9 20:12:16 openslice proxy-server - 75.101.56.125 09/Jan/2013/20/12/16 GET /auth/v1.0/ HTTP/1.0 200 - curl/7.24.0%20%28x86_64-apple-darwin12.0%29%20libcurl/7.24.0%20OpenSSL/0.9.8r%20zlib/1.2.5 - - - - tx9996e9eedb084ef4895852718a525638 - 0.2453
Jan 9 20:12:53 openslice account-server 127.0.0.1 - - [09/Jan/2013:20:12:53 +0000] "HEAD /sdb2/211791/AUTH_abc" 204 - "txf0a6ef8e270441f68b7a734da58159a6" "-" "-" 0.0061 ""
Jan 9 20:12:53 openslice container-server 127.0.0.1 - - [09/Jan/2013:20:12:53 +0000] "HEAD /sdb3/16676/AUTH_abc/c" 204 - "txf0a6ef8e270441f68b7a734da58159a6" "-" "-" 0.0102
Jan 9 20:12:53 openslice proxy-server ERROR with Object server 127.0.0.1:6020/sdb2 re: Expect: 100-continue on /AUTH_abc/c/o2: Connection refused (txn: txf0a6ef8e270441f68b7a734da58159a6) (client_ip: 75.101.56.125)
Jan 9 20:12:53 openslice proxy-server Handoff requested (1) (txn: txf0a6ef8e270441f68b7a734da58159a6) (client_ip: 75.101.56.125)
Jan 9 20:12:53 openslice proxy-server ERROR with Object server 127.0.0.1:6010/sdb1 re: Expect: 100-continue on /AUTH_abc/c/o2: Connection refused (txn: txf0a6ef8e270441f68b7a734da58159a6) (client_ip: 75.101.56.125)
Jan 9 20:12:53 openslice container-server 127.0.0.1 - - [09/Jan/2013:20:12:53 +0000] "PUT /sdb3/16676/AUTH_abc/c/o2" 201 - "txf0a6ef8e270441f68b7a734da58159a6" "-" "-" 0.0008
Jan 9 20:12:53 openslice object-server 127.0.0.1 - - [09/Jan/2013:20:12:53 +0000] "PUT /sdb4/96545/AUTH_abc/c/o2" 201 - "-" "txf0a6ef8e270441f68b7a734da58159a6" "curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5" 0.0468
Jan 9 20:12:53 openslice container-server 127.0.0.1 - - [09/Jan/2013:20:12:53 +0000] "PUT /sdb4/16676/AUTH_abc/c/o2" 201 - "txf0a6ef8e270441f68b7a734da58159a6" "-" "-" 0.0034
Jan 9 20:12:53 openslice object-server 127.0.0.1 - - [09/Jan/2013:20:12:53 +0000] "PUT /sdb3/96545/AUTH_abc/c/o2" 201 - "-" "txf0a6ef8e270441f68b7a734da58159a6" "curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5" 0.0518
Jan 9 20:12:53 openslice proxy-server 75.101.56.125 75.101.56.125 09/Jan/2013/20/12/53 PUT /v1/AUTH_abc/c/o2 HTTP/1.0 201 - curl/7.24.0%20%28x86_64-apple-darwin12.0%29%20libcurl/7.24.0%20OpenSSL/0.9.8r%20zlib/1.2.5 testing1%2CAUTH_tk762a473ac16e46f1bb1d1c21683e388a 4 - - txf0a6ef8e270441f68b7a734da58159a6 - 0.0825 -
Jan 9 20:12:57 openslice proxy-server ERROR with Object server 127.0.0.1:6010/sdb1 re: Expect: 100-continue on /AUTH_abc/c/o: Connection refused (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server ERROR with Object server 127.0.0.1:6020/sdb2 re: Expect: 100-continue on /AUTH_abc/c/o: Connection refused (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server STDOUT: Traceback (most recent call last):
Jan 9 20:12:57 openslice proxy-server STDOUT: File "/usr/lib/pymodules/python2.6/eventlet/hubs/poll.py", line 105, in wait
Jan 9 20:12:57 openslice proxy-server STDOUT: writers.get(fileno, noop).cb(fileno)
Jan 9 20:12:57 openslice proxy-server STDOUT: File "/usr/lib/pymodules/python2.6/eventlet/greenthread.py", line 192, in main
Jan 9 20:12:57 openslice proxy-server STDOUT: result = function(*args, **kwargs)
Jan 9 20:12:57 openslice proxy-server STDOUT: File "/home/john/swift/swift/proxy/controllers/obj.py", line 521, in _connect_put_node
Jan 9 20:12:57 openslice proxy-server STDOUT: for node in nodes:
Jan 9 20:12:57 openslice proxy-server STDOUT: ValueError: generator already executing
Jan 9 20:12:57 openslice proxy-server STDOUT: Removing descriptor: 17
Jan 9 20:12:57 openslice proxy-server Handoff requested (1) (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server ERROR Unhandled exception in request: #012Traceback (most recent call last):#012 File "/home/john/swift/swift/proxy/server.py", line 240, in handle_request#012 return handler(req)#012 File "/home/john/swift/swift/common/utils.py", line 1489, in wrapped#012 return func(*a, **kw)#012 File "/home/john/swift/swift/proxy/controllers/base.py", line 86, in wrapped#012 return func(*a, **kw)#012 File "/home/john/swift/swift/proxy/controllers/obj.py", line 733, in PUT#012 conns = [conn for conn in pile if conn]#012 File "/usr/lib/pymodules/python2.6/eventlet/greenpool.py", line 218, in next#012 return self.waiters.get().wait()#012 File "/usr/lib/pymodules/python2.6/eventlet/greenthread.py", line 166, in wait#012 return self._exit_event.wait()#012 File "/usr/lib/pymodules/python2.6/eventlet/event.py", line 120, in wait#012 current.throw(*self._exc)#012 File "/usr/lib/pymodules/python2.6/eventlet/greenthread.py", line 192, in main#012 result = function(*args, **kwargs)#012 File "/home/john/swift/swift/proxy/controllers/obj.py", line 521, in _connect_put_node#012 for node in nodes:#012ValueError: generator already executing (txn: txb4001805d44d411095bc9495e1cd72c0) (client_ip: 75.101.56.125)
Jan 9 20:12:57 openslice proxy-server 75.101.56.125 75.101.56.125 09/Jan/2013/20/12/57 PUT /v1/AUTH_abc/c/o HTTP/1.0 500 - curl/7.24.0%20%28x86_64-apple-darwin12.0%29%20libcurl/7.24.0%20OpenSSL/0.9.8r%20zlib/1.2.5 testing1%2CAUTH_tk762a473ac16e46f1bb1d1c21683e388a - 125 - txb4001805d44d411095bc9495e1cd72c0 - 0.0084 -
Jan 9 20:12:57 openslice object-server 127.0.0.1 - - [09/Jan/2013:20:12:57 +0000] "PUT /sdb4/146656/AUTH_abc/c/o" 499 - "-" "txb4001805d44d411095bc9495e1cd72c0" "curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5" 0.0048
Jan 9 20:12:57 openslice object-server 127.0.0.1 - - [09/Jan/2013:20:12:57 +0000] "PUT /sdb3/146656/AUTH_abc/c/o" 499 - "-" "txb4001805d44d411095bc9495e1cd72c0" "curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5" 0.0016
john@openslice:~$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment