Skip to content

Instantly share code, notes, and snippets.

@yookore

yookore/gist:25b8270683368f08f3f9

Created July 25, 2015 07:28
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save yookore/25b8270683368f08f3f9 to your computer and use it in GitHub Desktop.
Save yookore/25b8270683368f08f3f9 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
Jul 24 21:50:43 swiftfs1 container-replicator: no_change:12 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:50:43 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:50:43 +0000] "HEAD /d3/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "txdff88d2b30d6462d9198c-0055b29713" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:50:43 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:50:43 +0000] "HEAD /d1/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "txdff88d2b30d6462d9198c-0055b29713" "proxy-server 13447" 0.0003 "-" 13509 -
Jul 24 21:50:43 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:50:43 +0000] "HEAD /d2/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "txdff88d2b30d6462d9198c-0055b29713" "proxy-server 13447" 0.0002 "-" 13509 -
Jul 24 21:50:43 swiftfs1 swift: - - 24/Jul/2015/19/50/43 GET /v1/.misplaced_objects/1437764400%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 70 - txdff88d2b30d6462d9198c-0055b29713 - 0.0071 - - 1437767443.578778982 1437767443.585912943 -
Jul 24 21:50:43 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:50:43 +0000] "GET /d2/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "txb79e0b5077f44208930f4-0055b29713" "proxy-server 13447" 0.0003 "-" 13509 -
Jul 24 21:50:43 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:50:43 +0000] "GET /d1/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "txb79e0b5077f44208930f4-0055b29713" "proxy-server 13447" 0.0004 "-" 13510 -
Jul 24 21:50:43 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:50:43 +0000] "GET /d3/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "txb79e0b5077f44208930f4-0055b29713" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:50:43 swiftfs1 swift: - - 24/Jul/2015/19/50/43 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Container%20Reconciler - - - - txb79e0b5077f44208930f4-0055b29713 - 0.0057 - - 1437767443.586435080 1437767443.592086077 -
Jul 24 21:50:43 swiftfs1 container-reconciler: Reconciler Stats: {}
Jul 24 21:50:43 swiftfs1 container-reconciler: sleeping between intervals (30s)
Jul 24 21:50:55 swiftfs1 proxy-server: ERROR with Object server 10.10.10.215:6000/d3 re: Trying to get final status of PUT to /v1/yookore/media/videos/video1.mp4: Timeout (10s)
Jul 24 21:50:55 swiftfs1 proxy-server: ERROR with Object server 10.10.10.215:6000/d1 re: Trying to get final status of PUT to /v1/yookore/media/videos/video1.mp4: Timeout (10s)
Jul 24 21:50:55 swiftfs1 proxy-server: ERROR with Object server 10.10.10.215:6000/d2 re: Trying to get final status of PUT to /v1/yookore/media/videos/video1.mp4: Timeout (10s)
Jul 24 21:50:55 swiftfs1 proxy-server: Object PUT returning 503 for [503, 503, 503] (txn: tx22b6f3ba72074570a21d6-0055b296f7) (client_ip: 192.168.2.29)
Jul 24 21:50:55 swiftfs1 proxy-server: 192.168.2.29 192.168.2.29 24/Jul/2015/19/50/55 PUT /v1/yookore/media/videos/video1.mp4 HTTP/1.0 503 - python-swiftclient-2.5.0 tk6c16ededba4444... 340893696 118 - tx22b6f3ba72074570a21d6-0055b296f7 - 39.2914 - - 1437767415.855555058 1437767455.146982908 1
Jul 24 21:51:00 swiftfs1 object-reconstructor: Starting object reconstruction pass.
Jul 24 21:51:00 swiftfs1 object-reconstructor: Nothing reconstructed for 0.00102186203003 seconds.
Jul 24 21:51:00 swiftfs1 object-reconstructor: Object reconstruction complete. (0.00 minutes)
Jul 24 21:51:00 swiftfs1 object-replicator: Starting object replication pass.
Jul 24 21:51:02 swiftfs1 account-replicator: Beginning replication run
Jul 24 21:51:02 swiftfs1 account-replicator: Replication run OVER
Jul 24 21:51:02 swiftfs1 account-replicator: Attempted to replicate 3 dbs in 0.02755 seconds (108.90862/s)
Jul 24 21:51:02 swiftfs1 account-replicator: Removed 0 dbs
Jul 24 21:51:02 swiftfs1 account-replicator: 6 successes, 0 failures
Jul 24 21:51:06 swiftfs1 proxy-server: ERROR with Object server 10.10.10.215:6000/d2 re: Expect: 100-continue on /yookore/media/videos/video1.mp4: Timeout (10s) (txn: tx1675936079f74111b2f88-0055b29720) (client_ip: 192.168.2.29)
Jul 24 21:51:16 swiftfs1 object-auditor: Begin object audit "forever" mode (ZBF)
Jul 24 21:51:16 swiftfs1 container-replicator: Beginning replication run
Jul 24 21:51:16 swiftfs1 object-auditor: Object audit (ZBF). Since Fri Jul 24 19:51:16 2015: Locally: 1 passed, 0 quarantined, 0 errors files/sec: 1075.46 , bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00
Jul 24 21:51:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:16 +0000] "HEAD /d2/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx05e0d493ae8345ccaedcc-0055b29734" "proxy-server 13447" 0.0004 "-" 13510 -
Jul 24 21:51:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:16 +0000] "HEAD /d3/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx05e0d493ae8345ccaedcc-0055b29734" "proxy-server 13447" 0.0003 "-" 13509 -
Jul 24 21:51:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:16 +0000] "HEAD /d1/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx05e0d493ae8345ccaedcc-0055b29734" "proxy-server 13447" 0.0002 "-" 13509 -
Jul 24 21:51:16 swiftfs1 swift: - - 24/Jul/2015/19/51/16 GET /v1/.misplaced_objects/1437764400%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 70 - tx05e0d493ae8345ccaedcc-0055b29734 - 0.0077 - - 1437767476.811916113 1437767476.819643974 -
Jul 24 21:51:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:16 +0000] "GET /d1/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx2b2c1b23d7f048afa1c37-0055b29734" "proxy-server 13447" 0.0003 "-" 13509 -
Jul 24 21:51:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:16 +0000] "GET /d2/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx2b2c1b23d7f048afa1c37-0055b29734" "proxy-server 13447" 0.0004 "-" 13510 -
Jul 24 21:51:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:16 +0000] "GET /d3/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx2b2c1b23d7f048afa1c37-0055b29734" "proxy-server 13447" 0.0004 "-" 13510 -
Jul 24 21:51:16 swiftfs1 swift: - - 24/Jul/2015/19/51/16 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Container%20Reconciler - - - - tx2b2c1b23d7f048afa1c37-0055b29734 - 0.0084 - - 1437767476.820374012 1437767476.828811884 -
Jul 24 21:51:16 swiftfs1 container-reconciler: Reconciler Stats: {}
Jul 24 21:51:16 swiftfs1 container-reconciler: sleeping between intervals (30s)
Jul 24 21:51:16 swiftfs1 container-replicator: Replication run OVER
Jul 24 21:51:16 swiftfs1 container-replicator: Attempted to replicate 6 dbs in 0.06994 seconds (85.79022/s)
Jul 24 21:51:16 swiftfs1 container-replicator: Removed 0 dbs
Jul 24 21:51:16 swiftfs1 container-replicator: 12 successes, 0 failures
Jul 24 21:51:19 swiftfs1 object-auditor: Object audit (ALL). Since Fri Jul 24 19:50:38 2015: Locally: 1 passed, 0 quarantined, 0 errors files/sec: 0.02 , bytes/sec: 5084.77, Total time: 41.08, Auditing time: 0.00, Rate: 0.00
Jul 24 21:51:20 swiftfs1 account-replicator: no_change:6 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:51:20 swiftfs1 container-replicator: no_change:12 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:51:20 swiftfs1 object-auditor: Object audit (ZBF) "forever" mode completed: 3.78s. Total quarantined: 0, Total errors: 0, Total files/sec: 4.76, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.00
Jul 24 21:51:20 swiftfs1 object-server: ERROR __call__ error with PUT /d2/235379/yookore/media/videos/video1.mp4 : #012Traceback (most recent call last):#012 File "/usr/local/lib/python2.7/dist-packages/swift/obj/server.py", line 908, in __call__#012 res = method(req)#012 File "/usr/local/lib/python2.7/dist-packages/swift/common/utils.py", line 2667, in wrapped#012 return func(*a, **kw)#012 File "/usr/local/lib/python2.7/dist-packages/swift/common/utils.py", line 1207, in _timing_stats#012 resp = func(ctrl, *args, **kwargs)#012 File "/usr/local/lib/python2.7/dist-packages/swift/obj/server.py", line 584, in PUT#012 for chunk in iter(timeout_reader, ''):#012 File "/usr/local/lib/python2.7/dist-packages/swift/obj/server.py", line 370, in timeout_reader#012 return file_like.read(self.network_chunk_size)#012 File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 188, in read#012 return self._chunked_read(self.rfile, length)#012 File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 178, in _chunked_read#012 self.chunk_length = int(rfile.readline().split(b";", 1)[0], 16)#012ValueError: invalid literal for int() with base 16: '' (txn: tx1675936079f74111b2f88-0055b29720)
Jul 24 21:51:20 swiftfs1 object-server: 10.10.10.215 - - [24/Jul/2015:19:51:20 +0000] "PUT /d2/235379/yookore/media/videos/video1.mp4" 500 1020 "PUT http://10.10.10.215:8080/v1/yookore/media/videos/video1.mp4" "tx1675936079f74111b2f88-0055b29720" "proxy-server 13511" 24.4734 "-" 13507 1
Jul 24 21:51:23 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:23 +0000] "HEAD /d3/53290/.expiring_objects" 404 - "HEAD http://localhost/v1/.expiring_objects" "tx871cc0b4b7e947de8ffa1-0055b2973b" "proxy-server 13438" 0.0003 "-" 13510 -
Jul 24 21:51:23 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:23 +0000] "HEAD /d2/53290/.expiring_objects" 404 - "HEAD http://localhost/v1/.expiring_objects" "tx871cc0b4b7e947de8ffa1-0055b2973b" "proxy-server 13438" 0.0005 "-" 13509 -
Jul 24 21:51:23 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:23 +0000] "HEAD /d1/53290/.expiring_objects" 404 - "HEAD http://localhost/v1/.expiring_objects" "tx871cc0b4b7e947de8ffa1-0055b2973b" "proxy-server 13438" 0.0002 "-" 13510 -
Jul 24 21:51:23 swiftfs1 swift: - - 24/Jul/2015/19/51/23 HEAD /v1/.expiring_objects HTTP/1.0 404 - Swift%20Object%20Expirer - - - - tx871cc0b4b7e947de8ffa1-0055b2973b - 0.0086 - - 1437767483.565023899 1437767483.573631048 -
Jul 24 21:51:23 swiftfs1 object-expirer: Pass beginning; 0 possible containers; 0 possible objects
Jul 24 21:51:23 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:23 +0000] "GET /d1/53290/.expiring_objects" 404 - "GET http://localhost/v1/.expiring_objects?format=json&marker=&end_marker=" "tx1b22409458c740bfaa3b3-0055b2973b" "proxy-server 13438" 0.0003 "-" 13510 -
Jul 24 21:51:23 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:23 +0000] "GET /d3/53290/.expiring_objects" 404 - "GET http://localhost/v1/.expiring_objects?format=json&marker=&end_marker=" "tx1b22409458c740bfaa3b3-0055b2973b" "proxy-server 13438" 0.0003 "-" 13510 -
Jul 24 21:51:23 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:23 +0000] "GET /d2/53290/.expiring_objects" 404 - "GET http://localhost/v1/.expiring_objects?format=json&marker=&end_marker=" "tx1b22409458c740bfaa3b3-0055b2973b" "proxy-server 13438" 0.0004 "-" 13509 -
Jul 24 21:51:23 swiftfs1 swift: - - 24/Jul/2015/19/51/23 GET /v1/.expiring_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Object%20Expirer - - - - tx1b22409458c740bfaa3b3-0055b2973b - 0.0081 - - 1437767483.574314117 1437767483.582459927 -
Jul 24 21:51:23 swiftfs1 object-expirer: Pass completed in 0s; 0 objects expired
Jul 24 21:51:32 swiftfs1 account-replicator: Beginning replication run
Jul 24 21:51:32 swiftfs1 account-replicator: Replication run OVER
Jul 24 21:51:32 swiftfs1 account-replicator: Attempted to replicate 3 dbs in 0.02287 seconds (131.17117/s)
Jul 24 21:51:32 swiftfs1 account-replicator: Removed 0 dbs
Jul 24 21:51:32 swiftfs1 account-replicator: 6 successes, 0 failures
Jul 24 21:51:32 swiftfs1 account-replicator: no_change:6 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:51:46 swiftfs1 container-replicator: Beginning replication run
Jul 24 21:51:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:46 +0000] "HEAD /d3/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx8fce7eba0471402a8d815-0055b29752" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:51:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:46 +0000] "HEAD /d1/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx8fce7eba0471402a8d815-0055b29752" "proxy-server 13447" 0.0003 "-" 13509 -
Jul 24 21:51:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:46 +0000] "HEAD /d2/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx8fce7eba0471402a8d815-0055b29752" "proxy-server 13447" 0.0002 "-" 13509 -
Jul 24 21:51:46 swiftfs1 swift: - - 24/Jul/2015/19/51/46 GET /v1/.misplaced_objects/1437764400%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 70 - tx8fce7eba0471402a8d815-0055b29752 - 0.0072 - - 1437767506.860208988 1437767506.867379904 -
Jul 24 21:51:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:46 +0000] "GET /d3/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx27a398c943a2489380941-0055b29752" "proxy-server 13447" 0.0003 "-" 13509 -
Jul 24 21:51:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:46 +0000] "GET /d2/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx27a398c943a2489380941-0055b29752" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:51:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:46 +0000] "GET /d1/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx27a398c943a2489380941-0055b29752" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:51:46 swiftfs1 swift: - - 24/Jul/2015/19/51/46 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Container%20Reconciler - - - - tx27a398c943a2489380941-0055b29752 - 0.0054 - - 1437767506.867944956 1437767506.873352051 -
Jul 24 21:51:46 swiftfs1 container-reconciler: Reconciler Stats: {}
Jul 24 21:51:46 swiftfs1 container-reconciler: sleeping between intervals (30s)
Jul 24 21:51:46 swiftfs1 container-replicator: Replication run OVER
Jul 24 21:51:46 swiftfs1 container-replicator: Attempted to replicate 6 dbs in 0.05048 seconds (118.86123/s)
Jul 24 21:51:46 swiftfs1 container-replicator: Removed 0 dbs
Jul 24 21:51:46 swiftfs1 container-replicator: 12 successes, 0 failures
Jul 24 21:51:46 swiftfs1 container-replicator: no_change:12 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:51:50 swiftfs1 object-reconstructor: Starting object reconstruction pass.
Jul 24 21:51:50 swiftfs1 object-reconstructor: Nothing reconstructed for 0.000534057617188 seconds.
Jul 24 21:51:50 swiftfs1 object-reconstructor: Object reconstruction complete. (0.00 minutes)
Jul 24 21:51:50 swiftfs1 object-auditor: Begin object audit "forever" mode (ZBF)
Jul 24 21:51:50 swiftfs1 object-auditor: Object audit (ZBF). Since Fri Jul 24 19:51:50 2015: Locally: 1 passed, 0 quarantined, 0 errors files/sec: 996.98 , bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00
Jul 24 21:51:54 swiftfs1 proxy-server: ERROR with Object server 10.10.10.215:6000/d1 re: Trying to get final status of PUT to /v1/yookore/media/videos/video1.mp4: Timeout (10s)
Jul 24 21:51:54 swiftfs1 proxy-server: ERROR with Object server 10.10.10.215:6000/d3 re: Trying to get final status of PUT to /v1/yookore/media/videos/video1.mp4: Timeout (10s)
Jul 24 21:51:54 swiftfs1 proxy-server: Object PUT returning 503 for [503, 503, 503] (txn: tx1675936079f74111b2f88-0055b29720) (client_ip: 192.168.2.29)
Jul 24 21:51:54 swiftfs1 proxy-server: 192.168.2.29 192.168.2.29 24/Jul/2015/19/51/54 PUT /v1/yookore/media/videos/video1.mp4 HTTP/1.0 503 - python-swiftclient-2.5.0 tk6c16ededba4444... 340893696 118 - tx1675936079f74111b2f88-0055b29720 - 58.7391 - - 1437767456.156734943 1437767514.895864964 1
Jul 24 21:51:56 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:51:56 +0000] "HEAD /d2/252371/yookore" 204 - "HEAD http://10.10.10.215:8080/v1/yookore" "txfb0430aa84844752b0572-0055b2975c" "proxy-server 13511" 0.0021 "-" 13509 -
Jul 24 21:51:56 swiftfs1 proxy-server: - - 24/Jul/2015/19/51/56 HEAD /v1/yookore HTTP/1.0 204 - Swift - - - - txfb0430aa84844752b0572-0055b2975c - 0.0055 RL - 1437767516.909276962 1437767516.914804935 -
Jul 24 21:51:56 swiftfs1 container-server: 10.10.10.215 - - [24/Jul/2015:19:51:56 +0000] "HEAD /d2/20303/yookore/media" 204 - "HEAD http://10.10.10.215:8080/v1/yookore/media" "txfb0430aa84844752b0572-0055b2975c" "proxy-server 13511" 0.0019 "-" 13505 1
Jul 24 21:51:56 swiftfs1 proxy-server: - - 24/Jul/2015/19/51/56 HEAD /v1/yookore/media HTTP/1.0 204 - Swift - - - - txfb0430aa84844752b0572-0055b2975c - 0.0061 RL - 1437767516.915786028 1437767516.921855927 1
Jul 24 21:52:02 swiftfs1 account-replicator: Beginning replication run
Jul 24 21:52:02 swiftfs1 account-replicator: Replication run OVER
Jul 24 21:52:02 swiftfs1 account-replicator: Attempted to replicate 3 dbs in 0.02560 seconds (117.20034/s)
Jul 24 21:52:02 swiftfs1 account-replicator: Removed 0 dbs
Jul 24 21:52:02 swiftfs1 account-replicator: 6 successes, 0 failures
Jul 24 21:52:03 swiftfs1 account-replicator: no_change:6 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:52:03 swiftfs1 container-server: 10.10.10.215 - - [24/Jul/2015:19:52:03 +0000] "PUT /d3/20303/yookore/media/videos/video1.mp4" 201 - "PUT http://10.10.10.215:8080/d2/235379/yookore/media/videos/video1.mp4" "tx22b6f3ba72074570a21d6-0055b296f7" "object-server 13508" 0.0005 "-" 13506 1
Jul 24 21:52:03 swiftfs1 object-server: 10.10.10.215 - - [24/Jul/2015:19:52:03 +0000] "PUT /d2/235379/yookore/media/videos/video1.mp4" 201 - "PUT http://10.10.10.215:8080/v1/yookore/media/videos/video1.mp4" "tx22b6f3ba72074570a21d6-0055b296f7" "proxy-server 13511" 107.7004 "-" 13508 1
Jul 24 21:52:03 swiftfs1 object-auditor: Object audit (ZBF) "forever" mode completed: 13.15s. Total quarantined: 0, Total errors: 0, Total files/sec: 1.37, Total bytes/sec: 0.00, Auditing time: 0.32, Rate: 0.02
Jul 24 21:52:16 swiftfs1 container-replicator: Beginning replication run
Jul 24 21:52:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:16 +0000] "HEAD /d3/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "txfc3c114fa9824b09a027e-0055b29770" "proxy-server 13447" 0.0006 "-" 13509 -
Jul 24 21:52:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:16 +0000] "HEAD /d2/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "txfc3c114fa9824b09a027e-0055b29770" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:16 +0000] "HEAD /d1/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "txfc3c114fa9824b09a027e-0055b29770" "proxy-server 13447" 0.0002 "-" 13510 -
Jul 24 21:52:16 swiftfs1 swift: - - 24/Jul/2015/19/52/16 GET /v1/.misplaced_objects/1437764400%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 70 - txfc3c114fa9824b09a027e-0055b29770 - 0.0092 - - 1437767536.904253006 1437767536.913472891 -
Jul 24 21:52:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:16 +0000] "GET /d1/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx754ad366749949a4bd8f4-0055b29770" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:16 +0000] "GET /d3/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx754ad366749949a4bd8f4-0055b29770" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:16 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:16 +0000] "GET /d2/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx754ad366749949a4bd8f4-0055b29770" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:16 swiftfs1 swift: - - 24/Jul/2015/19/52/16 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Container%20Reconciler - - - - tx754ad366749949a4bd8f4-0055b29770 - 0.0053 - - 1437767536.913995028 1437767536.919279099 -
Jul 24 21:52:16 swiftfs1 container-reconciler: Reconciler Stats: {}
Jul 24 21:52:16 swiftfs1 container-reconciler: sleeping between intervals (30s)
Jul 24 21:52:20 swiftfs1 object-reconstructor: Starting object reconstruction pass.
Jul 24 21:52:20 swiftfs1 object-reconstructor: Nothing reconstructed for 0.000813007354736 seconds.
Jul 24 21:52:20 swiftfs1 object-reconstructor: Object reconstruction complete. (0.00 minutes)
Jul 24 21:52:32 swiftfs1 account-replicator: Beginning replication run
Jul 24 21:52:32 swiftfs1 account-replicator: Replication run OVER
Jul 24 21:52:32 swiftfs1 account-replicator: Attempted to replicate 3 dbs in 0.02201 seconds (136.29461/s)
Jul 24 21:52:32 swiftfs1 account-replicator: Removed 0 dbs
Jul 24 21:52:32 swiftfs1 account-replicator: 6 successes, 0 failures
Jul 24 21:52:32 swiftfs1 account-replicator: no_change:6 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:52:33 swiftfs1 object-auditor: Begin object audit "forever" mode (ZBF)
Jul 24 21:52:33 swiftfs1 object-auditor: Object audit (ZBF). Since Fri Jul 24 19:52:33 2015: Locally: 1 passed, 0 quarantined, 0 errors files/sec: 972.71 , bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00
Jul 24 21:52:34 swiftfs1 object-auditor: Object audit (ZBF) "forever" mode completed: 0.36s. Total quarantined: 0, Total errors: 0, Total files/sec: 52.60, Total bytes/sec: 0.00, Auditing time: 0.36, Rate: 0.99
Jul 24 21:52:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:46 +0000] "HEAD /d1/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx73e26e89d120496dacad7-0055b2978e" "proxy-server 13447" 0.0005 "-" 13509 -
Jul 24 21:52:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:46 +0000] "HEAD /d3/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx73e26e89d120496dacad7-0055b2978e" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:46 +0000] "HEAD /d2/44773/.misplaced_objects" 404 - "HEAD http://localhost/v1/.misplaced_objects" "tx73e26e89d120496dacad7-0055b2978e" "proxy-server 13447" 0.0005 "-" 13509 -
Jul 24 21:52:46 swiftfs1 swift: - - 24/Jul/2015/19/52/46 GET /v1/.misplaced_objects/1437764400%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 499 - Swift%20Container%20Reconciler - - 70 - tx73e26e89d120496dacad7-0055b2978e - 0.0090 - - 1437767566.946700096 1437767566.955683947 -
Jul 24 21:52:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:46 +0000] "GET /d3/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx3805014e181a4d0680737-0055b2978e" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:46 +0000] "GET /d1/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx3805014e181a4d0680737-0055b2978e" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:46 swiftfs1 account-server: 10.10.10.215 - - [24/Jul/2015:19:52:46 +0000] "GET /d2/44773/.misplaced_objects" 404 - "GET http://localhost/v1/.misplaced_objects?format=json&marker=&end_marker=" "tx3805014e181a4d0680737-0055b2978e" "proxy-server 13447" 0.0003 "-" 13510 -
Jul 24 21:52:46 swiftfs1 swift: - - 24/Jul/2015/19/52/46 GET /v1/.misplaced_objects%3Fformat%3Djson%26marker%3D%26end_marker%3D HTTP/1.0 404 - Swift%20Container%20Reconciler - - - - tx3805014e181a4d0680737-0055b2978e - 0.0054 - - 1437767566.956217051 1437767566.961574078 -
Jul 24 21:52:46 swiftfs1 container-reconciler: Reconciler Stats: {}
Jul 24 21:52:46 swiftfs1 container-reconciler: sleeping between intervals (30s)
Jul 24 21:52:50 swiftfs1 object-reconstructor: Starting object reconstruction pass.
Jul 24 21:52:50 swiftfs1 object-reconstructor: Nothing reconstructed for 0.000785827636719 seconds.
Jul 24 21:52:50 swiftfs1 object-reconstructor: Object reconstruction complete. (0.00 minutes)
Jul 24 21:53:02 swiftfs1 account-replicator: Beginning replication run
Jul 24 21:53:02 swiftfs1 account-replicator: Replication run OVER
Jul 24 21:53:02 swiftfs1 account-replicator: Attempted to replicate 3 dbs in 0.02511 seconds (119.46020/s)
Jul 24 21:53:02 swiftfs1 account-replicator: Removed 0 dbs
Jul 24 21:53:02 swiftfs1 account-replicator: 6 successes, 0 failures
Jul 24 21:53:02 swiftfs1 account-replicator: no_change:6 ts_repl:0 diff:0 rsync:0 diff_capped:0 hashmatch:0 empty:0
Jul 24 21:53:04 swiftfs1 object-auditor: Begin object audit "forever" mode (ZBF)
Jul 24 21:53:04 swiftfs1 object-auditor: Object audit (ZBF). Since Fri Jul 24 19:53:04 2015: Locally: 1 passed, 0 quarantined, 0 errors files/sec: 594.60 , bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00
Jul 24 21:53:04 swiftfs1 object-auditor: Object audit (ZBF) "forever" mode completed: 0.36s. Total quarantined: 0, Total errors: 0, Total files/sec: 52.49, Total bytes/sec: 0.00, Auditing time: 0.35, Rate: 0.98
@clayg
Copy link

clayg commented Jul 25, 2015 

Jul 24 21:50:55 swiftfs1 proxy-server: Object PUT returning 503 for [503, 503, 503] (txn: tx22b6f3ba72074570a21d6-0055b296f7) (client_ip: 192.168.2.29)
Jul 24 21:50:55 swiftfs1 proxy-server: 192.168.2.29 192.168.2.29 24/Jul/2015/19/50/55 PUT /v1/yookore/media/videos/video1.mp4 HTTP/1.0 503 - python-swiftclient-2.5.0 tk6c16ededba4444... 340893696 118 - tx22b6f3ba72074570a21d6-0055b296f7 - 39.2914 - - 1437767415.855555058 1437767455.146982908 1
Jul 24 21:52:03 swiftfs1 container-server: 10.10.10.215 - - [24/Jul/2015:19:52:03 +0000] "PUT /d3/20303/yookore/media/videos/video1.mp4" 201 - "PUT http://10.10.10.215:8080/d2/235379/yookore/media/videos/video1.mp4" "tx22b6f3ba72074570a21d6-0055b296f7" "object-server 13508" 0.0005 "-" 13506 1
Jul 24 21:52:03 swiftfs1 object-server: 10.10.10.215 - - [24/Jul/2015:19:52:03 +0000] "PUT /d2/235379/yookore/media/videos/video1.mp4" 201 - "PUT http://10.10.10.215:8080/v1/yookore/media/videos/video1.mp4" "tx22b6f3ba72074570a21d6-0055b296f7" "proxy-server 13511" 107.7004 "-" 13508 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment