Skip to content

Instantly share code, notes, and snippets.

@charz

charz/s3cmd.txt Secret

Last active November 2, 2016 10:25
Show Gist options
  • Save charz/4dbdcf188202ac121992526564e8aedd to your computer and use it in GitHub Desktop.
Save charz/4dbdcf188202ac121992526564e8aedd to your computer and use it in GitHub Desktop.
Download ZIP
Swift multipart upload issue when write affinity enabled (See https://bugs.launchpad.net/swift3/+bug/1638512)
Raw
s3cmd.txt
$ s3cmd --debug put test.zip s3://test/test9.zip
DEBUG: s3cmd version 1.6.1
DEBUG: ConfigParser: Reading file '/Users/charles/.s3cfg'
DEBUG: ConfigParser: use_https->False
DEBUG: ConfigParser: enable_multipart->True
DEBUG: ConfigParser: multipart_chunk_size_mb->5
DEBUG: ConfigParser: signature_v2->True
DEBUG: ConfigParser: host_bucket->192.168.200.21
DEBUG: ConfigParser: host_base->192.168.200.21
DEBUG: ConfigParser: access_key->de...1_chars...o
DEBUG: ConfigParser: secret_key->8f...29_chars...4
DEBUG: ConfigParser: bucket_location->us-east-1
DEBUG: ConfigParser: cloudfront_host->cloudfront.amazonaws.com
DEBUG: ConfigParser: cloudfront_resource->/2010-07-15/distribution
DEBUG: ConfigParser: default_mime_type->binary/octet-stream
DEBUG: ConfigParser: delete_removed->False
DEBUG: ConfigParser: dry_run->False
DEBUG: ConfigParser: encoding->US-ASCII
DEBUG: ConfigParser: encrypt->False
DEBUG: ConfigParser: follow_symlinks->False
DEBUG: ConfigParser: force->False
DEBUG: ConfigParser: get_continue->False
DEBUG: ConfigParser: gpg_command->None
DEBUG: ConfigParser: gpg_decrypt->%(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
DEBUG: ConfigParser: gpg_encrypt->%(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
DEBUG: ConfigParser: gpg_passphrase->...-3_chars...
DEBUG: ConfigParser: guess_mime_type->True
DEBUG: ConfigParser: human_readable_sizes->False
DEBUG: ConfigParser: list_md5->False
DEBUG: ConfigParser: log_target_prefix->
DEBUG: ConfigParser: preserve_attrs->True
DEBUG: ConfigParser: progress_meter->True
DEBUG: ConfigParser: proxy_host->
DEBUG: ConfigParser: proxy_port->0
DEBUG: ConfigParser: recursive->False
DEBUG: ConfigParser: recv_chunk->4096
DEBUG: ConfigParser: reduced_redundancy->False
DEBUG: ConfigParser: send_chunk->4096
DEBUG: ConfigParser: simpledb_host->
DEBUG: ConfigParser: skip_existing->False
DEBUG: ConfigParser: socket_timeout->300
DEBUG: ConfigParser: urlencoding_mode->normal
DEBUG: ConfigParser: verbosity->WARNING
DEBUG: Updating Config.Config cache_file ->
DEBUG: Updating Config.Config follow_symlinks -> False
DEBUG: Updating Config.Config verbosity -> 10
DEBUG: Unicodising 'put' using US-ASCII
DEBUG: Unicodising 'test.zip' using US-ASCII
DEBUG: Unicodising 's3://test/test9.zip' using US-ASCII
DEBUG: Command: put
DEBUG: DeUnicodising u'test.zip' using US-ASCII
INFO: Compiling list of local files...
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Unicodising '' using US-ASCII
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Applying --exclude/--include
DEBUG: CHECK: test.zip
DEBUG: PASS: u'test.zip'
INFO: Running stat() and reading/calculating MD5 values on 1 files, this may take some time...
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: doing file I/O to read md5 of test.zip
DEBUG: DeUnicodising u'test.zip' using US-ASCII
INFO: Summary: 1 local files to upload
DEBUG: attr_header: {'x-amz-meta-s3cmd-attrs': 'uid:502/gname:staff/uname:charles/gid:20/mode:33188/mtime:1477452704/atime:1478079645/md5:58f06dd588d8ffb3beb46ada6309436b/ctime:1477452704'}
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?uploads
DEBUG: Using signature v2
DEBUG: SignHeaders: 'POST\n\napplication/octet-stream\n\nx-amz-date:Wed, 02 Nov 2016 09:48:10 +0000\nx-amz-meta-s3cmd-attrs:uid:502/gname:staff/uname:charles/gid:20/mode:33188/mtime:1477452704/atime:1478079645/md5:58f06dd588d8ffb3beb46ada6309436b/ctime:1477452704\nx-amz-storage-class:STANDARD\n/test/test9.zip?uploads'
DEBUG: Processing request, please wait...
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): creating new connection: http://192.168.200.21
DEBUG: non-proxied HTTPConnection(192.168.200.21)
DEBUG: format_uri(): /test/test9.zip?uploads
DEBUG: Sending request method_string='POST', uri='/test/test9.zip?uploads', headers={'x-amz-meta-s3cmd-attrs': 'uid:502/gname:staff/uname:charles/gid:20/mode:33188/mtime:1477452704/atime:1478079645/md5:58f06dd588d8ffb3beb46ada6309436b/ctime:1477452704', 'content-type': 'application/octet-stream', 'Authorization': 'AWS demo:IRwDkB8NVgfazlZsCaCMIdPfEsg=', 'x-amz-date': 'Wed, 02 Nov 2016 09:48:10 +0000', 'x-amz-storage-class': 'STANDARD'}, body=(0 bytes)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '260', 'x-amz-id-2': 'tx4f65ae945c3d4af3a928f-005819b65a', 'x-amz-request-id': 'tx4f65ae945c3d4af3a928f-005819b65a', 'x-trans-id': 'tx4f65ae945c3d4af3a928f-005819b65a', 'date': 'Wed, 02 Nov 2016 09:48:11 GMT', 'content-type': 'application/xml'}, 'reason': 'OK', 'data': '<?xml version=\'1.0\' encoding=\'UTF-8\'?>\n<InitiateMultipartUploadResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Bucket>test</Bucket><Key>test9.zip</Key><UploadId>N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw</UploadId></InitiateMultipartUploadResult>'}
DEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#1)
DEBUG: Unicodising 'test.zip' using US-ASCII
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: MultiPart: Uploading test.zip in 7 parts
DEBUG: Uploading part 1 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (5242880 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=1&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:10 +0000\n/test/test9.zip?partNumber=1&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 1 of 7, 5MB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:11 +0000\n/test/test9.zip?partNumber=1&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#1
DEBUG: format_uri(): /test/test9.zip?partNumber=1&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 5242880 0% in 0s 172.25 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#2)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'tx2e435e99b2da4caf98cb4-005819b65b', 'x-trans-id': 'tx2e435e99b2da4caf98cb4-005819b65b', 'last-modified': 'Wed, 02 Nov 2016 09:48:12 GMT', 'etag': '"5f363e0e58a95f06cbe9bbc662c5dfb6"', 'x-amz-request-id': 'tx2e435e99b2da4caf98cb4-005819b65b', 'date': 'Wed, 02 Nov 2016 09:48:11 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 5242880L}
5242880 of 5242880 100% in 0s 7.13 MB/s done
DEBUG: MD5 sums: computed=5f363e0e58a95f06cbe9bbc662c5dfb6, received="5f363e0e58a95f06cbe9bbc662c5dfb6"
DEBUG: Uploading part 2 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (5242880 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=2&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:11 +0000\n/test/test9.zip?partNumber=2&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 2 of 7, 5MB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:11 +0000\n/test/test9.zip?partNumber=2&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#2
DEBUG: format_uri(): /test/test9.zip?partNumber=2&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 5242880 0% in 0s 180.37 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#3)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'tx295f052ef2bb4ccbbc48a-005819b65b', 'x-trans-id': 'tx295f052ef2bb4ccbbc48a-005819b65b', 'last-modified': 'Wed, 02 Nov 2016 09:48:13 GMT', 'etag': '"5f363e0e58a95f06cbe9bbc662c5dfb6"', 'x-amz-request-id': 'tx295f052ef2bb4ccbbc48a-005819b65b', 'date': 'Wed, 02 Nov 2016 09:48:12 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 5242880L}
5242880 of 5242880 100% in 0s 10.19 MB/s done
DEBUG: MD5 sums: computed=5f363e0e58a95f06cbe9bbc662c5dfb6, received="5f363e0e58a95f06cbe9bbc662c5dfb6"
DEBUG: Uploading part 3 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (5242880 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=3&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:12 +0000\n/test/test9.zip?partNumber=3&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 3 of 7, 5MB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:12 +0000\n/test/test9.zip?partNumber=3&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#3
DEBUG: format_uri(): /test/test9.zip?partNumber=3&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 5242880 0% in 0s 195.95 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#4)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'tx3594c32e39b54205a55df-005819b65c', 'x-trans-id': 'tx3594c32e39b54205a55df-005819b65c', 'last-modified': 'Wed, 02 Nov 2016 09:48:13 GMT', 'etag': '"5f363e0e58a95f06cbe9bbc662c5dfb6"', 'x-amz-request-id': 'tx3594c32e39b54205a55df-005819b65c', 'date': 'Wed, 02 Nov 2016 09:48:13 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 5242880L}
5242880 of 5242880 100% in 0s 5.29 MB/s done
DEBUG: MD5 sums: computed=5f363e0e58a95f06cbe9bbc662c5dfb6, received="5f363e0e58a95f06cbe9bbc662c5dfb6"
DEBUG: Uploading part 4 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (5242880 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=4&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:13 +0000\n/test/test9.zip?partNumber=4&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 4 of 7, 5MB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:13 +0000\n/test/test9.zip?partNumber=4&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#4
DEBUG: format_uri(): /test/test9.zip?partNumber=4&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 5242880 0% in 0s 201.43 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#5)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'txcfdcfbc2fbdf4a2bbff77-005819b65d', 'x-trans-id': 'txcfdcfbc2fbdf4a2bbff77-005819b65d', 'last-modified': 'Wed, 02 Nov 2016 09:48:14 GMT', 'etag': '"5f363e0e58a95f06cbe9bbc662c5dfb6"', 'x-amz-request-id': 'txcfdcfbc2fbdf4a2bbff77-005819b65d', 'date': 'Wed, 02 Nov 2016 09:48:13 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 5242880L}
5242880 of 5242880 100% in 0s 14.21 MB/s done
DEBUG: MD5 sums: computed=5f363e0e58a95f06cbe9bbc662c5dfb6, received="5f363e0e58a95f06cbe9bbc662c5dfb6"
DEBUG: Uploading part 5 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (5242880 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=5&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:13 +0000\n/test/test9.zip?partNumber=5&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 5 of 7, 5MB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:13 +0000\n/test/test9.zip?partNumber=5&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#5
DEBUG: format_uri(): /test/test9.zip?partNumber=5&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 5242880 0% in 0s 229.67 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#6)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'tx4d18b38d4c2242ee9c679-005819b65d', 'x-trans-id': 'tx4d18b38d4c2242ee9c679-005819b65d', 'last-modified': 'Wed, 02 Nov 2016 09:48:14 GMT', 'etag': '"5f363e0e58a95f06cbe9bbc662c5dfb6"', 'x-amz-request-id': 'tx4d18b38d4c2242ee9c679-005819b65d', 'date': 'Wed, 02 Nov 2016 09:48:13 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 5242880L}
5242880 of 5242880 100% in 0s 16.57 MB/s done
DEBUG: MD5 sums: computed=5f363e0e58a95f06cbe9bbc662c5dfb6, received="5f363e0e58a95f06cbe9bbc662c5dfb6"
DEBUG: Uploading part 6 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (5242880 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=6&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:13 +0000\n/test/test9.zip?partNumber=6&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 6 of 7, 5MB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:13 +0000\n/test/test9.zip?partNumber=6&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#6
DEBUG: format_uri(): /test/test9.zip?partNumber=6&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 5242880 0% in 0s 227.01 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#7)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'txddcec3dff30e422b9e978-005819b65d', 'x-trans-id': 'txddcec3dff30e422b9e978-005819b65d', 'last-modified': 'Wed, 02 Nov 2016 09:48:14 GMT', 'etag': '"5f363e0e58a95f06cbe9bbc662c5dfb6"', 'x-amz-request-id': 'txddcec3dff30e422b9e978-005819b65d', 'date': 'Wed, 02 Nov 2016 09:48:14 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 5242880L}
5242880 of 5242880 100% in 0s 18.72 MB/s done
DEBUG: MD5 sums: computed=5f363e0e58a95f06cbe9bbc662c5dfb6, received="5f363e0e58a95f06cbe9bbc662c5dfb6"
DEBUG: Uploading part 7 of u'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw' (2097152 bytes)
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?partNumber=7&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:14 +0000\n/test/test9.zip?partNumber=7&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Unicodising 'test.zip' using US-ASCII
upload: 'test.zip' -> 's3://test/test9.zip' [part 7 of 7, 2048kB] [1 of 1]
DEBUG: DeUnicodising u'test.zip' using US-ASCII
DEBUG: Using signature v2
DEBUG: SignHeaders: 'PUT\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:14 +0000\n/test/test9.zip?partNumber=7&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#7
DEBUG: format_uri(): /test/test9.zip?partNumber=7&uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
4096 of 2097152 0% in 0s 489.84 kB/sDEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#8)
DEBUG: Response: {'status': 200, 'headers': {'content-length': '0', 'x-amz-id-2': 'tx571e7083c51f4cb581bc4-005819b65e', 'x-trans-id': 'tx571e7083c51f4cb581bc4-005819b65e', 'last-modified': 'Wed, 02 Nov 2016 09:48:15 GMT', 'etag': '"b2d1236c286a3c0704224fe4105eca49"', 'x-amz-request-id': 'tx571e7083c51f4cb581bc4-005819b65e', 'date': 'Wed, 02 Nov 2016 09:48:14 GMT', 'content-type': 'text/html; charset=UTF-8'}, 'reason': 'OK', 'data': '', 'size': 2097152L}
2097152 of 2097152 100% in 0s 12.39 MB/s done
DEBUG: MD5 sums: computed=b2d1236c286a3c0704224fe4105eca49, received="b2d1236c286a3c0704224fe4105eca49"
DEBUG: MultiPart: Upload finished: 7 parts
DEBUG: MultiPart: Completing upload: N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: String 'test9.zip' encoded to 'test9.zip'
DEBUG: CreateRequest: resource[uri]=/test9.zip?uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Using signature v2
DEBUG: SignHeaders: 'POST\n\n\n\nx-amz-date:Wed, 02 Nov 2016 09:48:14 +0000\n/test/test9.zip?uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
DEBUG: Processing request, please wait...
DEBUG: get_hostname(test): 192.168.200.21
DEBUG: ConnMan.get(): re-using connection: http://192.168.200.21#8
DEBUG: format_uri(): /test/test9.zip?uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw
DEBUG: Sending request method_string='POST', uri='/test/test9.zip?uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw', headers={'content-length': '653', 'Authorization': 'AWS demo:SbAR/JSq+wb+1kYcDzHR1/vZBOo=', 'x-amz-date': 'Wed, 02 Nov 2016 09:48:14 +0000'}, body=(653 bytes)
DEBUG: Response: {'status': 404, 'headers': {'x-amz-id-2': 'tx53f714d010ef4f0a90984-005819b65e', 'transfer-encoding': 'chunked', 'x-amz-request-id': 'tx53f714d010ef4f0a90984-005819b65e', 'x-trans-id': 'tx53f714d010ef4f0a90984-005819b65e', 'date': 'Wed, 02 Nov 2016 09:48:14 GMT', 'content-type': 'application/xml'}, 'reason': 'Not Found', 'data': "<?xml version='1.0' encoding='UTF-8'?>\n<Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><RequestId>tx53f714d010ef4f0a90984-005819b65e</RequestId><Key>test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw</Key></Error>"}
DEBUG: ConnMan.put(): connection put back to pool (http://192.168.200.21#9)
DEBUG: S3Error: 404 (Not Found)
DEBUG: HttpHeader: x-amz-id-2: tx53f714d010ef4f0a90984-005819b65e
DEBUG: HttpHeader: transfer-encoding: chunked
DEBUG: HttpHeader: x-amz-request-id: tx53f714d010ef4f0a90984-005819b65e
DEBUG: HttpHeader: x-trans-id: tx53f714d010ef4f0a90984-005819b65e
DEBUG: HttpHeader: date: Wed, 02 Nov 2016 09:48:14 GMT
DEBUG: HttpHeader: content-type: application/xml
DEBUG: ErrorXML: Code: 'NoSuchKey'
DEBUG: ErrorXML: Message: 'The specified key does not exist.'
DEBUG: ErrorXML: RequestId: 'tx53f714d010ef4f0a90984-005819b65e'
DEBUG: ErrorXML: Key: 'test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'
ERROR: S3 error: 404 (NoSuchKey): The specified key does not exist.
Raw
swiftlogs.txt
$ sudo grep tx53f714d010ef4f0a90984-005819b65e *
all.log:Nov 2 09:48:14 dev21 proxy-server: Calling Swift3 Middleware (txn: tx53f714d010ef4f0a90984-005819b65e) (client_ip: 192.168.200.100)
all.log:Nov 2 09:48:14 dev21 proxy-server: {'access_key': 'demo', 'account': None, '_timestamp': 1478080094.00000_0000000000000000, 'user_id': None, 'slo_enabled': True, 'token': 'UE9TVAoKCgp4LWFtei1kYXRlOldlZCwgMDIgTm92IDIwMTYgMDk6NDg6MTQgKzAwMDAKL3Rlc3QvdGVzdDkuemlwP3VwbG9hZElkPU4yTTRPVEU0WlRRdE16SXhaaTAwT0RFM0xXSTRPRGd0WTJNNE56UXpZekF6TldZdw==', '_params_cache': {'uploadId': 'N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw'}, 'headers': <swift.common.swob.HeaderEnvironProxy object at 0x7f175d492790>, 'object_name': 'test9.zip', 'bucket_in_host': None, 'environ': {'HTTP_AUTHORIZATION': 'AWS demo:SbAR/JSq+wb+1kYcDzHR1/vZBOo=', 'SCRIPT_NAME': '', 'swift.proxy_access_log_made': True, 'REQUEST_METHOD': 'POST', 'HTTP_X_AMZ_DATE': 'Wed, 02 Nov 2016 09:48:14 +0000', 'PATH_INFO': '/test/test9.zip', 'SERVER_PROTOCOL': 'HTTP/1.0', 'QUERY_STRING': 'uploadId=N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw', 'REMOTE_ADDR': '192.168.200.100', 'CONTENT_LENGTH': '653', 'swiftstack.auth.users_db': {'test': {'s3key': '03a859deabf39015cf199bec85f5056e', 'storageURL': 'http://swift.chhsu.com/v1/AUTH_test', 'groups': [], 'key': 'scrypt\x00\x0b\x00\x00\x00\x08\x00\x00\x00\x01\x1b2@\xac\xcay0\x9d\xaaZ\x0c\'\xc7\x08\xc5r\xeb\xdc\x92K]\x90\xdc\xf7\xa1\xb3\xf2\xc87\xf1\xfaA\xda\xe7\xdb7b\x10@\x181\xa4\xd6\x9ft\xae\x04\xbcs1\xb0\x9e\xb4\xd6\xbd\xc8"C\x99)\xb6(M\xbd\x9b\xfe\xea\x8d\x13D\x89n\x8d\xf7\xb8"\x0c\' f!V\x80\xff\xf9FCxi\x12\xd7 \xa7\xf0j9U\xc6\x1347\xe0\xe1\x14O\xd7\xed2\x84rcih\xdb\x83"\xc5I\x17\x14\xae\xcf9G\xe5\xb1\xc1\xa2\xa7({\xec\x82h\x80\x05\xf5p\xf4\xd5\x8f\x97\xd2\xcd\x16\xfa\xd3\xe3\x8d;.G\xb4\xc7\x9f\x81\xa5\xd5\x95\x1f\xbe\x1f\xde\x9d\xe9>n\xc2\x9b\xad"}\xfb\xaf\xa4\x0f'}, 'demo': {'s3key': '8f9ca71b11b007c9ea567695551c0524', 'storageURL': 'http://swift.chhsu.com/v1/AUTH_demo', 'groups': ['.reseller_admin'], 'key': 'scrypt\x00\r\x00\x00\x00\x08\x00\x00\x00\x01\x83\x07\xe0\x06X\xa6\x17\x15la"\xaa\xa78d\xb0\xdel\t\xb4G\xf3\xaa\x7f\xe5\xc2\xa7v\xee\xeb\x0b\x9e\x1cY\xf6N,\xcf}Y\xa4\x98s\x7f\x19"\xcaP\xb4\xf2s\xc4u?\xeau\x90\x160B\x861\xa3\xf1\x98\n\x9c\x9f\xea\xec\xc5\xd8Q\x8c\xa3&M(&\x93\xbfq \xf1\xf3s\xb2\xd0_+\x8cP5\xcd]\xb1\xf1\xc4&\xcd\xd1j\xe0\xd9\xc0k0\xd1\x1b\xdb\xba\xcd6.\xa7\r\xf4?\xbd N\x84\xa3\xb16g\xfa\x04\xe4\xd8r\x14\xa9\xb2%<t\xf3!\x98\x9e\xc8\xa7\xff\x05 X\xbcK\x07)\xb07A\xaa\xa4eoM\xb5?-\x08\x99[\xb4\xba\xa8\xac\xae\xa9\xda\x0c\xef\x1d3'}}, 'eventlet.posthooks': [], 'RAW_PATH_INFO': '/test/test9.zip', 'REMOTE_PORT': '57134', 'eventlet.input': <eventlet.wsgi.Input object at 0x7f175d47e210>, 'wsgi.url_scheme': 'http', 'SERVER_PORT': '80', 'CONTENT_TYPE': None, 'swift.leave_relative_location': True, 'swiftstack.auth.nuacct_db': {}, 'wsgi.input': <swift.common.utils.InputProxy object at 0x7f175d492ad0>, 'HTTP_HOST': '192.168.200.21', 'swift.cache': <swift.common.memcached.MemcacheRing object at 0x7f175eb92e50>, 'wsgi.multithread': True, 'wsgi.version': (1, 0), 'SERVER_NAME': '192.168.200.21', 'GATEWAY_INTERFACE': 'CGI/1.1', 'wsgi.run_once': False, 'wsgi.errors': <swift.common.utils.LoggerFileObject object at 0x7f175eb9b610>, 'wsgi.multiprocess': False, 'swift.trans_id': 'tx53f714d010ef4f0a90984-005819b65e', 'headers_raw': (('Host', '192.168.200.21'), ('Accept-Encoding', 'identity'), ('content-length', '653'), ('Authorization', 'AWS demo:SbAR/JSq+wb+1kYcDzHR1/vZBOo='), ('x-amz-date', 'Wed, 02 Nov 2016 09:48:14 +0000')), 'HTTP_ACCEPT_ENCODING': 'identity'}, 'container_name': 'test'}
all.log:Nov 2 09:48:14 dev21 proxy-server: 192.168.200.100 192.168.200.100 02/Nov/2016/09/48/14 HEAD /v1/AUTH_demo/test HTTP/1.0 204 - - demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0087 S3 - 1478080094.347054958 1478080094.355714083 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d5/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 200 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0075 "-" 2616 0
all.log:Nov 2 09:48:14 dev21 proxy-server: 192.168.200.100 192.168.200.100 02/Nov/2016/09/48/14 HEAD /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw HTTP/1.0 200 - - demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0333 S3 - 1478080094.359725952 1478080094.393052101 0
all.log:Nov 2 09:48:14 dev21 proxy-server: 192.168.200.100 192.168.200.100 02/Nov/2016/09/48/14 GET /v1/AUTH_demo/test%252Bsegments%3Fdelimiter%3D/%26format%3Djson%26prefix%3Dtest9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/ HTTP/1.0 200 - - demo%2Cs3 - 1589 - tx53f714d010ef4f0a90984-005819b65e - 0.0118 S3 - 1478080094.395699024 1478080094.407511950 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d5/1610/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1" 200 5242880 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0008 "-" 2614 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0106 SLO - 1478080094.411127090 1478080094.421730042 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d5/6989/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2" 200 5242880 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0004 "-" 2615 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0098 SLO - 1478080094.423158884 1478080094.432957888 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d7/1072/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3" 200 5242880 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0003 "-" 2620 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0100 SLO - 1478080094.433927059 1478080094.443969011 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d15/57100/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4" 200 5242880 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0009 "-" 2622 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0109 SLO - 1478080094.445054054 1478080094.455914974 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d15/51300/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5" 200 5242880 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0013 "-" 2623 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0201 SLO - 1478080094.457097054 1478080094.477154016 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d5/14051/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6" 200 5242880 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0009 "-" 2613 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0118 SLO - 1478080094.478395939 1478080094.490216970 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d5/41802/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7" 200 2097152 "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0006 "-" 2615 0
all.log:Nov 2 09:48:14 dev21 proxy-server: - - 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7 HTTP/1.0 200 - SLO%20MultipartPUT demo%2Cs3 - - - tx53f714d010ef4f0a90984-005819b65e - 0.0101 SLO - 1478080094.491439104 1478080094.501557112 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "PUT /d5/21321/AUTH_demo/test/test9.zip" 201 - "PUT http://192.168.200.21/v1/AUTH_demo/test/test9.zip?multipart-manifest=put" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0180 "-" 2614 0
all.log:Nov 2 09:48:14 dev21 container-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "PUT /d15/64010/AUTH_demo/test/test9.zip" 201 - "PUT http://192.168.200.21/d15/21321/AUTH_demo/test/test9.zip" "tx53f714d010ef4f0a90984-005819b65e" "object-server 2624" 0.0004 "-" 2601 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "PUT /d15/21321/AUTH_demo/test/test9.zip" 201 - "PUT http://192.168.200.21/v1/AUTH_demo/test/test9.zip?multipart-manifest=put" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0470 "-" 2624 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "PUT /d7/21321/AUTH_demo/test/test9.zip" 201 - "PUT http://192.168.200.21/v1/AUTH_demo/test/test9.zip?multipart-manifest=put" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0440 "-" 2621 0
all.log:Nov 2 09:48:14 dev21 proxy-server: 192.168.200.100 192.168.200.100 02/Nov/2016/09/48/14 PUT /v1/AUTH_demo/test/test9.zip%3Fmultipart-manifest%3Dput HTTP/1.0 201 - - demo%2Cs3 1694 - - tx53f714d010ef4f0a90984-005819b65e - 0.0531 S3 - 1478080094.502849102 1478080094.555907965 0
all.log:Nov 2 09:48:14 dev21 container-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "DELETE /d15/7802/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 204 - "DELETE http://192.168.200.21/d5/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "object-server 2614" 0.0011 "-" 2601 0
all.log:Nov 2 09:48:14 dev21 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "DELETE /d5/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 204 - "DELETE http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0085 "-" 2614 0
all.log:Nov 2 09:48:14 dev21 proxy-server: 192.168.200.100 192.168.200.100 02/Nov/2016/09/48/14 DELETE /v1/AUTH_demo/test%252Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw HTTP/1.0 404 - - demo%2Cs3 - 70 - tx53f714d010ef4f0a90984-005819b65e - 0.0457 S3 - 1478080094.558212996 1478080094.603941917 0
all.log:Nov 2 09:48:14 dev21 proxy-server: 192.168.200.100 192.168.200.100 02/Nov/2016/09/48/14 POST /test/test9.zip%3FuploadId%3DN2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw HTTP/1.0 404 - - - 653 254 - tx53f714d010ef4f0a90984-005819b65e - 0.2660 - - 1478080094.339886904 1478080094.605886936 -
$ sudo grep tx53f714d010ef4f0a90984-005819b65e /var/log/swift/all.log
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d10/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0007 "-" 14663 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d10/1610/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 14666 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d10/6989/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0004 "-" 14664 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d11/1072/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0007 "-" 14667 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d11/57100/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0010 "-" 14669 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d16/51300/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 14673 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d16/14051/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 14674 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d11/41802/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0004 "-" 14670 0
Nov 2 09:48:14 dev221 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "DELETE /d10/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 404 - "DELETE http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0202 "-" 14664 0
$ sudo grep tx53f714d010ef4f0a90984-005819b65e /var/log/swift/all.log
Nov 2 09:48:14 dev222 container-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d2/64010/AUTH_demo/test" 204 - "HEAD http://192.168.200.21/v1/AUTH_demo/test" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0023 "-" 16085 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d0/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 6358 0
Nov 2 09:48:14 dev222 container-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "GET /d1/7802/AUTH_demo/test%2Bsegments" 200 1589 "GET http://192.168.200.21/v1/AUTH_demo/test%2Bsegments?delimiter=/&format=json&prefix=test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0063 "-" 16085 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d0/1610/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/1" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 6358 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d3/6989/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/2" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0003 "-" 6376 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d3/1072/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/3" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0004 "-" 6375 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d2/57100/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/4" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 6370 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d0/51300/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/5" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0033 "-" 6359 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d1/14051/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/6" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0011 "-" 6363 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "HEAD /d1/41802/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7" 404 - "HEAD http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw/7" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0005 "-" 6364 0
Nov 2 09:48:14 dev222 container-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "PUT /d1/64010/AUTH_demo/test/test9.zip" 201 - "PUT http://192.168.200.21/d5/21321/AUTH_demo/test/test9.zip" "tx53f714d010ef4f0a90984-005819b65e" "object-server 2614" 0.0006 "-" 16085 0
Nov 2 09:48:14 dev222 container-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "PUT /d2/64010/AUTH_demo/test/test9.zip" 201 - "PUT http://192.168.200.21/d7/21321/AUTH_demo/test/test9.zip" "tx53f714d010ef4f0a90984-005819b65e" "object-server 2621" 0.0006 "-" 16085 0
Nov 2 09:48:14 dev222 container-server: 192.168.200.221 - - [02/Nov/2016:09:48:14 +0000] "DELETE /d2/7802/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 204 - "DELETE http://192.168.200.21/d10/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "object-server 14664" 0.0007 "-" 16085 0
Nov 2 09:48:14 dev222 container-server: 192.168.200.222 - - [02/Nov/2016:09:48:14 +0000] "DELETE /d1/7802/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 204 - "DELETE http://192.168.200.21/d0/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "object-server 6359" 0.0005 "-" 16085 0
Nov 2 09:48:14 dev222 object-server: 192.168.200.21 - - [02/Nov/2016:09:48:14 +0000] "DELETE /d0/31978/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" 404 - "DELETE http://192.168.200.21/v1/AUTH_demo/test%2Bsegments/test9.zip/N2M4OTE4ZTQtMzIxZi00ODE3LWI4ODgtY2M4NzQzYzAzNWYw" "tx53f714d010ef4f0a90984-005819b65e" "proxy-server 2619" 0.0374 "-" 6359 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment