wip_rgw_compression s3test failure

gistfile1.txt

from teuthology.log: http://qa-proxy.ceph.com/teuthology/cbodley-2016-09-06_10:26:26-rgw-wip_rgw_compression---basic-mira/402146/teuthology.log

2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:======================================================================
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:ERROR: s3tests.functional.test_s3.test_region_copy_object
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:----------------------------------------------------------------------
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:Traceback (most recent call last):
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:    self.test(*self.arg)
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/functional/test_s3.py", line 5974, in test_region_copy_object
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:    _verify_atomic_key_data(dest_key, file_size, 'A')
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/s3tests/functional/test_s3.py", line 5485, in _verify_atomic_key_data
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:    key.get_contents_to_file(fp_verify)
2016-09-06T14:54:34.128 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 1650, in get_contents_to_file
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:    response_headers=response_headers)
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 1482, in get_file
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:    query_args=None)
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 1514, in _get_file_internal
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:    override_num_retries=override_num_retries)
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 343, in open
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:    override_num_retries=override_num_retries)
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:  File "/home/ubuntu/cephtest/s3-tests/virtualenv/local/lib/python2.7/site-packages/boto/s3/key.py", line 303, in open_read
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:    self.resp.reason, body)
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:S3ResponseError: S3ResponseError: 403 Forbidden
2016-09-06T14:54:34.129 INFO:teuthology.orchestra.run.mira110.stderr:<?xml version="1.0" encoding="UTF-8"?><Error><Code>AccessDenied</Code><BucketName>test-client.0-xsr2hqppfyhjss9-293</BucketName><RequestId>tx000000000000000000c84-0057ced7c1-102a-r0z1</RequestId><HostId>102a-r0z1-zero</HostId></Error>


from the radosgw log: http://qa-proxy.ceph.com/teuthology/cbodley-2016-09-06_10:26:26-rgw-wip_rgw_compression---basic-mira/402146/remote/mira110/log/rgw.client.0.log.gz

2016-09-06 14:50:41.475795 41856700  2 req 3204:0.011066:s3:GET /test-client.0-xsr2hqppfyhjss9-293/testobj-dest:get_obj:executing
2016-09-06 14:50:41.476042 41856700 20 get_obj_state: rctx=0x41850750 obj=test-client.0-xsr2hqppfyhjss9-293:testobj-dest state=0x746e80e8 s->prefetch_data=1
2016-09-06 14:50:41.476313 41856700 20 Read xattr: user.rgw.acl
2016-09-06 14:50:41.476359 41856700 20 Read xattr: user.rgw.compression
2016-09-06 14:50:41.476394 41856700 20 Read xattr: user.rgw.content_type
2016-09-06 14:50:41.476429 41856700 20 Read xattr: user.rgw.etag
2016-09-06 14:50:41.476463 41856700 20 Read xattr: user.rgw.idtag
2016-09-06 14:50:41.476497 41856700 20 Read xattr: user.rgw.manifest
2016-09-06 14:50:41.476531 41856700 20 Read xattr: user.rgw.pg_ver
2016-09-06 14:50:41.476565 41856700 20 Read xattr: user.rgw.source_zone
2016-09-06 14:50:41.476957 41856700 20 get_obj_state: rctx=0x41850750 obj=test-client.0-xsr2hqppfyhjss9-293:testobj-dest state=0x746e80e8 s->prefetch_data=1
2016-09-06 14:50:41.477099 41856700 10 Compression for rgw is enabled, decompress part 53
2016-09-06 14:50:41.478535 41856700 -1 Compression failed with exit code -1
2016-09-06 14:50:41.483073 41856700 20 get_obj_data::cancel_all_io()
2016-09-06 14:50:41.485939 41856700  2 req 3204:0.021202:s3:GET /test-client.0-xsr2hqppfyhjss9-293/testobj-dest:get_obj:completing
2016-09-06 14:50:41.487474 41856700  2 req 3204:0.022745:s3:GET /test-client.0-xsr2hqppfyhjss9-293/testobj-dest:get_obj:op status=-1
2016-09-06 14:50:41.487550 41856700  2 req 3204:0.022822:s3:GET /test-client.0-xsr2hqppfyhjss9-293/testobj-dest:get_obj:http status=403
2016-09-06 14:50:41.487682 41856700  1 ====== req done req=0x41850850 op status=-1 http_status=403 ======