Skip to content

Instantly share code, notes, and snippets.

@tleyden

tleyden/gist:56dac8fbba6e8d273210582f59679d51 Secret

Created April 26, 2017 22:25
Show Gist options
  • Save tleyden/56dac8fbba6e8d273210582f59679d51 to your computer and use it in GitHub Desktop.
Save tleyden/56dac8fbba6e8d273210582f59679d51 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [copy the run ngrep script] ***********************************************
ok: [sg2]
ok: [sg1]
TASK [start ngrep on loopback interface in screen] *****************************
changed: [sg2]
changed: [sg1]
TASK [start ngrep on eth0 in screen] *******************************************
changed: [sg1]
changed: [sg2]
TASK [start ngrep on eth1 in screen] *******************************************
changed: [sg1]
changed: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=5 changed=3 unreachable=0 failed=0
sg2 : ok=5 changed=3 unreachable=0 failed=0
SETUP F params_from_base_test_setup (fixtures used: params_from_base_suite_setup)
testsuites/syncgateway/functional/topology_specific_tests/multiple_sync_gateways/test_bucket_shadow.py::test_bucket_shadow_low_revs_limit_repeated_deletes (fixtures used: environment, params_from_base_suite_setup, params_from_base_test_setup)Running 'test_bucket_shadow_low_revs_limit_repeated_deletes'
Using cluster_config: resources/cluster_configs/multiple_sync_gateways_cc
resources/cluster_configs/multiple_sync_gateways_cc
cbs: [{'ip': u'192.168.33.10', 'name': u'cb1'}]
sgs: [{'ip': u'192.168.33.11', 'name': u'sg1'}, {'ip': u'192.168.33.12', 'name': u'sg2'}]
acs: []
ssl: False
>>> Stopping sync_gateway
Running playbook: libraries/provision/ansible/playbooks/stop-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway service] ********************************
changed: [sg1]
changed: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway for CentOS 6] ***************************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Verify sync_gateway not listening on port] ****************
ok: [sg1]
ok: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway service on Windows] *********************
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=3 changed=1 unreachable=0 failed=0
sg2 : ok=3 changed=1 unreachable=0 failed=0
>>> Stopping sg_accel
Running playbook: libraries/provision/ansible/playbooks/stop-sg-accel.yml
PLAY RECAP *********************************************************************
>>> Deleting sync_gateway artifacts
Running playbook: libraries/provision/ansible/playbooks/delete-sync-gateway-artifacts.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs] *********************************
changed: [sg1]
[WARNING]: Consider using file module with state=absent rather than running rm
changed: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs on Windows] **********************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Create sync_gateway logs directory on Windows] ************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs on Windows] **********************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs directory under Temp on Windows] *
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs on Windows] **********************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Create sync_gateway logs directory under c:/tmp on Windows] ***
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=2 changed=1 unreachable=0 failed=0
sg2 : ok=2 changed=1 unreachable=0 failed=0
>>> Deleting sg_accel artifacts
Running playbook: libraries/provision/ansible/playbooks/delete-sg-accel-artifacts.yml
PLAY RECAP *********************************************************************
>>> Deleting buckets on: http://192.168.33.10:8091
GET http://192.168.33.10:8091/pools/default/buckets 200
Existing buckets: [u'data-bucket', u'source-bucket']
Deleting buckets: [u'data-bucket', u'source-bucket']
GET http://Administrator:password@192.168.33.10:8091/pools 200
DELETE http://192.168.33.10:8091/pools/default/buckets/data-bucket 200
GET http://Administrator:password@192.168.33.10:8091/pools 200
DELETE http://192.168.33.10:8091/pools/default/buckets/source-bucket 200
GET http://192.168.33.10:8091/pools/default/buckets 200
>>> Creating buckets on: http://192.168.33.10:8091
>>> Creating buckets [u'data-bucket', u'source-bucket']
Creating buckets: [u'data-bucket', u'source-bucket']
total_avail_ram_mb: 1840
effective_avail_ram_mb: 960
Creating bucket data-bucket with RAM 480
GET http://Administrator:password@192.168.33.10:8091/pools 200
POST http://192.168.33.10:8091/pools/default/buckets 202
Error from server: <RC=0x16[Data received on socket was not in the expected format], There was a problem while trying to send/receive your request over the network. This may be a result of a bad network or a misconfigured client or server, C Source=(src/bucket.c,759)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Key not found error: Bucket is ready!
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
All nodes are healthy
Creating bucket source-bucket with RAM 480
GET http://Administrator:password@192.168.33.10:8091/pools 200
POST http://192.168.33.10:8091/pools/default/buckets 202
Error from server: <RC=0x16[Data received on socket was not in the expected format], There was a problem while trying to send/receive your request over the network. This may be a result of a bad network or a misconfigured client or server, C Source=(src/bucket.c,759)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Key not found error: Bucket is ready!
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
All nodes are healthy
>>> Waiting for Server: http://192.168.33.10:8091 to be in a healthy state
GET http://192.168.33.10:8091/pools/nodes 200
All nodes are healthy
>>> Starting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json
Running playbook: libraries/provision/ansible/playbooks/start-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [SYNC GATEWAY | Copy sync gateway config to host] *************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Check deployed config] ************************************
changed: [sg1]
changed: [sg2]
TASK [SYNC GATEWAY | Print deployed config] ************************************
ok: [sg1] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091",
"shadow": {
"bucket": "source-bucket",
"password": "password",
"server": "http://192.168.33.10:8091",
"username": "source-bucket"
}
}
},
"interface": ":4984",
"log": [
"*"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
ok: [sg2] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091",
"shadow": {
"bucket": "source-bucket",
"password": "password",
"server": "http://192.168.33.10:8091",
"username": "source-bucket"
}
}
},
"interface": ":4984",
"log": [
"*"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
TASK [SYNC GATEWAY | Copy sync gateway config to Windows host] *****************
skipping: [sg1]
skipping: [sg2]
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [debug] *******************************************************************
ok: [sg1] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json"
}
ok: [sg2] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json"
}
TASK [SYNC GATEWAY | Start sync gateway service] *******************************
changed: [sg1]
changed: [sg2]
TASK [SYNC GATEWAY | Wait until sync gateway to listen on port] ****************
ok: [sg2]
ok: [sg1]
TASK [debug] *******************************************************************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Start sync_gateway service on Windows] ********************
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=8 changed=3 unreachable=0 failed=0
sg2 : ok=8 changed=3 unreachable=0 failed=0
>>> Running in channel cache
2017-04-26 15:15:06,316 - INFO - restart - >>> Restarting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_default_low_revs_cc.json
INFO:test_framework:>>> Restarting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_default_low_revs_cc.json
Running playbook: libraries/provision/ansible/playbooks/reset-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway service] ********************************
changed: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway for CentOS 6] ***************************
skipping: [sg2]
TASK [SYNC GATEWAY | Verify sync_gateway not listening on port] ****************
ok: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs] *********************************
changed: [sg2]
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
TASK [SYNC GATEWAY | Copy sync gateway config to host] *************************
changed: [sg2]
TASK [SYNC GATEWAY | Check deployed config] ************************************
changed: [sg2]
TASK [SYNC GATEWAY | Print deployed config] ************************************
ok: [sg2] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091"
}
},
"interface": ":4984",
"log": [
"CRUD+",
"Cache+",
"HTTP+",
"Changes+"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
TASK [debug] *******************************************************************
ok: [sg2] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_default_low_revs_cc.json"
}
TASK [SYNC GATEWAY | Start sync gateway service] *******************************
changed: [sg2]
TASK [SYNC GATEWAY | Wait until sync gateway to listen on port] ****************
ok: [sg2]
PLAY RECAP *********************************************************************
sg2 : ok=12 changed=5 unreachable=0 failed=0
2017-04-26 15:15:11,940 - INFO - register_user - PUT http://192.168.33.12:4985/db/_user/alice
INFO:test_framework:PUT http://192.168.33.12:4985/db/_user/alice
2017-04-26 15:15:12,084 - INFO - register_user - PUT http://192.168.33.12:4985/db/_user/bob
INFO:test_framework:PUT http://192.168.33.12:4985/db/_user/bob
2017-04-26 15:15:12,097 - INFO - wait_until_db_online - DB [db] waiting until online
INFO:test_framework:DB [db] waiting until online
2017-04-26 15:15:12,225 - INFO - wait_until_db_online - DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244904162399, u'committed_update_seq': 2}
INFO:test_framework:DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244904162399, u'committed_update_seq': 2}
2017-04-26 15:15:12,225 - INFO - wait_until_db_online - DB [db] waiting until online
INFO:test_framework:DB [db] waiting until online
2017-04-26 15:15:12,363 - INFO - wait_until_db_online - DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244910218303, u'committed_update_seq': 2}
INFO:test_framework:DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244910218303, u'committed_update_seq': 2}
sync_gateway: http://192.168.33.11:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
sync_gateway: http://192.168.33.12:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
Running playbook: libraries/provision/ansible/playbooks/stop-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway service] ********************************
changed: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway for CentOS 6] ***************************
skipping: [sg1]
TASK [SYNC GATEWAY | Verify sync_gateway not listening on port] ****************
ok: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway service on Windows] *********************
skipping: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=3 changed=1 unreachable=0 failed=0
2017-04-26 15:15:21,077 - INFO - start - >>> Starting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json
INFO:test_framework:>>> Starting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json
Running playbook: libraries/provision/ansible/playbooks/start-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
TASK [SYNC GATEWAY | Copy sync gateway config to host] *************************
ok: [sg1]
TASK [SYNC GATEWAY | Check deployed config] ************************************
changed: [sg1]
TASK [SYNC GATEWAY | Print deployed config] ************************************
ok: [sg1] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091",
"shadow": {
"bucket": "source-bucket",
"password": "password",
"server": "http://192.168.33.10:8091",
"username": "source-bucket"
}
}
},
"interface": ":4984",
"log": [
"*"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
TASK [SYNC GATEWAY | Copy sync gateway config to Windows host] *****************
skipping: [sg1]
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
TASK [debug] *******************************************************************
ok: [sg1] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json"
}
TASK [SYNC GATEWAY | Start sync gateway service] *******************************
changed: [sg1]
TASK [SYNC GATEWAY | Wait until sync gateway to listen on port] ****************
ok: [sg1]
TASK [debug] *******************************************************************
skipping: [sg1]
TASK [SYNC GATEWAY | Start sync_gateway service on Windows] ********************
skipping: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=8 changed=2 unreachable=0 failed=0
PASSEDTearing down test 'test_bucket_shadow_low_revs_limit_repeated_deletes'
----------------
Socket usage on mobile-testkit client ...
ESTABLISHED: 201
TIME_WAIT: 0
Running playbook: libraries/provision/ansible/playbooks/stop-ngrep.yml
PLAY [sync_gateways:sg_accels] *************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [kill any running ngrep screens] ******************************************
changed: [sg2]
changed: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=2 changed=1 unreachable=0 failed=0
sg2 : ok=2 changed=1 unreachable=0 failed=0
Running playbook: libraries/provision/ansible/playbooks/collect-ngrep.yml
PLAY [sync_gateways:sg_accels] *************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [NGREP | fetch ngrep packet capture from loopback device] *****************
changed: [sg1]
changed: [sg2]
TASK [NGREP | fetch ngrep packet capture from eth0 device] *********************
changed: [sg1]
changed: [sg2]
TASK [NGREP | fetch ngrep packet capture from eth1 device] *********************
changed: [sg2]
changed: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=4 changed=3 unreachable=0 failed=0
sg2 : ok=4 changed=3 unreachable=0 failed=0
ngrep logs copied here /tmp/ngrep-test_bucket_shadow_low_revs_limit_repeated_deletes-2017-04-26-15-15-28-output.zip
resources/cluster_configs/multiple_sync_gateways_cc
cbs: [{'ip': u'192.168.33.10', 'name': u'cb1'}]
sgs: [{'ip': u'192.168.33.11', 'name': u'sg1'}, {'ip': u'192.168.33.12', 'name': u'sg2'}]
acs: []
ssl: False
sync_gateway: http://192.168.33.11:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
sync_gateway: http://192.168.33.12:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
TEARDOWN F params_from_base_test_setup
testsuites/syncgateway/functional/topology_specific_tests/multiple_sync_gateways/test_bucket_shadow.py::test_bucket_shadow_low_revs_limit Setting up test 'test_bucket_shadow_low_revs_limit'
Running playbook: libraries/provision/ansible/playbooks/start-ngrep.yml
PLAY [sync_gateways:sg_accels] *************************************************
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [copy the run ngrep script] ***********************************************
ok: [sg1]
ok: [sg2]
TASK [start ngrep on loopback interface in screen] *****************************
changed: [sg1]
changed: [sg2]
TASK [start ngrep on eth0 in screen] *******************************************
changed: [sg1]
changed: [sg2]
TASK [start ngrep on eth1 in screen] *******************************************
changed: [sg1]
changed: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=5 changed=3 unreachable=0 failed=0
sg2 : ok=5 changed=3 unreachable=0 failed=0
SETUP F params_from_base_test_setup (fixtures used: params_from_base_suite_setup)
testsuites/syncgateway/functional/topology_specific_tests/multiple_sync_gateways/test_bucket_shadow.py::test_bucket_shadow_low_revs_limit (fixtures used: environment, params_from_base_suite_setup, params_from_base_test_setup)Running 'test_bucket_shadow_low_revs_limit'
Using cluster_config: resources/cluster_configs/multiple_sync_gateways_cc
resources/cluster_configs/multiple_sync_gateways_cc
cbs: [{'ip': u'192.168.33.10', 'name': u'cb1'}]
sgs: [{'ip': u'192.168.33.11', 'name': u'sg1'}, {'ip': u'192.168.33.12', 'name': u'sg2'}]
acs: []
ssl: False
>>> Stopping sync_gateway
Running playbook: libraries/provision/ansible/playbooks/stop-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway service] ********************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway for CentOS 6] ***************************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Verify sync_gateway not listening on port] ****************
ok: [sg1]
ok: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway service on Windows] *********************
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=3 changed=1 unreachable=0 failed=0
sg2 : ok=3 changed=1 unreachable=0 failed=0
>>> Stopping sg_accel
Running playbook: libraries/provision/ansible/playbooks/stop-sg-accel.yml
PLAY RECAP *********************************************************************
>>> Deleting sync_gateway artifacts
Running playbook: libraries/provision/ansible/playbooks/delete-sync-gateway-artifacts.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [SYNC GATEWAY | Delete sync_gateway logs] *********************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Delete sync_gateway logs on Windows] **********************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Create sync_gateway logs directory on Windows] ************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs on Windows] **********************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs directory under Temp on Windows] *
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs on Windows] **********************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Create sync_gateway logs directory under c:/tmp on Windows] ***
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=2 changed=1 unreachable=0 failed=0
sg2 : ok=2 changed=1 unreachable=0 failed=0
>>> Deleting sg_accel artifacts
Running playbook: libraries/provision/ansible/playbooks/delete-sg-accel-artifacts.yml
PLAY RECAP *********************************************************************
>>> Deleting buckets on: http://192.168.33.10:8091
GET http://192.168.33.10:8091/pools/default/buckets 200
Existing buckets: [u'data-bucket', u'source-bucket']
Deleting buckets: [u'data-bucket', u'source-bucket']
GET http://Administrator:password@192.168.33.10:8091/pools 200
DELETE http://192.168.33.10:8091/pools/default/buckets/data-bucket 200
GET http://Administrator:password@192.168.33.10:8091/pools 200
DELETE http://192.168.33.10:8091/pools/default/buckets/source-bucket 200
GET http://192.168.33.10:8091/pools/default/buckets 200
>>> Creating buckets on: http://192.168.33.10:8091
>>> Creating buckets [u'data-bucket', u'source-bucket']
Creating buckets: [u'data-bucket', u'source-bucket']
total_avail_ram_mb: 1840
effective_avail_ram_mb: 960
Creating bucket data-bucket with RAM 480
GET http://Administrator:password@192.168.33.10:8091/pools 200
POST http://192.168.33.10:8091/pools/default/buckets 202
Error from server: <RC=0x16[Data received on socket was not in the expected format], There was a problem while trying to send/receive your request over the network. This may be a result of a bad network or a misconfigured client or server, C Source=(src/bucket.c,759)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Key not found error: Bucket is ready!
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
All nodes are healthy
Creating bucket source-bucket with RAM 480
GET http://Administrator:password@192.168.33.10:8091/pools 200
POST http://192.168.33.10:8091/pools/default/buckets 202
Error from server: <RC=0x16[Data received on socket was not in the expected format], There was a problem while trying to send/receive your request over the network. This may be a result of a bad network or a misconfigured client or server, C Source=(src/bucket.c,759)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Error from server: <Key=u'foo', RC=0xB[Temporary failure received from server. Try again later], Operational Error, Results=1, C Source=(src/multiresult.c,309)>, Retrying ...
Key not found error: Bucket is ready!
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
Node is still not healthy. Status: warmup Retrying ...
GET http://192.168.33.10:8091/pools/nodes 200
All nodes are healthy
>>> Waiting for Server: http://192.168.33.10:8091 to be in a healthy state
GET http://192.168.33.10:8091/pools/nodes 200
All nodes are healthy
>>> Starting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json
Running playbook: libraries/provision/ansible/playbooks/start-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [SYNC GATEWAY | Copy sync gateway config to host] *************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Check deployed config] ************************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Print deployed config] ************************************
ok: [sg1] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091",
"shadow": {
"bucket": "source-bucket",
"password": "password",
"server": "http://192.168.33.10:8091",
"username": "source-bucket"
}
}
},
"interface": ":4984",
"log": [
"*"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
ok: [sg2] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091",
"shadow": {
"bucket": "source-bucket",
"password": "password",
"server": "http://192.168.33.10:8091",
"username": "source-bucket"
}
}
},
"interface": ":4984",
"log": [
"*"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
TASK [SYNC GATEWAY | Copy sync gateway config to Windows host] *****************
skipping: [sg1]
skipping: [sg2]
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [debug] *******************************************************************
ok: [sg1] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json"
}
ok: [sg2] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json"
}
TASK [SYNC GATEWAY | Start sync gateway service] *******************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Wait until sync gateway to listen on port] ****************
ok: [sg2]
ok: [sg1]
TASK [debug] *******************************************************************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Start sync_gateway service on Windows] ********************
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=8 changed=3 unreachable=0 failed=0
sg2 : ok=8 changed=3 unreachable=0 failed=0
>>> Running in channel cache
2017-04-26 15:15:51,188 - INFO - restart - >>> Restarting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_default_low_revs_cc.json
INFO:test_framework:>>> Restarting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_default_low_revs_cc.json
Running playbook: libraries/provision/ansible/playbooks/reset-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway service] ********************************
changed: [sg2]
TASK [SYNC GATEWAY | Stop sync_gateway for CentOS 6] ***************************
skipping: [sg2]
TASK [SYNC GATEWAY | Verify sync_gateway not listening on port] ****************
ok: [sg2]
TASK [SYNC GATEWAY | Delete sync_gateway logs] *********************************
changed: [sg2]
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
TASK [SYNC GATEWAY | Copy sync gateway config to host] *************************
changed: [sg2]
TASK [SYNC GATEWAY | Check deployed config] ************************************
changed: [sg2]
TASK [SYNC GATEWAY | Print deployed config] ************************************
ok: [sg2] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091"
}
},
"interface": ":4984",
"log": [
"CRUD+",
"Cache+",
"HTTP+",
"Changes+"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
TASK [debug] *******************************************************************
ok: [sg2] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_default_low_revs_cc.json"
}
TASK [SYNC GATEWAY | Start sync gateway service] *******************************
changed: [sg2]
TASK [SYNC GATEWAY | Wait until sync gateway to listen on port] ****************
ok: [sg2]
PLAY RECAP *********************************************************************
sg2 : ok=12 changed=5 unreachable=0 failed=0
2017-04-26 15:15:56,652 - INFO - register_user - PUT http://192.168.33.12:4985/db/_user/alice
INFO:test_framework:PUT http://192.168.33.12:4985/db/_user/alice
2017-04-26 15:15:56,805 - INFO - register_user - PUT http://192.168.33.12:4985/db/_user/bob
INFO:test_framework:PUT http://192.168.33.12:4985/db/_user/bob
2017-04-26 15:15:56,812 - INFO - wait_until_db_online - DB [db] waiting until online
INFO:test_framework:DB [db] waiting until online
2017-04-26 15:15:56,956 - INFO - wait_until_db_online - DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244949059421, u'committed_update_seq': 2}
INFO:test_framework:DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244949059421, u'committed_update_seq': 2}
2017-04-26 15:15:56,956 - INFO - wait_until_db_online - DB [db] waiting until online
INFO:test_framework:DB [db] waiting until online
2017-04-26 15:15:57,102 - INFO - wait_until_db_online - DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244954988141, u'committed_update_seq': 2}
INFO:test_framework:DB [db] is online. Response: {u'update_seq': 2, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244954988141, u'committed_update_seq': 2}
Wrote doc 6823ac3d33e482868a365e41b973f063 into USER: name=alice password=password db=db channels=['ABC', 'NBC', 'CBS'] cache=1
Wrote new rev {u'6823ac3d33e482868a365e41b973f063': u'2-8962e1a19309cc8c9a13453799b0735b'} into USER: name=alice password=password db=db channels=['ABC', 'NBC', 'CBS'] cache=1
Running playbook: libraries/provision/ansible/playbooks/stop-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway service] ********************************
changed: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway for CentOS 6] ***************************
skipping: [sg1]
TASK [SYNC GATEWAY | Verify sync_gateway not listening on port] ****************
ok: [sg1]
TASK [SYNC GATEWAY | Stop sync_gateway service on Windows] *********************
skipping: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=3 changed=1 unreachable=0 failed=0
2017-04-26 15:16:05,722 - INFO - start - >>> Starting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json
INFO:test_framework:>>> Starting sync_gateway with configuration: /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json
Running playbook: libraries/provision/ansible/playbooks/start-sync-gateway.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
TASK [SYNC GATEWAY | Copy sync gateway config to host] *************************
ok: [sg1]
TASK [SYNC GATEWAY | Check deployed config] ************************************
changed: [sg1]
TASK [SYNC GATEWAY | Print deployed config] ************************************
ok: [sg1] => {
"out.stdout": {
"adminInterface": "0.0.0.0:4985",
"compressResponses": false,
"databases": {
"db": {
"bucket": "data-bucket",
"feed_type": "DCP",
"password": "password",
"revs_limit": 5,
"server": "http://192.168.33.10:8091",
"shadow": {
"bucket": "source-bucket",
"password": "password",
"server": "http://192.168.33.10:8091",
"username": "source-bucket"
}
}
},
"interface": ":4984",
"log": [
"*"
],
"maxCouchbaseConnections": 16,
"maxFileDescriptors": 90000,
"maxIncomingConnections": 0,
"slowServerCallWarningThreshold": 500
}
}
TASK [SYNC GATEWAY | Copy sync gateway config to Windows host] *****************
skipping: [sg1]
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg1]
TASK [debug] *******************************************************************
ok: [sg1] => {
"msg": "Starting sync_gateway with config /Users/tleyden/Development/mobile-testkit/resources/sync_gateway_configs/sync_gateway_bucketshadow_low_revs_cc.json"
}
TASK [SYNC GATEWAY | Start sync gateway service] *******************************
changed: [sg1]
TASK [SYNC GATEWAY | Wait until sync gateway to listen on port] ****************
ok: [sg1]
TASK [debug] *******************************************************************
skipping: [sg1]
TASK [SYNC GATEWAY | Start sync_gateway service on Windows] ********************
skipping: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=8 changed=2 unreachable=0 failed=0
2017-04-26 15:16:10,167 - INFO - wait_until_db_online - DB [db] waiting until online
INFO:test_framework:DB [db] waiting until online
2017-04-26 15:16:10,247 - INFO - wait_until_db_online - DB [db] is online. Response: {u'update_seq': 106, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244967955398, u'committed_update_seq': 106}
INFO:test_framework:DB [db] is online. Response: {u'update_seq': 106, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244967955398, u'committed_update_seq': 106}
2017-04-26 15:16:10,247 - INFO - wait_until_db_online - DB [db] waiting until online
INFO:test_framework:DB [db] waiting until online
2017-04-26 15:16:10,250 - INFO - wait_until_db_online - DB [db] is online. Response: {u'update_seq': 106, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244954988141, u'committed_update_seq': 106}
INFO:test_framework:DB [db] is online. Response: {u'update_seq': 106, u'purge_seq': 0, u'compact_running': False, u'state': u'Online', u'db_name': u'db', u'disk_format_version': 0, u'instance_start_time': 1493244954988141, u'committed_update_seq': 106}
sync_gateway: http://192.168.33.11:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
sync_gateway: http://192.168.33.12:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
FAILEDTearing down test 'test_bucket_shadow_low_revs_limit'
----------------
Socket usage on mobile-testkit client ...
ESTABLISHED: 207
TIME_WAIT: 0
Running playbook: libraries/provision/ansible/playbooks/stop-ngrep.yml
PLAY [sync_gateways:sg_accels] *************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [kill any running ngrep screens] ******************************************
changed: [sg2]
changed: [sg1]
PLAY RECAP *********************************************************************
sg1 : ok=2 changed=1 unreachable=0 failed=0
sg2 : ok=2 changed=1 unreachable=0 failed=0
Running playbook: libraries/provision/ansible/playbooks/collect-ngrep.yml
PLAY [sync_gateways:sg_accels] *************************************************
TASK [setup] *******************************************************************
ok: [sg1]
ok: [sg2]
TASK [NGREP | fetch ngrep packet capture from loopback device] *****************
changed: [sg2]
changed: [sg1]
TASK [NGREP | fetch ngrep packet capture from eth0 device] *********************
changed: [sg2]
changed: [sg1]
TASK [NGREP | fetch ngrep packet capture from eth1 device] *********************
changed: [sg1]
changed: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=4 changed=3 unreachable=0 failed=0
sg2 : ok=4 changed=3 unreachable=0 failed=0
ngrep logs copied here /tmp/ngrep-test_bucket_shadow_low_revs_limit-2017-04-26-15-16-18-output.zip
resources/cluster_configs/multiple_sync_gateways_cc
cbs: [{'ip': u'192.168.33.10', 'name': u'cb1'}]
sgs: [{'ip': u'192.168.33.11', 'name': u'sg1'}, {'ip': u'192.168.33.12', 'name': u'sg2'}]
acs: []
ssl: False
sync_gateway: http://192.168.33.11:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
sync_gateway: http://192.168.33.12:4984, info: {"couchdb":"Welcome","vendor":{"name":"Couchbase Sync Gateway","version":1.4},"version":"Couchbase Sync Gateway/HEAD(nobranch)(674d1a9)"}
Pulling sync_gateway / sg_accel logs
Running playbook: libraries/provision/ansible/playbooks/fetch-sync-gateway-logs.yml
PLAY [sync_gateways] ***********************************************************
TASK [setup] *******************************************************************
ok: [sg2]
ok: [sg1]
TASK [SYNC GATEWAY | Check if sync_gateway access log is present] **************
ok: [sg1]
ok: [sg2]
TASK [SYNC GATEWAY | Fetch sync_gateway access logs] ***************************
changed: [sg2]
changed: [sg1]
TASK [SYNC GATEWAY | Check if sync_gateway error log is present] ***************
ok: [sg1]
ok: [sg2]
TASK [SYNC GATEWAY | Fetch sync_gateway error logs] ****************************
changed: [sg1]
changed: [sg2]
TASK [SYNC GATEWAY | Check if sync_gateway access log is present on Windows] ***
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Fetch sync_gateway access log for Windows] ****************
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Check if sync_gateway error log is present on Windows] ****
skipping: [sg1]
skipping: [sg2]
TASK [SYNC GATEWAY | Fetch sync_gateway error log for Windows] *****************
skipping: [sg1]
skipping: [sg2]
PLAY RECAP *********************************************************************
sg1 : ok=5 changed=2 unreachable=0 failed=0
sg2 : ok=5 changed=2 unreachable=0 failed=0
sync_gateway logs copied to results/logs/test_bucket_shadow_low_revs_limit-2017-04-26-15-16-20-sglogs.zip
TODO: Running Analysis: results/logs/test_bucket_shadow_low_revs_limit-2017-04-26-15-16-20-sglogs.zip
TEARDOWN F params_from_base_test_setupTearing down 'params_from_base_suite_setup' ...
TEARDOWN M params_from_base_suite_setup
TEARDOWN S environment
----------------------------------- generated xml file: /Users/tleyden/Development/mobile-testkit/results/results.xml -----------------------------------
---------------------------------- generated html file: /Users/tleyden/Development/mobile-testkit/results/report.html -----------------------------------
======================================================================= FAILURES ========================================================================
___________________________________________________________ test_bucket_shadow_low_revs_limit ___________________________________________________________
params_from_base_test_setup = {'cluster_config': 'resources/cluster_configs/multiple_sync_gateways_cc', 'mode': 'cc'}
@pytest.mark.topospecific
@pytest.mark.sanity
@pytest.mark.syncgateway
@pytest.mark.bucketshadow
@pytest.mark.channel
@pytest.mark.basicauth
def test_bucket_shadow_low_revs_limit(params_from_base_test_setup):
"""
Set revs limit to 40
Add doc and makes sure it syncs to source bucket
Take shadower offline
Update one doc more than 50 times
Bring shadower online
Look for panics
Add more revisions to SG -- expected issue
Look for panics
(TODO: Update doc in shadow bucket and look for panics?)
"""
cluster_config = params_from_base_test_setup["cluster_config"]
mode = params_from_base_test_setup["mode"]
if mode == "di":
pytest.skip("https://github.com/couchbase/sync_gateway/issues/2193")
log_info("Running 'test_bucket_shadow_low_revs_limit'")
log_info("Using cluster_config: {}".format(cluster_config))
default_config_path_shadower_low_revs = sync_gateway_config_path_for_mode("sync_gateway_bucketshadow_low_revs", mode)
default_config_path_non_shadower_low_revs = sync_gateway_config_path_for_mode("sync_gateway_default_low_revs", mode)
cluster = Cluster(config=cluster_config)
sc = init_shadow_cluster(cluster, default_config_path_shadower_low_revs, default_config_path_non_shadower_low_revs)
# Wait until shadower db is online, since deleting the bucket as part of provisioning might take it offline for a bit
sc.alice_shadower.wait_until_db_online()
sc.bob_non_shadower.wait_until_db_online()
# Write doc into shadower SG
doc_id = sc.alice_shadower.add_doc()
log_info("Wrote doc {} into {}".format(doc_id, sc.alice_shadower))
# Update the doc just so we have a rev_id
resp = sc.alice_shadower.update_doc(doc_id, content=fake_doc_content, num_revision=1)
log_info("Wrote new rev {} into {}".format(resp, sc.alice_shadower))
# Make sure it makes it to source bucket
get_doc_with_content_from_source_bucket_retry(doc_id, fake_doc_content, sc.source_bucket)
# Stop the SG shadower
sc.shadower_sg.stop()
# Update doc more than 50 times in non-shadower SG (since shadower is down)
sc.bob_non_shadower.update_doc(doc_id, num_revision=100)
sc.bob_non_shadower.update_doc(doc_id, content=fake_doc_content, num_revision=1)
# Bring SG shadower back up
sc.shadower_sg.start(default_config_path_shadower_low_revs)
# Wait until db online
sc.alice_shadower.wait_until_db_online()
sc.bob_non_shadower.wait_until_db_online()
# Look for panics
time.sleep(5) # Give tap feed a chance to initialize
errors = cluster.verify_alive(sc.mode)
assert len(errors) == 0
# Verify that the latest revision sync'd to source bucket
get_doc_with_content_from_source_bucket_retry(doc_id, fake_doc_content, sc.source_bucket)
# Add more revisions
> sc.bob_non_shadower.update_doc(doc_id, num_revision=50)
testsuites/syncgateway/functional/topology_specific_tests/multiple_sync_gateways/test_bucket_shadow.py:227:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
libraries/testkit/user.py:301: in update_doc
resp.raise_for_status()
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <Response [503]>
def raise_for_status(self):
"""Raises stored :class:`HTTPError`, if one occurred."""
http_error_msg = ''
if isinstance(self.reason, bytes):
# We attempt to decode utf-8 first because some servers
# choose to localize their reason strings. If the string
# isn't utf-8, we fall back to iso-8859-1 for all other
# encodings. (See PR #3538)
try:
reason = self.reason.decode('utf-8')
except UnicodeDecodeError:
reason = self.reason.decode('iso-8859-1')
else:
reason = self.reason
if 400 <= self.status_code < 500:
http_error_msg = u'%s Client Error: %s for url: %s' % (self.status_code, reason, self.url)
elif 500 <= self.status_code < 600:
http_error_msg = u'%s Server Error: %s for url: %s' % (self.status_code, reason, self.url)
if http_error_msg:
> raise HTTPError(http_error_msg, response=self)
E HTTPError: 503 Server Error: Service Unavailable for url: http://192.168.33.12:4984/db/6823ac3d33e482868a365e41b973f063
venv/lib/python2.7/site-packages/requests/models.py:909: HTTPError
================================================================== 21 tests deselected ==================================================================
================================================== 1 failed, 1 passed, 21 deselected in 98.16 seconds ===================================================
(venv) tleyden_macbook:mobile-testkit tleyden$
(venv) tleyden_macbook:mobile-testkit tleyden$
(venv) tleyden_macbook:mobile-testkit tleyden$
(venv) tleyden_macbook:mobile-testkit tleyden$ pytest -s -p no:sugar --mode=cc -k test_bucket_shadow_low_revs_limit --skip-provisioning testsuites/syncgateway/functional/topology_specific_tests/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment