Skip to content

Instantly share code, notes, and snippets.

@arunapiravi

arunapiravi/gist:01a4e4ad92ac4f7d9ced8406357116bd

Created May 3, 2016 00:45
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save arunapiravi/01a4e4ad92ac4f7d9ced8406357116bd to your computer and use it in GitHub Desktop.
Save arunapiravi/01a4e4ad92ac4f7d9ced8406357116bd to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
./testrunner -i INI_FILE.ini get-cbcollect-info=True,get-logs=False,stop-on-failure=False,GROUP=P1 -t fts.moving_topology_fts.MovingTopFTS.fts_crash_during_querying,items=10000,cluster=D,F,F,compare_es=False,num_queries=20,GROUP=P1
Test Input params:
{'num_queries': '20', 'logs_folder': '/data/workspace/cen006-p1-fts-vset02-01-moving-topology/logs/testrunner-16-May-01_19-59-59/test_23', 'GROUP': 'P1', 'compare_es': 'False', 'items': '10000', 'conf_file': 'conf/fts/py-fts-movingtopology.conf', 'num_nodes': 5, 'cluster_name': 'INI_FILE', 'cluster': 'D,F,F', 'stop-on-failure': 'False', 'ini': 'INI_FILE.ini', 'case_number': 23, 'get-logs': 'False', 'get-cbcollect-info': 'True', 'spec': 'py-fts-movingtopology'}
[2016-05-01 22:34:21,076] - [fts_base:1925] INFO - ==== FTSbasetests setup is started for test #23 fts_crash_during_querying ====
[2016-05-01 22:34:21,095] - [fts_base:909] INFO - removing nodes from cluster ...
[2016-05-01 22:34:21,109] - [fts_base:911] INFO - cleanup [ip:172.23.105.96 port:8091 ssh_username:root]
[2016-05-01 22:34:21,121] - [bucket_helper:137] INFO - deleting existing buckets [] on 172.23.105.96
[2016-05-01 22:34:21,162] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.105.96:8091
[2016-05-01 22:34:21,169] - [cluster_helper:80] INFO - ns_server @ 172.23.105.96:8091 is running
[2016-05-01 22:34:21,169] - [fts_base:858] INFO - Initializing Cluster ...
[2016-05-01 22:34:22,092] - [rest_client:876] INFO - pools/default params : memoryQuota=2069
[2016-05-01 22:34:22,107] - [rest_client:904] INFO - settings/indexes params : storageMode=forestdb
[2016-05-01 22:34:22,117] - [rest_client:792] INFO - settings/web params on 172.23.105.96:8091:username=Administrator&password=password&port=8091
[2016-05-01 22:34:22,149] - [fts_base:874] INFO - 172.23.105.190 will be configured with services fts
[2016-05-01 22:34:22,149] - [fts_base:874] INFO - 172.23.106.66 will be configured with services fts
[2016-05-01 22:34:23,150] - [task:405] INFO - adding node 172.23.105.190:8091 to cluster
[2016-05-01 22:34:23,150] - [rest_client:1062] INFO - adding remote node @172.23.105.190:8091 to this cluster @172.23.105.96:8091
[2016-05-01 22:34:28,389] - [task:405] INFO - adding node 172.23.106.66:8091 to cluster
[2016-05-01 22:34:28,390] - [rest_client:1062] INFO - adding remote node @172.23.106.66:8091 to this cluster @172.23.105.96:8091
[2016-05-01 22:34:33,212] - [rest_client:1280] INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%40172.23.106.66%2Cns_1%40172.23.105.96%2Cns_1%40172.23.105.190
[2016-05-01 22:34:33,222] - [rest_client:1284] INFO - rebalance operation started
[2016-05-01 22:34:33,229] - [rest_client:1415] INFO - rebalance percentage : 0.00 %
[2016-05-01 22:34:43,248] - [task:521] INFO - rebalancing was completed with progress: 100% in 10.025231123 sec
[2016-05-01 22:34:44,274] - [rest_client:1856] INFO - http://172.23.105.96:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=1569&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None
[2016-05-01 22:34:44,294] - [rest_client:1878] INFO - 0.02 seconds to create bucket default
[2016-05-01 22:34:44,294] - [bucket_helper:308] INFO - waiting for memcached bucket : default in 172.23.105.96 to accept set ops
[2016-05-01 22:34:45,881] - [data_helper:295] INFO - creating direct client 172.23.105.96:11210 default
[2016-05-01 22:34:46,030] - [data_helper:295] INFO - creating direct client 172.23.105.96:11210 default
[2016-05-01 22:34:47,237] - [task:289] INFO - bucket 'default' was created with per node RAM quota: 1569
[2016-05-01 22:34:47,303] - [rest_client:1296] INFO - /diag/eval status on 172.23.105.96:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2016-05-01 22:34:47,306] - [remote_util:169] INFO - connecting to 172.23.105.96 with username : root password : couchbase ssh_key:
[2016-05-01 22:34:47,576] - [remote_util:203] INFO - Connected to 172.23.105.96
[2016-05-01 22:34:48,108] - [remote_util:2234] INFO - running command.raw on 172.23.105.96: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:48,215] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:48,216] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:48,217] - [remote_util:2234] INFO - running command.raw on 172.23.105.96: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:48,319] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:48,320] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:48,437] - [remote_util:169] INFO - connecting to 172.23.105.190 with username : root password : couchbase ssh_key:
[2016-05-01 22:34:48,681] - [remote_util:203] INFO - Connected to 172.23.105.190
[2016-05-01 22:34:49,226] - [remote_util:2234] INFO - running command.raw on 172.23.105.190: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:49,437] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:49,439] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:49,439] - [remote_util:2234] INFO - running command.raw on 172.23.105.190: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:49,615] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:49,615] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:49,732] - [remote_util:169] INFO - connecting to 172.23.106.66 with username : root password : couchbase ssh_key:
[2016-05-01 22:34:50,005] - [remote_util:203] INFO - Connected to 172.23.106.66
[2016-05-01 22:34:50,547] - [remote_util:2234] INFO - running command.raw on 172.23.106.66: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:50,709] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:50,710] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:50,710] - [remote_util:2234] INFO - running command.raw on 172.23.106.66: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:50,853] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:50,855] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:50,972] - [remote_util:169] INFO - connecting to 172.23.105.69 with username : root password : couchbase ssh_key:
[2016-05-01 22:34:51,212] - [remote_util:203] INFO - Connected to 172.23.105.69
[2016-05-01 22:34:51,762] - [remote_util:2234] INFO - running command.raw on 172.23.105.69: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:51,871] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:51,872] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:51,872] - [remote_util:2234] INFO - running command.raw on 172.23.105.69: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:51,984] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:51,985] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:52,102] - [remote_util:169] INFO - connecting to 172.23.105.54 with username : root password : couchbase ssh_key:
[2016-05-01 22:34:52,319] - [remote_util:203] INFO - Connected to 172.23.105.54
[2016-05-01 22:34:52,931] - [remote_util:2234] INFO - running command.raw on 172.23.105.54: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:53,054] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:53,055] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:53,056] - [remote_util:2234] INFO - running command.raw on 172.23.105.54: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-01 22:34:53,171] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:34:53,172] - [fts_base:2362] INFO - 0
[2016-05-01 22:34:53,287] - [fts_base:2133] INFO - {'172.23.105.190': {'crash in forestdb': 0, 'panic:': 0}, '172.23.106.66': {'crash in forestdb': 0, 'panic:': 0}, '172.23.105.69': {'crash in forestdb': 0, 'panic:': 0}, '172.23.105.54': {'crash in forestdb': 0, 'panic:': 0}, '172.23.105.96': {'crash in forestdb': 0, 'panic:': 0}}
[2016-05-01 22:34:53,287] - [fts_base:1934] INFO - ==== FTSbasetests setup is finished for test #23 fts_crash_during_querying ====
[2016-05-01 22:34:53,346] - [fts_base:601] INFO - Checking if index already exists ...
[2016-05-01 22:34:53,375] - [rest_client:775] ERROR - http://172.23.105.190:8094/api/index/default_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found
rest_auth: preparePerm, err: index not found
[2016-05-01 22:34:53,378] - [rest_client:775] ERROR - http://172.23.105.190:8094/api/index/default_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found
rest_auth: preparePerm, err: index not found
[2016-05-01 22:34:53,379] - [fts_base:609] INFO - Creating fulltext-index default_index on 172.23.105.190
[2016-05-01 22:34:53,379] - [rest_client:2158] INFO - {"params": {}, "name": "default_index", "planParams": {"hierarchyRules": null, "nodePlanParams": null, "numReplicas": 0, "planFrozen": false, "maxPartitionsPerPIndex": 32}, "sourceName": "default", "sourceUUID": "", "sourceType": "couchbase", "type": "fulltext-index", "sourceParams": {"authUser": "default", "dataManagerSleepMaxMS": 20000, "authSaslUser": "", "clusterManagerSleepMaxMS": 20000, "authSaslPassword": "", "clusterManagerSleepInitMS": 0, "dataManagerBackoffFactor": 0, "authPassword": "", "dataManagerSleepInitMS": 0, "feedBufferAckThreshold": 0, "feedBufferSizeBytes": 0, "clusterManagerBackoffFactor": 0}, "uuid": ""}
[2016-05-01 22:34:53,428] - [rest_client:2167] INFO - Index default_index created
[2016-05-01 22:34:53,429] - [fts_base:2472] INFO - Validating index distribution for default_index ...
[2016-05-01 22:34:53,465] - [fts_base:2383] INFO - sleep for 5 secs. No pindexes found, waiting for index to get created ...
[2016-05-01 22:34:58,543] - [fts_base:2490] INFO - Validated: Number of PIndexes = 32
[2016-05-01 22:34:58,561] - [fts_base:2501] INFO - Validated: Every pIndex serves 32 partitions or lesser
[2016-05-01 22:34:58,561] - [fts_base:2517] INFO - Validated: pIndexes are distributed across [u'11ba0f08dfd744349cd8c24ae7ee473d', u'cf084badd724edb1b350e3f8c13d0362']
[2016-05-01 22:34:58,561] - [fts_base:2523] INFO - Expecting num of partitions in each node in range 480-544
[2016-05-01 22:34:58,561] - [fts_base:2538] INFO - Validated: Node 11ba0f08dfd744349cd8c24ae7ee473d houses 16 pindexes which serve 512 partitions
[2016-05-01 22:34:58,562] - [fts_base:2538] INFO - Validated: Node cf084badd724edb1b350e3f8c13d0362 houses 16 pindexes which serve 512 partitions
[2016-05-01 22:35:00,275] - [data_helper:295] INFO - creating direct client 172.23.105.96:11210 default
[2016-05-01 22:35:05,690] - [fts_base:2718] INFO - Loading phase complete!
[2016-05-01 22:35:05,924] - [fts_base:2405] INFO - Docs in bucket = 10000, docs in FTS index 'default_index': 899
[2016-05-01 22:35:12,116] - [fts_base:2405] INFO - Docs in bucket = 10000, docs in FTS index 'default_index': 2616
[2016-05-01 22:35:18,293] - [fts_base:2405] INFO - Docs in bucket = 10000, docs in FTS index 'default_index': 5045
[2016-05-01 22:35:24,557] - [fts_base:2405] INFO - Docs in bucket = 10000, docs in FTS index 'default_index': 7691
[2016-05-01 22:35:30,687] - [fts_base:2405] INFO - Docs in bucket = 10000, docs in FTS index 'default_index': 10000
[2016-05-01 22:35:30,687] - [fts_base:2425] INFO - FTS indexed 10000 docs in 0.42 mins
[2016-05-01 22:35:31,326] - [task:1098] INFO - ------------------------------------------------------------------ Query # 1 -----------------------------------------------------------------
[2016-05-01 22:35:31,340] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hanna Drucilla"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:31,421] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:31,423] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Hanna Drucilla"} is 1009 (took 23.893813ms)
[2016-05-01 22:35:31,424] - [task:1098] INFO - ------------------------------------------------------------------ Query # 2 -----------------------------------------------------------------
[2016-05-01 22:35:31,438] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Solita Hanna Cytheria"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:31,593] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:31,597] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Solita Hanna Cytheria"} is 1402 (took 81.776552ms)
[2016-05-01 22:35:31,597] - [task:1098] INFO - ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
[2016-05-01 22:35:31,617] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Training"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:31,694] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:31,696] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Training"} is 912 (took 27.316856ms)
[2016-05-01 22:35:31,697] - [task:1098] INFO - ------------------------------------------------------------------ Query # 4 -----------------------------------------------------------------
[2016-05-01 22:35:31,712] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:31,742] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:31,743] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 9.268626ms)
[2016-05-01 22:35:31,743] - [task:1098] INFO - ------------------------------------------------------------------ Query # 5 -----------------------------------------------------------------
[2016-05-01 22:35:31,757] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fuscienne@mcdiabetes.com"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:32,271] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:32,295] - [task:1107] INFO - FTS hits for query: {"field": "email", "match": "fuscienne@mcdiabetes.com"} is 10000 (took 182.670854ms)
[2016-05-01 22:35:32,297] - [task:1098] INFO - ------------------------------------------------------------------ Query # 6 -----------------------------------------------------------------
[2016-05-01 22:35:32,312] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:32,746] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:32,765] - [task:1107] INFO - FTS hits for query: {"field": "languages_known", "match": "French"} is 7922 (took 143.349993ms)
[2016-05-01 22:35:32,766] - [task:1098] INFO - ------------------------------------------------------------------ Query # 7 -----------------------------------------------------------------
[2016-05-01 22:35:32,790] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Malay Urdu"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:33,582] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:33,603] - [task:1107] INFO - FTS hits for query: {"field": "languages_known", "match": "Malay Urdu"} is 5260 (took 94.176678ms)
[2016-05-01 22:35:33,604] - [task:1098] INFO - ------------------------------------------------------------------ Query # 8 -----------------------------------------------------------------
[2016-05-01 22:35:33,619] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Kimberly Adara Gallia Severin"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:33,719] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:33,723] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Kimberly Adara Gallia Severin"} is 1339 (took 28.006466ms)
[2016-05-01 22:35:33,723] - [task:1098] INFO - ------------------------------------------------------------------ Query # 9 -----------------------------------------------------------------
[2016-05-01 22:35:33,741] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:33,768] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:33,769] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 7.459074ms)
[2016-05-01 22:35:33,769] - [task:1098] INFO - ------------------------------------------------------------------ Query # 10 -----------------------------------------------------------------
[2016-05-01 22:35:33,782] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:34,277] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:34,305] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 166.576969ms)
[2016-05-01 22:35:34,307] - [task:1098] INFO - ------------------------------------------------------------------ Query # 11 -----------------------------------------------------------------
[2016-05-01 22:35:34,328] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:34,397] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:34,399] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 909 (took 16.916221ms)
[2016-05-01 22:35:34,400] - [task:1098] INFO - ------------------------------------------------------------------ Query # 12 -----------------------------------------------------------------
[2016-05-01 22:35:34,419] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:35,251] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:35,274] - [task:1107] INFO - FTS hits for query: {"field": "languages_known", "match": "German"} is 8953 (took 122.77222ms)
[2016-05-01 22:35:35,275] - [task:1098] INFO - ------------------------------------------------------------------ Query # 13 -----------------------------------------------------------------
[2016-05-01 22:35:35,292] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Accounts"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:35,359] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:35,362] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Accounts"} is 940 (took 17.226573ms)
[2016-05-01 22:35:35,362] - [task:1098] INFO - ------------------------------------------------------------------ Query # 14 -----------------------------------------------------------------
[2016-05-01 22:35:35,384] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Mia"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:35,417] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:35,417] - [task:1107] INFO - FTS hits for query: {"field": "name", "match": "Mia"} is 149 (took 9.087791ms)
[2016-05-01 22:35:35,418] - [task:1098] INFO - ------------------------------------------------------------------ Query # 15 -----------------------------------------------------------------
[2016-05-01 22:35:35,432] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Support"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:35,507] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:35,509] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Support"} is 925 (took 28.351653ms)
[2016-05-01 22:35:35,509] - [task:1098] INFO - ------------------------------------------------------------------ Query # 16 -----------------------------------------------------------------
[2016-05-01 22:35:35,522] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Mercedes"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:35,581] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:35,583] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Mercedes"} is 531 (took 18.368369ms)
[2016-05-01 22:35:35,583] - [task:1098] INFO - ------------------------------------------------------------------ Query # 17 -----------------------------------------------------------------
[2016-05-01 22:35:35,598] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:36,097] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:36,123] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 156.588661ms)
[2016-05-01 22:35:36,124] - [task:1098] INFO - ------------------------------------------------------------------ Query # 18 -----------------------------------------------------------------
[2016-05-01 22:35:36,140] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Cynara Quella Salina"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:36,243] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:36,247] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Cynara Quella Salina"} is 1404 (took 29.120323ms)
[2016-05-01 22:35:36,247] - [task:1098] INFO - ------------------------------------------------------------------ Query # 19 -----------------------------------------------------------------
[2016-05-01 22:35:36,263] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:36,791] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:36,816] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 130.53218ms)
[2016-05-01 22:35:36,817] - [task:1098] INFO - ------------------------------------------------------------------ Query # 20 -----------------------------------------------------------------
[2016-05-01 22:35:36,841] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.105.190:
[2016-05-01 22:35:37,737] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:37,764] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 129.051424ms)
[2016-05-01 22:35:37,768] - [fts_base:2770] INFO - SUCCESS: 20 out of 20 queries passed
[2016-05-01 22:35:38,141] - [fts_base:385] INFO - Killing cbft on server: ip:172.23.105.190 port:8091 ssh_username:root
[2016-05-01 22:35:38,144] - [remote_util:169] INFO - connecting to 172.23.105.190 with username : root password : couchbase ssh_key:
[2016-05-01 22:35:38,387] - [remote_util:203] INFO - Connected to 172.23.105.190
[2016-05-01 22:35:38,953] - [remote_util:2234] INFO - running command.raw on 172.23.105.190: killall -9 cbft
[2016-05-01 22:35:39,053] - [remote_util:2271] INFO - command executed successfully
[2016-05-01 22:35:39,771] - [task:1098] INFO - ------------------------------------------------------------------ Query # 1 -----------------------------------------------------------------
[2016-05-01 22:35:39,792] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hanna Drucilla"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:39,857] - [rest_client:775] ERROR - http://172.23.106.66:8094/api/index/default_index/query error 400 reason: status: 400, content: rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hanna Drucilla"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e7a00), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"229"}, "Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}}, Body:(*http.body)(0xc82162a2c0), ContentLength:229, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55417", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hanna Drucilla"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e7a00), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"229"}, "Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}}, Body:(*http.body)(0xc82162a2c0), ContentLength:229, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55417", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
[2016-05-01 22:35:39,858] - [fts_base:683] ERROR - Error running query: 'NoneType' object is not iterable
[2016-05-01 22:35:39,858] - [task:1098] INFO - ------------------------------------------------------------------ Query # 2 -----------------------------------------------------------------
[2016-05-01 22:35:39,873] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Solita Hanna Cytheria"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:39,923] - [rest_client:775] ERROR - http://172.23.106.66:8094/api/index/default_index/query error 400 reason: status: 400, content: rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Solita Hanna Cytheria"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e6c00), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"236"}}, Body:(*http.body)(0xc8210c6d40), ContentLength:236, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55421", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Solita Hanna Cytheria"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e6c00), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"236"}}, Body:(*http.body)(0xc8210c6d40), ContentLength:236, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55421", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
[2016-05-01 22:35:39,923] - [fts_base:683] ERROR - Error running query: 'NoneType' object is not iterable
[2016-05-01 22:35:39,923] - [task:1098] INFO - ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
[2016-05-01 22:35:39,937] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Training"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:39,992] - [rest_client:775] ERROR - http://172.23.106.66:8094/api/index/default_index/query error 400 reason: status: 400, content: rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Training"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc820292980), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"212"}}, Body:(*http.body)(0xc8212e60c0), ContentLength:212, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55425", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Training"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc820292980), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"212"}}, Body:(*http.body)(0xc8212e60c0), ContentLength:212, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55425", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
[2016-05-01 22:35:39,993] - [fts_base:683] ERROR - Error running query: 'NoneType' object is not iterable
[2016-05-01 22:35:39,993] - [task:1098] INFO - ------------------------------------------------------------------ Query # 4 -----------------------------------------------------------------
[2016-05-01 22:35:40,008] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:40,043] - [rest_client:775] ERROR - http://172.23.106.66:8094/api/index/default_index/query error 400 reason: status: 400, content: rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e6300), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Length":[]string{"208"}, "Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}}, Body:(*http.body)(0xc8218c3a40), ContentLength:208, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55429", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e6300), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Length":[]string{"208"}, "Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}}, Body:(*http.body)(0xc8218c3a40), ContentLength:208, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55429", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
[2016-05-01 22:35:40,044] - [fts_base:683] ERROR - Error running query: 'NoneType' object is not iterable
[2016-05-01 22:35:40,044] - [task:1098] INFO - ------------------------------------------------------------------ Query # 5 -----------------------------------------------------------------
[2016-05-01 22:35:40,067] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fuscienne@mcdiabetes.com"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:40,231] - [rest_client:775] ERROR - http://172.23.106.66:8094/api/index/default_index/query error 400 reason: status: 400, content: rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fuscienne@mcdiabetes.com"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e6580), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"229"}, "Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}}, Body:(*http.body)(0xc821062740), ContentLength:229, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55433", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fuscienne@mcdiabetes.com"}, "size": 10000000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8207e6580), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"229"}, "Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}}, Body:(*http.body)(0xc821062740), ContentLength:229, TransferEncoding:[]string(nil), Close:false, Host:"172.23.106.66:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.122.47:55433", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
[2016-05-01 22:35:40,231] - [fts_base:683] ERROR - Error running query: 'NoneType' object is not iterable
[2016-05-01 22:35:40,232] - [task:1098] INFO - ------------------------------------------------------------------ Query # 6 -----------------------------------------------------------------
[2016-05-01 22:35:40,252] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:40,682] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:40,703] - [task:1107] INFO - FTS hits for query: {"field": "languages_known", "match": "French"} is 7922 (took 141.215573ms)
[2016-05-01 22:35:40,705] - [task:1098] INFO - ------------------------------------------------------------------ Query # 7 -----------------------------------------------------------------
[2016-05-01 22:35:40,719] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Malay Urdu"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:41,404] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:41,422] - [task:1107] INFO - FTS hits for query: {"field": "languages_known", "match": "Malay Urdu"} is 5260 (took 97.98288ms)
[2016-05-01 22:35:41,423] - [task:1098] INFO - ------------------------------------------------------------------ Query # 8 -----------------------------------------------------------------
[2016-05-01 22:35:41,442] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Kimberly Adara Gallia Severin"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:41,569] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:41,572] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Kimberly Adara Gallia Severin"} is 1339 (took 57.418526ms)
[2016-05-01 22:35:41,573] - [task:1098] INFO - ------------------------------------------------------------------ Query # 9 -----------------------------------------------------------------
[2016-05-01 22:35:41,598] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:41,627] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:41,627] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 10.070157ms)
[2016-05-01 22:35:41,627] - [task:1098] INFO - ------------------------------------------------------------------ Query # 10 -----------------------------------------------------------------
[2016-05-01 22:35:41,640] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:42,135] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:42,157] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 159.44647ms)
[2016-05-01 22:35:42,158] - [task:1098] INFO - ------------------------------------------------------------------ Query # 11 -----------------------------------------------------------------
[2016-05-01 22:35:42,172] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:42,251] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:42,253] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 909 (took 21.844231ms)
[2016-05-01 22:35:42,254] - [task:1098] INFO - ------------------------------------------------------------------ Query # 12 -----------------------------------------------------------------
[2016-05-01 22:35:42,271] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:42,824] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:42,847] - [task:1107] INFO - FTS hits for query: {"field": "languages_known", "match": "German"} is 8953 (took 195.365709ms)
[2016-05-01 22:35:42,848] - [task:1098] INFO - ------------------------------------------------------------------ Query # 13 -----------------------------------------------------------------
[2016-05-01 22:35:42,872] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Accounts"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:42,954] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:42,956] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Accounts"} is 940 (took 22.819979ms)
[2016-05-01 22:35:42,957] - [task:1098] INFO - ------------------------------------------------------------------ Query # 14 -----------------------------------------------------------------
[2016-05-01 22:35:42,969] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Mia"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:43,014] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:43,015] - [task:1107] INFO - FTS hits for query: {"field": "name", "match": "Mia"} is 149 (took 12.51788ms)
[2016-05-01 22:35:43,015] - [task:1098] INFO - ------------------------------------------------------------------ Query # 15 -----------------------------------------------------------------
[2016-05-01 22:35:43,035] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Support"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:43,115] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:43,118] - [task:1107] INFO - FTS hits for query: {"field": "dept", "match": "Support"} is 925 (took 28.845895ms)
[2016-05-01 22:35:43,118] - [task:1098] INFO - ------------------------------------------------------------------ Query # 16 -----------------------------------------------------------------
[2016-05-01 22:35:43,137] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Mercedes"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:43,198] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:43,200] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Mercedes"} is 531 (took 24.015045ms)
[2016-05-01 22:35:43,200] - [task:1098] INFO - ------------------------------------------------------------------ Query # 17 -----------------------------------------------------------------
[2016-05-01 22:35:43,218] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:44,161] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:44,188] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 186.678761ms)
[2016-05-01 22:35:44,189] - [task:1098] INFO - ------------------------------------------------------------------ Query # 18 -----------------------------------------------------------------
[2016-05-01 22:35:44,283] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Cynara Quella Salina"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:44,382] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:44,386] - [task:1107] INFO - FTS hits for query: {"field": "manages.reports", "match": "Cynara Quella Salina"} is 1404 (took 29.001585ms)
[2016-05-01 22:35:44,386] - [task:1098] INFO - ------------------------------------------------------------------ Query # 19 -----------------------------------------------------------------
[2016-05-01 22:35:44,399] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:44,861] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:44,883] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 126.740902ms)
[2016-05-01 22:35:44,884] - [task:1098] INFO - ------------------------------------------------------------------ Query # 20 -----------------------------------------------------------------
[2016-05-01 22:35:44,900] - [fts_base:1104] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000000} on node: 172.23.106.66:
[2016-05-01 22:35:45,712] - [rest_client:2304] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-01 22:35:45,735] - [task:1107] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 10000 (took 117.922675ms)
FAIL
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment