arunapiravi/gist:43cb9e413aafde826adb5cfc19b5de03

## gistfile1.txt
./testrunner -i INI_FILE.ini get-cbcollect-info=True,get-coredumps=True,get-logs=False,stop-on-failure=False,GROUP=P1 -t fts.stable_topology_fts.StableTopFTS.index_query_in_parallel,items=1000000,num_queries=200,query_max_matches=10000,GROUP=P1

Test Input params:
{'get-coredumps': 'True', 'num_queries': '200', 'logs_folder': '/data/workspace/cen006-p1-fts-vset00-02-stable-topology/logs/testrunner-16-May-08_20-49-32/test_12', 'GROUP': 'P1', 'items': '1000000', 'conf_file': 'conf/fts/py-fts-simpletopology.conf', 'num_nodes': 3, 'cluster_name': 'INI_FILE', 'query_max_matches': '10000', 'ini': 'INI_FILE.ini', 'case_number': 12, 'get-logs': 'False', 'stop-on-failure': 'False', 'get-cbcollect-info': 'True', 'spec': 'py-fts-simpletopology'}
[2016-05-09 00:04:58,015] - [remote_util:169] INFO - connecting to 172.23.107.187 with username : root password : couchbase ssh_key:
[2016-05-09 00:04:58,181] - [remote_util:203] INFO - Connected to 172.23.107.187
looking for Erlang/Memcached crashes on 172.23.107.187 ...
dump files not found on 172.23.107.187
[2016-05-09 00:04:58,930] - [remote_util:169] INFO - connecting to 172.23.107.145 with username : root password : couchbase ssh_key:
[2016-05-09 00:04:59,097] - [remote_util:203] INFO - Connected to 172.23.107.145
looking for Erlang/Memcached crashes on 172.23.107.145 ...
dump files not found on 172.23.107.145
[2016-05-09 00:04:59,857] - [remote_util:169] INFO - connecting to 172.23.107.234 with username : root password : couchbase ssh_key:
[2016-05-09 00:05:00,092] - [remote_util:203] INFO - Connected to 172.23.107.234
index_query_in_parallel (fts.stable_topology_fts.StableTopFTS) ... looking for Erlang/Memcached crashes on 172.23.107.234 ...
dump files not found on 172.23.107.234
[2016-05-09 00:05:00,956] - [fts_base:1953] INFO - ==== FTSbasetests setup is started for test #12 index_query_in_parallel ====
[2016-05-09 00:05:00,970] - [fts_base:937] INFO - removing nodes from cluster ...
[2016-05-09 00:05:00,979] - [fts_base:939] INFO - cleanup [ip:172.23.107.187 port:8091 ssh_username:root]
[2016-05-09 00:05:00,988] - [bucket_helper:137] INFO - deleting existing buckets [] on 172.23.107.187
[2016-05-09 00:05:01,014] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.107.187:8091
[2016-05-09 00:05:01,019] - [cluster_helper:80] INFO - ns_server @ 172.23.107.187:8091 is running
[2016-05-09 00:05:01,019] - [fts_base:886] INFO - Initializing Cluster ...
[2016-05-09 00:05:01,970] - [rest_client:876] INFO - pools/default params : memoryQuota=2069
[2016-05-09 00:05:01,976] - [rest_client:904] INFO - settings/indexes params : storageMode=forestdb
[2016-05-09 00:05:01,986] - [rest_client:792] INFO - settings/web params on 172.23.107.187:8091:username=Administrator&password=password&port=8091
[2016-05-09 00:05:02,006] - [fts_base:902] INFO - 172.23.107.145 will be configured with services kv,fts
[2016-05-09 00:05:02,007] - [fts_base:902] INFO - 172.23.107.234 will be configured with services fts
[2016-05-09 00:05:03,007] - [task:405] INFO - adding node 172.23.107.145:8091 to cluster
[2016-05-09 00:05:03,008] - [rest_client:1062] INFO - adding remote node @172.23.107.145:8091 to this cluster @172.23.107.187:8091
[2016-05-09 00:05:07,336] - [task:405] INFO - adding node 172.23.107.234:8091 to cluster
[2016-05-09 00:05:07,336] - [rest_client:1062] INFO - adding remote node @172.23.107.234:8091 to this cluster @172.23.107.187:8091
[2016-05-09 00:05:13,148] - [rest_client:1280] INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%40172.23.107.187%2Cns_1%40172.23.107.145%2Cns_1%40172.23.107.234
[2016-05-09 00:05:13,155] - [rest_client:1284] INFO - rebalance operation started
[2016-05-09 00:05:13,163] - [rest_client:1415] INFO - rebalance percentage : 0.00 %
[2016-05-09 00:05:23,179] - [task:521] INFO - rebalancing was completed with progress: 100% in 10.0230128765 sec
[2016-05-09 00:05:24,196] - [rest_client:1856] INFO - http://172.23.107.187:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=1569&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None
[2016-05-09 00:05:24,205] - [rest_client:1878] INFO - 0.01 seconds to create bucket default
[2016-05-09 00:05:24,205] - [bucket_helper:308] INFO - waiting for memcached bucket : default in 172.23.107.187 to accept set ops
[2016-05-09 00:05:25,916] - [data_helper:295] INFO - creating direct client 172.23.107.145:11210 default
[2016-05-09 00:05:26,020] - [data_helper:295] INFO - creating direct client 172.23.107.187:11210 default
[2016-05-09 00:05:26,167] - [data_helper:295] INFO - creating direct client 172.23.107.145:11210 default
[2016-05-09 00:05:26,287] - [data_helper:295] INFO - creating direct client 172.23.107.187:11210 default
[2016-05-09 00:05:26,998] - [task:289] INFO - bucket 'default' was created with per node RAM quota: 1569
[2016-05-09 00:05:27,034] - [rest_client:1296] INFO - /diag/eval status on 172.23.107.187:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2016-05-09 00:05:27,035] - [remote_util:169] INFO - connecting to 172.23.107.187 with username : root password : couchbase ssh_key:
[2016-05-09 00:05:27,205] - [remote_util:203] INFO - Connected to 172.23.107.187
[2016-05-09 00:05:27,717] - [remote_util:2292] INFO - running command.raw on 172.23.107.187: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 00:05:27,819] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 00:05:27,820] - [fts_base:2390] INFO - 0
[2016-05-09 00:05:27,820] - [remote_util:2292] INFO - running command.raw on 172.23.107.187: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 00:05:27,922] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 00:05:27,922] - [fts_base:2390] INFO - 0
[2016-05-09 00:05:28,037] - [remote_util:169] INFO - connecting to 172.23.107.145 with username : root password : couchbase ssh_key:
[2016-05-09 00:05:28,205] - [remote_util:203] INFO - Connected to 172.23.107.145
[2016-05-09 00:05:28,717] - [remote_util:2292] INFO - running command.raw on 172.23.107.145: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 00:05:28,903] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 00:05:28,903] - [fts_base:2390] INFO - 0
[2016-05-09 00:05:28,904] - [remote_util:2292] INFO - running command.raw on 172.23.107.145: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 00:05:29,052] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 00:05:29,052] - [fts_base:2390] INFO - 0
[2016-05-09 00:05:29,167] - [remote_util:169] INFO - connecting to 172.23.107.234 with username : root password : couchbase ssh_key:
[2016-05-09 00:05:29,402] - [remote_util:203] INFO - Connected to 172.23.107.234
[2016-05-09 00:05:29,967] - [remote_util:2292] INFO - running command.raw on 172.23.107.234: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 00:05:30,100] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 00:05:30,101] - [fts_base:2390] INFO - 0
[2016-05-09 00:05:30,101] - [remote_util:2292] INFO - running command.raw on 172.23.107.234: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 00:05:30,259] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 00:05:30,260] - [fts_base:2390] INFO - 0
[2016-05-09 00:05:30,374] - [fts_base:2161] INFO - {'172.23.107.145': {'crash in forestdb': 0, 'panic:': 0}, '172.23.107.234': {'crash in forestdb': 0, 'panic:': 0}, '172.23.107.187': {'crash in forestdb': 0, 'panic:': 0}}
[2016-05-09 00:05:30,374] - [fts_base:1962] INFO - ==== FTSbasetests setup is finished for test #12 index_query_in_parallel ====
[2016-05-09 00:05:30,433] - [fts_base:602] INFO - Checking if index already exists ...
[2016-05-09 00:05:30,458] - [rest_client:775] ERROR - http://172.23.107.234:8094/api/index/default_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found
 rest_auth: preparePerm, err: index not found
[2016-05-09 00:05:30,460] - [rest_client:775] ERROR - http://172.23.107.234:8094/api/index/default_index error 403 reason: status: 403, content: rest_auth: preparePerm, err: index not found
 rest_auth: preparePerm, err: index not found
[2016-05-09 00:05:30,460] - [fts_base:610] INFO - Creating fulltext-index default_index on 172.23.107.234
[2016-05-09 00:05:30,460] - [rest_client:2158] INFO - {"params": {}, "name": "default_index", "planParams": {"hierarchyRules": null, "nodePlanParams": null, "numReplicas": 0, "planFrozen": false, "maxPartitionsPerPIndex": 32}, "sourceName": "default", "sourceUUID": "", "sourceType": "couchbase", "type": "fulltext-index", "sourceParams": {"authUser": "default", "dataManagerSleepMaxMS": 20000, "authSaslUser": "", "clusterManagerSleepMaxMS": 20000, "authSaslPassword": "", "clusterManagerSleepInitMS": 0, "dataManagerBackoffFactor": 0, "authPassword": "", "dataManagerSleepInitMS": 0, "feedBufferAckThreshold": 0, "feedBufferSizeBytes": 0, "clusterManagerBackoffFactor": 0}, "uuid": ""}
[2016-05-09 00:05:30,526] - [rest_client:2167] INFO - Index default_index created
[2016-05-09 00:05:30,526] - [fts_base:2500] INFO - Validating index distribution for default_index ...
[2016-05-09 00:05:30,556] - [fts_base:2411] INFO - sleep for 5 secs. No pindexes found, waiting for index to get created ...
[2016-05-09 00:05:35,643] - [fts_base:2518] INFO - Validated: Number of PIndexes = 32
[2016-05-09 00:05:35,653] - [fts_base:2530] INFO - Validated: Every pIndex serves 32 partitions or lesser
[2016-05-09 00:05:35,653] - [fts_base:2546] INFO - Validated: pIndexes are distributed across [u'88ffdf642faaeb87dc484ea6c53f80b9', u'0a180bd4b99e59252f7426109874ce7c']
[2016-05-09 00:05:35,653] - [fts_base:2552] INFO - Expecting num of partitions in each node in range 480-544
[2016-05-09 00:05:35,654] - [fts_base:2567] INFO - Validated: Node 88ffdf642faaeb87dc484ea6c53f80b9 houses 16 pindexes which serve 512 partitions
[2016-05-09 00:05:35,654] - [fts_base:2567] INFO - Validated: Node 0a180bd4b99e59252f7426109874ce7c houses 16 pindexes which serve 512 partitions
[2016-05-09 00:07:39,434] - [data_helper:295] INFO - creating direct client 172.23.107.145:11210 default
[2016-05-09 00:07:39,540] - [data_helper:295] INFO - creating direct client 172.23.107.187:11210 default
[2016-05-09 00:13:26,097] - [fts_base:2747] INFO - Loading phase complete!
[2016-05-09 00:13:27,281] - [task:1099] INFO - ------------------------------------------------------------------ Query # 1 -----------------------------------------------------------------
[2016-05-09 00:13:27,306] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hanna Drucilla"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:13:41,082] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:13:41,083] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Hanna Drucilla"} is 12415 (took 12669.677642ms)
[2016-05-09 00:13:41,084] - [task:1099] INFO - ------------------------------------------------------------------ Query # 2 -----------------------------------------------------------------
[2016-05-09 00:13:41,103] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Solita Hanna Cytheria"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:13:54,672] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:13:54,672] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Solita Hanna Cytheria"} is 18460 (took 12229.055064ms)
[2016-05-09 00:13:54,673] - [task:1099] INFO - ------------------------------------------------------------------ Query # 3 -----------------------------------------------------------------
[2016-05-09 00:13:54,703] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Training"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:14:05,916] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:14:05,917] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Training"} is 12439 (took 10113.167813ms)
[2016-05-09 00:14:05,918] - [task:1099] INFO - ------------------------------------------------------------------ Query # 4 -----------------------------------------------------------------
[2016-05-09 00:14:05,941] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:14:06,279] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:14:06,279] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 280.582854ms)
[2016-05-09 00:14:06,279] - [task:1099] INFO - ------------------------------------------------------------------ Query # 5 -----------------------------------------------------------------
[2016-05-09 00:14:06,294] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fuscienne@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:14:27,545] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:14:27,546] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "fuscienne@mcdiabetes.com"} is 139644 (took 20109.89256ms)
[2016-05-09 00:14:27,547] - [task:1099] INFO - ------------------------------------------------------------------ Query # 6 -----------------------------------------------------------------
[2016-05-09 00:14:27,571] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:14:41,715] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:14:41,716] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "French"} is 112499 (took 13315.249896ms)
[2016-05-09 00:14:41,716] - [task:1099] INFO - ------------------------------------------------------------------ Query # 7 -----------------------------------------------------------------
[2016-05-09 00:14:41,736] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Malay Urdu"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:15:01,736] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:15:01,736] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Malay Urdu"} is 76010 (took 18080.069236ms)
[2016-05-09 00:15:01,737] - [task:1099] INFO - ------------------------------------------------------------------ Query # 8 -----------------------------------------------------------------
[2016-05-09 00:15:01,757] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Kimberly Adara Gallia Severin"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:15:11,810] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:15:11,810] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Kimberly Adara Gallia Severin"} is 20383 (took 8938.235367ms)
[2016-05-09 00:15:11,811] - [task:1099] INFO - ------------------------------------------------------------------ Query # 9 -----------------------------------------------------------------
[2016-05-09 00:15:11,828] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:15:12,176] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:15:12,176] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 258.504998ms)
[2016-05-09 00:15:12,176] - [task:1099] INFO - ------------------------------------------------------------------ Query # 10 -----------------------------------------------------------------
[2016-05-09 00:15:12,187] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:15:43,561] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:15:43,562] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 150618 (took 30714.828035ms)
[2016-05-09 00:15:43,563] - [task:1099] INFO - ------------------------------------------------------------------ Query # 11 -----------------------------------------------------------------
[2016-05-09 00:15:43,580] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:15:52,548] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:15:52,549] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 14375 (took 7874.935588ms)
[2016-05-09 00:15:52,549] - [task:1099] INFO - ------------------------------------------------------------------ Query # 12 -----------------------------------------------------------------
[2016-05-09 00:15:52,568] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:16:18,372] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:16:18,372] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "German"} is 145128 (took 24800.686849ms)
[2016-05-09 00:16:18,373] - [task:1099] INFO - ------------------------------------------------------------------ Query # 13 -----------------------------------------------------------------
[2016-05-09 00:16:18,391] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Accounts"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:16:27,216] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:16:27,217] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Accounts"} is 14997 (took 8165.315374ms)
[2016-05-09 00:16:27,218] - [task:1099] INFO - ------------------------------------------------------------------ Query # 14 -----------------------------------------------------------------
[2016-05-09 00:16:27,231] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Mia"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:16:29,803] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:16:29,804] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Mia"} is 2425 (took 2503.042303ms)
[2016-05-09 00:16:29,804] - [task:1099] INFO - ------------------------------------------------------------------ Query # 15 -----------------------------------------------------------------
[2016-05-09 00:16:29,820] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Support"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:16:34,993] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:16:34,993] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Support"} is 15203 (took 4940.277464ms)
[2016-05-09 00:16:34,994] - [task:1099] INFO - ------------------------------------------------------------------ Query # 16 -----------------------------------------------------------------
[2016-05-09 00:16:35,011] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Mercedes"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:16:42,577] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:16:42,578] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Mercedes"} is 8613 (took 6151.34756ms)
[2016-05-09 00:16:42,578] - [task:1099] INFO - ------------------------------------------------------------------ Query # 17 -----------------------------------------------------------------
[2016-05-09 00:16:42,598] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:17:11,712] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:17:11,712] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 170447 (took 28358.798979ms)
[2016-05-09 00:17:11,714] - [task:1099] INFO - ------------------------------------------------------------------ Query # 18 -----------------------------------------------------------------
[2016-05-09 00:17:11,732] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Cynara Quella Salina"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:17:26,191] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:17:26,192] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Cynara Quella Salina"} is 23905 (took 14176.452749ms)
[2016-05-09 00:17:26,193] - [task:1099] INFO - ------------------------------------------------------------------ Query # 19 -----------------------------------------------------------------
[2016-05-09 00:17:26,212] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:17:57,941] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:17:57,942] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 177817 (took 31151.472606ms)
[2016-05-09 00:17:57,942] - [task:1099] INFO - ------------------------------------------------------------------ Query # 20 -----------------------------------------------------------------
[2016-05-09 00:17:57,960] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:18:41,672] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:18:41,673] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 182026 (took 43117.253972ms)
[2016-05-09 00:18:41,673] - [task:1099] INFO - ------------------------------------------------------------------ Query # 21 -----------------------------------------------------------------
[2016-05-09 00:18:41,699] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Quechua Chinese"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:19:15,069] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:19:15,069] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Quechua Chinese"} is 80183 (took 32442.363775ms)
[2016-05-09 00:19:15,070] - [task:1099] INFO - ------------------------------------------------------------------ Query # 22 -----------------------------------------------------------------
[2016-05-09 00:19:15,181] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Pre-sales"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:19:39,201] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:19:39,202] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Pre-sales"} is 35553 (took 20261.003116ms)
[2016-05-09 00:19:39,203] - [task:1099] INFO - ------------------------------------------------------------------ Query # 23 -----------------------------------------------------------------
[2016-05-09 00:19:39,220] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Maura"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:19:48,345] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:19:48,345] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Maura"} is 10051 (took 8874.3903ms)
[2016-05-09 00:19:48,346] - [task:1099] INFO - ------------------------------------------------------------------ Query # 24 -----------------------------------------------------------------
[2016-05-09 00:19:48,363] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "keelia@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:20:37,245] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:20:37,246] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "keelia@mcdiabetes.com"} is 201752 (took 45981.562234ms)
[2016-05-09 00:20:37,247] - [task:1099] INFO - ------------------------------------------------------------------ Query # 25 -----------------------------------------------------------------
[2016-05-09 00:20:37,276] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Keelia Foster"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:20:42,917] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:20:42,918] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Keelia Foster"} is 5991 (took 5484.873664ms)
[2016-05-09 00:20:42,919] - [task:1099] INFO - ------------------------------------------------------------------ Query # 26 -----------------------------------------------------------------
[2016-05-09 00:20:42,937] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Adrianne Adena Trista Callia"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:21:05,745] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:21:05,745] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Adrianne Adena Trista Callia"} is 36608 (took 21233.537661ms)
[2016-05-09 00:21:05,746] - [task:1099] INFO - ------------------------------------------------------------------ Query # 27 -----------------------------------------------------------------
[2016-05-09 00:21:05,764] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "thea@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:21:57,182] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:21:57,183] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "thea@mcdiabetes.com"} is 212734 (took 51146.275498ms)
[2016-05-09 00:21:57,183] - [task:1099] INFO - ------------------------------------------------------------------ Query # 28 -----------------------------------------------------------------
[2016-05-09 00:21:57,201] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Amara Davis"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:22:04,871] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:22:04,871] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Amara Davis"} is 6088 (took 7496.149272ms)
[2016-05-09 00:22:04,872] - [task:1099] INFO - ------------------------------------------------------------------ Query # 29 -----------------------------------------------------------------
[2016-05-09 00:22:04,890] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Adrianne Wilson"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:22:12,926] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:22:12,926] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Adrianne Wilson"} is 6225 (took 6233.809046ms)
[2016-05-09 00:22:12,927] - [task:1099] INFO - ------------------------------------------------------------------ Query # 30 -----------------------------------------------------------------
[2016-05-09 00:22:12,947] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Safiya Tempest Bryn"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:22:33,231] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:22:33,232] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Safiya Tempest Bryn"} is 30361 (took 19974.099668ms)
[2016-05-09 00:22:33,233] - [task:1099] INFO - ------------------------------------------------------------------ Query # 31 -----------------------------------------------------------------
[2016-05-09 00:22:33,250] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Darcei"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:22:36,438] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:22:36,439] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Darcei"} is 3160 (took 3095.353102ms)
[2016-05-09 00:22:36,439] - [task:1099] INFO - ------------------------------------------------------------------ Query # 32 -----------------------------------------------------------------
[2016-05-09 00:22:36,458] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Sidonia"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:22:40,066] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:22:40,067] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Sidonia"} is 3068 (took 2954.105773ms)
[2016-05-09 00:22:40,067] - [task:1099] INFO - ------------------------------------------------------------------ Query # 33 -----------------------------------------------------------------
[2016-05-09 00:22:40,084] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hanna Darcei Delores"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:22:55,197] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:22:55,198] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Hanna Darcei Delores"} is 30725 (took 13160.301895ms)
[2016-05-09 00:22:55,199] - [task:1099] INFO - ------------------------------------------------------------------ Query # 34 -----------------------------------------------------------------
[2016-05-09 00:22:55,216] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Urdu Portuguese"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:23:29,063] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:23:29,064] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Urdu Portuguese"} is 119981 (took 31816.907056ms)
[2016-05-09 00:23:29,065] - [task:1099] INFO - ------------------------------------------------------------------ Query # 35 -----------------------------------------------------------------
[2016-05-09 00:23:29,083] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Gerónimo"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:23:34,731] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:23:34,732] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Gerónimo"} is 3462 (took 5066.124621ms)
[2016-05-09 00:23:34,733] - [task:1099] INFO - ------------------------------------------------------------------ Query # 36 -----------------------------------------------------------------
[2016-05-09 00:23:34,752] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Keelia Kallie Lilith Devi"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:23:56,143] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:23:56,143] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Keelia Kallie Lilith Devi"} is 40755 (took 21049.794246ms)
[2016-05-09 00:23:56,144] - [task:1099] INFO - ------------------------------------------------------------------ Query # 37 -----------------------------------------------------------------
[2016-05-09 00:23:56,163] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Kory Moore"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:24:03,858] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:24:03,858] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Kory Moore"} is 6725 (took 7529.216574ms)
[2016-05-09 00:24:03,859] - [task:1099] INFO - ------------------------------------------------------------------ Query # 38 -----------------------------------------------------------------
[2016-05-09 00:24:03,875] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "kimberly@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:24:15,916] - [rest_client:778] ERROR - socket error while connecting to http://172.23.107.145:8094/api/index/default_index/query error [Errno 111] Connection refused
[2016-05-09 00:24:18,921] - [rest_client:778] ERROR - socket error while connecting to http://172.23.107.145:8094/api/index/default_index/query error [Errno 111] Connection refused
[2016-05-09 00:25:22,736] - [task:1103] INFO - Status: {u'successful': 9, u'failed': 23, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_3cf74ad7': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_b7ff6b68': u'pindex not available', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d6109bff': u'pindex not available', u'default_index_5442ab3f4ac94e7a_f17535e5': u'pindex not available', u'default_index_5442ab3f4ac94e7a_54127e67': u'pindex not available', u'default_index_5442ab3f4ac94e7a_348f5c3c': u'pindex not available', u'default_index_5442ab3f4ac94e7a_596cc6a1': u'pindex not available', u'default_index_5442ab3f4ac94e7a_5c5f941e': u'pindex not available', u'default_index_5442ab3f4ac94e7a_4a7ce4ca': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d90ca3e7': u'pindex not available', u'default_index_5442ab3f4ac94e7a_8b80958a': u'pindex not available', u'default_index_5442ab3f4ac94e7a_9e13fa43': u'pindex not available', u'default_index_5442ab3f4ac94e7a_76ac2a42': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_e64340fa': u'pindex not available'}}
[2016-05-09 00:25:22,736] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:25:22,736] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "kimberly@mcdiabetes.com"} is 65534 (took 60004.146953ms)
[2016-05-09 00:25:22,737] - [task:1099] INFO - ------------------------------------------------------------------ Query # 39 -----------------------------------------------------------------
[2016-05-09 00:25:22,762] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:26:20,366] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:26:20,367] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 243779 (took 55441.026374ms)
[2016-05-09 00:26:20,368] - [task:1099] INFO - ------------------------------------------------------------------ Query # 40 -----------------------------------------------------------------
[2016-05-09 00:26:20,390] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Ciara Moore"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:26:28,923] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:26:28,924] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Ciara Moore"} is 7430 (took 6330.78306ms)
[2016-05-09 00:26:28,924] - [task:1099] INFO - ------------------------------------------------------------------ Query # 41 -----------------------------------------------------------------
[2016-05-09 00:26:28,941] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "English"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:27:30,594] - [task:1103] INFO - Status: {u'successful': 26, u'failed': 6, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded'}}
[2016-05-09 00:27:30,594] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:27:30,594] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "English"} is 164674 (took 60665.009384ms)
[2016-05-09 00:27:30,597] - [task:1099] INFO - ------------------------------------------------------------------ Query # 42 -----------------------------------------------------------------
[2016-05-09 00:27:30,616] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:27:34,408] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:27:34,408] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 3434.7176ms)
[2016-05-09 00:27:34,409] - [task:1099] INFO - ------------------------------------------------------------------ Query # 43 -----------------------------------------------------------------
[2016-05-09 00:27:34,426] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Trista Vala Safiya"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:27:59,171] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:27:59,172] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Trista Vala Safiya"} is 37729 (took 21001.779884ms)
[2016-05-09 00:27:59,173] - [task:1099] INFO - ------------------------------------------------------------------ Query # 44 -----------------------------------------------------------------
[2016-05-09 00:27:59,194] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:27:59,342] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:27:59,342] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 47.092517ms)
[2016-05-09 00:27:59,343] - [task:1099] INFO - ------------------------------------------------------------------ Query # 45 -----------------------------------------------------------------
[2016-05-09 00:27:59,360] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "vala@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:29:00,497] - [task:1103] INFO - Status: {u'successful': 24, u'failed': 8, u'total': 32, u'errors': {u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:29:00,497] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:29:00,497] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "vala@mcdiabetes.com"} is 156732 (took 60196.012053ms)
[2016-05-09 00:29:00,498] - [task:1099] INFO - ------------------------------------------------------------------ Query # 46 -----------------------------------------------------------------
[2016-05-09 00:29:00,516] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "HR"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:29:10,751] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:29:10,751] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "HR"} is 26525 (took 9046.317756ms)
[2016-05-09 00:29:10,752] - [task:1099] INFO - ------------------------------------------------------------------ Query # 47 -----------------------------------------------------------------
[2016-05-09 00:29:10,776] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "callia@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:30:12,030] - [task:1103] INFO - Status: {u'successful': 26, u'failed': 6, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded'}}
[2016-05-09 00:30:12,030] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:30:12,031] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "callia@mcdiabetes.com"} is 184235 (took 60339.1563ms)
[2016-05-09 00:30:12,031] - [task:1099] INFO - ------------------------------------------------------------------ Query # 48 -----------------------------------------------------------------
[2016-05-09 00:30:12,054] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Arabic Dutch"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:31:15,500] - [task:1103] INFO - Status: {u'successful': 26, u'failed': 6, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded'}}
[2016-05-09 00:31:15,500] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:31:15,501] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Arabic Dutch"} is 141038 (took 61432.684083ms)
[2016-05-09 00:31:15,502] - [task:1099] INFO - ------------------------------------------------------------------ Query # 49 -----------------------------------------------------------------
[2016-05-09 00:31:15,516] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Morgan"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:31:20,337] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:31:20,337] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Morgan"} is 4373 (took 4389.518099ms)
[2016-05-09 00:31:20,338] - [task:1099] INFO - ------------------------------------------------------------------ Query # 50 -----------------------------------------------------------------
[2016-05-09 00:31:20,354] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Adrianne"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:31:24,849] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:31:24,849] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Adrianne"} is 4327 (took 3506.548745ms)
[2016-05-09 00:31:24,850] - [task:1099] INFO - ------------------------------------------------------------------ Query # 51 -----------------------------------------------------------------
[2016-05-09 00:31:24,866] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Hindi"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:32:13,083] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:32:13,084] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Hindi"} is 195378 (took 45999.610807ms)
[2016-05-09 00:32:13,085] - [task:1099] INFO - ------------------------------------------------------------------ Query # 52 -----------------------------------------------------------------
[2016-05-09 00:32:13,108] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:33:15,108] - [task:1103] INFO - Status: {u'successful': 26, u'failed': 6, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded'}}
[2016-05-09 00:33:15,108] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:33:15,109] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 199263 (took 60501.696914ms)
[2016-05-09 00:33:15,110] - [task:1099] INFO - ------------------------------------------------------------------ Query # 53 -----------------------------------------------------------------
[2016-05-09 00:33:15,195] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Japanese Japanese"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:33:39,681] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:33:39,681] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Japanese Japanese"} is 120097 (took 23645.913815ms)
[2016-05-09 00:33:39,682] - [task:1099] INFO - ------------------------------------------------------------------ Query # 54 -----------------------------------------------------------------
[2016-05-09 00:33:39,699] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German Nepalese"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:34:42,444] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded'}}
[2016-05-09 00:34:42,445] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:34:42,445] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "German Nepalese"} is 79004 (took 60103.42592ms)
[2016-05-09 00:34:42,446] - [task:1099] INFO - ------------------------------------------------------------------ Query # 55 -----------------------------------------------------------------
[2016-05-09 00:34:42,465] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Adams"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:34:48,293] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:34:48,294] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Adams"} is 4772 (took 4916.581303ms)
[2016-05-09 00:34:48,294] - [task:1099] INFO - ------------------------------------------------------------------ Query # 56 -----------------------------------------------------------------
[2016-05-09 00:34:48,315] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:34:48,777] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:34:48,777] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 324.262383ms)
[2016-05-09 00:34:48,777] - [task:1099] INFO - ------------------------------------------------------------------ Query # 57 -----------------------------------------------------------------
[2016-05-09 00:34:48,797] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:34:57,996] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:34:57,997] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 30498 (took 8422.879163ms)
[2016-05-09 00:34:57,997] - [task:1099] INFO - ------------------------------------------------------------------ Query # 58 -----------------------------------------------------------------
[2016-05-09 00:34:58,022] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:35:03,101] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:35:03,102] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 30596 (took 3446.163527ms)
[2016-05-09 00:35:03,103] - [task:1099] INFO - ------------------------------------------------------------------ Query # 59 -----------------------------------------------------------------
[2016-05-09 00:35:03,120] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Info-tech"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:35:29,559] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:35:29,559] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Info-tech"} is 30400 (took 24115.172903ms)
[2016-05-09 00:35:29,560] - [task:1099] INFO - ------------------------------------------------------------------ Query # 60 -----------------------------------------------------------------
[2016-05-09 00:35:29,576] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Vala Deirdre Gabi Kory"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:36:22,521] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:36:22,522] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Vala Deirdre Gabi Kory"} is 59693 (took 51489.431556ms)
[2016-05-09 00:36:22,523] - [task:1099] INFO - ------------------------------------------------------------------ Query # 61 -----------------------------------------------------------------
[2016-05-09 00:36:22,544] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "sirena@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:37:24,384] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded'}}
[2016-05-09 00:37:24,385] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:37:24,385] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "sirena@mcdiabetes.com"} is 90784 (took 60244.340511ms)
[2016-05-09 00:37:24,386] - [task:1099] INFO - ------------------------------------------------------------------ Query # 62 -----------------------------------------------------------------
[2016-05-09 00:37:24,401] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Keelia Alvita Ambika Lysha"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:37:53,310] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:37:53,310] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Keelia Alvita Ambika Lysha"} is 62076 (took 24988.243679ms)
[2016-05-09 00:37:53,311] - [task:1099] INFO - ------------------------------------------------------------------ Query # 63 -----------------------------------------------------------------
[2016-05-09 00:37:53,329] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Fantine Gallia Kagami"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:38:06,925] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:38:06,925] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Fantine Gallia Kagami"} is 49561 (took 12366.429792ms)
[2016-05-09 00:38:06,926] - [task:1099] INFO - ------------------------------------------------------------------ Query # 64 -----------------------------------------------------------------
[2016-05-09 00:38:06,945] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Ciara Mia Ebony Delores"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:38:24,523] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:38:24,524] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Ciara Mia Ebony Delores"} is 62773 (took 16031.105631ms)
[2016-05-09 00:38:24,525] - [task:1099] INFO - ------------------------------------------------------------------ Query # 65 -----------------------------------------------------------------
[2016-05-09 00:38:24,543] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "solita@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:39:26,207] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:39:26,207] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:39:26,207] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "solita@mcdiabetes.com"} is 90784 (took 60116.14081ms)
[2016-05-09 00:39:26,208] - [task:1099] INFO - ------------------------------------------------------------------ Query # 66 -----------------------------------------------------------------
[2016-05-09 00:39:26,226] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Ciara Howard Jr."}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:39:43,722] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:39:43,723] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Ciara Howard Jr."} is 21137 (took 15873.650283ms)
[2016-05-09 00:39:43,723] - [task:1099] INFO - ------------------------------------------------------------------ Query # 67 -----------------------------------------------------------------
[2016-05-09 00:39:43,748] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Italian Japanese"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:40:46,162] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded'}}
[2016-05-09 00:40:46,163] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:40:46,163] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Italian Japanese"} is 78016 (took 60251.783692ms)
[2016-05-09 00:40:46,164] - [task:1099] INFO - ------------------------------------------------------------------ Query # 68 -----------------------------------------------------------------
[2016-05-09 00:40:46,180] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:41:47,220] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:41:47,220] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:41:47,220] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 93755 (took 60355.697761ms)
[2016-05-09 00:41:47,221] - [task:1099] INFO - ------------------------------------------------------------------ Query # 69 -----------------------------------------------------------------
[2016-05-09 00:41:47,242] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "sidonia@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:42:49,091] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded'}}
[2016-05-09 00:42:49,091] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:42:49,091] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "sidonia@mcdiabetes.com"} is 93755 (took 60070.759171ms)
[2016-05-09 00:42:49,092] - [task:1099] INFO - ------------------------------------------------------------------ Query # 70 -----------------------------------------------------------------
[2016-05-09 00:42:49,111] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:42:59,268] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:42:59,268] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 35254 (took 8165.161705ms)
[2016-05-09 00:42:59,269] - [task:1099] INFO - ------------------------------------------------------------------ Query # 71 -----------------------------------------------------------------
[2016-05-09 00:42:59,285] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "HR"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:43:08,904] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:43:08,904] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "HR"} is 35868 (took 8088.718826ms)
[2016-05-09 00:43:08,905] - [task:1099] INFO - ------------------------------------------------------------------ Query # 72 -----------------------------------------------------------------
[2016-05-09 00:43:08,924] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:44:10,256] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:44:10,257] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:44:10,257] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 93755 (took 60397.709999ms)
[2016-05-09 00:44:10,258] - [task:1099] INFO - ------------------------------------------------------------------ Query # 73 -----------------------------------------------------------------
[2016-05-09 00:44:10,279] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Kala Moore"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:44:19,599] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:44:19,599] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Kala Moore"} is 11264 (took 7343.41569ms)
[2016-05-09 00:44:19,600] - [task:1099] INFO - ------------------------------------------------------------------ Query # 74 -----------------------------------------------------------------
[2016-05-09 00:44:19,617] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fuscienne@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:45:21,453] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded'}}
[2016-05-09 00:45:21,453] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:45:21,454] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "fuscienne@mcdiabetes.com"} is 93755 (took 60113.556222ms)
[2016-05-09 00:45:21,454] - [task:1099] INFO - ------------------------------------------------------------------ Query # 75 -----------------------------------------------------------------
[2016-05-09 00:45:21,472] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:46:22,981] - [task:1103] INFO - Status: {u'successful': 31, u'failed': 1, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_596cc6a1': u'context deadline exceeded'}}
[2016-05-09 00:46:22,981] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:46:22,981] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 59996.962532ms)
[2016-05-09 00:46:22,982] - [task:1099] INFO - ------------------------------------------------------------------ Query # 76 -----------------------------------------------------------------
[2016-05-09 00:46:23,002] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "fantine@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:47:24,739] - [task:1103] INFO - Status: {u'successful': 15, u'failed': 17, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_596cc6a1': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:47:24,740] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:47:24,740] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "fantine@mcdiabetes.com"} is 89217 (took 60569.528745ms)
[2016-05-09 00:47:24,741] - [task:1099] INFO - ------------------------------------------------------------------ Query # 77 -----------------------------------------------------------------
[2016-05-09 00:47:24,756] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:47:34,424] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:47:34,424] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 8750.29723ms)
[2016-05-09 00:47:34,424] - [task:1099] INFO - ------------------------------------------------------------------ Query # 78 -----------------------------------------------------------------
[2016-05-09 00:47:34,443] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Quechua Africans"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:48:37,967] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:48:37,967] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:48:37,967] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Quechua Africans"} is 66456 (took 60206.359306ms)
[2016-05-09 00:48:37,968] - [task:1099] INFO - ------------------------------------------------------------------ Query # 79 -----------------------------------------------------------------
[2016-05-09 00:48:37,988] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:49:39,534] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:49:39,534] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:49:39,534] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 98479 (took 60371.624508ms)
[2016-05-09 00:49:39,535] - [task:1099] INFO - ------------------------------------------------------------------ Query # 80 -----------------------------------------------------------------
[2016-05-09 00:49:39,556] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Vietnamese"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:50:41,501] - [task:1103] INFO - Status: {u'successful': 26, u'failed': 6, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded'}}
[2016-05-09 00:50:41,501] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:50:41,501] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Vietnamese"} is 154490 (took 60567.088574ms)
[2016-05-09 00:50:41,502] - [task:1099] INFO - ------------------------------------------------------------------ Query # 81 -----------------------------------------------------------------
[2016-05-09 00:50:41,526] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:51:44,252] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:51:44,253] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:51:44,253] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 102055 (took 61151.338037ms)
[2016-05-09 00:51:44,254] - [task:1099] INFO - ------------------------------------------------------------------ Query # 82 -----------------------------------------------------------------
[2016-05-09 00:51:44,284] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Adara"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:51:46,386] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:51:46,387] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Adara"} is 0 (took 342.874151ms)
[2016-05-09 00:51:46,387] - [task:1099] INFO - ------------------------------------------------------------------ Query # 83 -----------------------------------------------------------------
[2016-05-09 00:51:46,410] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Engineering"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:52:03,599] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:52:03,599] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Engineering"} is 40243 (took 15709.843513ms)
[2016-05-09 00:52:03,600] - [task:1099] INFO - ------------------------------------------------------------------ Query # 84 -----------------------------------------------------------------
[2016-05-09 00:52:03,621] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Info-tech"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:52:28,796] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:52:28,796] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Info-tech"} is 40548 (took 23044.007777ms)
[2016-05-09 00:52:28,797] - [task:1099] INFO - ------------------------------------------------------------------ Query # 85 -----------------------------------------------------------------
[2016-05-09 00:52:28,813] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French Arabic"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:53:30,968] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:53:30,969] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:53:30,969] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "French Arabic"} is 81693 (took 60400.52735ms)
[2016-05-09 00:53:30,970] - [task:1099] INFO - ------------------------------------------------------------------ Query # 86 -----------------------------------------------------------------
[2016-05-09 00:53:30,986] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Sirena"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:53:41,530] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:53:41,531] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Sirena"} is 23073 (took 9348.070629ms)
[2016-05-09 00:53:41,532] - [task:1099] INFO - ------------------------------------------------------------------ Query # 87 -----------------------------------------------------------------
[2016-05-09 00:53:41,549] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "quella@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:54:43,363] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:54:43,364] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:54:43,364] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "quella@mcdiabetes.com"} is 103448 (took 60021.543051ms)
[2016-05-09 00:54:43,365] - [task:1099] INFO - ------------------------------------------------------------------ Query # 88 -----------------------------------------------------------------
[2016-05-09 00:54:43,382] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Antonia Maura"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:55:01,164] - [task:1103] INFO - Status: {u'successful': 20, u'failed': 12, u'total': 32, u'errors': {u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_27184a97': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_27184a97/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d90ca3e7': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d90ca3e7/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_b7ff6b68': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_b7ff6b68/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_4a7ce4ca': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_4a7ce4ca/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_76ac2a42': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_76ac2a42/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d6109bff': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d6109bff/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_e64340fa': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_e64340fa/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_596cc6a1': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_596cc6a1/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_5c5f941e': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_5c5f941e/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_54127e67': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_54127e67/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_0ffd4517': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_0ffd4517/query: EOF', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_348f5c3c': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_348f5c3c/query: EOF'}}
[2016-05-09 00:55:01,164] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:55:01,164] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Antonia Maura"} is 36623 (took 16213.502849ms)
[2016-05-09 00:55:01,165] - [task:1099] INFO - ------------------------------------------------------------------ Query # 89 -----------------------------------------------------------------
[2016-05-09 00:55:01,183] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Antonia Cook"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:55:08,028] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_27184a97': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_27184a97/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d90ca3e7': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d90ca3e7/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_b7ff6b68': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_b7ff6b68/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_e64340fa': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_e64340fa/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_4a7ce4ca': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_4a7ce4ca/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_76ac2a42': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_76ac2a42/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_f17535e5': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_f17535e5/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d6109bff': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_d6109bff/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_3cf74ad7': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_3cf74ad7/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_596cc6a1': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_596cc6a1/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_5c5f941e': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_5c5f941e/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_54127e67': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_54127e67/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_0ffd4517': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_0ffd4517/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_8b80958a': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_8b80958a/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_9e13fa43': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_9e13fa43/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused', u'IndexClient - http://172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_348f5c3c': u'Post http://%40fts-cbauth:bdfc39653a451fe81e67bd89ec92d6d8@172.23.107.145:8094/api/pindex/default_index_5442ab3f4ac94e7a_348f5c3c/query: dial tcp 172.23.107.145:8094: getsockopt: connection refused'}}
[2016-05-09 00:55:08,029] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:55:08,029] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Antonia Cook"} is 10022 (took 5111.099122ms)
[2016-05-09 00:55:08,030] - [task:1099] INFO - ------------------------------------------------------------------ Query # 90 -----------------------------------------------------------------
[2016-05-09 00:55:08,045] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "gallia@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:56:08,365] - [rest_client:775] ERROR - http://172.23.107.234:8094/api/index/default_index/query error 400 reason: status: 400, content: rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "gallia@mcdiabetes.com"}, "size": 10000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8209c4280), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"223"}}, Body:(*http.body)(0xc82c346340), ContentLength:223, TransferEncoding:[]string(nil), Close:false, Host:"172.23.107.234:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.106.205:42895", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found

 rest_index: Query, indexName: default_index, requestBody: {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "gallia@mcdiabetes.com"}, "size": 10000}, req: &http.Request{Method:"POST", URL:(*url.URL)(0xc8209c4280), Proto:"HTTP/1.1", ProtoMajor:1, ProtoMinor:1, Header:http.Header{"Content-Type":[]string{"application/json"}, "Authorization":[]string{"Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA=="}, "Accept":[]string{"*/*"}, "User-Agent":[]string{"Python-httplib2/$Rev: 259 $"}, "Accept-Encoding":[]string{"identity"}, "Content-Length":[]string{"223"}}, Body:(*http.body)(0xc82c346340), ContentLength:223, TransferEncoding:[]string(nil), Close:false, Host:"172.23.107.234:8094", Form:url.Values{}, PostForm:url.Values{}, MultipartForm:(*multipart.Form)(nil), Trailer:http.Header(nil), RemoteAddr:"172.23.106.205:42895", RequestURI:"/api/index/default_index/query", TLS:(*tls.ConnectionState)(nil), Cancel:(<-chan struct {})(nil)}, err: bleve: QueryBlevePIndexImpl remote client returned status: 403 body: rest_auth: preparePerm, err: pindex not found
[2016-05-09 00:56:08,365] - [fts_base:689] ERROR - Error running query: 'NoneType' object is not iterable
[2016-05-09 00:56:08,365] - [task:1103] INFO - Status: {}
[2016-05-09 00:56:08,365] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "gallia@mcdiabetes.com"} is -1 (took 0.0ms)
[2016-05-09 00:56:08,365] - [task:1099] INFO - ------------------------------------------------------------------ Query # 91 -----------------------------------------------------------------
[2016-05-09 00:56:08,383] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Deirdre Araceli Killian"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:56:28,018] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:56:28,018] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Deirdre Araceli Killian"} is 63255 (took 19127.530679ms)
[2016-05-09 00:56:28,019] - [task:1099] INFO - ------------------------------------------------------------------ Query # 92 -----------------------------------------------------------------
[2016-05-09 00:56:28,036] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Mia"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:56:32,034] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:56:32,035] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Mia"} is 6633 (took 3829.92452ms)
[2016-05-09 00:56:32,035] - [task:1099] INFO - ------------------------------------------------------------------ Query # 93 -----------------------------------------------------------------
[2016-05-09 00:56:32,055] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:57:32,295] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:57:32,296] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:57:32,296] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 99831 (took 60000.488757ms)
[2016-05-09 00:57:32,297] - [task:1099] INFO - ------------------------------------------------------------------ Query # 94 -----------------------------------------------------------------
[2016-05-09 00:57:32,321] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:57:32,612] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:57:32,612] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 274.864084ms)
[2016-05-09 00:57:32,612] - [task:1099] INFO - ------------------------------------------------------------------ Query # 95 -----------------------------------------------------------------
[2016-05-09 00:57:32,627] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Marketing"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:57:43,805] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:57:43,806] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Marketing"} is 42757 (took 8693.458534ms)
[2016-05-09 00:57:43,806] - [task:1099] INFO - ------------------------------------------------------------------ Query # 96 -----------------------------------------------------------------
[2016-05-09 00:57:43,824] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 00:57:44,029] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 00:57:44,030] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 179.556883ms)
[2016-05-09 00:57:44,030] - [task:1099] INFO - ------------------------------------------------------------------ Query # 97 -----------------------------------------------------------------
[2016-05-09 00:57:44,048] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Quechua"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:58:46,521] - [task:1103] INFO - Status: {u'successful': 26, u'failed': 6, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded'}}
[2016-05-09 00:58:46,522] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:58:46,522] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Quechua"} is 120463 (took 60980.065235ms)
[2016-05-09 00:58:46,523] - [task:1099] INFO - ------------------------------------------------------------------ Query # 98 -----------------------------------------------------------------
[2016-05-09 00:58:46,542] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "sidonia@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 00:59:49,627] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 00:59:49,627] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 00:59:49,627] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "sidonia@mcdiabetes.com"} is 107761 (took 60196.957017ms)
[2016-05-09 00:59:49,629] - [task:1099] INFO - ------------------------------------------------------------------ Query # 99 -----------------------------------------------------------------
[2016-05-09 00:59:49,646] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Araceli Duvessa"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:00:08,881] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:00:08,882] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Araceli Duvessa"} is 46382 (took 18648.748964ms)
[2016-05-09 01:00:08,883] - [task:1099] INFO - ------------------------------------------------------------------ Query # 100 -----------------------------------------------------------------
[2016-05-09 01:00:08,900] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:00:09,162] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:00:09,162] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 192.10879ms)
[2016-05-09 01:00:09,163] - [task:1099] INFO - ------------------------------------------------------------------ Query # 101 -----------------------------------------------------------------
[2016-05-09 01:00:09,174] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "adrianne@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:01:09,221] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:01:09,221] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:01:09,221] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "adrianne@mcdiabetes.com"} is 109671 (took 59787.442749ms)
[2016-05-09 01:01:09,222] - [task:1099] INFO - ------------------------------------------------------------------ Query # 102 -----------------------------------------------------------------
[2016-05-09 01:01:09,240] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Edwards Sr."}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:01:19,569] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:01:19,569] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Edwards Sr."} is 21188 (took 9969.509246ms)
[2016-05-09 01:01:19,570] - [task:1099] INFO - ------------------------------------------------------------------ Query # 103 -----------------------------------------------------------------
[2016-05-09 01:01:19,588] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Killian"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:01:28,333] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:01:28,333] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Killian"} is 24787 (took 7876.539821ms)
[2016-05-09 01:01:28,335] - [task:1099] INFO - ------------------------------------------------------------------ Query # 104 -----------------------------------------------------------------
[2016-05-09 01:01:28,355] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "casondrah@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:02:28,375] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:02:28,375] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:02:28,375] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "casondrah@mcdiabetes.com"} is 109671 (took 59742.679632ms)
[2016-05-09 01:02:28,376] - [task:1099] INFO - ------------------------------------------------------------------ Query # 105 -----------------------------------------------------------------
[2016-05-09 01:02:28,402] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Caryssa Bailey"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:02:47,124] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:02:47,124] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Caryssa Bailey"} is 14096 (took 17689.319539ms)
[2016-05-09 01:02:47,125] - [task:1099] INFO - ------------------------------------------------------------------ Query # 106 -----------------------------------------------------------------
[2016-05-09 01:02:47,148] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Killian Tomás"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:03:06,632] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:03:06,632] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Killian Tomás"} is 14391 (took 19207.716494ms)
[2016-05-09 01:03:06,633] - [task:1099] INFO - ------------------------------------------------------------------ Query # 107 -----------------------------------------------------------------
[2016-05-09 01:03:06,654] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Kory Ciara"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:03:29,370] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:03:29,370] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Kory Ciara"} is 48493 (took 22420.723499ms)
[2016-05-09 01:03:29,371] - [task:1099] INFO - ------------------------------------------------------------------ Query # 108 -----------------------------------------------------------------
[2016-05-09 01:03:29,390] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Dabria Sidonia Jetta Deandra"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:03:49,079] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:03:49,079] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Dabria Sidonia Jetta Deandra"} is 88197 (took 19309.832297ms)
[2016-05-09 01:03:49,080] - [task:1099] INFO - ------------------------------------------------------------------ Query # 109 -----------------------------------------------------------------
[2016-05-09 01:03:49,104] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Italian German"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:04:50,544] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:04:50,544] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:04:50,544] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Italian German"} is 99898 (took 60148.339841ms)
[2016-05-09 01:04:50,546] - [task:1099] INFO - ------------------------------------------------------------------ Query # 110 -----------------------------------------------------------------
[2016-05-09 01:04:50,564] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Support"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:05:00,464] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:05:00,465] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Support"} is 46345 (took 9663.49457ms)
[2016-05-09 01:05:00,466] - [task:1099] INFO - ------------------------------------------------------------------ Query # 111 -----------------------------------------------------------------
[2016-05-09 01:05:00,490] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Balandria"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:05:07,824] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:05:07,825] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Balandria"} is 25559 (took 5752.198149ms)
[2016-05-09 01:05:07,826] - [task:1099] INFO - ------------------------------------------------------------------ Query # 112 -----------------------------------------------------------------
[2016-05-09 01:05:07,843] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Dabria Wood"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:05:16,111] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:05:16,111] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Dabria Wood"} is 14583 (took 8034.756548ms)
[2016-05-09 01:05:16,113] - [task:1099] INFO - ------------------------------------------------------------------ Query # 113 -----------------------------------------------------------------
[2016-05-09 01:05:16,127] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Marketing"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:05:22,588] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:05:22,589] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Marketing"} is 46902 (took 6217.886162ms)
[2016-05-09 01:05:22,589] - [task:1099] INFO - ------------------------------------------------------------------ Query # 114 -----------------------------------------------------------------
[2016-05-09 01:05:22,605] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Spanish"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:06:24,751] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:06:24,752] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:06:24,752] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Spanish"} is 105562 (took 59933.42572ms)
[2016-05-09 01:06:24,753] - [task:1099] INFO - ------------------------------------------------------------------ Query # 115 -----------------------------------------------------------------
[2016-05-09 01:06:24,774] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "deandra@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:07:24,806] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:07:24,807] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:07:24,807] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "deandra@mcdiabetes.com"} is 112447 (took 59772.649988ms)
[2016-05-09 01:07:24,808] - [task:1099] INFO - ------------------------------------------------------------------ Query # 116 -----------------------------------------------------------------
[2016-05-09 01:07:24,825] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Perdita Cynara Joby Killian"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:07:57,834] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:07:57,835] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Perdita Cynara Joby Killian"} is 91628 (took 31801.651429ms)
[2016-05-09 01:07:57,836] - [task:1099] INFO - ------------------------------------------------------------------ Query # 117 -----------------------------------------------------------------
[2016-05-09 01:07:57,854] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Ebony Chatha Fantine Thea"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:08:35,791] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:08:35,792] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Ebony Chatha Fantine Thea"} is 92229 (took 37554.298844ms)
[2016-05-09 01:08:35,793] - [task:1099] INFO - ------------------------------------------------------------------ Query # 118 -----------------------------------------------------------------
[2016-05-09 01:08:35,811] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Thai Nepalese"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:09:18,091] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:09:18,092] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Thai Nepalese"} is 140048 (took 40094.711612ms)
[2016-05-09 01:09:18,093] - [task:1099] INFO - ------------------------------------------------------------------ Query # 119 -----------------------------------------------------------------
[2016-05-09 01:09:18,112] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Araceli"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:09:29,859] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:09:29,859] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Araceli"} is 26866 (took 9413.358275ms)
[2016-05-09 01:09:29,861] - [task:1099] INFO - ------------------------------------------------------------------ Query # 120 -----------------------------------------------------------------
[2016-05-09 01:09:29,879] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Nepalese Dutch"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:10:30,657] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:10:30,657] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:10:30,657] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Nepalese Dutch"} is 53327 (took 60139.950084ms)
[2016-05-09 01:10:30,658] - [task:1099] INFO - ------------------------------------------------------------------ Query # 121 -----------------------------------------------------------------
[2016-05-09 01:10:30,678] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Accounts"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:10:41,386] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:10:41,386] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Accounts"} is 48834 (took 10451.330206ms)
[2016-05-09 01:10:41,387] - [task:1099] INFO - ------------------------------------------------------------------ Query # 122 -----------------------------------------------------------------
[2016-05-09 01:10:41,413] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Harris"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:10:47,055] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:10:47,056] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Harris"} is 7767 (took 5129.743448ms)
[2016-05-09 01:10:47,056] - [task:1099] INFO - ------------------------------------------------------------------ Query # 123 -----------------------------------------------------------------
[2016-05-09 01:10:47,075] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:11:48,086] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:11:48,086] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:11:48,087] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 112843 (took 60172.740067ms)
[2016-05-09 01:11:48,087] - [task:1099] INFO - ------------------------------------------------------------------ Query # 124 -----------------------------------------------------------------
[2016-05-09 01:11:48,105] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Kimberly Caryssa Ambika Amara"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:12:28,321] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:12:28,322] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Kimberly Caryssa Ambika Amara"} is 94961 (took 39103.667809ms)
[2016-05-09 01:12:28,323] - [task:1099] INFO - ------------------------------------------------------------------ Query # 125 -----------------------------------------------------------------
[2016-05-09 01:12:28,353] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Gallia"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:12:33,428] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:12:33,428] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Gallia"} is 7818 (took 4844.487133ms)
[2016-05-09 01:12:33,429] - [task:1099] INFO - ------------------------------------------------------------------ Query # 126 -----------------------------------------------------------------
[2016-05-09 01:12:33,454] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Hedda Kacila"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:12:48,385] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:12:48,386] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Hedda Kacila"} is 53014 (took 13934.65497ms)
[2016-05-09 01:12:48,387] - [task:1099] INFO - ------------------------------------------------------------------ Query # 127 -----------------------------------------------------------------
[2016-05-09 01:12:48,407] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Drucilla Maura Maura"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:13:09,624] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:13:09,625] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Drucilla Maura Maura"} is 53339 (took 17726.307914ms)
[2016-05-09 01:13:09,626] - [task:1099] INFO - ------------------------------------------------------------------ Query # 128 -----------------------------------------------------------------
[2016-05-09 01:13:09,644] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "German Sinhalese"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:14:11,959] - [rest_client:778] ERROR - socket error while connecting to http://172.23.107.145:8094/api/index/default_index/query error [Errno 111] Connection refused
[2016-05-09 01:15:14,979] - [task:1103] INFO - Status: {u'successful': 0, u'failed': 32, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_3cf74ad7': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_b7ff6b68': u'pindex not available', u'default_index_5442ab3f4ac94e7a_76ac2a42': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d6109bff': u'pindex not available', u'default_index_5442ab3f4ac94e7a_f17535e5': u'pindex not available', u'default_index_5442ab3f4ac94e7a_54127e67': u'pindex not available', u'default_index_5442ab3f4ac94e7a_348f5c3c': u'pindex not available', u'default_index_5442ab3f4ac94e7a_596cc6a1': u'pindex not available', u'default_index_5442ab3f4ac94e7a_5c5f941e': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4a7ce4ca': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_27184a97': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d90ca3e7': u'pindex not available', u'default_index_5442ab3f4ac94e7a_8b80958a': u'pindex not available', u'default_index_5442ab3f4ac94e7a_9e13fa43': u'pindex not available', u'default_index_5442ab3f4ac94e7a_0ffd4517': u'pindex not available', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_e64340fa': u'pindex not available'}}
[2016-05-09 01:15:14,979] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "German Sinhalese"} is 0 (took 59996.55371ms)
[2016-05-09 01:15:14,979] - [task:1099] INFO - ------------------------------------------------------------------ Query # 129 -----------------------------------------------------------------
[2016-05-09 01:15:15,201] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Hindi Dutch"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:16:16,182] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'IndexClient - http://172.23.107.234:8094/api/pindex/default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:16:16,182] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:16:16,183] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Hindi Dutch"} is 68002 (took 60011.532922ms)
[2016-05-09 01:16:16,184] - [task:1099] INFO - ------------------------------------------------------------------ Query # 130 -----------------------------------------------------------------
[2016-05-09 01:16:16,203] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "darcei@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:17:16,076] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:17:16,077] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:17:16,077] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "darcei@mcdiabetes.com"} is 110524 (took 59623.219918ms)
[2016-05-09 01:17:16,078] - [task:1099] INFO - ------------------------------------------------------------------ Query # 131 -----------------------------------------------------------------
[2016-05-09 01:17:16,098] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Accounts"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:17:26,384] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:17:26,384] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Accounts"} is 51623 (took 10046.847652ms)
[2016-05-09 01:17:26,385] - [task:1099] INFO - ------------------------------------------------------------------ Query # 132 -----------------------------------------------------------------
[2016-05-09 01:17:26,403] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Dominique Sr."}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:17:36,915] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:17:36,916] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Dominique Sr."} is 32495 (took 10264.822596ms)
[2016-05-09 01:17:36,917] - [task:1099] INFO - ------------------------------------------------------------------ Query # 133 -----------------------------------------------------------------
[2016-05-09 01:17:36,936] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "amara@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:18:37,254] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:18:37,254] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:18:37,254] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "amara@mcdiabetes.com"} is 112702 (took 59915.584055ms)
[2016-05-09 01:18:37,255] - [task:1099] INFO - ------------------------------------------------------------------ Query # 134 -----------------------------------------------------------------
[2016-05-09 01:18:37,274] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Araceli Adara"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:18:45,482] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:18:45,482] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Araceli Adara"} is 29196 (took 7347.191696ms)
[2016-05-09 01:18:45,483] - [task:1099] INFO - ------------------------------------------------------------------ Query # 135 -----------------------------------------------------------------
[2016-05-09 01:18:45,504] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Dev-ops"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:19:01,952] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:19:01,952] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Dev-ops"} is 52743 (took 14763.734266ms)
[2016-05-09 01:19:01,954] - [task:1099] INFO - ------------------------------------------------------------------ Query # 136 -----------------------------------------------------------------
[2016-05-09 01:19:01,979] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Info-tech"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:19:25,378] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:19:25,379] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Info-tech"} is 53073 (took 22331.005991ms)
[2016-05-09 01:19:25,380] - [task:1099] INFO - ------------------------------------------------------------------ Query # 137 -----------------------------------------------------------------
[2016-05-09 01:19:25,413] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Pre-sales"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:19:45,342] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:19:45,343] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Pre-sales"} is 107290 (took 19147.830501ms)
[2016-05-09 01:19:45,344] - [task:1099] INFO - ------------------------------------------------------------------ Query # 138 -----------------------------------------------------------------
[2016-05-09 01:19:45,365] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:19:45,717] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:19:45,717] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 333.916798ms)
[2016-05-09 01:19:45,718] - [task:1099] INFO - ------------------------------------------------------------------ Query # 139 -----------------------------------------------------------------
[2016-05-09 01:19:45,732] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Marketing"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:19:52,681] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:19:52,682] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Marketing"} is 53786 (took 6196.15633ms)
[2016-05-09 01:19:52,683] - [task:1099] INFO - ------------------------------------------------------------------ Query # 140 -----------------------------------------------------------------
[2016-05-09 01:19:52,702] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Perdita Ebony Caryssa"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:20:26,680] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:20:26,681] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Perdita Ebony Caryssa"} is 81138 (took 32754.783797ms)
[2016-05-09 01:20:26,682] - [task:1099] INFO - ------------------------------------------------------------------ Query # 141 -----------------------------------------------------------------
[2016-05-09 01:20:26,701] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Bryn"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:20:34,294] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:20:34,294] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Bryn"} is 8505 (took 7033.713089ms)
[2016-05-09 01:20:34,295] - [task:1099] INFO - ------------------------------------------------------------------ Query # 142 -----------------------------------------------------------------
[2016-05-09 01:20:34,311] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "French Nepalese"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:21:35,054] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:21:35,054] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:21:35,055] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "French Nepalese"} is 90852 (took 60063.339572ms)
[2016-05-09 01:21:35,055] - [task:1099] INFO - ------------------------------------------------------------------ Query # 143 -----------------------------------------------------------------
[2016-05-09 01:21:35,074] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "mia@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:22:35,198] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:22:35,199] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:22:35,199] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "mia@mcdiabetes.com"} is 115078 (took 59853.207994ms)
[2016-05-09 01:22:35,200] - [task:1099] INFO - ------------------------------------------------------------------ Query # 144 -----------------------------------------------------------------
[2016-05-09 01:22:35,218] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Brown"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:22:43,567] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:22:43,567] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Brown"} is 8581 (took 5857.913133ms)
[2016-05-09 01:22:43,568] - [task:1099] INFO - ------------------------------------------------------------------ Query # 145 -----------------------------------------------------------------
[2016-05-09 01:22:43,587] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:23:43,839] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:23:43,840] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:23:43,840] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 115078 (took 59865.164324ms)
[2016-05-09 01:23:43,841] - [task:1099] INFO - ------------------------------------------------------------------ Query # 146 -----------------------------------------------------------------
[2016-05-09 01:23:43,866] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "cassandra@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:24:44,810] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:24:44,811] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:24:44,811] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "cassandra@mcdiabetes.com"} is 115078 (took 60098.055579ms)
[2016-05-09 01:24:44,812] - [task:1099] INFO - ------------------------------------------------------------------ Query # 147 -----------------------------------------------------------------
[2016-05-09 01:24:44,830] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Cytheria Smith"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:24:49,988] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:24:49,988] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Cytheria Smith"} is 8516 (took 4542.504584ms)
[2016-05-09 01:24:49,989] - [task:1099] INFO - ------------------------------------------------------------------ Query # 148 -----------------------------------------------------------------
[2016-05-09 01:24:50,004] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "HR"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:24:57,511] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:24:57,512] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "HR"} is 55978 (took 7178.23848ms)
[2016-05-09 01:24:57,513] - [task:1099] INFO - ------------------------------------------------------------------ Query # 149 -----------------------------------------------------------------
[2016-05-09 01:24:57,531] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "HR"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:25:04,568] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:25:04,568] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "HR"} is 56033 (took 6752.151991ms)
[2016-05-09 01:25:04,569] - [task:1099] INFO - ------------------------------------------------------------------ Query # 150 -----------------------------------------------------------------
[2016-05-09 01:25:04,586] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:25:13,401] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:25:13,402] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 55576 (took 8238.904978ms)
[2016-05-09 01:25:13,403] - [task:1099] INFO - ------------------------------------------------------------------ Query # 151 -----------------------------------------------------------------
[2016-05-09 01:25:13,422] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Hindi Thai"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:26:13,380] - [task:1103] INFO - Status: {u'successful': 16, u'failed': 16, u'total': 32, u'errors': {u'default_index_5442ab3f4ac94e7a_577e9974': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_63ef8109': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_0a44bddb': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_dee61dfa': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_24e7ea2d': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_77082885': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_321cbb28': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_d8c75a95': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_9284f0ad': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_a4a23588': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_ee590b16': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4728ab89': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_5b1351c0': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_4cdba0cf': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_37fdcf3c': u'context deadline exceeded', u'default_index_5442ab3f4ac94e7a_cd5a61e8': u'context deadline exceeded'}}
[2016-05-09 01:26:13,380] - [task:1120] INFO - FTS returned partial results...skipping ES validation
[2016-05-09 01:26:13,381] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Hindi Thai"} is 72697 (took 59587.726035ms)
[2016-05-09 01:26:13,382] - [task:1099] INFO - ------------------------------------------------------------------ Query # 152 -----------------------------------------------------------------
[2016-05-09 01:26:13,407] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Pre-sales"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:26:31,935] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:26:31,936] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Pre-sales"} is 112089 (took 17824.689739ms)
[2016-05-09 01:26:31,936] - [task:1099] INFO - ------------------------------------------------------------------ Query # 153 -----------------------------------------------------------------
[2016-05-09 01:26:31,957] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:26:32,253] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:26:32,253] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 206.599922ms)
[2016-05-09 01:26:32,254] - [task:1099] INFO - ------------------------------------------------------------------ Query # 154 -----------------------------------------------------------------
[2016-05-09 01:26:32,265] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Miller XII"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:26:40,361] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:26:40,362] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Miller XII"} is 8751 (took 7116.652634ms)
[2016-05-09 01:26:40,363] - [task:1099] INFO - ------------------------------------------------------------------ Query # 155 -----------------------------------------------------------------
[2016-05-09 01:26:40,400] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Drucilla Gallia Ebony Ambika"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:27:03,725] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:03,725] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Drucilla Gallia Ebony Ambika"} is 107480 (took 22947.000068ms)
[2016-05-09 01:27:03,726] - [task:1099] INFO - ------------------------------------------------------------------ Query # 156 -----------------------------------------------------------------
[2016-05-09 01:27:03,745] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Josué"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:27:08,035] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:08,036] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Josué"} is 8752 (took 3965.581349ms)
[2016-05-09 01:27:08,037] - [task:1099] INFO - ------------------------------------------------------------------ Query # 157 -----------------------------------------------------------------
[2016-05-09 01:27:08,067] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Riona Adrianne Bryn Gallia"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:27:29,962] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:29,963] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Riona Adrianne Bryn Gallia"} is 108156 (took 21479.82676ms)
[2016-05-09 01:27:29,964] - [task:1099] INFO - ------------------------------------------------------------------ Query # 158 -----------------------------------------------------------------
[2016-05-09 01:27:29,984] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:27:30,070] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:30,071] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 66.592849ms)
[2016-05-09 01:27:30,071] - [task:1099] INFO - ------------------------------------------------------------------ Query # 159 -----------------------------------------------------------------
[2016-05-09 01:27:30,083] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Finance"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:27:34,588] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:34,588] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Finance"} is 55750 (took 4210.278741ms)
[2016-05-09 01:27:34,589] - [task:1099] INFO - ------------------------------------------------------------------ Query # 160 -----------------------------------------------------------------
[2016-05-09 01:27:34,607] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Jerica Ciara Casondrah"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:27:47,268] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:47,268] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Jerica Ciara Casondrah"} is 84208 (took 12281.344273ms)
[2016-05-09 01:27:47,269] - [task:1099] INFO - ------------------------------------------------------------------ Query # 161 -----------------------------------------------------------------
[2016-05-09 01:27:47,287] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Riona"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:27:54,846] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:54,846] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Riona"} is 8695 (took 5389.992759ms)
[2016-05-09 01:27:54,847] - [task:1099] INFO - ------------------------------------------------------------------ Query # 162 -----------------------------------------------------------------
[2016-05-09 01:27:54,862] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:27:54,946] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:27:54,947] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 62.978906ms)
[2016-05-09 01:27:54,947] - [task:1099] INFO - ------------------------------------------------------------------ Query # 163 -----------------------------------------------------------------
[2016-05-09 01:27:54,958] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Kerry Taylor"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:28:03,817] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:28:03,818] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Kerry Taylor"} is 25935 (took 8595.156115ms)
[2016-05-09 01:28:03,818] - [task:1099] INFO - ------------------------------------------------------------------ Query # 164 -----------------------------------------------------------------
[2016-05-09 01:28:03,849] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "kory@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:28:45,351] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:28:45,351] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "kory@mcdiabetes.com"} is 615078 (took 41079.243622ms)
[2016-05-09 01:28:45,353] - [task:1099] INFO - ------------------------------------------------------------------ Query # 165 -----------------------------------------------------------------
[2016-05-09 01:28:45,371] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "chatha@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:29:20,538] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:29:20,539] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "chatha@mcdiabetes.com"} is 615078 (took 34918.709965ms)
[2016-05-09 01:29:20,540] - [task:1099] INFO - ------------------------------------------------------------------ Query # 166 -----------------------------------------------------------------
[2016-05-09 01:29:20,559] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "HR"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:29:25,606] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:29:25,606] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "HR"} is 56260 (took 4792.19212ms)
[2016-05-09 01:29:25,607] - [task:1099] INFO - ------------------------------------------------------------------ Query # 167 -----------------------------------------------------------------
[2016-05-09 01:29:25,625] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "jetta@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:29:59,495] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:29:59,496] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "jetta@mcdiabetes.com"} is 615078 (took 33557.792583ms)
[2016-05-09 01:29:59,497] - [task:1099] INFO - ------------------------------------------------------------------ Query # 168 -----------------------------------------------------------------
[2016-05-09 01:29:59,522] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Sidonia Moore"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:30:08,256] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:30:08,256] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Sidonia Moore"} is 17166 (took 8490.83664ms)
[2016-05-09 01:30:08,257] - [task:1099] INFO - ------------------------------------------------------------------ Query # 169 -----------------------------------------------------------------
[2016-05-09 01:30:08,276] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Maura Ann"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:30:16,696] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:30:16,697] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Maura Ann"} is 25779 (took 8184.675197ms)
[2016-05-09 01:30:16,697] - [task:1099] INFO - ------------------------------------------------------------------ Query # 170 -----------------------------------------------------------------
[2016-05-09 01:30:16,723] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Accounts"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:30:22,325] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:30:22,325] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Accounts"} is 55565 (took 5366.717854ms)
[2016-05-09 01:30:22,326] - [task:1099] INFO - ------------------------------------------------------------------ Query # 171 -----------------------------------------------------------------
[2016-05-09 01:30:22,346] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Keelia Sirena Antonia"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:30:42,664] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:30:42,665] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Keelia Sirena Antonia"} is 84664 (took 19941.984659ms)
[2016-05-09 01:30:42,666] - [task:1099] INFO - ------------------------------------------------------------------ Query # 172 -----------------------------------------------------------------
[2016-05-09 01:30:42,687] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Adara Cassandra"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:30:47,861] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:30:47,861] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Adara Cassandra"} is 30919 (took 4880.409992ms)
[2016-05-09 01:30:47,862] - [task:1099] INFO - ------------------------------------------------------------------ Query # 173 -----------------------------------------------------------------
[2016-05-09 01:30:47,883] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Gabi Darcei Salina Ciara"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:31:03,480] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:31:03,481] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Gabi Darcei Salina Ciara"} is 107271 (took 15182.35475ms)
[2016-05-09 01:31:03,482] - [task:1099] INFO - ------------------------------------------------------------------ Query # 174 -----------------------------------------------------------------
[2016-05-09 01:31:03,502] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "maura@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:31:39,106] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:31:39,106] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "maura@mcdiabetes.com"} is 615078 (took 35250.508158ms)
[2016-05-09 01:31:39,107] - [task:1099] INFO - ------------------------------------------------------------------ Query # 175 -----------------------------------------------------------------
[2016-05-09 01:31:39,126] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Stewart"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:31:43,369] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:31:43,370] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Stewart"} is 8669 (took 4002.993426ms)
[2016-05-09 01:31:43,370] - [task:1099] INFO - ------------------------------------------------------------------ Query # 176 -----------------------------------------------------------------
[2016-05-09 01:31:43,394] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "kerry-ann@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:32:26,463] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:32:26,464] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "kerry-ann@mcdiabetes.com"} is 615078 (took 42661.056036ms)
[2016-05-09 01:32:26,465] - [task:1099] INFO - ------------------------------------------------------------------ Query # 177 -----------------------------------------------------------------
[2016-05-09 01:32:26,490] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Delores Cook"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:32:32,688] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:32:32,689] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Delores Cook"} is 17263 (took 6002.126138ms)
[2016-05-09 01:32:32,690] - [task:1099] INFO - ------------------------------------------------------------------ Query # 178 -----------------------------------------------------------------
[2016-05-09 01:32:32,709] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Araceli"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:32:37,653] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:32:37,654] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Araceli"} is 8673 (took 2625.653455ms)
[2016-05-09 01:32:37,654] - [task:1099] INFO - ------------------------------------------------------------------ Query # 179 -----------------------------------------------------------------
[2016-05-09 01:32:37,683] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:32:37,956] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:32:37,956] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 231.205444ms)
[2016-05-09 01:32:37,957] - [task:1099] INFO - ------------------------------------------------------------------ Query # 180 -----------------------------------------------------------------
[2016-05-09 01:32:37,970] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Sinhalese Thai"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:33:01,563] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:33:01,564] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Sinhalese Thai"} is 129724 (took 23257.210916ms)
[2016-05-09 01:33:01,565] - [task:1099] INFO - ------------------------------------------------------------------ Query # 181 -----------------------------------------------------------------
[2016-05-09 01:33:01,594] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Marketing"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:33:05,006] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:33:05,007] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Marketing"} is 56039 (took 3173.509999ms)
[2016-05-09 01:33:05,007] - [task:1099] INFO - ------------------------------------------------------------------ Query # 182 -----------------------------------------------------------------
[2016-05-09 01:33:05,027] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Ciara Jerica"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:33:16,955] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:33:16,956] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Ciara Jerica"} is 59044 (took 11594.37688ms)
[2016-05-09 01:33:16,957] - [task:1099] INFO - ------------------------------------------------------------------ Query # 183 -----------------------------------------------------------------
[2016-05-09 01:33:16,977] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Tempest"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:33:22,619] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:33:22,619] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Tempest"} is 30917 (took 5357.734306ms)
[2016-05-09 01:33:22,620] - [task:1099] INFO - ------------------------------------------------------------------ Query # 184 -----------------------------------------------------------------
[2016-05-09 01:33:22,638] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Kallie Bailey"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:33:29,426] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:33:29,426] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Kallie Bailey"} is 17425 (took 6545.808571ms)
[2016-05-09 01:33:29,427] - [task:1099] INFO - ------------------------------------------------------------------ Query # 185 -----------------------------------------------------------------
[2016-05-09 01:33:29,446] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Safiya Simón"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:33:34,834] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:33:34,834] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Safiya Simón"} is 17428 (took 5128.45662ms)
[2016-05-09 01:33:34,835] - [task:1099] INFO - ------------------------------------------------------------------ Query # 186 -----------------------------------------------------------------
[2016-05-09 01:33:34,859] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "bryn@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:34:01,364] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:34:01,365] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "bryn@mcdiabetes.com"} is 615078 (took 26174.551254ms)
[2016-05-09 01:34:01,366] - [task:1099] INFO - ------------------------------------------------------------------ Query # 187 -----------------------------------------------------------------
[2016-05-09 01:34:01,384] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Engineering"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:34:07,145] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:34:07,146] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Engineering"} is 55857 (took 5527.33566ms)
[2016-05-09 01:34:07,146] - [task:1099] INFO - ------------------------------------------------------------------ Query # 188 -----------------------------------------------------------------
[2016-05-09 01:34:07,172] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "languages_known", "match": "Nepalese Hindi"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:34:35,973] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:34:35,974] - [task:1127] INFO - FTS hits for query: {"field": "languages_known", "match": "Nepalese Hindi"} is 388452 (took 28462.794565ms)
[2016-05-09 01:34:35,975] - [task:1099] INFO - ------------------------------------------------------------------ Query # 189 -----------------------------------------------------------------
[2016-05-09 01:34:35,996] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "devi@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:35:05,648] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:35:05,649] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "devi@mcdiabetes.com"} is 615078 (took 29405.548164ms)
[2016-05-09 01:35:05,650] - [task:1099] INFO - ------------------------------------------------------------------ Query # 190 -----------------------------------------------------------------
[2016-05-09 01:35:05,672] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Kimberly Fantine"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:35:15,226] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:35:15,226] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Kimberly Fantine"} is 59021 (took 9234.968341ms)
[2016-05-09 01:35:15,227] - [task:1099] INFO - ------------------------------------------------------------------ Query # 191 -----------------------------------------------------------------
[2016-05-09 01:35:15,268] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "deirdre@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:35:44,647] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:35:44,648] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "deirdre@mcdiabetes.com"} is 615078 (took 29046.811244ms)
[2016-05-09 01:35:44,649] - [task:1099] INFO - ------------------------------------------------------------------ Query # 192 -----------------------------------------------------------------
[2016-05-09 01:35:44,678] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "name", "match": "Mitchell"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:35:47,549] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:35:47,549] - [task:1127] INFO - FTS hits for query: {"field": "name", "match": "Mitchell"} is 8845 (took 2653.79228ms)
[2016-05-09 01:35:47,550] - [task:1099] INFO - ------------------------------------------------------------------ Query # 193 -----------------------------------------------------------------
[2016-05-09 01:35:47,569] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "kacila@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:36:23,792] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:36:23,792] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "kacila@mcdiabetes.com"} is 615078 (took 35891.609295ms)
[2016-05-09 01:36:23,793] - [task:1099] INFO - ------------------------------------------------------------------ Query # 194 -----------------------------------------------------------------
[2016-05-09 01:36:23,813] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "manages.reports", "match": "Drucilla Gallia Adena"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:36:39,041] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:36:39,042] - [task:1127] INFO - FTS hits for query: {"field": "manages.reports", "match": "Drucilla Gallia Adena"} is 84747 (took 12916.544305ms)
[2016-05-09 01:36:39,043] - [task:1099] INFO - ------------------------------------------------------------------ Query # 195 -----------------------------------------------------------------
[2016-05-09 01:36:39,064] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "kacila@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:37:11,238] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:37:11,239] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "kacila@mcdiabetes.com"} is 615078 (took 31855.580323ms)
[2016-05-09 01:37:11,240] - [task:1099] INFO - ------------------------------------------------------------------ Query # 196 -----------------------------------------------------------------
[2016-05-09 01:37:11,257] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "caryssa@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:38:11,523] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:38:11,524] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "caryssa@mcdiabetes.com"} is 617850 (took 59931.835212ms)
[2016-05-09 01:38:11,525] - [task:1099] INFO - ------------------------------------------------------------------ Query # 197 -----------------------------------------------------------------
[2016-05-09 01:38:11,545] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "emp"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:39:02,464] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:39:02,465] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "emp"} is 618048 (took 50684.135992ms)
[2016-05-09 01:39:02,466] - [task:1099] INFO - ------------------------------------------------------------------ Query # 198 -----------------------------------------------------------------
[2016-05-09 01:39:02,484] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "dept", "match": "Training"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:39:15,599] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:39:15,599] - [task:1127] INFO - FTS hits for query: {"field": "dept", "match": "Training"} is 56340 (took 12854.291716ms)
[2016-05-09 01:39:15,600] - [task:1099] INFO - ------------------------------------------------------------------ Query # 199 -----------------------------------------------------------------
[2016-05-09 01:39:15,619] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "email", "match": "killian@mcdiabetes.com"}, "size": 10000} on node: 172.23.107.234:
[2016-05-09 01:39:51,326] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:39:51,326] - [task:1127] INFO - FTS hits for query: {"field": "email", "match": "killian@mcdiabetes.com"} is 618247 (took 35430.438014ms)
[2016-05-09 01:39:51,327] - [task:1099] INFO - ------------------------------------------------------------------ Query # 200 -----------------------------------------------------------------
[2016-05-09 01:39:51,345] - [fts_base:1132] INFO - Running query {"from": 0, "indexName": "default_index", "fields": [], "explain": false, "ctl": {"timeout": 60000, "consistency": {"vectors": {}, "level": ""}}, "query": {"field": "type", "match": "wiki"}, "size": 10000} on node: 172.23.107.145:
[2016-05-09 01:39:51,693] - [task:1103] INFO - Status: {u'successful': 32, u'failed': 0, u'total': 32}
[2016-05-09 01:39:51,694] - [task:1127] INFO - FTS hits for query: {"field": "type", "match": "wiki"} is 0 (took 329.28268ms)
FAIL
[2016-05-09 01:39:51,723] - [rest_client:1296] INFO - /diag/eval status on 172.23.107.187:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
[2016-05-09 01:39:51,725] - [remote_util:169] INFO - connecting to 172.23.107.187 with username : root password : couchbase ssh_key:
[2016-05-09 01:39:51,901] - [remote_util:203] INFO - Connected to 172.23.107.187
[2016-05-09 01:39:52,405] - [remote_util:2292] INFO - running command.raw on 172.23.107.187: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 01:39:52,446] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 01:39:52,446] - [fts_base:2390] INFO - 0
[2016-05-09 01:39:52,446] - [fts_base:2398] INFO - Initial 'panic:' count on 172.23.107.187 :0, now :0
[2016-05-09 01:39:52,447] - [remote_util:2292] INFO - running command.raw on 172.23.107.187: zgrep "crash in forestdb" "/opt/couchbase/var/lib/couchbase/logs"/fts.log* | wc -l
[2016-05-09 01:39:52,551] - [remote_util:2329] INFO - command executed successfully
[2016-05-09 01:39:52,552] - [fts_base:2390] INFO - 0
[2016-05-09 01:39:52,552] - [fts_base:2398] INFO - Initial 'crash in forestdb' count on 172.23.107.187 :0, now :0
[2016-05-09 01:39:52,667] - [remote_util:169] INFO - connecting to 172.23.107.145 with username : root password : couchbase ssh_key:
[2016-05-09 01:40:07,703] - [remote_util:201] ERROR - Can't establish SSH session to node 172.23.107.145 :                                                   Error reading SSH protocol banner
ERROR

======================================================================
ERROR: index_query_in_parallel (fts.stable_topology_fts.StableTopFTS)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "pytests/fts/stable_topology_fts.py", line 13, in tearDown
    super(StableTopFTS, self).tearDown()
  File "pytests/fts/fts_base.py", line 1983, in tearDown
    error_logger = self.check_error_count_in_fts_log()
  File "pytests/fts/fts_base.py", line 2382, in check_error_count_in_fts_log
    shell = RemoteMachineShellConnection(node)
  File "lib/remote/remote_util.py", line 202, in __init__
    exit(1)
  File "/usr/lib64/python2.7/site.py", line 364, in __call__
    raise SystemExit(code)
SystemExit: 1

======================================================================
FAIL: index_query_in_parallel (fts.stable_topology_fts.StableTopFTS)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "pytests/fts/stable_topology_fts.py", line 367, in index_query_in_parallel
    self.run_query_and_compare(index)
  File "pytests/fts/fts_base.py", line 2796, in run_query_and_compare
    failed_queries))
AssertionError: 1 out of 200 queries failed! - [90]

----------------------------------------------------------------------