Skip to content

Instantly share code, notes, and snippets.

@pswu11
Created May 14, 2020 10:05
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save pswu11/0724531689b5f700a40ccd4384c3fb15 to your computer and use it in GitHub Desktop.
Save pswu11/0724531689b5f700a40ccd4384c3fb15 to your computer and use it in GitHub Desktop.
[southpark-search] python app.py -t index -n 10000 12:03:10 ☁ master ☂ ⚡
Flow@26466[S]:successfully built Flow from a yaml config
splittor@26476[I]:post initiating, this may take some time...
splittor@26476[I]:post initiating, this may take some time takes 0.000 secs
splittor@26476[S]:successfully built Sentencizer from a yaml config
splittor@26476[I]:setting up sockets...
splittor@26476[I]:input tcp://0.0.0.0:46327 (SUB_CONNECT) output tcp://0.0.0.0:46989 (PUSH_CONNECT) control over tcp://0.0.0.0:40635 (PAIR_BIND)
splittor@26476[S]:ready and listening
encoder@26479[I]:post initiating, this may take some time...
encoder@26479[I]:post initiating, this may take some time takes 2.066 secs
encoder@26479[S]:successfully built TransformerTorchEncoder from a yaml config
encoder@26479[I]:setting up sockets...
encoder@26479[I]:input tcp://0.0.0.0:46989 (PULL_BIND) output tcp://0.0.0.0:48349 (PUSH_CONNECT) control over tcp://0.0.0.0:54789 (PAIR_BIND)
encoder@26479[S]:ready and listening
chunk_indexer@26482[I]:post initiating, this may take some time...
chunk_indexer@26482[I]:post initiating, this may take some time takes 0.000 secs
chunk_indexer@26482[S]:restore NumpyIndexer from /tmp/jina/southpark/sbnpsago/chunk_indexer-0/vecidx.bin
chunk_indexer@26482[I]:post initiating, this may take some time...
chunk_indexer@26482[I]:post initiating, this may take some time takes 0.000 secs
chunk_indexer@26482[S]:restore BasePbIndexer from /tmp/jina/southpark/sbnpsago/chunk_indexer-0/chunkidx.bin
chunk_indexer@26482[I]:post initiating, this may take some time...
chunk_indexer@26482[I]:post initiating, this may take some time takes 0.000 secs
chunk_indexer@26482[S]:successfully built ChunkIndexer from a yaml config
chunk_indexer@26482[I]:setting up sockets...
chunk_indexer@26482[I]:input tcp://0.0.0.0:48349 (PULL_BIND) output tcp://0.0.0.0:51495 (PUSH_CONNECT) control over tcp://0.0.0.0:58107 (PAIR_BIND)
chunk_indexer@26482[S]:ready and listening
doc_indexer@26485[I]:post initiating, this may take some time...
doc_indexer@26485[I]:post initiating, this may take some time takes 0.000 secs
doc_indexer@26485[S]:successfully built DocPbIndexer from a yaml config
doc_indexer@26485[I]:setting up sockets...
doc_indexer@26485[I]:input tcp://0.0.0.0:46327 (SUB_CONNECT) output tcp://0.0.0.0:51495 (PUSH_CONNECT) control over tcp://0.0.0.0:48965 (PAIR_BIND)
doc_indexer@26485[S]:ready and listening
join_all@26488[I]:post initiating, this may take some time...
join_all@26488[I]:post initiating, this may take some time takes 0.000 secs
join_all@26488[S]:successfully built BaseExecutor from a yaml config
join_all@26488[I]:setting up sockets...
join_all@26488[I]:input tcp://0.0.0.0:51495 (PULL_BIND) output tcp://0.0.0.0:56589 (PUSH_BIND) control over tcp://0.0.0.0:38037 (PAIR_BIND)
join_all@26488[S]:ready and listening
join_all@26466[I]:post initiating, this may take some time...
join_all@26466[I]:post initiating, this may take some time takes 0.001 secs
join_all@26466[S]:gateway is listening at: 0.0.0.0:58021
Flow@26466[I]:6 Pods (i.e. 6 Peas) are running in this Flow
Flow@26466[S]:flow is now ready for use, current build_level is GRAPH
JINA@26466[W]:"raw_bytes" is deprecated in "index()" and will be removed in the next version; please use "input_fn" instead
join_all@26466[S]:connected to the gateway at 0.0.0.0:58021!
index [= ] 📃 0 ⏱️ 0.0s 🐎 0.0/s 0 batchindex ... join_all@26466[I]:setting up sockets...
join_all@26466[I]:input tcp://0.0.0.0:56589 (PULL_CONNECT) output tcp://0.0.0.0:46327 (PUB_BIND) control over ipc:///tmp/tmplnpvwrrt (PAIR_BIND)
join_all@26466[I]:prefetching 50 requests...
join_all@26466[W]:if this takes too long, you may want to take smaller "--prefetch" or ask client to reduce "--batch-size"
join_all@26466[I]:prefetching 50 requests takes 0.126 secs
join_all@26466[I]:send: 0 recv: 0 pending: 0
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
splittor@26476[I]:received "index" from gateway▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
encoder@26479[I]:received "index" from gateway▸splittor-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
chunk_indexer@26482[I]:received "index" from gateway▸splittor-0▸encoder-0▸⚐
join_all@26488[I]:received "index" from gateway▸splittor-0▸encoder-0▸chunk_indexer-0▸⚐
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment