Skip to content

Instantly share code, notes, and snippets.

@halfak
Created June 2, 2016 13:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save halfak/277975af5de6153719e1985d06210a23 to your computer and use it in GitHub Desktop.
Save halfak/277975af5de6153719e1985d06210a23 to your computer and use it in GitHub Desktop.
Example run of dependent task processor
$ python generate_score_requests.py foo bar -d 0.1
Processing fake rev_id 0
Looking for in-progress tasks:
Checking if foo:0 is already being processed...
Could not find result for foo:0
Checking if bar:0 is already being processed...
Could not find result for bar:0
Submitting scoring request...
foo:0 {'score': True}
bar:0 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 1
Looking for in-progress tasks:
Checking if foo:1 is already being processed...
Found in-progress result for foo:1
Checking if bar:1 is already being processed...
Found in-progress result for bar:1
No models need to be applied!
foo:1 {'score': True}
bar:1 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 2
Looking for in-progress tasks:
Checking if foo:2 is already being processed...
Could not find result for foo:2
Checking if bar:2 is already being processed...
Could not find result for bar:2
Submitting scoring request...
foo:2 {'score': True}
bar:2 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 3
Looking for in-progress tasks:
Checking if foo:3 is already being processed...
Found in-progress result for foo:3
Checking if bar:3 is already being processed...
Found in-progress result for bar:3
No models need to be applied!
foo:3 {'score': True}
bar:3 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 4
Looking for in-progress tasks:
Checking if foo:4 is already being processed...
Could not find result for foo:4
Checking if bar:4 is already being processed...
Could not find result for bar:4
Submitting scoring request...
foo:4 {'score': True}
bar:4 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 5
Looking for in-progress tasks:
Checking if foo:5 is already being processed...
Found in-progress result for foo:5
Checking if bar:5 is already being processed...
Found in-progress result for bar:5
No models need to be applied!
foo:5 {'score': True}
bar:5 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 6
Looking for in-progress tasks:
Checking if foo:6 is already being processed...
Could not find result for foo:6
Checking if bar:6 is already being processed...
Could not find result for bar:6
Submitting scoring request...
foo:6 {'score': True}
bar:6 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 7
Looking for in-progress tasks:
Checking if foo:7 is already being processed...
Found in-progress result for foo:7
Checking if bar:7 is already being processed...
Found in-progress result for bar:7
No models need to be applied!
foo:7 {'score': True}
bar:7 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 8
Looking for in-progress tasks:
Checking if foo:8 is already being processed...
Could not find result for foo:8
Checking if bar:8 is already being processed...
Could not find result for bar:8
Submitting scoring request...
foo:8 {'score': True}
bar:8 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 9
Looking for in-progress tasks:
Checking if foo:9 is already being processed...
Found in-progress result for foo:9
Checking if bar:9 is already being processed...
Found in-progress result for bar:9
No models need to be applied!
foo:9 {'score': True}
bar:9 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 10
Looking for in-progress tasks:
Checking if foo:10 is already being processed...
Could not find result for foo:10
Checking if bar:10 is already being processed...
Could not find result for bar:10
Submitting scoring request...
foo:10 {'score': True}
bar:10 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 11
Looking for in-progress tasks:
Checking if foo:11 is already being processed...
Found in-progress result for foo:11
Checking if bar:11 is already being processed...
Found in-progress result for bar:11
No models need to be applied!
foo:11 {'score': True}
bar:11 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 12
Looking for in-progress tasks:
Checking if foo:12 is already being processed...
Could not find result for foo:12
Checking if bar:12 is already being processed...
Could not find result for bar:12
Submitting scoring request...
foo:12 {'score': True}
bar:12 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 13
Looking for in-progress tasks:
Checking if foo:13 is already being processed...
Found in-progress result for foo:13
Checking if bar:13 is already being processed...
Found in-progress result for bar:13
No models need to be applied!
foo:13 {'score': True}
bar:13 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 14
Looking for in-progress tasks:
Checking if foo:14 is already being processed...
Could not find result for foo:14
Checking if bar:14 is already being processed...
Could not find result for bar:14
Submitting scoring request...
foo:14 {'score': True}
bar:14 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 15
Looking for in-progress tasks:
Checking if foo:15 is already being processed...
Found in-progress result for foo:15
Checking if bar:15 is already being processed...
Found in-progress result for bar:15
No models need to be applied!
foo:15 {'score': True}
bar:15 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 16
Looking for in-progress tasks:
Checking if foo:16 is already being processed...
Could not find result for foo:16
Checking if bar:16 is already being processed...
Could not find result for bar:16
Submitting scoring request...
foo:16 {'score': True}
bar:16 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 17
Looking for in-progress tasks:
Checking if foo:17 is already being processed...
Found in-progress result for foo:17
Checking if bar:17 is already being processed...
Found in-progress result for bar:17
No models need to be applied!
foo:17 {'score': True}
bar:17 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 18
Looking for in-progress tasks:
Checking if foo:18 is already being processed...
Could not find result for foo:18
Checking if bar:18 is already being processed...
Could not find result for bar:18
Submitting scoring request...
foo:18 {'score': True}
bar:18 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 19
Looking for in-progress tasks:
Checking if foo:19 is already being processed...
Found in-progress result for foo:19
Checking if bar:19 is already being processed...
Found in-progress result for bar:19
No models need to be applied!
foo:19 {'score': True}
bar:19 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 20
Looking for in-progress tasks:
Checking if foo:20 is already being processed...
Could not find result for foo:20
Checking if bar:20 is already being processed...
Could not find result for bar:20
Submitting scoring request...
foo:20 {'score': True}
bar:20 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 21
Looking for in-progress tasks:
Checking if foo:21 is already being processed...
Found in-progress result for foo:21
Checking if bar:21 is already being processed...
Found in-progress result for bar:21
No models need to be applied!
foo:21 {'score': True}
bar:21 {'score': True}
Sleeping for remaining 0 seconds
$ python generate_score_requests.py foo bar -d 0.1
Processing fake rev_id 0
Looking for in-progress tasks:
Checking if foo:0 is already being processed...
Found in-progress result for foo:0
Checking if bar:0 is already being processed...
Found in-progress result for bar:0
No models need to be applied!
foo:0 {'score': True}
bar:0 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 1
Looking for in-progress tasks:
Checking if foo:1 is already being processed...
Could not find result for foo:1
Checking if bar:1 is already being processed...
Could not find result for bar:1
Submitting scoring request...
foo:1 {'score': True}
bar:1 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 2
Looking for in-progress tasks:
Checking if foo:2 is already being processed...
Found in-progress result for foo:2
Checking if bar:2 is already being processed...
Found in-progress result for bar:2
No models need to be applied!
foo:2 {'score': True}
bar:2 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 3
Looking for in-progress tasks:
Checking if foo:3 is already being processed...
Could not find result for foo:3
Checking if bar:3 is already being processed...
Could not find result for bar:3
Submitting scoring request...
foo:3 {'score': True}
bar:3 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 4
Looking for in-progress tasks:
Checking if foo:4 is already being processed...
Found in-progress result for foo:4
Checking if bar:4 is already being processed...
Found in-progress result for bar:4
No models need to be applied!
foo:4 {'score': True}
bar:4 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 5
Looking for in-progress tasks:
Checking if foo:5 is already being processed...
Could not find result for foo:5
Checking if bar:5 is already being processed...
Could not find result for bar:5
Submitting scoring request...
foo:5 {'score': True}
bar:5 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 6
Looking for in-progress tasks:
Checking if foo:6 is already being processed...
Found in-progress result for foo:6
Checking if bar:6 is already being processed...
Found in-progress result for bar:6
No models need to be applied!
foo:6 {'score': True}
bar:6 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 7
Looking for in-progress tasks:
Checking if foo:7 is already being processed...
Could not find result for foo:7
Checking if bar:7 is already being processed...
Could not find result for bar:7
Submitting scoring request...
foo:7 {'score': True}
bar:7 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 8
Looking for in-progress tasks:
Checking if foo:8 is already being processed...
Found in-progress result for foo:8
Checking if bar:8 is already being processed...
Found in-progress result for bar:8
No models need to be applied!
foo:8 {'score': True}
bar:8 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 9
Looking for in-progress tasks:
Checking if foo:9 is already being processed...
Could not find result for foo:9
Checking if bar:9 is already being processed...
Could not find result for bar:9
Submitting scoring request...
foo:9 {'score': True}
bar:9 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 10
Looking for in-progress tasks:
Checking if foo:10 is already being processed...
Found in-progress result for foo:10
Checking if bar:10 is already being processed...
Found in-progress result for bar:10
No models need to be applied!
foo:10 {'score': True}
bar:10 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 11
Looking for in-progress tasks:
Checking if foo:11 is already being processed...
Could not find result for foo:11
Checking if bar:11 is already being processed...
Could not find result for bar:11
Submitting scoring request...
foo:11 {'score': True}
bar:11 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 12
Looking for in-progress tasks:
Checking if foo:12 is already being processed...
Found in-progress result for foo:12
Checking if bar:12 is already being processed...
Found in-progress result for bar:12
No models need to be applied!
foo:12 {'score': True}
bar:12 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 13
Looking for in-progress tasks:
Checking if foo:13 is already being processed...
Could not find result for foo:13
Checking if bar:13 is already being processed...
Could not find result for bar:13
Submitting scoring request...
foo:13 {'score': True}
bar:13 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 14
Looking for in-progress tasks:
Checking if foo:14 is already being processed...
Found in-progress result for foo:14
Checking if bar:14 is already being processed...
Found in-progress result for bar:14
No models need to be applied!
foo:14 {'score': True}
bar:14 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 15
Looking for in-progress tasks:
Checking if foo:15 is already being processed...
Could not find result for foo:15
Checking if bar:15 is already being processed...
Could not find result for bar:15
Submitting scoring request...
foo:15 {'score': True}
bar:15 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 16
Looking for in-progress tasks:
Checking if foo:16 is already being processed...
Found in-progress result for foo:16
Checking if bar:16 is already being processed...
Found in-progress result for bar:16
No models need to be applied!
foo:16 {'score': True}
bar:16 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 17
Looking for in-progress tasks:
Checking if foo:17 is already being processed...
Could not find result for foo:17
Checking if bar:17 is already being processed...
Could not find result for bar:17
Submitting scoring request...
foo:17 {'score': True}
bar:17 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 18
Looking for in-progress tasks:
Checking if foo:18 is already being processed...
Found in-progress result for foo:18
Checking if bar:18 is already being processed...
Found in-progress result for bar:18
No models need to be applied!
foo:18 {'score': True}
bar:18 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 19
Looking for in-progress tasks:
Checking if foo:19 is already being processed...
Could not find result for foo:19
Checking if bar:19 is already being processed...
Could not find result for bar:19
Submitting scoring request...
foo:19 {'score': True}
bar:19 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 20
Looking for in-progress tasks:
Checking if foo:20 is already being processed...
Found in-progress result for foo:20
Checking if bar:20 is already being processed...
Found in-progress result for bar:20
No models need to be applied!
foo:20 {'score': True}
bar:20 {'score': True}
Sleeping for remaining 0 seconds
Processing fake rev_id 21
Looking for in-progress tasks:
Checking if foo:21 is already being processed...
Could not find result for foo:21
Checking if bar:21 is already being processed...
Could not find result for bar:21
Submitting scoring request...
foo:21 {'score': True}
bar:21 {'score': True}
Sleeping for remaining 0 seconds
$ celery worker --app=dtt.celery_tasks --loglevel=INFO
[2016-06-02 08:03:30,643: WARNING/MainProcess] /home/halfak/env/3.4/lib/python3.4/site-packages/celery/apps/worker.py:161: CDeprecationWarning:
Starting from version 3.2 Celery will refuse to accept pickle by default.
The pickle serializer is a security concern as it may give attackers
the ability to execute any command. It's important to secure
your broker from unauthorized access when using pickle, so we think
that enabling pickle should require a deliberate action and not be
the default choice.
If you depend on pickle then you should set a setting to disable this
warning and to be sure that everything will continue working
when you upgrade to Celery 3.2::
CELERY_ACCEPT_CONTENT = ['pickle', 'json', 'msgpack', 'yaml']
You must only enable the serializers that you will actually use.
warnings.warn(CDeprecationWarning(W_PICKLE_DEPRECATED))
-------------- celery@graphite v3.1.23 (Cipater)
---- **** -----
--- * *** * -- Linux-3.16.0-71-generic-x86_64-with-Ubuntu-14.04-trusty
-- * - **** ---
- ** ---------- [config]
- ** ---------- .> app: celery_tasks:0x7f4cf194d240
- ** ---------- .> transport: redis://localhost:6379//
- ** ---------- .> results: redis://localhost/
- *** --- * --- .> concurrency: 4 (prefork)
-- ******* ----
--- ***** ----- [queues]
-------------- .> celery exchange=celery(direct) key=celery
[tasks]
. dtt.celery_tasks.score_many_models
. dtt.celery_tasks.score_model
[2016-06-02 08:03:30,777: INFO/MainProcess] Connected to redis://localhost:6379//
[2016-06-02 08:03:30,794: INFO/MainProcess] mingle: searching for neighbors
[2016-06-02 08:03:31,798: INFO/MainProcess] mingle: all alone
[2016-06-02 08:03:31,806: WARNING/MainProcess] celery@graphite ready.
[2016-06-02 08:03:36,132: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[bc3c17d6-71e2-44c1-8fa5-9fed1356c9d6]
[2016-06-02 08:03:36,135: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:0]
[2016-06-02 08:03:36,137: WARNING/Worker-4] /home/halfak/env/3.4/lib/python3.4/site-packages/celery/result.py:45: RuntimeWarning: Never call result.get() within a task!
See http://docs.celeryq.org/en/latest/userguide/tasks.html#task-synchronous-subtasks
In Celery 3.2 this will result in an exception being
raised instead of just being a warning.
warnings.warn(RuntimeWarning(E_WOULDBLOCK))[2016-06-02 08:03:36,137: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:0]
[2016-06-02 08:03:36,140: WARNING/Worker-2] /home/halfak/env/3.4/lib/python3.4/site-packages/celery/result.py:45: RuntimeWarning: Never call result.get() within a task!
See http://docs.celeryq.org/en/latest/userguide/tasks.html#task-synchronous-subtasks
In Celery 3.2 this will result in an exception being
raised instead of just being a warning.
warnings.warn(RuntimeWarning(E_WOULDBLOCK))
[2016-06-02 08:03:36,384: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[bc3c17d6-71e2-44c1-8fa5-9fed1356c9d6] succeeded in 0.2485919340106193s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:36,641: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:0] succeeded in 0.5049028359935619s: {'score': True}
[2016-06-02 08:03:36,643: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:0] succeeded in 0.5036362639948493s: {'score': True}
[2016-06-02 08:03:36,699: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[35d865a5-3ecc-4522-9e9e-5e380ffbd97f]
[2016-06-02 08:03:36,701: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:1]
[2016-06-02 08:03:36,703: WARNING/Worker-3] /home/halfak/env/3.4/lib/python3.4/site-packages/celery/result.py:45: RuntimeWarning: Never call result.get() within a task!
See http://docs.celeryq.org/en/latest/userguide/tasks.html#task-synchronous-subtasks
In Celery 3.2 this will result in an exception being
raised instead of just being a warning.
warnings.warn(RuntimeWarning(E_WOULDBLOCK))
[2016-06-02 08:03:36,706: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:1]
[2016-06-02 08:03:37,819: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[35d865a5-3ecc-4522-9e9e-5e380ffbd97f] succeeded in 1.1168628229934257s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:38,209: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:1] succeeded in 1.506706877000397s: {'score': True}
[2016-06-02 08:03:38,211: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:1] succeeded in 1.5034100719931303s: {'score': True}
[2016-06-02 08:03:38,645: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[f1800d77-5756-4884-9982-8d32a48e57dd]
[2016-06-02 08:03:38,647: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:2]
[2016-06-02 08:03:38,648: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:2]
[2016-06-02 08:03:38,650: WARNING/Worker-1] /home/halfak/env/3.4/lib/python3.4/site-packages/celery/result.py:45: RuntimeWarning: Never call result.get() within a task!
See http://docs.celeryq.org/en/latest/userguide/tasks.html#task-synchronous-subtasks
In Celery 3.2 this will result in an exception being
raised instead of just being a warning.
warnings.warn(RuntimeWarning(E_WOULDBLOCK))
[2016-06-02 08:03:38,944: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[f1800d77-5756-4884-9982-8d32a48e57dd] succeeded in 0.2971449799952097s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:39,151: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:2] succeeded in 0.5019071590068052s: {'score': True}
[2016-06-02 08:03:39,153: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:2] succeeded in 0.5044574220082723s: {'score': True}
[2016-06-02 08:03:39,212: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[23058c44-6365-4b5b-b19d-7bb94e300813]
[2016-06-02 08:03:39,225: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:3]
[2016-06-02 08:03:39,233: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:3]
[2016-06-02 08:03:39,954: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[23058c44-6365-4b5b-b19d-7bb94e300813] succeeded in 0.738613883004291s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:40,239: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:3] succeeded in 1.0042963860032614s: {'score': True}
[2016-06-02 08:03:40,240: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:3] succeeded in 1.0038500910013681s: {'score': True}
[2016-06-02 08:03:40,666: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[b6fdbd80-8dd7-47e5-99c7-9f8772bcd946]
[2016-06-02 08:03:40,678: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:4]
[2016-06-02 08:03:40,685: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:4]
[2016-06-02 08:03:42,276: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[b6fdbd80-8dd7-47e5-99c7-9f8772bcd946] succeeded in 1.6074406609986909s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:42,697: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:4] succeeded in 2.0092356319946703s: {'score': True}
[2016-06-02 08:03:42,699: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:4] succeeded in 2.0090185809967807s: {'score': True}
[2016-06-02 08:03:42,734: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[57dbace9-ca3c-4a4f-a531-360ac857739e]
[2016-06-02 08:03:42,735: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:5]
[2016-06-02 08:03:42,736: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:5]
[2016-06-02 08:03:42,933: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[57dbace9-ca3c-4a4f-a531-360ac857739e] succeeded in 0.19811423700593878s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:43,237: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:5] succeeded in 0.5017999069968937s: {'score': True}
[2016-06-02 08:03:43,239: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:5] succeeded in 0.5016814720002003s: {'score': True}
[2016-06-02 08:03:43,692: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[692f5023-d009-4085-835f-54b1db275c41]
[2016-06-02 08:03:43,693: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:6]
[2016-06-02 08:03:43,696: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:6]
[2016-06-02 08:03:44,889: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[692f5023-d009-4085-835f-54b1db275c41] succeeded in 1.1949748629995156s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:45,199: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:6] succeeded in 1.5042826140124816s: {'score': True}
[2016-06-02 08:03:45,201: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:6] succeeded in 1.5036516420077533s: {'score': True}
[2016-06-02 08:03:45,246: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[09078b63-a1ef-4cf6-91b7-65a3b1f5a1a3]
[2016-06-02 08:03:45,247: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:7]
[2016-06-02 08:03:45,248: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:7]
[2016-06-02 08:03:46,936: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[09078b63-a1ef-4cf6-91b7-65a3b1f5a1a3] succeeded in 1.6883164909959305s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:47,253: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:7] succeeded in 2.0050073789898306s: {'score': True}
[2016-06-02 08:03:47,254: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:7] succeeded in 2.00455581699498s: {'score': True}
[2016-06-02 08:03:47,707: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[73816281-255f-44cc-952b-90e86ff6864a]
[2016-06-02 08:03:47,708: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:8]
[2016-06-02 08:03:47,710: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:8]
[2016-06-02 08:03:48,028: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[73816281-255f-44cc-952b-90e86ff6864a] succeeded in 0.31887142099731136s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:48,211: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:8] succeeded in 0.5019210069876863s: {'score': True}
[2016-06-02 08:03:48,213: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:8] succeeded in 0.5020234609983163s: {'score': True}
[2016-06-02 08:03:48,258: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[b2293c44-39b5-400d-b28c-db5edd19a6b8]
[2016-06-02 08:03:48,268: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:9]
[2016-06-02 08:03:48,274: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:9]
[2016-06-02 08:03:48,628: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[b2293c44-39b5-400d-b28c-db5edd19a6b8] succeeded in 0.3663604080065852s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:48,780: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:9] succeeded in 0.5042721860081656s: {'score': True}
[2016-06-02 08:03:48,783: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:9] succeeded in 0.5044061609951314s: {'score': True}
[2016-06-02 08:03:49,219: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[a0a49f92-2236-4e7e-84bf-e1f0c31bf951]
[2016-06-02 08:03:49,220: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:10]
[2016-06-02 08:03:49,221: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:10]
[2016-06-02 08:03:49,718: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[a0a49f92-2236-4e7e-84bf-e1f0c31bf951] succeeded in 0.497005490004085s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:49,723: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:10] succeeded in 0.5023937320074765s: {'score': True}
[2016-06-02 08:03:49,725: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:10] succeeded in 0.5027379509992898s: {'score': True}
[2016-06-02 08:03:49,779: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[219a8bf7-909f-4ab0-8815-b6e521af0fb6]
[2016-06-02 08:03:49,781: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:11]
[2016-06-02 08:03:49,783: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:11]
[2016-06-02 08:03:50,608: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[219a8bf7-909f-4ab0-8815-b6e521af0fb6] succeeded in 0.8265171579987509s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:50,785: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:11] succeeded in 1.0037951639969833s: {'score': True}
[2016-06-02 08:03:50,787: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:11] succeeded in 1.0028942770004505s: {'score': True}
[2016-06-02 08:03:51,229: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[ebe68fdb-7c9b-4e82-8e0b-ea03112ef059]
[2016-06-02 08:03:51,231: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:12]
[2016-06-02 08:03:51,234: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:12]
[2016-06-02 08:03:51,605: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[ebe68fdb-7c9b-4e82-8e0b-ea03112ef059] succeeded in 0.37237129799905233s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:51,734: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:12] succeeded in 0.5021730959997512s: {'score': True}
[2016-06-02 08:03:51,737: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:12] succeeded in 0.5018755339988274s: {'score': True}
[2016-06-02 08:03:51,792: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[c881c6ae-a329-45ca-8c27-d72251d6a1ab]
[2016-06-02 08:03:51,796: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:13]
[2016-06-02 08:03:51,797: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:13]
[2016-06-02 08:03:52,341: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[c881c6ae-a329-45ca-8c27-d72251d6a1ab] succeeded in 0.5474948070041137s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:52,801: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:13] succeeded in 1.0035106580035063s: {'score': True}
[2016-06-02 08:03:52,802: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:13] succeeded in 1.0043531749979593s: {'score': True}
[2016-06-02 08:03:53,243: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[a6351506-74a4-422d-9f7d-6d52f093f7f9]
[2016-06-02 08:03:53,245: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:14]
[2016-06-02 08:03:53,247: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:14]
[2016-06-02 08:03:55,604: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[a6351506-74a4-422d-9f7d-6d52f093f7f9] succeeded in 2.358925612992607s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:55,751: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:14] succeeded in 2.505458779996843s: {'score': True}
[2016-06-02 08:03:55,755: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:14] succeeded in 2.5065382629982196s: {'score': True}
[2016-06-02 08:03:55,812: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[6b97a532-3374-478f-b148-7ccd88563b06]
[2016-06-02 08:03:55,813: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:15]
[2016-06-02 08:03:55,815: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:15]
[2016-06-02 08:03:56,057: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[6b97a532-3374-478f-b148-7ccd88563b06] succeeded in 0.24319409800227731s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:56,317: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:15] succeeded in 0.5019362950115465s: {'score': True}
[2016-06-02 08:03:56,318: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:15] succeeded in 0.5019413190020714s: {'score': True}
[2016-06-02 08:03:56,757: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[8dc47643-8e17-4ae7-9e81-14d3121bd4d9]
[2016-06-02 08:03:56,759: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:16]
[2016-06-02 08:03:56,761: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:16]
[2016-06-02 08:03:57,339: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[8dc47643-8e17-4ae7-9e81-14d3121bd4d9] succeeded in 0.5793615620059427s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:57,763: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:16] succeeded in 1.0028873140108772s: {'score': True}
[2016-06-02 08:03:57,764: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:16] succeeded in 1.0025574999890523s: {'score': True}
[2016-06-02 08:03:57,824: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[b2495baa-c7f0-4764-9d00-a7935a1eb45b]
[2016-06-02 08:03:57,825: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:17]
[2016-06-02 08:03:57,827: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:17]
[2016-06-02 08:03:58,168: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[b2495baa-c7f0-4764-9d00-a7935a1eb45b] succeeded in 0.342236247000983s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:03:58,328: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:17] succeeded in 0.5020932320039719s: {'score': True}
[2016-06-02 08:03:58,332: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:17] succeeded in 0.5027364069974283s: {'score': True}
[2016-06-02 08:03:58,767: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[840a80d1-bf03-4928-b67a-cd8e2498546a]
[2016-06-02 08:03:58,768: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:18]
[2016-06-02 08:03:58,770: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:18]
[2016-06-02 08:04:00,147: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[840a80d1-bf03-4928-b67a-cd8e2498546a] succeeded in 1.3777978750003967s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:04:00,276: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:18] succeeded in 1.5066305369982729s: {'score': True}
[2016-06-02 08:04:00,278: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:18] succeeded in 1.506938386010006s: {'score': True}
[2016-06-02 08:04:00,337: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[93412b47-4d62-41c6-adb6-63bb063322db]
[2016-06-02 08:04:00,339: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:19]
[2016-06-02 08:04:00,344: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:19]
[2016-06-02 08:04:00,602: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[93412b47-4d62-41c6-adb6-63bb063322db] succeeded in 0.26202826599183027s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:04:00,843: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:19] succeeded in 0.5028759069973603s: {'score': True}
[2016-06-02 08:04:00,850: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:19] succeeded in 0.5023056359932525s: {'score': True}
[2016-06-02 08:04:01,281: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[0c6bc50e-c7cd-4ad1-b38a-113c1131ea56]
[2016-06-02 08:04:01,283: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:20]
[2016-06-02 08:04:01,284: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:20]
[2016-06-02 08:04:01,441: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[0c6bc50e-c7cd-4ad1-b38a-113c1131ea56] succeeded in 0.15824638500635047s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:04:01,786: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:20] succeeded in 0.5032911770103965s: {'score': True}
[2016-06-02 08:04:01,788: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:20] succeeded in 0.5024430799967377s: {'score': True}
[2016-06-02 08:04:01,848: INFO/MainProcess] Received task: dtt.celery_tasks.score_many_models[3186efb1-f431-4797-adaf-83d98eb5e6d7]
[2016-06-02 08:04:01,850: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[foo:21]
[2016-06-02 08:04:01,852: INFO/MainProcess] Received task: dtt.celery_tasks.score_model[bar:21]
[2016-06-02 08:04:01,977: INFO/MainProcess] Task dtt.celery_tasks.score_many_models[3186efb1-f431-4797-adaf-83d98eb5e6d7] succeeded in 0.12642825000511948s: {'bar': {'score': True}, 'foo': {'score': True}}
[2016-06-02 08:04:02,353: INFO/MainProcess] Task dtt.celery_tasks.score_model[foo:21] succeeded in 0.5019358939898666s: {'score': True}
[2016-06-02 08:04:02,355: INFO/MainProcess] Task dtt.celery_tasks.score_model[bar:21] succeeded in 0.5019361750019016s: {'score': True}
^C
worker: Hitting Ctrl+C again will terminate all running tasks!
worker: Warm shutdown (MainProcess)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment