Skip to content

Instantly share code, notes, and snippets.

@mikeumus
Last active August 29, 2015 14:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mikeumus/133631d3fa66ad53280c to your computer and use it in GitHub Desktop.
Save mikeumus/133631d3fa66ad53280c to your computer and use it in GitHub Desktop.
django-celery in --loglevel=DEBUG
```
mikeumus@celery-django-example:~/workspace (master) $ ./manage.py celery events --camera=djcelery.snapshot.Camera --loglevel=DEBUG
-> evcam: Taking snapshots with djcelery.snapshot.Camera (every 1.0 secs.)
[2015-06-20 19:38:37,974: INFO/MainProcess] Connected to django://localhost//
[2015-06-20 19:38:37,978: DEBUG/MainProcess] (0.001) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',); args=('celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',)
[2015-06-20 19:38:37,979: DEBUG/MainProcess] (0.000) QUERY = u'BEGIN' - PARAMS = (); args=None
[2015-06-20 19:38:37,980: DEBUG/MainProcess] (0.001) QUERY = u'INSERT INTO "djkombu_queue" ("name") VALUES (%s)' - PARAMS = (u'celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',); args=['celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4']
[2015-06-20 19:38:37,991: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',); args=('celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',)
[2015-06-20 19:38:37,993: DEBUG/MainProcess] (0.000) QUERY = u'SELECT COUNT(*) FROM "djkombu_message" WHERE "djkombu_message"."queue_id" = %s' - PARAMS = (6,); args=(6,)
[2015-06-20 19:38:37,996: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',); args=('celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',)
[2015-06-20 19:38:37,997: DEBUG/MainProcess] (0.000) QUERY = u'BEGIN' - PARAMS = (); args=None
[2015-06-20 19:38:37,999: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_message"."id", "djkombu_message"."visible", "djkombu_message"."sent_at", "djkombu_message"."payload", "djkombu_message"."queue_id" FROM "djkombu_message" WHERE ("djkombu_message"."queue_id" = %s AND "djkombu_message"."visible" = %s) ORDER BY "djkombu_message"."sent_at" ASC, "djkombu_message"."id" ASC LIMIT 1' - PARAMS = (6, True); args=(6, True)
[2015-06-20 19:38:38,965: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
[2015-06-20 19:38:39,966: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
[2015-06-20 19:38:40,968: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
[2015-06-20 19:38:41,969: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
[2015-06-20 19:38:42,970: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
[2015-06-20 19:38:43,003: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',); args=('celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',)
[2015-06-20 19:38:43,004: DEBUG/MainProcess] (0.000) QUERY = u'BEGIN' - PARAMS = (); args=None
[2015-06-20 19:38:43,006: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_message"."id", "djkombu_message"."visible", "djkombu_message"."sent_at", "djkombu_message"."payload", "djkombu_message"."queue_id" FROM "djkombu_message" WHERE ("djkombu_message"."queue_id" = %s AND "djkombu_message"."visible" = %s) ORDER BY "djkombu_message"."sent_at" ASC, "djkombu_message"."id" ASC LIMIT 1' - PARAMS = (6, True); args=(6, True)
[2015-06-20 19:38:43,008: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',); args=('celeryev.b5ddbe3d-6e82-4edc-88a1-589e58680aa4',)
[2015-06-20 19:38:43,008: DEBUG/MainProcess] (0.000) QUERY = u'BEGIN' - PARAMS = (); args=None
[2015-06-20 19:38:43,011: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_message"."id", "djkombu_message"."visible", "djkombu_message"."sent_at", "djkombu_message"."payload", "djkombu_message"."queue_id" FROM "djkombu_message" WHERE ("djkombu_message"."queue_id" = %s AND "djkombu_message"."visible" = %s) ORDER BY "djkombu_message"."sent_at" ASC, "djkombu_message"."id" ASC LIMIT 1' - PARAMS = (6, True); args=(6, True)
[2015-06-20 19:38:43,971: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
[2015-06-20 19:38:44,973: DEBUG/MainProcess] Shutter: <State: events=0 tasks=0>
```
```
mikeumus@celery-django-example:~/workspace (master) $ ./manage.py celery -A proj worker -l info --loglevel=DEBUG
System check identified some issues:
WARNINGS:
?: (1_6.W001) Some project unittests may not execute as expected.
HINT: Django 1.6 introduced a new default test runner. It looks like this project was generated using Django 1.5 or earlier. You should ensure your tests are all running & behaving as expected. See https://docs.djangoproject.com/en/dev/releases/1.6/#new-test-runner for more information.
[2015-06-20 19:08:38,970: DEBUG/MainProcess] | Worker: Preparing bootsteps.
[2015-06-20 19:08:38,974: DEBUG/MainProcess] | Worker: Building graph...
[2015-06-20 19:08:38,975: DEBUG/MainProcess] | Worker: New boot order: {Timer, Hub, Queues (intra), Pool, Autoscaler, Beat, Autoreloader, StateDB, Consumer}
[2015-06-20 19:08:38,984: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
[2015-06-20 19:08:38,985: DEBUG/MainProcess] | Consumer: Building graph...
[2015-06-20 19:08:38,992: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Events, Mingle, Gossip, Heart, Tasks, Control, Agent, event loop}
-------------- celery@mikeumus-celery-django-example-1607400 v3.1.18 (Cipater)
---- **** -----
--- * *** * -- Linux-3.14.13-c9-x86_64-with-Ubuntu-14.04-trusty
-- * - **** ---
- ** ---------- [config]
- ** ---------- .> app: proj:0x7f9fd7ac9510
- ** ---------- .> transport: django://localhost//
- ** ---------- .> results: djcelery.backends.database:DatabaseBackend
- *** --- * --- .> concurrency: 8 (prefork)
-- ******* ----
--- ***** ----- [queues]
-------------- .> celery exchange=celery(direct) key=celery
[tasks]
. celery.backend_cleanup
. celery.chain
. celery.chord
. celery.chord_unlock
. celery.chunks
. celery.group
. celery.map
. celery.starmap
. demoapp.tasks.add
. demoapp.tasks.mul
. demoapp.tasks.xsum
. proj.celery.debug_task
[2015-06-20 19:08:39,016: DEBUG/MainProcess] | Worker: Starting Pool
[2015-06-20 19:08:39,048: DEBUG/MainProcess] ^-- substep ok
[2015-06-20 19:08:39,049: DEBUG/MainProcess] | Worker: Starting Consumer
[2015-06-20 19:08:39,049: DEBUG/MainProcess] | Consumer: Starting Connection
[2015-06-20 19:08:39,055: INFO/MainProcess] Connected to django://localhost//
[2015-06-20 19:08:39,055: DEBUG/MainProcess] ^-- substep ok
[2015-06-20 19:08:39,056: DEBUG/MainProcess] | Consumer: Starting Events
[2015-06-20 19:08:39,060: DEBUG/MainProcess] ^-- substep ok
[2015-06-20 19:08:39,060: DEBUG/MainProcess] | Consumer: Starting Heart
[2015-06-20 19:08:39,060: DEBUG/MainProcess] ^-- substep ok
[2015-06-20 19:08:39,060: DEBUG/MainProcess] | Consumer: Starting Tasks
[2015-06-20 19:08:39,069: DEBUG/MainProcess] (0.001) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celery',); args=('celery',)
[2015-06-20 19:08:39,070: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celery',); args=('celery',)
[2015-06-20 19:08:39,073: DEBUG/MainProcess] (0.000) QUERY = u'SELECT COUNT(*) FROM "djkombu_message" WHERE "djkombu_message"."queue_id" = %s' - PARAMS = (1,); args=(1,)
[2015-06-20 19:08:39,073: DEBUG/MainProcess] ^-- substep ok
[2015-06-20 19:08:39,073: DEBUG/MainProcess] | Consumer: Starting Control
[2015-06-20 19:08:39,074: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celery@mikeumus-celery-django-example-1607400.celery.pidbox',); args=(u'celery@mikeumus-celery-django-example-1607400.celery.pidbox',)
[2015-06-20 19:08:39,075: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celery@mikeumus-celery-django-example-1607400.celery.pidbox',); args=(u'celery@mikeumus-celery-django-example-1607400.celery.pidbox',)
[2015-06-20 19:08:39,077: DEBUG/MainProcess] (0.000) QUERY = u'SELECT COUNT(*) FROM "djkombu_message" WHERE "djkombu_message"."queue_id" = %s' - PARAMS = (3,); args=(3,)
[2015-06-20 19:08:39,077: DEBUG/MainProcess] ^-- substep ok
[2015-06-20 19:08:39,077: DEBUG/MainProcess] | Consumer: Starting event loop
/usr/local/lib/python2.7/dist-packages/celery/fixups/django.py:265: UserWarning: Using settings.DEBUG leads to a memory leak, never use this setting in production environments!
warnings.warn('Using settings.DEBUG leads to a memory leak, never '
[2015-06-20 19:08:39,078: WARNING/MainProcess] /usr/local/lib/python2.7/dist-packages/celery/fixups/django.py:265: UserWarning: Using settings.DEBUG leads to a memory leak, never use this setting in production environments!
warnings.warn('Using settings.DEBUG leads to a memory leak, never '
[2015-06-20 19:08:39,078: WARNING/MainProcess] celery@mikeumus-celery-django-example-1607400 ready.
[2015-06-20 19:08:39,078: DEBUG/MainProcess] basic.qos: prefetch_count->32
[2015-06-20 19:08:39,079: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celery',); args=('celery',)
[2015-06-20 19:08:39,080: DEBUG/MainProcess] (0.000) QUERY = u'BEGIN' - PARAMS = (); args=None
[2015-06-20 19:08:39,081: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_message"."id", "djkombu_message"."visible", "djkombu_message"."sent_at", "djkombu_message"."payload", "djkombu_message"."queue_id" FROM "djkombu_message" WHERE ("djkombu_message"."queue_id" = %s AND "djkombu_message"."visible" = %s) ORDER BY "djkombu_message"."sent_at" ASC, "djkombu_message"."id" ASC LIMIT 1' - PARAMS = (1, True); args=(1, True)
^C
worker: Hitting Ctrl+C again will terminate all running tasks!
worker: Warm shutdown (MainProcess)
[2015-06-20 19:08:41,270: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_queue"."id", "djkombu_queue"."name" FROM "djkombu_queue" WHERE "djkombu_queue"."name" = %s LIMIT 21' - PARAMS = (u'celery',); args=('celery',)
[2015-06-20 19:08:41,271: DEBUG/MainProcess] (0.000) QUERY = u'BEGIN' - PARAMS = (); args=None
[2015-06-20 19:08:41,272: DEBUG/MainProcess] (0.000) QUERY = u'SELECT "djkombu_message"."id", "djkombu_message"."visible", "djkombu_message"."sent_at", "djkombu_message"."payload", "djkombu_message"."queue_id" FROM "djkombu_message" WHERE ("djkombu_message"."queue_id" = %s AND "djkombu_message"."visible" = %s) ORDER BY "djkombu_message"."sent_at" ASC, "djkombu_message"."id" ASC LIMIT 1' - PARAMS = (1, True); args=(1, True)
[2015-06-20 19:08:41,272: DEBUG/MainProcess] | Worker: Closing Pool...
[2015-06-20 19:08:41,651: DEBUG/MainProcess] | Worker: Closing Consumer...
[2015-06-20 19:08:41,651: DEBUG/MainProcess] | Worker: Stopping Consumer...
[2015-06-20 19:08:41,651: DEBUG/MainProcess] | Consumer: Closing Connection...
[2015-06-20 19:08:41,651: DEBUG/MainProcess] | Consumer: Closing Events...
[2015-06-20 19:08:41,652: DEBUG/MainProcess] | Consumer: Closing Heart...
[2015-06-20 19:08:41,652: DEBUG/MainProcess] | Consumer: Closing Tasks...
[2015-06-20 19:08:41,652: DEBUG/MainProcess] | Consumer: Closing Control...
[2015-06-20 19:08:41,652: DEBUG/MainProcess] | Consumer: Closing event loop...
[2015-06-20 19:08:41,653: DEBUG/MainProcess] | Consumer: Stopping event loop...
[2015-06-20 19:08:41,653: DEBUG/MainProcess] | Consumer: Stopping Control...
[2015-06-20 19:08:41,653: DEBUG/MainProcess] | Consumer: Stopping Tasks...
[2015-06-20 19:08:41,654: DEBUG/MainProcess] Cancelling task consumer...
[2015-06-20 19:08:41,654: DEBUG/MainProcess] | Consumer: Stopping Heart...
[2015-06-20 19:08:41,654: DEBUG/MainProcess] | Consumer: Stopping Events...
[2015-06-20 19:08:41,655: DEBUG/MainProcess] | Consumer: Stopping Connection...
[2015-06-20 19:08:41,655: DEBUG/MainProcess] | Worker: Stopping Pool...
^C
worker: Cold shutdown (MainProcess)
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment