django logging fluentd

gistfile1.py

LOGGING = {
    'version': 1,
    'disable_existing_loggers': False,
    'formatters': {
        'verbose': {
            'format': "%(asctime)s %(levelname)s: %(message)s [in %(pathname)s:%(lineno)d]"
        },
    },
    'handlers': {
       'fluentinfo':{
            'level':'INFO',
            'class':'fluent.handler.FluentHandler',
            'formatter': 'verbose',
            'tag':'app.info',
            'host':'localhost',
            'port':24224,
            # 'timeout':3.0,
            # 'verbose': False
        },
       'fluentdebug':{
            'level':'DEBUG',
            'class':'fluent.handler.FluentHandler',
            'formatter': 'verbose',
            'tag':'app.debug',
            'host':'localhost',
            'port':24224,
            # 'timeout':3.0,
            'verbose': True
        },
    },
    'loggers': {
        'app.debug': {
            'handlers': ['fluentdebug'],
            'level': 'DEBUG',
            'propagate': True,
        },
        'app.info': {
            'handlers': ['fluentinfo'],
            'level': 'DEBUG',
            'propagate': True,
        },
    }
}

for future googlers :)

if you using fluentd to send log entries to elasticsearch (via fluent-plugin-elasticsearch), you must use fluent.handler.FluentRecordFormatter formatter. Coz fluent-plugin-elasticsearch wants pure json as log entry.

Something like this:

...
    'formatters': {
        'fluentd': {
            '()': 'fluent.handler.FluentRecordFormatter',
            'format': {
                'level': '%(levelname)s',
                'hostname': '%(hostname)s',
                'where': '%(module)s',
            }
        }
    },
...
    'handlers': {
       'fluentd':{
            'level': 'INFO',
            'class': 'fluent.handler.FluentHandler',
            'formatter': 'fluentd',
            'tag': 'django.log',
      }

Change DEBUG to INFO on line 39.