Skip to content

Instantly share code, notes, and snippets.

@arnecls
Created April 30, 2015 13:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save arnecls/84a7aa67088488a23cdc to your computer and use it in GitHub Desktop.
Save arnecls/84a7aa67088488a23cdc to your computer and use it in GitHub Desktop.
Gollum Kafka to file
- "consumer.Kafka":
Enable: true
Topic: "mmbb"
DefaultOffset: "Oldest"
Stream: "kafka"
Servers:
- "kafka0:9092"
- "kafka1:9092"
- "kafka2:9092"
- "producer.File":
Channel: 65535
Rotate: false
File: "mmbb_gollum.log"
Stream: "kafka"
Formatter: "format.JSON"
JSONDirectives:
- 'serverIP : : serverName ::esc'
- 'serverName : : forwardedFor ::esc'
- 'forwardedFor :, : forwardedFor :append:'
- 'forwardedFor : : remoteIP ::esc'
- 'forwardedFor :- : remoteIP ::'
- 'remoteIP : : @timestamp ::esc'
- 'remoteIP :- : @timestamp ::'
- '@timestamp : ": method ::dat'
- 'method : : request ::esc'
- 'request : : protocol ::esc'
- 'protocol :" : status ::esc'
- 'status : : responseSize ::val'
- 'responseSize : : responseTime ::val'
- 'responseTime : : pageID ::val'
- 'pageID : : metricDb ::esc'
- 'pageID :- : metricDb ::'
- 'metricDb : : metricJava ::val'
- 'metricDb :- : metricJava ::'
- 'metricJava : : metricMemcache ::val'
- 'metricJava :- : metricMemcache ::'
- 'metricMemcache : : metricXCache ::val'
- 'metricMemcache :- : metricXCache ::'
- 'metricXCache : : metricFTP ::val'
- 'metricXCache :- : metricFTP ::'
- 'metricFTP : : metricSolr ::val'
- 'metricFTP :- : metricSolr ::'
- 'metricSolr : : metricRedis ::val'
- 'metricSolr :- : metricRedis ::'
- 'metricRedis : ": referrer ::val'
- 'metricRedis :- ": referrer ::'
- 'referrer :" ": hash ::esc'
- 'referrer :-" ": hash ::'
- 'hash :" ": agent ::esc'
- 'agent :": ::esc'
- 'agent :-": ::'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment