Skip to content

Instantly share code, notes, and snippets.

@oranie
Created March 22, 2012 03:21
Show Gist options
  • Save oranie/2155394 to your computer and use it in GitHub Desktop.
Save oranie/2155394 to your computer and use it in GitHub Desktop.
fluentd csv file tail
<source>
type tail
tag app_csv_log_file_name
format /^(?<column1>[^,]*),(?<column2>[^ ]*),(?<column3>[^ ]*),(?<column4>[^ ]*),(?<column5>[^ ]*)?$/
path /var/log/app_log_dir/app_csv_log_file
pos_file /var/log/td-agent/tmp/app_csv_log.pos
</source>
<match *.**>
type forward
<server>
name aggregate
host 192.168.1.1
port 24224
weight 60
</server>
buffer_type file
buffer_path /var/log/td-agent/myapp-forward
retry_limit 50
flush_interval 1s
</match>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment