Skip to content

Instantly share code, notes, and snippets.

@nvquanghuy
Created February 26, 2014 23:43
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nvquanghuy/35aba82d7e3dbe24938e to your computer and use it in GitHub Desktop.
Save nvquanghuy/35aba82d7e3dbe24938e to your computer and use it in GitHub Desktop.
<match **.production.**>
type copy
<store>
type mod_s3
aws_key_id X
aws_sec_key X
s3_bucket X
path X
buffer_type memory
time_slice_format %Y-%m-%d-%H-%M
buffer_chunk_limit 8m
buffer_queue_limit 128
flush_interval 30s
retry_limit 10
retry_wait 30s
utc
</store>
<store>
type tdlog
auto_create_table false
database X
table X
apikey X
buffer_type memory
</store>
<store>
type kestrel
host X
queue events
flush_interval 30s
</store>
<store>
type flowcounter
count_keys *
aggregate all
tag flowcount.prod
</store>
</match>
2014-02-26 23:36:40 +0000 [warn]: emit transaction failed error_class=Fluent::BufferQueueLimitError error=#<Fluent::BufferQueueLimitError: queue size exceeds limit>
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/buffer.rb:182:in `block in emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/rubies/ruby-1.9.3-p484/lib/ruby/1.9.1/monitor.rb:211:in `mon_synchronize'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/buffer.rb:168:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:240:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:33:in `next'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/buffer.rb:172:in `block in emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/rubies/ruby-1.9.3-p484/lib/ruby/1.9.1/monitor.rb:211:in `mon_synchronize'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/buffer.rb:168:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:240:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluent-plugin-td-0.10.12/lib/fluent/plugin/out_tdlog.rb:191:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:33:in `next'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/buffer.rb:172:in `block in emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/rubies/ruby-1.9.3-p484/lib/ruby/1.9.1/monitor.rb:211:in `mon_synchronize'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/buffer.rb:168:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:528:in `block in emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/event.rb:142:in `feed_each'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/event.rb:142:in `each'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:518:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/output.rb:33:in `next'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/plugin/out_copy.rb:73:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/match.rb:36:in `emit'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/engine.rb:151:in `emit_stream'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/plugin/in_forward.rb:121:in `on_message'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/plugin/in_forward.rb:186:in `feed_each'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/plugin/in_forward.rb:186:in `on_read_msgpack'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/cool.io-1.1.1/lib/cool.io/io.rb:108:in `on_readable'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/cool.io-1.1.1/lib/cool.io/io.rb:170:in `on_readable'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/cool.io-1.1.1/lib/cool.io/loop.rb:96:in `run_once'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/cool.io-1.1.1/lib/cool.io/loop.rb:96:in `run'
2014-02-26 23:36:40 +0000 [warn]: /home/analytics/.rvm/gems/ruby-1.9.3-p484@collector/gems/fluentd-0.10.43/lib/fluent/plugin/in_forward.rb:81:in `run'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment