Skip to content

Instantly share code, notes, and snippets.

@joker1007
Last active September 27, 2017 06:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save joker1007/60b7f8e8dc1131656800f34342985fb3 to your computer and use it in GitHub Desktop.
Save joker1007/60b7f8e8dc1131656800f34342985fb3 to your computer and use it in GitHub Desktop.
[Resolved] fluentd out_relabe is buffered??
<match dummy.tag>
  @type copy

  <store>
    @type relabel
    @label @bigquery-out
  </store>

  <store>
    @type relabel
    @label @s3-out
  </store>

  <store>
    @type flowcounter

    count_keys *
    unit minute
    tag repro.fluentd.traffic
  </store>
</match>
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:  2017-09-26 22:51:35 +0000 [warn]: #0 emit transaction failed: error_class=Fluent::Plugin::Buffer::BufferOverflowError error="buffer space has too many data" tag="dummy.tag"
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/buffer.rb:196:in `write'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:879:in `block in handle_stream_with_custom_format'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:805:in `write_guard'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:878:in `handle_stream_with_custom_format'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:797:in `execute_chunking'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:732:in `emit_buffered'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/event_router.rb:96:in `emit_stream'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/out_relabel.rb:29:in `process'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/output.rb:721:in `emit_sync'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/out_copy.rb:42:in `block in process'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/out_copy.rb:41:in `each'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/out_copy.rb:41:in `process'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/multi_output.rb:147:in `emit_sync'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/event_router.rb:96:in `emit_stream'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/in_forward.rb:300:in `on_message'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/in_forward.rb:211:in `block in handle_connection'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/in_forward.rb:248:in `block (3 levels) in read_messages'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/in_forward.rb:247:in `feed_each'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/in_forward.rb:247:in `block (2 levels) in read_messages'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin/in_forward.rb:256:in `block in read_messages'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin_helper/server.rb:576:in `on_read_without_connection'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/cool.io-1.5.1/lib/cool.io/io.rb:123:in `on_readable'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/cool.io-1.5.1/lib/cool.io/io.rb:186:in `on_readable'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/cool.io-1.5.1/lib/cool.io/loop.rb:88:in `run_once'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/cool.io-1.5.1/lib/cool.io/loop.rb:88:in `run'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin_helper/event_loop.rb:84:in `block in start'
Sep 27 07:51:35 54.199.182.194 fluentd-aggregator:    2017-09-26 22:51:35 +0000 [warn]: #0 /fluentd/etc/vendor/bundle/ruby/2.3.0/gems/fluentd-0.14.20/lib/fluent/plugin_helper/thread.rb:78:in `block in thread_create'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment