td-agent

gistfile1.txt

install
------------
yum -y install td-agent
/usr/lib64/fluent/ruby/bin/fluent-gem update fluentd
/usr/lib64/fluent/ruby/bin/fluent-gem update fluent-plugin-mongo
/usr/lib64/fluent/ruby/bin/fluent-gem install bson_ext



/var/log/td-agent/td-agent.log
--------------------------------
2012-02-11 14:23:21 +0900: starting fluentd-0.10.11
2012-02-11 14:23:21 +0900: reading config file path="/etc/td-agent/td-agent.conf"
2012-02-11 14:23:22 +0900: adding source type="tail"
2012-02-11 14:23:22 +0900: 'pos_file PATH' parameter is not set to a 'tail' source.
2012-02-11 14:23:22 +0900: this parameter is highly recommended to save the position to resume tailing.
2012-02-11 14:23:22 +0900: adding match pattern="dak.app" type="mongo"
2012-02-11 14:23:22 +0900: adding match pattern="td.*.*" type="file"
2012-02-11 14:24:36 +0900: failed to flush the buffer, retrying. error="Exceded maximum insert size of 16,000,000 bytes" instance=41053780
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluent-plugin-mongo-0.6.3/lib/fluent/plugin/mongo_ext.rb:36:in `insert_documents'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/mongo-1.5.2/lib/mongo/collection.rb:343:in `insert'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluent-plugin-mongo-0.6.3/lib/fluent/plugin/out_mongo.rb:110:in `operate'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluent-plugin-mongo-0.6.3/lib/fluent/plugin/out_mongo.rb:100:in `write'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.11/lib/fluent/buffer.rb:262:in `write_chunk'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.11/lib/fluent/buffer.rb:246:in `pop'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.11/lib/fluent/output.rb:299:in `try_flush'
  2012-02-11 14:24:36 +0900: /usr/lib64/fluent/ruby/lib/ruby/gems/1.9.1/gems/fluentd-0.10.11/lib/fluent/output.rb:121:in `run'