Skip to content

Instantly share code, notes, and snippets.

View tagomoris's full-sized avatar

Satoshi Tagomori tagomoris

448 followers · 0 following
View GitHub Profile
@tagomoris
tagomoris / gist:1321863
Created October 28, 2011 08:21
2011-10-28 17:16:59 +0900: failed to flush the buffer error="incompatible character encodings: ASCII-8BIT and UTF-8"
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/thrift-0.7.0/lib/thrift/transport/framed_transport.rb:84:in `write'
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/thrift-0.7.0/lib/thrift/protocol/binary_protocol.rb:112:in `write_string'
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/thrift-0.7.0/lib/thrift/client.rb:35:in `write'
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/thrift-0.7.0/lib/thrift/client.rb:35:in `send_message'
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/fluent-plugin-scribe-0.10.3/lib/fluent/plugin/thrift/scribe.rb:21:in `send_Log'
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/fluent-plugin-scribe-0.10.3/lib/fluent/plugin/thrift/scribe.rb:16:in `Log'
2011-10-28 17:16:59 +0900: /home/hoge/.rvm/gems/ruby-1.9.2-p180/gems/fluent-plu
@tagomoris
tagomoris / hoop_append_bench.rb
Created October 31, 2011 10:25
continuous write over hoop
#!/usr/bin/env ruby
source_file = ARGV.shift
target_host = ARGV.shift
target_port = ARGV.shift
target_path = ARGV.shift
username = ARGV.shift
lasting_seconds = ARGV.shift.to_i
@tagomoris
tagomoris / check_each_line.pl
Created December 22, 2011 05:40
check tags/data length
#!/usr/bin/env perl
use 5.14.0;
my $odata = '============================================================================================================================================================================================================================================================================================================';
my $data_length = length($odata);
my $seq = {first => [], second => [], third => [], forth => []};
my $lines = 0;
my $bytes = 0;
@tagomoris
tagomoris / reduce_checker_result.pl
Created December 22, 2011 05:41
reduce results of checker
#!/usr/bin/env perl
use 5.14.0;
my $seq = {first => [], second => [], third => [], forth => []};
my $lines = 0;
my $bytes = 0;
my $broken = 0;
while(my $line = <STDIN>){
@tagomoris
tagomoris / test_hoop_racecondition.rb
Created December 22, 2011 09:32
#!/usr/bin/env ruby
require 'net/http'
(host,port,username,path) = ARGV
port = port.to_i
data = '============================================================================================================================================================================================================================================================================================================'
$i = 0
@tagomoris
tagomoris / fluentd.conf
Created December 26, 2011 07:08
fluentd + out_hoop benchmark configuration
<source>
type scribe
# 14631, 14632, 14633, 14634
port 14631
add_prefix scribe
</source>
<match scribe.*>
type hoop
hoop_server hoop-server.local:14000
@tagomoris
tagomoris / gist:1523001
Created December 27, 2011 08:09
OK, I understand what is not supported (now?).
In this case, hoop server should send response message means correct reason, like
'concurrent append not supported'.
But now, in fact, hoop send message as 'failed to create file'. We cannot know what is wrong
from this message. (request method? wrong path? or ...?)
This is wrong message, and i want to be fixed.
@tagomoris
tagomoris / gist:1526226
Created December 28, 2011 04:19
$ ack dfs.block.size
hoop-server/src/main/java/com/cloudera/hoop/fs/FSCreate.java
72: blockSize = fs.getConf().getInt("dfs.block.size", 67108864);
@tagomoris
tagomoris / gist:1588034
Created January 10, 2012 09:20
2012-01-10 18:16:09 +0900: failed to flush the buffer, retrying. error="undefined method `write' for nil:NilClass" instance=76009820
2012-01-10 18:16:09 +0900: /home/username/.rvm/gems/ruby-1.9.2-p180/gems/fluentd-0.10.8/lib/fluent/plugin/out_exec_filter.rb:139:in `write'
2012-01-10 18:16:09 +0900: /home/username/.rvm/gems/ruby-1.9.2-p180/gems/fluentd-0.10.8/lib/fluent/buffer.rb:262:in `write_chunk'
2012-01-10 18:16:09 +0900: /home/username/.rvm/gems/ruby-1.9.2-p180/gems/fluentd-0.10.8/lib/fluent/buffer.rb:246:in `pop'
2012-01-10 18:16:09 +0900: /home/username/.rvm/gems/ruby-1.9.2-p180/gems/fluentd-0.10.8/lib/fluent/output.rb:299:in `try_flush'
2012-01-10 18:16:09 +0900: /home/username/.rvm/gems/ruby-1.9.2-p180/gems/fluentd-0.10.8/lib/fluent/output.rb:121:in `run'
@tagomoris
tagomoris / gist:1797422
Created February 11, 2012 07:24
after file rotation by 'ln -s /tmp/real2 /tmp/symlink'
2012-02-11 16:23:43 +0900: detected rotation of /tmp/symlink; waiting 5 seconds
2012-02-11 16:23:45 +0900: unexpected error error="undefined method `call' for #<Fluent::TailInput::RotateHandler:0x0000010229f6c8>"
2012-02-11 16:23:45 +0900: /Users/tagomoris/Documents/fluentd/lib/fluent/plugin/in_tail.rb:241:in `on_change'
2012-02-11 16:23:45 +0900: /Users/tagomoris/.rvm/gems/ruby-1.9.2-p290/gems/cool.io-1.1.0/lib/cool.io/loop.rb:96:in `run_once'
2012-02-11 16:23:45 +0900: /Users/tagomoris/.rvm/gems/ruby-1.9.2-p290/gems/cool.io-1.1.0/lib/cool.io/loop.rb:96:in `run'
2012-02-11 16:23:45 +0900: /Users/tagomoris/Documents/fluentd/lib/fluent/plugin/in_tail.rb:76:in `run'