Skip to content

Instantly share code, notes, and snippets.

View shun0102's full-sized avatar

Shusuke Mikami shun0102

View GitHub Profile
@shun0102
shun0102 / gist:2476820
Created April 24, 2012 05:38
fluent-logger error
dyld: lazy symbol binding failed: Symbol not found: _yajl_set_static_value
Referenced from: /Users/mikami/.rvm/gems/ruby-1.9.3-p125/gems/yajl-ruby-1.0.0/lib/yajl/yajl.bundle
Expected in: flat namespace
dyld: Symbol not found: _yajl_set_static_value
Referenced from: /Users/mikami/.rvm/gems/ruby-1.9.3-p125/gems/yajl-ruby-1.0.0/lib/yajl/yajl.bundle
Expected in: flat namespace
@shun0102
shun0102 / deploy.rb
Created May 22, 2012 11:46
td-agentデプロイ用のcapistranoレシピ
set :config_file, "config/upload/fluent_#{stage}.conf"
set :fluent_plugins, ["file-alternative", "mongo"]
namespace :td do
task :start, :roles => :fluentd do
run "#{try_sudo} /etc/init.d/td-agent start"
end
task :stop, :roles => :fluentd do
run "#{try_sudo} /etc/init.d/td-agent stop"
<match **>
type forward
buffer_chunk_limit 8MB
<server>
host lle11
</server>
#about 10mins
retry_limit 9
<secondary>
<server>
data-config.xmlの設定
<field column="ts" name="ts" dateTimeFormat="yyyy-MM-dd hh:mm:ss" locale="ja" />
以下の様な対応で日付が変換される
2012-03-02 00:00:00 => 2012-03-02T15:00:00Z
2012-03-03 12:00:00 => 2012-03-02T15:00:00Z
2012-03-03 00:00:00 => 2012-03-02T15:00:00Z
Thu Aug 23 02:10:45 [conn262470] authenticate: { authenticate: 1, nonce: "e9b20d11d36d8841", user: "__system", key: "721ad512d6133393a33ffcdf72e8f613" }
Thu Aug 23 02:10:55 Invalid access at address: 0x7f54f4d751d8
Thu Aug 23 02:10:55 Got signal: 7 (Bus error).
Thu Aug 23 02:10:55 Backtrace:
0xa95ce9 0xa9640c 0x3e3f80f4a0 0x85f390 0x8a7e98 0x8b4439 0x8b5b3b 0x961b5d 0x963e25 0x83355f 0x822b1b 0x826805 0x827c85 0x827cd8 0x828170 0xaabca0 0x3e3f8077f1 0x3e3f4e5ccd
/usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x3a9) [0xa95ce9]
/usr/bin/mongod(_ZN5mongo24abruptQuitWithAddrSignalEiP7siginfoPv+0x22c) [0xa9640c]
/lib64/libpthread.so.0() [0x3e3f80f4a0]
@shun0102
shun0102 / input_mysql.rb
Last active August 29, 2015 14:14
embulk mysql input plugin example
module Embulk
class InputMysql < InputPlugin
require 'jdbc/mysql'
Jdbc::MySQL.load_driver
Plugin.register_input('mysql', self)
def self.transaction(config, &control)
task = {
'host' => config.param('host', :string, :default => 'localhost'),
@shun0102
shun0102 / gist:a36109ae5e1626c8bba8
Created February 4, 2015 15:08
use timestamp at embulk input plugin
def self.transaction(config, &control)
  columns = [Column.new(0, 'time', :timestamp)]
end

def run
  @page_builder.add([Time.now])
end
embulk-work java -jar embulk.jar gem list
*** LOCAL GEMS ***
embulk-input-jdbc (0.1.0)
embulk-input-mysql (0.1.0)
embulk-output-mysql (0.1.0)
embulk-plugin-redis (0.1.2)
ffi (1.9.3 java)
jar-dependencies (0.1.2)
開始日,2015-01-01
終了日,2015-01-31
時間,URL,参照元,...
2015-01-01 00:00:00, http://example.com, ,...
2015-01-01 00:00:00, http://example.com, ,...
var url = 'http://104.154.70.25/?callback=?';
$.getJSON(url, function(data){
console.log(data);
});