Skip to content

Instantly share code, notes, and snippets.

View yosukehara's full-sized avatar

Yosuke Hara yosukehara

54 followers · 0 following
View GitHub Profile
@yosukehara
yosukehara / multipart_upload.rb
Created December 17, 2012 12:34
I tried multipart-upload-api with Ruby. Sample code is as the follows:
require 'aws-sdk'
Endpoint = "localhost"
Port = 8080
class LeoFSHandler < AWS::Core::Http::NetHttpHandler
def handle(request, response)
request.port = ::Port
super
end
@yosukehara
yosukehara / leofs_benchmark_with_0.14.4.md
Last active December 19, 2015 02:28
LeoFS benchmark result with v0.14.4

LeoFS v0.14.4's benchmark result

  • Servers
    • Benchmark-server: x1
      • Core:32, Xeon
      • RAM:32GB
    • Gateway-server: x1
      • Core:32, Xeon
  • RAM:32GB
@yosukehara
yosukehara / leo_pod_test.erl
Created July 3, 2013 14:59
leo_pod's test results
Eshell V5.9.3.1 (abort with ^G)
1> leo_pod:test(eredis_pool_0).
src/leo_pod_test.erl:64:<0.37.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.38.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.39.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.40.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.41.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.42.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.43.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
src/leo_pod_test.erl:64:<0.44.0>: WorkerArgs = [{protocol,tcp},{host,"127.0.0.1"},{port,8080}]
@yosukehara
yosukehara / exec_snmpwalk_results.txt
Created July 8, 2013 01:20
Execute results of "snmpwalk" to manager, gateway and storage
$ snmpwalk -v 2c -c public 127.0.0.1:4020 .1.3.6.1.4.1.35450
iso.3.6.1.4.1.35450.11.1.0 = STRING: "manager_0@127.0.0.1"
iso.3.6.1.4.1.35450.11.2.0 = Gauge32: 144
iso.3.6.1.4.1.35450.11.3.0 = Gauge32: 34802755
iso.3.6.1.4.1.35450.11.4.0 = Gauge32: 30823503
iso.3.6.1.4.1.35450.11.5.0 = Gauge32: 4397032
iso.3.6.1.4.1.35450.11.6.0 = Gauge32: 1120984
iso.3.6.1.4.1.35450.11.7.0 = Gauge32: 144
iso.3.6.1.4.1.35450.11.8.0 = Gauge32: 35184821
iso.3.6.1.4.1.35450.11.9.0 = Gauge32: 30810770
@yosukehara
yosukehara / example_embed.erl
Last active December 26, 2015 02:29
Embedding leofs(leo-gateway) in an application
%% Embedding leo-gateway in an application
%%
ok = leofs:start(),
not_found = leofs:get(<<"key/1">>),
{ok, ETag} = leofs:put(<<"key/1">>, <<"value_1">>),
{ok, {ETag, Bin}} = leofs:get(<<"key/1">>),
ok = leofs:delete(<<"key/1">>),
@yosukehara
yosukehara / get_object_metadata.rb
Created December 2, 2013 12:51
Retrieve object's metadata with S3-Client from LeoFS
##
## Retrieve object's metadata with S3-Client from LeoFS
##
require "aws-sdk"
Port = 8080
AccessKeyId = "YOUR_ACCESS_KEY_ID"
SecretAccessKey = "YOUR_SECRET_ACCESS_KEY"
class LeoFSHandler < AWS::Core::Http::NetHttpHandler
@yosukehara
yosukehara / reltool.config.v1.0.0-pre1.gateway
Created May 27, 2014 04:42
%% -*- mode: erlang;erlang-indent-level: 4;indent-tabs-mode: nil -*-
%%======================================================================
%%
%% LeoFS Gateway
%%
%% Copyright (c) 2012-2013 Rekuten, Inc.
%%
%% This file is provided to you under the Apache License,
%% Version 2.0 (the "License"); you may not use this file
%% except in compliance with the License. You may obtain
@yosukehara
yosukehara / reltool.config.v1.0.0-pre1.manager
Created May 27, 2014 04:45
%% -*- mode: erlang;erlang-indent-level: 4;indent-tabs-mode: nil -*-
%%======================================================================
%%
%% LeoFS Manager
%%
%% Copyright (c) 2012 Rakuten, Inc.
%%
%% This file is provided to you under the Apache License,
%% Version 2.0 (the "License"); you may not use this file
%% except in compliance with the License. You may obtain
@yosukehara
yosukehara / reltool.config.v1.0.0-pre1.storage
Created May 27, 2014 04:46
%% -*- mode: erlang;erlang-indent-level: 4;indent-tabs-mode: nil -*-
%%======================================================================
%%
%% LeoFS Storage
%%
%% Copyright (c) 2012-2013 Rakuten, Inc.
%%
%% This file is provided to you under the Apache License,
%% Version 2.0 (the "License"); you may not use this file
%% except in compliance with the License. You may obtain
@yosukehara
yosukehara / seasar-conference-2015-leofs.md
Last active September 15, 2015 06:04

LeoFSの未来 (The future of LeoFS)

LeoFSは、近年、爆発的に増加している「非構造化データ - Unstructured data」を格納するストレージ - Cloud Storage として、2010年2月から楽天技術研究所で開発が始まり、その成果をOSSとして公開してます.

非構造化データは、ビッグデータ解析のために蓄積されるデータ、センサーネットワークデータ、デジタルコンテンツ、アプリケーションのログ・バックアップデータ 等があります. これらは、今後もますます増え続けていくことが予想されている為、私たちは、次の３つの特徴を持つストレージを必要としてます.