Skip to content

Instantly share code, notes, and snippets.

@kuenishi
Last active August 29, 2015 14:13
Show Gist options
  • Save kuenishi/39a25a1da85bab6eabfb to your computer and use it in GitHub Desktop.
Save kuenishi/39a25a1da85bab6eabfb to your computer and use it in GitHub Desktop.
{sibling_benchmark,
[{write_concurrency, 8}, %% seems not working more than 20
{duration_sec, 10},
{leave_and_join, 3},
%%{version, previous}]
{version, current}]
%%]
},
2015-01-09 10:21:48.505 [notice] <0.42.0>@lager_file_backend:127 Changed loglevel of rtresult/sibling_benchmark.dat_test_output to debug
2015-01-09 10:21:48.873 [info] <0.80.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev5/bin/riak stop ~ wasn't running.
2015-01-09 10:21:48.873 [info] <0.81.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev6/bin/riak stop ~ wasn't running.
2015-01-09 10:21:48.878 [info] <0.69.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev6/bin/riak-cs stop ~ wasn't running.
2015-01-09 10:21:48.896 [info] <0.77.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak stop ~ wasn't running.
2015-01-09 10:21:48.905 [info] <0.68.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev5/bin/riak-cs stop ~ wasn't running.
2015-01-09 10:21:51.075 [info] <0.66.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs stop ~ ok.
2015-01-09 10:21:51.095 [info] <0.64.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs stop ~ ok.
2015-01-09 10:21:51.108 [info] <0.67.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs stop ~ ok.
2015-01-09 10:21:51.136 [info] <0.65.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs stop ~ ok.
2015-01-09 10:21:51.255 [info] <0.88.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion stop ~ ok.
2015-01-09 10:21:52.091 [info] <0.76.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak stop ~ ok.
2015-01-09 10:21:52.134 [info] <0.79.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak stop ~ ok.
2015-01-09 10:21:52.135 [info] <0.78.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak stop ~ ok.
2015-01-09 10:21:52.135 [info] <0.2.0>@rt_cs_dev:setup_harness:40 Resetting nodes to fresh state
2015-01-09 10:21:52.140 [info] <0.2.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour/.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour/" reset HEAD --hard
2015-01-09 10:21:52.240 [info] <0.2.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour/.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour/" clean -fd
2015-01-09 10:21:52.288 [info] <0.2.0>@rt_cs_dev:setup_harness:44 Cleaning up lingering pipe directories
2015-01-09 10:21:52.289 [warning] <0.2.0>@rt:set_backend:1102 rt:set_backend doesn't recognize undefined as a legit backend, using the default.
2015-01-09 10:21:52.289 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/riak_cs/current"
2015-01-09 10:21:52.338 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/riak_ee_onefour/current"
2015-01-09 10:21:52.355 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/stanchion/current"
2015-01-09 10:21:52.355 [info] <0.2.0>@riak_test_runner:check_prereqs:141 sibling_benchmark prereqs: []
2015-01-09 10:21:52.355 [notice] <0.2.0>@riak_test_runner:confirm:54 Running Test sibling_benchmark
2015-01-09 10:21:53.381 [info] <0.2.0>@riak_test_runner:execute:96 Test Runner `uname -a` : Linux nausicaa 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt2-1 (2014-12-08) x86_64 GNU/Linux
2015-01-09 10:21:53.408 [info] <0.108.0>@rtcs:setup:70 Flavor : basic
2015-01-09 10:21:53.498 [debug] <0.113.0> Supervisor sasl_safe_sup started alarm_handler:start_link() at pid <0.114.0>
2015-01-09 10:21:53.498 [debug] <0.113.0> Supervisor sasl_safe_sup started overload:start_link() at pid <0.115.0>
2015-01-09 10:21:53.498 [debug] <0.112.0> Supervisor sasl_sup started supervisor:start_link({local,sasl_safe_sup}, sasl, safe) at pid <0.113.0>
2015-01-09 10:21:53.502 [debug] <0.112.0> Supervisor sasl_sup started release_handler:start_link() at pid <0.116.0>
2015-01-09 10:21:53.502 [info] <0.7.0> Application sasl started on node 'riak_test@127.0.0.1'
2015-01-09 10:21:53.541 [debug] <0.121.0> Supervisor crypto_sup started crypto_server:start_link() at pid <0.122.0>
2015-01-09 10:21:53.541 [info] <0.7.0> Application crypto started on node 'riak_test@127.0.0.1'
2015-01-09 10:21:53.556 [info] <0.7.0> Application xmerl started on node 'riak_test@127.0.0.1'
2015-01-09 10:21:53.591 [debug] <0.127.0> Supervisor inets_sup started ftp_sup:start_link() at pid <0.128.0>
2015-01-09 10:21:53.639 [debug] <0.130.0> Supervisor httpc_profile_sup started httpc_manager:start_link(default, only_session_cookies, inets) at pid <0.131.0>
2015-01-09 10:21:53.639 [debug] <0.129.0> Supervisor httpc_sup started httpc_profile_sup:start_link([{httpc,{default,only_session_cookies}}]) at pid <0.130.0>
2015-01-09 10:21:53.646 [debug] <0.129.0> Supervisor httpc_sup started httpc_handler_sup:start_link() at pid <0.132.0>
2015-01-09 10:21:53.647 [debug] <0.127.0> Supervisor inets_sup started httpc_sup:start_link([{httpc,{default,only_session_cookies}}]) at pid <0.129.0>
2015-01-09 10:21:53.660 [debug] <0.127.0> Supervisor inets_sup started httpd_sup:start_link([]) at pid <0.133.0>
2015-01-09 10:21:53.670 [debug] <0.127.0> Supervisor inets_sup started tftp_sup:start_link([]) at pid <0.134.0>
2015-01-09 10:21:53.671 [info] <0.7.0> Application inets started on node 'riak_test@127.0.0.1'
2015-01-09 10:21:53.671 [info] <0.108.0>@rtcs:setup_clusters:115 Configs = [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{32,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:21:53.671 [info] <0.108.0>@rtcs:deploy_nodes:394 Initial Config: [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{32,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:21:53.671 [info] <0.108.0>@rtcs:deploy_nodes:400 RiakNodes: ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:21:53.671 [debug] <0.108.0>@rtcs:deploy_nodes:409 setting rt_versions> current =>
2015-01-09 10:21:53.671 [info] <0.108.0>@rtcs:deploy_nodes:413 VersionMap: [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:21:53.672 [info] <0.108.0>@rtcs:deploy_nodes:418 NodeList: [{'rcs-dev1@127.0.0.1','dev1@127.0.0.1','stanchion@127.0.0.1'},{'rcs-dev2@127.0.0.1','dev2@127.0.0.1'},{'rcs-dev3@127.0.0.1','dev3@127.0.0.1'},{'rcs-dev4@127.0.0.1','dev4@127.0.0.1'}]
2015-01-09 10:21:53.672 [info] <0.136.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs stop"
2015-01-09 10:21:53.672 [info] <0.138.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs stop"
2015-01-09 10:21:53.672 [info] <0.135.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs stop"
2015-01-09 10:21:53.672 [info] <0.137.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs stop"
2015-01-09 10:21:53.811 [info] <0.136.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak stop
2015-01-09 10:21:53.817 [info] <0.135.0>@rtcs:stop_stanchion:672 Running "/home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion stop"
2015-01-09 10:21:53.823 [info] <0.137.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak stop
2015-01-09 10:21:53.840 [info] <0.138.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak stop
2015-01-09 10:21:53.970 [info] <0.136.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev2@127.0.0.1' is not pingable
2015-01-09 10:21:53.971 [debug] <0.148.0> Supervisor inet_gethost_native_sup started undefined at pid <0.149.0>
2015-01-09 10:21:53.971 [debug] <0.26.0> Supervisor kernel_safe_sup started inet_gethost_native:start_link() at pid <0.148.0>
2015-01-09 10:21:53.987 [info] <0.136.0>@rt:wait_until_unpingable:601 Wait until 'dev2@127.0.0.1' is not pingable
2015-01-09 10:21:53.996 [info] <0.137.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev3@127.0.0.1' is not pingable
2015-01-09 10:21:53.996 [info] <0.137.0>@rt:wait_until_unpingable:601 Wait until 'dev3@127.0.0.1' is not pingable
2015-01-09 10:21:53.998 [info] <0.135.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak stop
2015-01-09 10:21:54.010 [info] <0.138.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev4@127.0.0.1' is not pingable
2015-01-09 10:21:54.011 [info] <0.138.0>@rt:wait_until_unpingable:601 Wait until 'dev4@127.0.0.1' is not pingable
2015-01-09 10:21:54.142 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev1@127.0.0.1' is not pingable
2015-01-09 10:21:54.143 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'stanchion@127.0.0.1' is not pingable
2015-01-09 10:21:54.144 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'dev1@127.0.0.1' is not pingable
2015-01-09 10:21:54.144 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting riak_ee nodes to fresh state
2015-01-09 10:21:54.144 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/riak_ee_onefour/"
2015-01-09 10:21:54.144 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour//.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour//" reset HEAD --hard
2015-01-09 10:21:54.217 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour//.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour//" clean -fd
2015-01-09 10:21:54.247 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting riak_cs nodes to fresh state
2015-01-09 10:21:54.247 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/riak_cs"
2015-01-09 10:21:54.247 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_cs/.git" --work-tree="/home/kuenishi/rt/riak_cs/" reset HEAD --hard
2015-01-09 10:21:54.358 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_cs/.git" --work-tree="/home/kuenishi/rt/riak_cs/" clean -fd
2015-01-09 10:21:54.409 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting stanchion nodes to fresh state
2015-01-09 10:21:54.409 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/stanchion"
2015-01-09 10:21:54.409 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/stanchion/.git" --work-tree="/home/kuenishi/rt/stanchion/" reset HEAD --hard
2015-01-09 10:21:54.430 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/stanchion/.git" --work-tree="/home/kuenishi/rt/stanchion/" clean -fd
2015-01-09 10:21:54.471 [info] <0.193.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:21:54.471 [info] <0.195.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:21:54.471 [info] <0.194.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:21:54.471 [info] <0.192.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:21:54.476 [debug] <0.194.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev3/etc/app.config
2015-01-09 10:21:54.477 [debug] <0.195.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev4/etc/app.config
2015-01-09 10:21:54.477 [debug] <0.193.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev2/etc/app.config
2015-01-09 10:21:54.477 [debug] <0.192.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev1/etc/app.config
2015-01-09 10:21:54.484 [debug] <0.192.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/stanchion/current/dev/stanchion/etc/app.config
2015-01-09 10:21:54.485 [info] <0.206.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak start
2015-01-09 10:21:54.485 [info] <0.207.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak start
2015-01-09 10:21:54.485 [debug] <0.205.0>@rtcs:start_all_nodes:535 starting riak #1 > ee_current => "/home/kuenishi/rt/riak_ee_onefour/current"
2015-01-09 10:21:54.485 [info] <0.208.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak start
2015-01-09 10:21:54.485 [info] <0.205.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak start
2015-01-09 10:22:08.680 [info] <0.225.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs start"
2015-01-09 10:22:09.958 [info] <0.227.0>@rtcs:start_stanchion:665 Running "/home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion start"
2015-01-09 10:22:09.958 [info] <0.228.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs start"
2015-01-09 10:22:10.158 [info] <0.231.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs start"
2015-01-09 10:22:11.460 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev1@127.0.0.1' is pingable
2015-01-09 10:22:11.460 [info] <0.233.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs start"
2015-01-09 10:22:11.464 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev2@127.0.0.1' is pingable
2015-01-09 10:22:11.465 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev3@127.0.0.1' is pingable
2015-01-09 10:22:11.465 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev4@127.0.0.1' is pingable
2015-01-09 10:22:11.465 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev1@127.0.0.1' is pingable
2015-01-09 10:22:11.467 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev2@127.0.0.1' is pingable
2015-01-09 10:22:12.477 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev3@127.0.0.1' is pingable
2015-01-09 10:22:12.478 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev4@127.0.0.1' is pingable
2015-01-09 10:22:12.479 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'stanchion@127.0.0.1' is pingable
2015-01-09 10:22:12.482 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev1@127.0.0.1' is a singleton
2015-01-09 10:22:12.533 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev2@127.0.0.1' is a singleton
2015-01-09 10:22:12.534 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev3@127.0.0.1' is a singleton
2015-01-09 10:22:12.534 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev4@127.0.0.1' is a singleton
2015-01-09 10:22:12.534 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:22:12.535 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:22:12.536 [info] <0.108.0>@rtcs:setup_clusters:118 Make cluster
2015-01-09 10:22:12.607 [info] <0.108.0>@rt:join:298 [join] 'dev2@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:22:12.674 [info] <0.108.0>@rt:join:298 [join] 'dev3@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:22:12.758 [info] <0.108.0>@rt:join:298 [join] 'dev4@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:22:12.758 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:22:14.768 [info] <0.108.0>@rt:wait_until_no_pending_changes:490 Wait until no pending changes on ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:22:14.769 [info] <0.108.0>@rt:wait_until_ring_converged:564 Wait until ring converged on ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:22:15.813 [info] <0.108.0>@rtcs:setup_admin_user:451 Initial Config: [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{32,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:22:15.813 [debug] <0.108.0>@rtcs:setup_admin_user:463 setting rt_versions> current => [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:22:15.813 [debug] <0.108.0>@rtcs:create_user:743 Trying to create user "admin@me.com"
2015-01-09 10:22:16.815 [debug] <0.108.0>@rtcs:create_user:753 Create user output="{\"email\":\"admin@me.com\",\"display_name\":\"admin\",\"name\":\"admin\",\"key_id\":\"6IEFG4YDR3VGCV9NM7EB\",\"key_secret\":\"xre1F3wge8j7t7-ApTVcIx6zv9u2hu8U1WKWIw==\",\"id\":\"70930c99254c91c8a46a77408da7a1f573a24a397e077884c5711a0428bf1698\",\"status\":\"enabled\"}"
2015-01-09 10:22:16.817 [info] <0.108.0>@rtcs:create_admin_user:197 Riak CS Admin account created with "admin@me.com"
2015-01-09 10:22:16.817 [info] <0.108.0>@rtcs:create_admin_user:198 KeyId = "6IEFG4YDR3VGCV9NM7EB"
2015-01-09 10:22:16.817 [info] <0.108.0>@rtcs:create_admin_user:199 KeySecret = "xre1F3wge8j7t7-ApTVcIx6zv9u2hu8U1WKWIw=="
2015-01-09 10:22:16.817 [info] <0.108.0>@rtcs:create_admin_user:200 Id = "70930c99254c91c8a46a77408da7a1f573a24a397e077884c5711a0428bf1698"
2015-01-09 10:22:16.818 [debug] <0.258.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev1/etc/app.config
2015-01-09 10:22:16.818 [debug] <0.259.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev2/etc/app.config
2015-01-09 10:22:16.818 [debug] <0.261.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev4/etc/app.config
2015-01-09 10:22:16.818 [debug] <0.260.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev3/etc/app.config
2015-01-09 10:22:16.819 [debug] <0.258.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/stanchion/current/dev/stanchion/etc/app.config
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:495 NodeConfig: [{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{32,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]},{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{32,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]},{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{32,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,...},...]},...]},...]},...]
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:496 RiakNodes: ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:497 CSNodes: ['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1']
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:498 NodeMap: [{'dev1@127.0.0.1',1},{'dev2@127.0.0.1',2},{'dev3@127.0.0.1',3},{'dev4@127.0.0.1',4}]
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:499 VersionMap: [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:500 NodeList: [{'rcs-dev1@127.0.0.1','dev1@127.0.0.1','stanchion@127.0.0.1'},{'rcs-dev2@127.0.0.1','dev2@127.0.0.1'},{'rcs-dev3@127.0.0.1','dev3@127.0.0.1'},{'rcs-dev4@127.0.0.1','dev4@127.0.0.1'}]
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:501 Nodes: {['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1'],['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1'],'stanchion@127.0.0.1'}
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:502 AdminCreds: {"6IEFG4YDR3VGCV9NM7EB","xre1F3wge8j7t7-ApTVcIx6zv9u2hu8U1WKWIw=="}
2015-01-09 10:22:16.822 [info] <0.108.0>@rtcs:setup_admin_user:503 Deployed nodes: {['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1'],['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1'],'stanchion@127.0.0.1'}
2015-01-09 10:22:16.969 [info] <0.108.0>@sibling_benchmark:confirm:71 creating bucket "riak-test-bucket"
2015-01-09 10:22:18.442 [info] <0.108.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [1]
2015-01-09 10:22:18.442 [info] <0.108.0>@sibling_benchmark:confirm:77 ====================== run benchmark =====================
2015-01-09 10:22:18.442 [info] <0.108.0>@sibling_benchmark:confirm:80 write_concurrency: 16
2015-01-09 10:22:18.443 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 0 0 0 0
2015-01-09 10:22:18.443 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 0 0 0 0
2015-01-09 10:22:18.443 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 0 0 0 0
2015-01-09 10:22:18.443 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 0 0 0 0
2015-01-09 10:22:18.443 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 376 0 0 0
2015-01-09 10:22:18.443 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 1451 0 0 0
2015-01-09 10:22:18.444 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [1]
2015-01-09 10:22:23.445 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 0 0 0
2015-01-09 10:22:23.445 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 16 0 0 0
2015-01-09 10:22:23.445 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 41535 0 0 0
2015-01-09 10:22:23.445 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 636750 0 0 0
2015-01-09 10:22:23.445 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 7060 0 0 0
2015-01-09 10:22:23.445 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 504915 0 0 0
2015-01-09 10:22:23.449 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [113]
2015-01-09 10:22:28.636 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 0 0 0
2015-01-09 10:22:28.636 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 24 0 0 0
2015-01-09 10:22:28.636 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 75403 0 0 0
2015-01-09 10:22:28.636 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 1871716 0 0 0
2015-01-09 10:22:28.636 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 4836 0 0 0
2015-01-09 10:22:28.636 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 504915 0 0 0
2015-01-09 10:22:28.710 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 30, HistoryCounts: [114,118,117,118,118,118,111,118,110,103,109,111,119,111,119,112,119,109,112,104,119,108,117,117,119,110,112,113,107,112]
2015-01-09 10:22:30.059 [info] <0.108.0>@sibling_benchmark:leave_and_join_node:205 leaving node2
2015-01-09 10:22:30.394 [info] <0.108.0>@rt:leave:315 [leave] 'dev2@127.0.0.1': ok
2015-01-09 10:22:30.394 [info] <0.108.0>@rt:wait_until_unpingable:601 Wait until 'dev2@127.0.0.1' is not pingable
2015-01-09 10:22:33.715 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 6 3 7
2015-01-09 10:22:33.715 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 33 30 8 31
2015-01-09 10:22:33.715 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 106929 85754 41973 98430
2015-01-09 10:22:33.715 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 435098 110233 451304
2015-01-09 10:22:33.715 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 9114 5209 1493 3498
2015-01-09 10:22:33.715 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 1495152 69415 3285 10860
2015-01-09 10:22:33.720 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 3, HistoryCounts: [30,30,30]
2015-01-09 10:22:38.721 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:22:38.721 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 33 37 34 37
2015-01-09 10:22:38.721 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 106929 24445 25905 26302
2015-01-09 10:22:38.721 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 550768 501036 550768
2015-01-09 10:22:38.721 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 9114 2089 5691 5447
2015-01-09 10:22:38.721 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 1495152 133082 1901133 1900048
2015-01-09 10:22:38.723 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [70]
2015-01-09 10:22:43.724 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:22:43.724 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 34 37
2015-01-09 10:22:43.724 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 95942 24435 26739 28170
2015-01-09 10:22:43.724 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 550768 501036 550768
2015-01-09 10:22:43.724 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 16549 2069 14931 23382
2015-01-09 10:22:43.724 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 3092117 133082 4457258 4454480
2015-01-09 10:22:43.726 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [49]
2015-01-09 10:22:48.727 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:22:48.727 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:22:48.727 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 72980 24435 35349 27157
2015-01-09 10:22:48.727 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 550768 2239629 550768
2015-01-09 10:22:48.727 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 16681 6612 27879 34593
2015-01-09 10:22:48.727 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 4454629 2373727 4457258 4454480
2015-01-09 10:22:53.331 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 33, HistoryCounts: [31,24,32,32,32,32,25,32,32,31,32,26,25,26,32,32,22,32,31,25,22,22,32,26,22,22,32,25,32,29,25,22,32]
2015-01-09 10:22:58.332 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:22:58.332 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:22:58.332 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 74459 24435 35349 27157
2015-01-09 10:22:58.332 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 550768 2239629 550768
2015-01-09 10:22:58.332 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 44179 23946 27976 34669
2015-01-09 10:22:58.332 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:22:58.334 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [13]
2015-01-09 10:23:03.335 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:23:03.335 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:23:03.335 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 68396 24435 35349 27157
2015-01-09 10:23:03.335 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 550768 2239629 550768
2015-01-09 10:23:03.335 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 39848 23946 27976 34669
2015-01-09 10:23:03.335 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:23:03.337 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [60]
2015-01-09 10:23:08.338 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:23:08.338 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:23:08.338 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 67447 24435 35349 27157
2015-01-09 10:23:08.338 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2161438 550768 2239629 550768
2015-01-09 10:23:08.339 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 31589 23946 27976 34669
2015-01-09 10:23:08.339 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:23:08.385 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 20, HistoryCounts: [141,142,143,146,141,145,144,142,142,143,143,142,142,144,143,139,143,143,143,143]
2015-01-09 10:23:13.386 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:23:13.386 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:23:13.386 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 72240 24435 35349 27157
2015-01-09 10:23:13.386 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2235268 550768 2239629 550768
2015-01-09 10:23:13.386 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 32274 23946 27976 34669
2015-01-09 10:23:13.386 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:23:13.390 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 3, HistoryCounts: [26,26,26]
2015-01-09 10:23:18.391 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:23:18.391 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:23:18.391 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 69065 24435 35349 27157
2015-01-09 10:23:18.391 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2235268 550768 2239629 550768
2015-01-09 10:23:18.391 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 26378 23946 27976 34669
2015-01-09 10:23:18.391 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:23:18.393 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [145]
2015-01-09 10:23:23.400 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 2 2 2 2
2015-01-09 10:23:23.400 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:23:23.400 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 74513 24435 35349 27157
2015-01-09 10:23:23.400 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2235268 550768 2239629 550768
2015-01-09 10:23:23.400 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 26803 23946 27976 34669
2015-01-09 10:23:23.400 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:23:23.403 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [79]
2015-01-09 10:23:28.416 [info] <0.274.0>@sibling_benchmark:pp:186 siblings Mean: 1 2 2 2
2015-01-09 10:23:28.416 [info] <0.274.0>@sibling_benchmark:pp:187 siblings Max: 37 37 60 37
2015-01-09 10:23:28.416 [info] <0.274.0>@sibling_benchmark:pp:186 objsize Mean: 66538 24435 35349 27157
2015-01-09 10:23:28.416 [info] <0.274.0>@sibling_benchmark:pp:187 objsize Max: 2235268 550768 2239629 550768
2015-01-09 10:23:28.416 [info] <0.274.0>@sibling_benchmark:pp:186 time Mean: 24795 23946 27976 34669
2015-01-09 10:23:28.416 [info] <0.274.0>@sibling_benchmark:pp:187 time Max: 5730256 9072457 4457258 4454480
2015-01-09 10:23:28.421 [info] <0.274.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [177]
2015-01-09 10:23:28.592 [error] emulator Error in process <0.284.0> on node 'riak_test@127.0.0.1' with exit value: {{aws_error,{http_error,500,[],"<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request</body></html>"}},[{erlcloud_s3...
2015-01-09 10:23:28.592 [warning] <0.2.0>@riak_test_runner:rec_loop:132 sibling_benchmark failed: {{aws_error,{http_error,500,[],"<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request</body></html>"}},[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},{erlcloud_s3,put_object,6,[{file,"src/erlcloud_s3.erl"},{line,642}]},{sibling_benchmark,object_writer,2,[{file,"riak_test/tests/sibling_benchmark.erl"},{line,137}]}]}
2015-01-09 10:23:28.592 [error] <0.2.0>@riak_test_runner:execute:107
================ sibling_benchmark failure stack trace =====================
{{aws_error,{http_error,500,[],
"<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request</body></html>"}},
[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},
{erlcloud_s3,put_object,6,[{file,"src/erlcloud_s3.erl"},{line,642}]},
{sibling_benchmark,object_writer,2,
[{file,"riak_test/tests/sibling_benchmark.erl"},
{line,137}]}]}
============================================================================
2015-01-09 10:23:28.592 [notice] <0.2.0>@riak_test_runner:confirm:62 sibling_benchmark Test Run Complete
2015-01-09 10:24:25.588 [notice] <0.42.0>@lager_file_backend:127 Changed loglevel of rtresult/sibling_benchmark.dat_test_output to debug
2015-01-09 10:24:25.940 [info] <0.68.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev5/bin/riak-cs stop ~ wasn't running.
2015-01-09 10:24:26.047 [info] <0.81.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev6/bin/riak stop ~ wasn't running.
2015-01-09 10:24:26.051 [info] <0.69.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev6/bin/riak-cs stop ~ wasn't running.
2015-01-09 10:24:26.091 [info] <0.80.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev5/bin/riak stop ~ wasn't running.
2015-01-09 10:24:28.167 [info] <0.66.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs stop ~ ok.
2015-01-09 10:24:28.194 [info] <0.67.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs stop ~ ok.
2015-01-09 10:24:28.230 [info] <0.65.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs stop ~ ok.
2015-01-09 10:24:28.235 [info] <0.64.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs stop ~ ok.
2015-01-09 10:24:28.334 [info] <0.88.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion stop ~ ok.
2015-01-09 10:24:30.208 [info] <0.78.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak stop ~ ok.
2015-01-09 10:24:30.213 [info] <0.76.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak stop ~ ok.
2015-01-09 10:24:30.249 [info] <0.77.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak stop ~ ok.
2015-01-09 10:24:30.282 [info] <0.79.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak stop ~ ok.
2015-01-09 10:24:30.282 [info] <0.2.0>@rt_cs_dev:setup_harness:40 Resetting nodes to fresh state
2015-01-09 10:24:30.286 [info] <0.2.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour/.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour/" reset HEAD --hard
2015-01-09 10:24:30.343 [info] <0.2.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour/.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour/" clean -fd
2015-01-09 10:24:30.394 [info] <0.2.0>@rt_cs_dev:setup_harness:44 Cleaning up lingering pipe directories
2015-01-09 10:24:30.395 [warning] <0.2.0>@rt:set_backend:1102 rt:set_backend doesn't recognize undefined as a legit backend, using the default.
2015-01-09 10:24:30.395 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/riak_cs/current"
2015-01-09 10:24:30.455 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/riak_ee_onefour/current"
2015-01-09 10:24:30.470 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/stanchion/current"
2015-01-09 10:24:30.470 [info] <0.2.0>@riak_test_runner:check_prereqs:141 sibling_benchmark prereqs: []
2015-01-09 10:24:30.470 [notice] <0.2.0>@riak_test_runner:confirm:54 Running Test sibling_benchmark
2015-01-09 10:24:31.489 [info] <0.2.0>@riak_test_runner:execute:96 Test Runner `uname -a` : Linux nausicaa 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt2-1 (2014-12-08) x86_64 GNU/Linux
2015-01-09 10:24:31.505 [info] <0.108.0>@rtcs:setup:70 Flavor : basic
2015-01-09 10:24:31.569 [debug] <0.113.0> Supervisor sasl_safe_sup started alarm_handler:start_link() at pid <0.114.0>
2015-01-09 10:24:31.569 [debug] <0.113.0> Supervisor sasl_safe_sup started overload:start_link() at pid <0.115.0>
2015-01-09 10:24:31.570 [debug] <0.112.0> Supervisor sasl_sup started supervisor:start_link({local,sasl_safe_sup}, sasl, safe) at pid <0.113.0>
2015-01-09 10:24:31.574 [debug] <0.112.0> Supervisor sasl_sup started release_handler:start_link() at pid <0.116.0>
2015-01-09 10:24:31.574 [info] <0.7.0> Application sasl started on node 'riak_test@127.0.0.1'
2015-01-09 10:24:31.615 [debug] <0.121.0> Supervisor crypto_sup started crypto_server:start_link() at pid <0.122.0>
2015-01-09 10:24:31.615 [info] <0.7.0> Application crypto started on node 'riak_test@127.0.0.1'
2015-01-09 10:24:31.631 [info] <0.7.0> Application xmerl started on node 'riak_test@127.0.0.1'
2015-01-09 10:24:31.661 [debug] <0.127.0> Supervisor inets_sup started ftp_sup:start_link() at pid <0.128.0>
2015-01-09 10:24:31.716 [debug] <0.130.0> Supervisor httpc_profile_sup started httpc_manager:start_link(default, only_session_cookies, inets) at pid <0.131.0>
2015-01-09 10:24:31.717 [debug] <0.129.0> Supervisor httpc_sup started httpc_profile_sup:start_link([{httpc,{default,only_session_cookies}}]) at pid <0.130.0>
2015-01-09 10:24:31.727 [debug] <0.129.0> Supervisor httpc_sup started httpc_handler_sup:start_link() at pid <0.132.0>
2015-01-09 10:24:31.727 [debug] <0.127.0> Supervisor inets_sup started httpc_sup:start_link([{httpc,{default,only_session_cookies}}]) at pid <0.129.0>
2015-01-09 10:24:31.735 [debug] <0.127.0> Supervisor inets_sup started httpd_sup:start_link([]) at pid <0.133.0>
2015-01-09 10:24:31.743 [debug] <0.127.0> Supervisor inets_sup started tftp_sup:start_link([]) at pid <0.134.0>
2015-01-09 10:24:31.743 [info] <0.7.0> Application inets started on node 'riak_test@127.0.0.1'
2015-01-09 10:24:31.743 [info] <0.108.0>@rtcs:setup_clusters:115 Configs = [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:24:31.743 [info] <0.108.0>@rtcs:deploy_nodes:394 Initial Config: [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:24:31.743 [info] <0.108.0>@rtcs:deploy_nodes:400 RiakNodes: ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:31.744 [debug] <0.108.0>@rtcs:deploy_nodes:409 setting rt_versions> current =>
2015-01-09 10:24:31.744 [info] <0.108.0>@rtcs:deploy_nodes:413 VersionMap: [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:24:31.744 [info] <0.108.0>@rtcs:deploy_nodes:418 NodeList: [{'rcs-dev1@127.0.0.1','dev1@127.0.0.1','stanchion@127.0.0.1'},{'rcs-dev2@127.0.0.1','dev2@127.0.0.1'},{'rcs-dev3@127.0.0.1','dev3@127.0.0.1'},{'rcs-dev4@127.0.0.1','dev4@127.0.0.1'}]
2015-01-09 10:24:31.744 [info] <0.138.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs stop"
2015-01-09 10:24:31.744 [info] <0.137.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs stop"
2015-01-09 10:24:31.744 [info] <0.135.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs stop"
2015-01-09 10:24:31.744 [info] <0.136.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs stop"
2015-01-09 10:24:31.909 [info] <0.138.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak stop
2015-01-09 10:24:31.910 [info] <0.135.0>@rtcs:stop_stanchion:672 Running "/home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion stop"
2015-01-09 10:24:31.917 [info] <0.137.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak stop
2015-01-09 10:24:31.924 [info] <0.136.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak stop
2015-01-09 10:24:32.073 [info] <0.138.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev4@127.0.0.1' is not pingable
2015-01-09 10:24:32.074 [debug] <0.148.0> Supervisor inet_gethost_native_sup started undefined at pid <0.149.0>
2015-01-09 10:24:32.074 [debug] <0.26.0> Supervisor kernel_safe_sup started inet_gethost_native:start_link() at pid <0.148.0>
2015-01-09 10:24:32.090 [info] <0.138.0>@rt:wait_until_unpingable:601 Wait until 'dev4@127.0.0.1' is not pingable
2015-01-09 10:24:32.093 [info] <0.135.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak stop
2015-01-09 10:24:32.097 [info] <0.136.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev2@127.0.0.1' is not pingable
2015-01-09 10:24:32.098 [info] <0.136.0>@rt:wait_until_unpingable:601 Wait until 'dev2@127.0.0.1' is not pingable
2015-01-09 10:24:32.107 [info] <0.137.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev3@127.0.0.1' is not pingable
2015-01-09 10:24:32.108 [info] <0.137.0>@rt:wait_until_unpingable:601 Wait until 'dev3@127.0.0.1' is not pingable
2015-01-09 10:24:32.239 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev1@127.0.0.1' is not pingable
2015-01-09 10:24:32.240 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'stanchion@127.0.0.1' is not pingable
2015-01-09 10:24:32.240 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'dev1@127.0.0.1' is not pingable
2015-01-09 10:24:32.241 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting riak_ee nodes to fresh state
2015-01-09 10:24:32.241 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/riak_ee_onefour/"
2015-01-09 10:24:32.241 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour//.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour//" reset HEAD --hard
2015-01-09 10:24:32.314 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour//.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour//" clean -fd
2015-01-09 10:24:32.344 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting riak_cs nodes to fresh state
2015-01-09 10:24:32.344 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/riak_cs"
2015-01-09 10:24:32.344 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_cs/.git" --work-tree="/home/kuenishi/rt/riak_cs/" reset HEAD --hard
2015-01-09 10:24:32.437 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_cs/.git" --work-tree="/home/kuenishi/rt/riak_cs/" clean -fd
2015-01-09 10:24:32.501 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting stanchion nodes to fresh state
2015-01-09 10:24:32.501 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/stanchion"
2015-01-09 10:24:32.501 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/stanchion/.git" --work-tree="/home/kuenishi/rt/stanchion/" reset HEAD --hard
2015-01-09 10:24:32.518 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/stanchion/.git" --work-tree="/home/kuenishi/rt/stanchion/" clean -fd
2015-01-09 10:24:32.558 [info] <0.193.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:24:32.558 [info] <0.195.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:24:32.558 [info] <0.192.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:24:32.558 [info] <0.194.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:24:32.563 [debug] <0.195.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev4/etc/app.config
2015-01-09 10:24:32.563 [debug] <0.194.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev3/etc/app.config
2015-01-09 10:24:32.563 [debug] <0.192.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev1/etc/app.config
2015-01-09 10:24:32.563 [debug] <0.193.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev2/etc/app.config
2015-01-09 10:24:32.567 [debug] <0.192.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/stanchion/current/dev/stanchion/etc/app.config
2015-01-09 10:24:32.568 [info] <0.207.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak start
2015-01-09 10:24:32.568 [debug] <0.205.0>@rtcs:start_all_nodes:535 starting riak #1 > ee_current => "/home/kuenishi/rt/riak_ee_onefour/current"
2015-01-09 10:24:32.568 [info] <0.206.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak start
2015-01-09 10:24:32.568 [info] <0.208.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak start
2015-01-09 10:24:32.568 [info] <0.205.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak start
2015-01-09 10:24:46.726 [info] <0.225.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs start"
2015-01-09 10:24:46.960 [info] <0.227.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs start"
2015-01-09 10:24:47.117 [info] <0.229.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs start"
2015-01-09 10:24:47.262 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev1@127.0.0.1' is pingable
2015-01-09 10:24:47.262 [info] <0.231.0>@rtcs:start_stanchion:665 Running "/home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion start"
2015-01-09 10:24:47.262 [info] <0.232.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs start"
2015-01-09 10:24:47.262 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev2@127.0.0.1' is pingable
2015-01-09 10:24:47.262 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev3@127.0.0.1' is pingable
2015-01-09 10:24:47.263 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev4@127.0.0.1' is pingable
2015-01-09 10:24:47.263 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev1@127.0.0.1' is pingable
2015-01-09 10:24:48.269 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev2@127.0.0.1' is pingable
2015-01-09 10:24:48.272 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev3@127.0.0.1' is pingable
2015-01-09 10:24:48.277 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev4@127.0.0.1' is pingable
2015-01-09 10:24:48.282 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'stanchion@127.0.0.1' is pingable
2015-01-09 10:24:48.806 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev1@127.0.0.1' is a singleton
2015-01-09 10:24:48.945 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev2@127.0.0.1' is a singleton
2015-01-09 10:24:48.946 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev3@127.0.0.1' is a singleton
2015-01-09 10:24:48.946 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev4@127.0.0.1' is a singleton
2015-01-09 10:24:48.946 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:48.948 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:48.949 [info] <0.108.0>@rtcs:setup_clusters:118 Make cluster
2015-01-09 10:24:49.068 [info] <0.108.0>@rt:join:298 [join] 'dev2@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:24:49.207 [info] <0.108.0>@rt:join:298 [join] 'dev3@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:24:49.367 [info] <0.108.0>@rt:join:298 [join] 'dev4@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:24:49.367 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:51.373 [info] <0.108.0>@rt:wait_until_no_pending_changes:490 Wait until no pending changes on ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:51.375 [info] <0.108.0>@rt:wait_until_ring_converged:564 Wait until ring converged on ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:53.421 [info] <0.108.0>@rtcs:setup_admin_user:451 Initial Config: [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:24:53.421 [debug] <0.108.0>@rtcs:setup_admin_user:463 setting rt_versions> current => [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:24:53.421 [debug] <0.108.0>@rtcs:create_user:743 Trying to create user "admin@me.com"
2015-01-09 10:24:54.424 [debug] <0.108.0>@rtcs:create_user:753 Create user output="{\"email\":\"admin@me.com\",\"display_name\":\"admin\",\"name\":\"admin\",\"key_id\":\"OHG0AVUJAWSCC8XYRPLV\",\"key_secret\":\"DktjpzdbLVpPSy1tJOZDS9BoJG-27Bge1WiGvw==\",\"id\":\"ca15be69b6e911f46db77fde27a691ea05a88e0fbf0d5e076a4ac9a5e1584c35\",\"status\":\"enabled\"}"
2015-01-09 10:24:54.427 [info] <0.108.0>@rtcs:create_admin_user:197 Riak CS Admin account created with "admin@me.com"
2015-01-09 10:24:54.427 [info] <0.108.0>@rtcs:create_admin_user:198 KeyId = "OHG0AVUJAWSCC8XYRPLV"
2015-01-09 10:24:54.427 [info] <0.108.0>@rtcs:create_admin_user:199 KeySecret = "DktjpzdbLVpPSy1tJOZDS9BoJG-27Bge1WiGvw=="
2015-01-09 10:24:54.427 [info] <0.108.0>@rtcs:create_admin_user:200 Id = "ca15be69b6e911f46db77fde27a691ea05a88e0fbf0d5e076a4ac9a5e1584c35"
2015-01-09 10:24:54.427 [debug] <0.262.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev3/etc/app.config
2015-01-09 10:24:54.427 [debug] <0.260.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev1/etc/app.config
2015-01-09 10:24:54.427 [debug] <0.261.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev2/etc/app.config
2015-01-09 10:24:54.427 [debug] <0.263.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev4/etc/app.config
2015-01-09 10:24:54.428 [debug] <0.260.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/stanchion/current/dev/stanchion/etc/app.config
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:495 NodeConfig: [{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]},{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]},{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,...},...]},...]},...]},...]
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:496 RiakNodes: ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:497 CSNodes: ['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1']
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:498 NodeMap: [{'dev1@127.0.0.1',1},{'dev2@127.0.0.1',2},{'dev3@127.0.0.1',3},{'dev4@127.0.0.1',4}]
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:499 VersionMap: [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:500 NodeList: [{'rcs-dev1@127.0.0.1','dev1@127.0.0.1','stanchion@127.0.0.1'},{'rcs-dev2@127.0.0.1','dev2@127.0.0.1'},{'rcs-dev3@127.0.0.1','dev3@127.0.0.1'},{'rcs-dev4@127.0.0.1','dev4@127.0.0.1'}]
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:501 Nodes: {['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1'],['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1'],'stanchion@127.0.0.1'}
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:502 AdminCreds: {"OHG0AVUJAWSCC8XYRPLV","DktjpzdbLVpPSy1tJOZDS9BoJG-27Bge1WiGvw=="}
2015-01-09 10:24:54.431 [info] <0.108.0>@rtcs:setup_admin_user:503 Deployed nodes: {['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1'],['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1'],'stanchion@127.0.0.1'}
2015-01-09 10:24:55.036 [info] <0.108.0>@sibling_benchmark:confirm:71 creating bucket "riak-test-bucket"
2015-01-09 10:24:56.723 [info] <0.108.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [1]
2015-01-09 10:24:56.723 [info] <0.108.0>@sibling_benchmark:confirm:77 ====================== run benchmark =====================
2015-01-09 10:24:56.723 [info] <0.108.0>@sibling_benchmark:confirm:80 write_concurrency: 8
2015-01-09 10:24:56.724 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 0 0 0 0
2015-01-09 10:24:56.724 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 0 0 0 0
2015-01-09 10:24:56.724 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 0 0 0 0
2015-01-09 10:24:56.724 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 0 0 0 0
2015-01-09 10:24:56.724 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 222916 0 0 0
2015-01-09 10:24:56.724 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 632120 0 0 0
2015-01-09 10:24:56.725 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [1]
2015-01-09 10:25:01.726 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 0 0 0
2015-01-09 10:25:01.726 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 14 0 0 0
2015-01-09 10:25:01.726 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 17238 0 0 0
2015-01-09 10:25:01.726 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 314977 0 0 0
2015-01-09 10:25:01.726 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 5926 0 0 0
2015-01-09 10:25:01.726 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 632120 0 0 0
2015-01-09 10:25:02.118 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [102]
2015-01-09 10:25:07.119 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 0 0 0
2015-01-09 10:25:07.119 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 15 0 0 0
2015-01-09 10:25:07.119 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 45314 0 0 0
2015-01-09 10:25:07.119 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 893814 0 0 0
2015-01-09 10:25:07.119 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 3751 0 0 0
2015-01-09 10:25:07.119 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 632120 0 0 0
2015-01-09 10:25:07.125 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 12, HistoryCounts: [42,44,42,45,45,45,45,45,42,44,45,45]
2015-01-09 10:25:07.532 [info] <0.108.0>@sibling_benchmark:leave_and_join_node:205 leaving node2
2015-01-09 10:25:07.680 [info] <0.108.0>@rt:leave:315 [leave] 'dev2@127.0.0.1': ok
2015-01-09 10:25:07.680 [info] <0.108.0>@rt:wait_until_unpingable:601 Wait until 'dev2@127.0.0.1' is not pingable
2015-01-09 10:25:12.126 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 2 2 1
2015-01-09 10:25:12.126 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 20 20 20 20
2015-01-09 10:25:12.126 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 45419 40884 46039 27065
2015-01-09 10:25:12.126 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 893814 534629 534629 534629
2015-01-09 10:25:12.126 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 15511 1631 2224 1185
2015-01-09 10:25:12.126 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 1845500 68025 283434 21854
2015-01-09 10:25:12.128 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [55]
2015-01-09 10:25:17.129 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 2 2 1
2015-01-09 10:25:17.129 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 20 20 20 20
2015-01-09 10:25:17.129 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 53725 40884 46039 27065
2015-01-09 10:25:17.129 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 1576568 534629 534629 534629
2015-01-09 10:25:17.129 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 10922 1631 2224 1185
2015-01-09 10:25:17.129 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 1845500 68025 283434 21854
2015-01-09 10:25:17.132 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [129]
2015-01-09 10:25:22.133 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 2 2 1
2015-01-09 10:25:22.134 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 27 27 27 20
2015-01-09 10:25:22.134 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 64517 73792 84082 31038
2015-01-09 10:25:22.134 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2105022 2105022 2105022 1353319
2015-01-09 10:25:22.134 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 8929 1996 2568 1345
2015-01-09 10:25:22.134 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 1845500 68025 283434 23574
2015-01-09 10:25:22.166 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 25, HistoryCounts: [119,119,119,118,115,115,119,118,115,119,115,119,117,115,118,117,119,118,115,117,119,115,119,119,119]
2015-01-09 10:25:27.167 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 2 3 1
2015-01-09 10:25:27.167 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 32 32 32 20
2015-01-09 10:25:27.167 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 77028 109720 140206 31038
2015-01-09 10:25:27.167 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2186506 2186506 2186506 1353319
2015-01-09 10:25:27.167 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 13603 2168 2750 1345
2015-01-09 10:25:27.167 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 3051818 68025 283434 23574
2015-01-09 10:25:27.760 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 45, HistoryCounts: [119,119,119,118,115,115,119,11,113,118,115,11,119,80,81,113,83,82,115,82,113,119,113,117,115,118,117,82,119,81,118,113,115,117,119,81,115,119,79,113,119,113,119,81,113]
2015-01-09 10:25:32.761 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 2 3 1
2015-01-09 10:25:32.761 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 56 42 46 20
2015-01-09 10:25:32.761 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 81134 118339 149867 31038
2015-01-09 10:25:32.761 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2828686 2680718 2790276 1353319
2015-01-09 10:25:32.761 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 17373 9407 3350 1345
2015-01-09 10:25:32.761 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 3929571 1944857 283434 23574
2015-01-09 10:25:32.763 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [9]
2015-01-09 10:25:34.707 [warning] <0.2.0>@riak_test_runner:rec_loop:132 sibling_benchmark failed: {{aws_error,{http_error,404,[],<<"<?xml version=\"1.0\" encoding=\"UTF-8\"?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Resource>/riak-test-bucket/riak_test_key1</Resource><RequestId></RequestId></Error>">>}},[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},{erlcloud_s3,fetch_object,5,[{file,"src/erlcloud_s3.erl"},{line,456}]},{sibling_benchmark,object_reader,2,[{file,"riak_test/tests/sibling_benchmark.erl"},{line,119}]}]}
2015-01-09 10:25:34.707 [error] emulator Error in process <0.293.0> on node 'riak_test@127.0.0.1' with exit value: {{aws_error,{http_error,404,[],<<203 bytes>>}},[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},{erlcloud_s3,fetch_object,5,[{file,"src/erlcloud_s3.erl"},{line,456}]},{sibling_benchmark,object_reader,2,[{file,"riak_test/...
2015-01-09 10:25:34.708 [error] <0.2.0>@riak_test_runner:execute:107
================ sibling_benchmark failure stack trace =====================
{{aws_error,{http_error,404,[],
<<"<?xml version=\"1.0\" encoding=\"UTF-8\"?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Resource>/riak-test-bucket/riak_test_key1</Resource><RequestId></RequestId></Error>">>}},
[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},
{erlcloud_s3,fetch_object,5,[{file,"src/erlcloud_s3.erl"},{line,456}]},
{sibling_benchmark,object_reader,2,
[{file,"riak_test/tests/sibling_benchmark.erl"},
{line,119}]}]}
============================================================================
2015-01-09 10:25:34.708 [notice] <0.2.0>@riak_test_runner:confirm:62 sibling_benchmark Test Run Complete
2015-01-09 10:27:32.257 [notice] <0.42.0>@lager_file_backend:127 Changed loglevel of rtresult/sibling_benchmark.dat_test_output to debug
2015-01-09 10:27:32.603 [info] <0.69.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev6/bin/riak-cs stop ~ wasn't running.
2015-01-09 10:27:32.621 [info] <0.68.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev5/bin/riak-cs stop ~ wasn't running.
2015-01-09 10:27:32.649 [info] <0.80.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev5/bin/riak stop ~ wasn't running.
2015-01-09 10:27:32.688 [info] <0.81.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev6/bin/riak stop ~ wasn't running.
2015-01-09 10:27:34.813 [info] <0.67.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs stop ~ ok.
2015-01-09 10:27:34.832 [info] <0.66.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs stop ~ ok.
2015-01-09 10:27:34.879 [info] <0.65.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs stop ~ ok.
2015-01-09 10:27:34.884 [info] <0.64.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs stop ~ ok.
2015-01-09 10:27:34.972 [info] <0.88.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion stop ~ ok.
2015-01-09 10:27:35.794 [info] <0.76.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak stop ~ ok.
2015-01-09 10:27:35.898 [info] <0.79.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak stop ~ ok.
2015-01-09 10:27:35.954 [info] <0.78.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak stop ~ ok.
2015-01-09 10:27:36.900 [info] <0.77.0>@rt_cs_dev:stop_all:254 Stopping Node... /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak stop ~ ok.
2015-01-09 10:27:36.901 [info] <0.2.0>@rt_cs_dev:setup_harness:40 Resetting nodes to fresh state
2015-01-09 10:27:36.906 [info] <0.2.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour/.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour/" reset HEAD --hard
2015-01-09 10:27:36.966 [info] <0.2.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour/.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour/" clean -fd
2015-01-09 10:27:37.011 [info] <0.2.0>@rt_cs_dev:setup_harness:44 Cleaning up lingering pipe directories
2015-01-09 10:27:37.012 [warning] <0.2.0>@rt:set_backend:1102 rt:set_backend doesn't recognize undefined as a legit backend, using the default.
2015-01-09 10:27:37.012 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/riak_cs/current"
2015-01-09 10:27:37.051 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/riak_ee_onefour/current"
2015-01-09 10:27:37.068 [error] <0.2.0>@rt_cs_dev:get_backends:154 "/home/kuenishi/rt/stanchion/current"
2015-01-09 10:27:37.068 [info] <0.2.0>@riak_test_runner:check_prereqs:141 sibling_benchmark prereqs: []
2015-01-09 10:27:37.068 [notice] <0.2.0>@riak_test_runner:confirm:54 Running Test sibling_benchmark
2015-01-09 10:27:38.094 [info] <0.2.0>@riak_test_runner:execute:96 Test Runner `uname -a` : Linux nausicaa 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt2-1 (2014-12-08) x86_64 GNU/Linux
2015-01-09 10:27:38.108 [info] <0.108.0>@rtcs:setup:70 Flavor : basic
2015-01-09 10:27:38.170 [debug] <0.113.0> Supervisor sasl_safe_sup started alarm_handler:start_link() at pid <0.114.0>
2015-01-09 10:27:38.170 [debug] <0.113.0> Supervisor sasl_safe_sup started overload:start_link() at pid <0.115.0>
2015-01-09 10:27:38.170 [debug] <0.112.0> Supervisor sasl_sup started supervisor:start_link({local,sasl_safe_sup}, sasl, safe) at pid <0.113.0>
2015-01-09 10:27:38.174 [debug] <0.112.0> Supervisor sasl_sup started release_handler:start_link() at pid <0.116.0>
2015-01-09 10:27:38.174 [info] <0.7.0> Application sasl started on node 'riak_test@127.0.0.1'
2015-01-09 10:27:38.214 [debug] <0.121.0> Supervisor crypto_sup started crypto_server:start_link() at pid <0.122.0>
2015-01-09 10:27:38.214 [info] <0.7.0> Application crypto started on node 'riak_test@127.0.0.1'
2015-01-09 10:27:38.229 [info] <0.7.0> Application xmerl started on node 'riak_test@127.0.0.1'
2015-01-09 10:27:38.259 [debug] <0.127.0> Supervisor inets_sup started ftp_sup:start_link() at pid <0.128.0>
2015-01-09 10:27:38.307 [debug] <0.130.0> Supervisor httpc_profile_sup started httpc_manager:start_link(default, only_session_cookies, inets) at pid <0.131.0>
2015-01-09 10:27:38.307 [debug] <0.129.0> Supervisor httpc_sup started httpc_profile_sup:start_link([{httpc,{default,only_session_cookies}}]) at pid <0.130.0>
2015-01-09 10:27:38.314 [debug] <0.129.0> Supervisor httpc_sup started httpc_handler_sup:start_link() at pid <0.132.0>
2015-01-09 10:27:38.314 [debug] <0.127.0> Supervisor inets_sup started httpc_sup:start_link([{httpc,{default,only_session_cookies}}]) at pid <0.129.0>
2015-01-09 10:27:38.322 [debug] <0.127.0> Supervisor inets_sup started httpd_sup:start_link([]) at pid <0.133.0>
2015-01-09 10:27:38.331 [debug] <0.127.0> Supervisor inets_sup started tftp_sup:start_link([]) at pid <0.134.0>
2015-01-09 10:27:38.331 [info] <0.7.0> Application inets started on node 'riak_test@127.0.0.1'
2015-01-09 10:27:38.331 [info] <0.108.0>@rtcs:setup_clusters:115 Configs = [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:27:38.331 [info] <0.108.0>@rtcs:deploy_nodes:394 Initial Config: [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:27:38.331 [info] <0.108.0>@rtcs:deploy_nodes:400 RiakNodes: ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:27:38.331 [debug] <0.108.0>@rtcs:deploy_nodes:409 setting rt_versions> current =>
2015-01-09 10:27:38.331 [info] <0.108.0>@rtcs:deploy_nodes:413 VersionMap: [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:27:38.331 [info] <0.108.0>@rtcs:deploy_nodes:418 NodeList: [{'rcs-dev1@127.0.0.1','dev1@127.0.0.1','stanchion@127.0.0.1'},{'rcs-dev2@127.0.0.1','dev2@127.0.0.1'},{'rcs-dev3@127.0.0.1','dev3@127.0.0.1'},{'rcs-dev4@127.0.0.1','dev4@127.0.0.1'}]
2015-01-09 10:27:38.331 [info] <0.135.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs stop"
2015-01-09 10:27:38.331 [info] <0.136.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs stop"
2015-01-09 10:27:38.331 [info] <0.137.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs stop"
2015-01-09 10:27:38.331 [info] <0.138.0>@rtcs:stop_cs:631 Running "/home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs stop"
2015-01-09 10:27:38.471 [info] <0.138.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak stop
2015-01-09 10:27:38.481 [info] <0.136.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak stop
2015-01-09 10:27:38.492 [info] <0.137.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak stop
2015-01-09 10:27:38.500 [info] <0.135.0>@rtcs:stop_stanchion:672 Running "/home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion stop"
2015-01-09 10:27:38.629 [info] <0.138.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev4@127.0.0.1' is not pingable
2015-01-09 10:27:38.630 [debug] <0.148.0> Supervisor inet_gethost_native_sup started undefined at pid <0.149.0>
2015-01-09 10:27:38.630 [debug] <0.26.0> Supervisor kernel_safe_sup started inet_gethost_native:start_link() at pid <0.148.0>
2015-01-09 10:27:38.643 [info] <0.136.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev2@127.0.0.1' is not pingable
2015-01-09 10:27:38.645 [info] <0.137.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev3@127.0.0.1' is not pingable
2015-01-09 10:27:38.649 [info] <0.137.0>@rt:wait_until_unpingable:601 Wait until 'dev3@127.0.0.1' is not pingable
2015-01-09 10:27:38.649 [info] <0.138.0>@rt:wait_until_unpingable:601 Wait until 'dev4@127.0.0.1' is not pingable
2015-01-09 10:27:38.649 [info] <0.136.0>@rt:wait_until_unpingable:601 Wait until 'dev2@127.0.0.1' is not pingable
2015-01-09 10:27:38.680 [info] <0.135.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak stop
2015-01-09 10:27:38.827 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'rcs-dev1@127.0.0.1' is not pingable
2015-01-09 10:27:38.828 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'stanchion@127.0.0.1' is not pingable
2015-01-09 10:27:38.829 [info] <0.135.0>@rt:wait_until_unpingable:601 Wait until 'dev1@127.0.0.1' is not pingable
2015-01-09 10:27:38.829 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting riak_ee nodes to fresh state
2015-01-09 10:27:38.829 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/riak_ee_onefour/"
2015-01-09 10:27:38.829 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour//.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour//" reset HEAD --hard
2015-01-09 10:27:38.895 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_ee_onefour//.git" --work-tree="/home/kuenishi/rt/riak_ee_onefour//" clean -fd
2015-01-09 10:27:38.927 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting riak_cs nodes to fresh state
2015-01-09 10:27:38.927 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/riak_cs"
2015-01-09 10:27:38.927 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_cs/.git" --work-tree="/home/kuenishi/rt/riak_cs/" reset HEAD --hard
2015-01-09 10:27:39.021 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/riak_cs/.git" --work-tree="/home/kuenishi/rt/riak_cs/" clean -fd
2015-01-09 10:27:39.071 [info] <0.108.0>@rtcs:reset_nodes:614 Resetting stanchion nodes to fresh state
2015-01-09 10:27:39.071 [debug] <0.108.0>@rtcs:reset_nodes:615 Project path for reset: "/home/kuenishi/rt/stanchion"
2015-01-09 10:27:39.072 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/stanchion/.git" --work-tree="/home/kuenishi/rt/stanchion/" reset HEAD --hard
2015-01-09 10:27:39.089 [info] <0.108.0>@rtdev:run_git:51 Running: git --git-dir="/home/kuenishi/rt/stanchion/.git" --work-tree="/home/kuenishi/rt/stanchion/" clean -fd
2015-01-09 10:27:39.128 [info] <0.193.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:27:39.128 [info] <0.194.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:27:39.129 [info] <0.192.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:27:39.129 [info] <0.195.0>@rt_cs_dev:update_app_config_file:126 rtdev:update_app_config_file(/home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/etc/app.config, [{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}])
2015-01-09 10:27:39.134 [debug] <0.195.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev4/etc/app.config
2015-01-09 10:27:39.134 [debug] <0.194.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev3/etc/app.config
2015-01-09 10:27:39.137 [debug] <0.193.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev2/etc/app.config
2015-01-09 10:27:39.141 [debug] <0.192.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev1/etc/app.config
2015-01-09 10:27:39.143 [debug] <0.192.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/stanchion/current/dev/stanchion/etc/app.config
2015-01-09 10:27:39.144 [info] <0.206.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev2/bin/riak start
2015-01-09 10:27:39.144 [info] <0.208.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev4/bin/riak start
2015-01-09 10:27:39.144 [info] <0.207.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev3/bin/riak start
2015-01-09 10:27:39.144 [debug] <0.205.0>@rtcs:start_all_nodes:535 starting riak #1 > ee_current => "/home/kuenishi/rt/riak_ee_onefour/current"
2015-01-09 10:27:39.144 [info] <0.205.0>@rtdev:run_riak:55 Running: /home/kuenishi/rt/riak_ee_onefour/current/dev/dev1/bin/riak start
2015-01-09 10:27:53.314 [info] <0.225.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev3/bin/riak-cs start"
2015-01-09 10:27:53.820 [info] <0.227.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev2/bin/riak-cs start"
2015-01-09 10:27:53.977 [info] <0.229.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev4/bin/riak-cs start"
2015-01-09 10:27:54.402 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev1@127.0.0.1' is pingable
2015-01-09 10:27:54.402 [info] <0.231.0>@rtcs:start_stanchion:665 Running "/home/kuenishi/rt/stanchion/current/dev/stanchion/bin/stanchion start"
2015-01-09 10:27:54.402 [info] <0.232.0>@rtcs:start_cs:624 Running "/home/kuenishi/rt/riak_cs/current/dev/dev1/bin/riak-cs start"
2015-01-09 10:27:54.402 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev2@127.0.0.1' is pingable
2015-01-09 10:27:54.402 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev3@127.0.0.1' is pingable
2015-01-09 10:27:54.403 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'dev4@127.0.0.1' is pingable
2015-01-09 10:27:54.403 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev1@127.0.0.1' is pingable
2015-01-09 10:27:55.412 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev2@127.0.0.1' is pingable
2015-01-09 10:27:55.413 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev3@127.0.0.1' is pingable
2015-01-09 10:27:55.414 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'rcs-dev4@127.0.0.1' is pingable
2015-01-09 10:27:55.415 [info] <0.108.0>@rt:wait_until_pingable:592 Wait until 'stanchion@127.0.0.1' is pingable
2015-01-09 10:27:55.918 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev1@127.0.0.1' is a singleton
2015-01-09 10:27:55.973 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev2@127.0.0.1' is a singleton
2015-01-09 10:27:55.973 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev3@127.0.0.1' is a singleton
2015-01-09 10:27:55.974 [info] <0.108.0>@rt:check_singleton_node:733 Check 'dev4@127.0.0.1' is a singleton
2015-01-09 10:27:55.974 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:27:55.975 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:27:55.975 [info] <0.108.0>@rtcs:setup_clusters:118 Make cluster
2015-01-09 10:27:56.018 [info] <0.108.0>@rt:join:298 [join] 'dev2@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:27:56.068 [info] <0.108.0>@rt:join:298 [join] 'dev3@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:27:56.152 [info] <0.108.0>@rt:join:298 [join] 'dev4@127.0.0.1' to ('dev1@127.0.0.1'): ok
2015-01-09 10:27:56.152 [info] <0.108.0>@rt:wait_until_nodes_ready:540 Wait until nodes are ready : ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:27:58.157 [info] <0.108.0>@rt:wait_until_no_pending_changes:490 Wait until no pending changes on ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:27:58.158 [info] <0.108.0>@rt:wait_until_ring_converged:564 Wait until ring converged on ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:28:01.214 [info] <0.108.0>@rtcs:setup_admin_user:451 Initial Config: [{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]
2015-01-09 10:28:01.214 [debug] <0.108.0>@rtcs:setup_admin_user:463 setting rt_versions> current => [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:28:01.215 [debug] <0.108.0>@rtcs:create_user:743 Trying to create user "admin@me.com"
2015-01-09 10:28:02.718 [debug] <0.108.0>@rtcs:create_user:753 Create user output="{\"email\":\"admin@me.com\",\"display_name\":\"admin\",\"name\":\"admin\",\"key_id\":\"XUYUNDKBKR-QB13C3BJF\",\"key_secret\":\"A6HlL98k6IkCR0xZY4xyzUaAxk1JRd-6HqV9ww==\",\"id\":\"f74b1dcd547349ea73f6beda4d3f6a5473f36aabb1c3c7fbedd626fd72c9dc3c\",\"status\":\"enabled\"}"
2015-01-09 10:28:02.722 [info] <0.108.0>@rtcs:create_admin_user:197 Riak CS Admin account created with "admin@me.com"
2015-01-09 10:28:02.722 [info] <0.108.0>@rtcs:create_admin_user:198 KeyId = "XUYUNDKBKR-QB13C3BJF"
2015-01-09 10:28:02.722 [info] <0.108.0>@rtcs:create_admin_user:199 KeySecret = "A6HlL98k6IkCR0xZY4xyzUaAxk1JRd-6HqV9ww=="
2015-01-09 10:28:02.722 [info] <0.108.0>@rtcs:create_admin_user:200 Id = "f74b1dcd547349ea73f6beda4d3f6a5473f36aabb1c3c7fbedd626fd72c9dc3c"
2015-01-09 10:28:02.722 [debug] <0.261.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev2/etc/app.config
2015-01-09 10:28:02.722 [debug] <0.260.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev1/etc/app.config
2015-01-09 10:28:02.722 [debug] <0.263.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev4/etc/app.config
2015-01-09 10:28:02.722 [debug] <0.262.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/riak_cs/current/dev/dev3/etc/app.config
2015-01-09 10:28:02.725 [debug] <0.260.0>@rtcs:update_app_config:726 updating /home/kuenishi/rt/stanchion/current/dev/stanchion/etc/app.config
2015-01-09 10:28:02.728 [info] <0.108.0>@rtcs:setup_admin_user:495 NodeConfig: [{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]},{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,10017},{stanchion_port,9095},{cs_version,10300}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]}]},{stanchion,[{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{stanchion,[{stanchion_port,9095},{riak_pb_port,10017}]}]}]},{current,[{riak,[{riak_repl,[{fullsync_on_connect,false},{fullsync_interval,disabled},{proxy_get,enabled}]},{lager,[{handlers,[{lager_console_backend,debug},{lager_file_backend,[{"./log/error.log",error,10485760,"$D0",5},{"./log/console.log",debug,10485760,"$D0",5}]}]}]},{riak_core,[{default_bucket_props,[{allow_mult,true}]},{ring_creation_size,8}]},{riak_api,[{pb_backlog,256}]},{riak_kv,[{add_paths,["/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs/ebin","/home/kuenishi/rt/riak_cs/current/dev/dev1/lib/riak_cs_multibag/ebin"]},{storage_backend,riak_cs_kv_multi_backend},{multi_backend_prefix_list,[{<<"0b:">>,be_blocks}]},{multi_backend_default,be_default},{multi_backend,[{be_default,riak_kv_eleveldb_backend,[{max_open_files,20},{data_root,"./data/leveldb"}]},{be_blocks,riak_kv_bitcask_backend,[{data_root,"./data/bitcask"}]}]}]}]},{cs,[{riak_cs,[{gc_interval,10},{leeway_seconds,5},{connection_pools,[{request_pool,{16,0}},{bucket_list_pool,{2,0}}]},{block_get_max_retries,1},{proxy_get,enabled},{anonymous_user_creation,true},{riak_pb_port,...},...]},...]},...]},...]
2015-01-09 10:28:02.728 [info] <0.108.0>@rtcs:setup_admin_user:496 RiakNodes: ['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1']
2015-01-09 10:28:02.728 [info] <0.108.0>@rtcs:setup_admin_user:497 CSNodes: ['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1']
2015-01-09 10:28:02.729 [info] <0.108.0>@rtcs:setup_admin_user:498 NodeMap: [{'dev1@127.0.0.1',1},{'dev2@127.0.0.1',2},{'dev3@127.0.0.1',3},{'dev4@127.0.0.1',4}]
2015-01-09 10:28:02.729 [info] <0.108.0>@rtcs:setup_admin_user:499 VersionMap: [{1,ee_current},{2,ee_current},{3,ee_current},{4,ee_current}]
2015-01-09 10:28:02.729 [info] <0.108.0>@rtcs:setup_admin_user:500 NodeList: [{'rcs-dev1@127.0.0.1','dev1@127.0.0.1','stanchion@127.0.0.1'},{'rcs-dev2@127.0.0.1','dev2@127.0.0.1'},{'rcs-dev3@127.0.0.1','dev3@127.0.0.1'},{'rcs-dev4@127.0.0.1','dev4@127.0.0.1'}]
2015-01-09 10:28:02.729 [info] <0.108.0>@rtcs:setup_admin_user:501 Nodes: {['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1'],['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1'],'stanchion@127.0.0.1'}
2015-01-09 10:28:02.729 [info] <0.108.0>@rtcs:setup_admin_user:502 AdminCreds: {"XUYUNDKBKR-QB13C3BJF","A6HlL98k6IkCR0xZY4xyzUaAxk1JRd-6HqV9ww=="}
2015-01-09 10:28:02.729 [info] <0.108.0>@rtcs:setup_admin_user:503 Deployed nodes: {['dev1@127.0.0.1','dev2@127.0.0.1','dev3@127.0.0.1','dev4@127.0.0.1'],['rcs-dev1@127.0.0.1','rcs-dev2@127.0.0.1','rcs-dev3@127.0.0.1','rcs-dev4@127.0.0.1'],'stanchion@127.0.0.1'}
2015-01-09 10:28:03.500 [info] <0.108.0>@sibling_benchmark:confirm:71 creating bucket "riak-test-bucket"
2015-01-09 10:28:04.675 [info] <0.108.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [1]
2015-01-09 10:28:04.675 [info] <0.108.0>@sibling_benchmark:confirm:77 ====================== run benchmark =====================
2015-01-09 10:28:04.675 [info] <0.108.0>@sibling_benchmark:confirm:80 write_concurrency: 8
2015-01-09 10:28:04.676 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 0 0 0 0
2015-01-09 10:28:04.676 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 0 0 0 0
2015-01-09 10:28:04.676 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 0 0 0 0
2015-01-09 10:28:04.676 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 0 0 0 0
2015-01-09 10:28:04.676 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 0 0 0 0
2015-01-09 10:28:04.676 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 0 0 0 0
2015-01-09 10:28:04.678 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [1]
2015-01-09 10:28:09.679 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 0 0 0
2015-01-09 10:28:09.679 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 15 0 0 0
2015-01-09 10:28:09.679 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 20439 0 0 0
2015-01-09 10:28:09.679 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 397784 0 0 0
2015-01-09 10:28:09.679 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 7328 0 0 0
2015-01-09 10:28:09.679 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 621412 0 0 0
2015-01-09 10:28:09.684 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 2, HistoryCounts: [92,91]
2015-01-09 10:28:14.685 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 0 0 0
2015-01-09 10:28:14.685 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 19 0 0 0
2015-01-09 10:28:14.685 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 42504 0 0 0
2015-01-09 10:28:14.685 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 517295 0 0 0
2015-01-09 10:28:14.685 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 2895 0 0 0
2015-01-09 10:28:14.685 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 621412 0 0 0
2015-01-09 10:28:14.688 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [122]
2015-01-09 10:28:15.484 [info] <0.108.0>@sibling_benchmark:leave_and_join_node:205 leaving node2
2015-01-09 10:28:15.802 [info] <0.108.0>@rt:leave:315 [leave] 'dev2@127.0.0.1': ok
2015-01-09 10:28:15.802 [info] <0.108.0>@rt:wait_until_unpingable:601 Wait until 'dev2@127.0.0.1' is not pingable
2015-01-09 10:28:19.689 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 5 6 6
2015-01-09 10:28:19.690 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 19 42 33 40
2015-01-09 10:28:19.690 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 53803 163454 193404 216452
2015-01-09 10:28:19.690 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 1315067 1372303 1076924 1306190
2015-01-09 10:28:19.690 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 2496 46395 6271 42802
2015-01-09 10:28:19.690 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 621412 1813673 154907 1827842
2015-01-09 10:28:19.919 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 2, HistoryCounts: [57,57]
2015-01-09 10:28:24.920 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 13 6 16
2015-01-09 10:28:24.920 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 19 98 33 95
2015-01-09 10:28:24.920 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 53803 416546 193404 500185
2015-01-09 10:28:24.920 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 1315067 2536427 1076924 2511923
2015-01-09 10:28:24.920 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 2496 38256 6271 28794
2015-01-09 10:28:24.920 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 621412 1813673 154907 1827842
2015-01-09 10:28:24.922 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [14]
2015-01-09 10:28:29.923 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 1 14 6 17
2015-01-09 10:28:29.923 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 19 104 33 104
2015-01-09 10:28:29.923 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 53803 434595 193404 532547
2015-01-09 10:28:29.923 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 1315067 2569609 1076924 2569609
2015-01-09 10:28:29.923 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 2496 73741 6271 43294
2015-01-09 10:28:29.923 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 621412 2752131 154907 2779334
2015-01-09 10:28:29.925 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [8]
2015-01-09 10:28:34.926 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 6 6 7
2015-01-09 10:28:34.926 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:28:34.926 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 119277 181122 193404 188835
2015-01-09 10:28:34.926 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:28:34.926 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 10194 31209 6271 18812
2015-01-09 10:28:34.926 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 2299751 2752131 154907 2779334
2015-01-09 10:28:34.928 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [7]
2015-01-09 10:28:39.929 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 6 6 7
2015-01-09 10:28:39.929 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:28:39.929 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 99459 181122 193404 188835
2015-01-09 10:28:39.929 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:28:39.929 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 9564 31209 6271 18812
2015-01-09 10:28:39.929 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 2299751 2752131 154907 2779334
2015-01-09 10:28:39.932 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [62]
2015-01-09 10:28:44.933 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 4 6 4
2015-01-09 10:28:44.933 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:28:44.933 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 91651 108702 193404 129099
2015-01-09 10:28:44.933 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:28:44.933 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 8331 15714 6271 10604
2015-01-09 10:28:44.933 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 2299751 2752131 154907 2779334
2015-01-09 10:28:44.935 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [79]
2015-01-09 10:28:49.936 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 4 6 4
2015-01-09 10:28:49.936 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:28:49.936 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 91567 108702 193404 129099
2015-01-09 10:28:49.936 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:28:49.936 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 8313 15714 6271 10604
2015-01-09 10:28:49.936 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 2299751 2752131 154907 2779334
2015-01-09 10:28:49.939 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [6]
2015-01-09 10:28:54.940 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 4 6 3
2015-01-09 10:28:54.940 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:28:54.940 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 91837 108702 193404 79861
2015-01-09 10:28:54.940 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:28:54.940 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 18108 15714 6271 6716
2015-01-09 10:28:54.940 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 6155162 2752131 154907 2779334
2015-01-09 10:28:54.942 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [12]
2015-01-09 10:28:59.943 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 2 4 6 3
2015-01-09 10:28:59.943 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:28:59.943 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 82427 107774 193404 79861
2015-01-09 10:28:59.943 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:28:59.943 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 26950 14111 6271 6716
2015-01-09 10:28:59.943 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 6808609 2752131 154907 2779334
2015-01-09 10:28:59.946 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [77]
2015-01-09 10:29:04.947 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 2 4 6 2
2015-01-09 10:29:04.947 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:29:04.948 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 79026 107774 193404 69608
2015-01-09 10:29:04.948 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:29:04.948 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 24710 14111 6271 5626
2015-01-09 10:29:04.948 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 6808609 2752131 154907 2779334
2015-01-09 10:29:04.950 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [44]
2015-01-09 10:29:09.951 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 2 3 6 2
2015-01-09 10:29:09.951 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:29:09.951 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 86155 93174 193404 69608
2015-01-09 10:29:09.951 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:29:09.951 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 27509 12121 6271 5626
2015-01-09 10:29:09.951 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 6808609 2752131 154907 2779334
2015-01-09 10:29:09.954 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 4, HistoryCounts: [24,24,24,24]
2015-01-09 10:29:14.955 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 3 6 2
2015-01-09 10:29:14.955 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 33 104
2015-01-09 10:29:14.955 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 85828 93174 193404 64342
2015-01-09 10:29:14.955 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 1076924 2569609
2015-01-09 10:29:14.955 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 34092 12121 6271 5088
2015-01-09 10:29:14.955 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 6808609 2752131 154907 2779334
2015-01-09 10:29:14.961 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [26]
2015-01-09 10:29:19.962 [info] <0.276.0>@sibling_benchmark:pp:186 siblings Mean: 3 3 0 2
2015-01-09 10:29:19.962 [info] <0.276.0>@sibling_benchmark:pp:187 siblings Max: 114 104 0 104
2015-01-09 10:29:19.962 [info] <0.276.0>@sibling_benchmark:pp:186 objsize Mean: 75214 74662 0 51279
2015-01-09 10:29:19.962 [info] <0.276.0>@sibling_benchmark:pp:187 objsize Max: 2601496 2569609 0 2569609
2015-01-09 10:29:19.962 [info] <0.276.0>@sibling_benchmark:pp:186 time Mean: 36468 7569 0 2944
2015-01-09 10:29:19.962 [info] <0.276.0>@sibling_benchmark:pp:187 time Max: 6808609 2752131 0 2779334
2015-01-09 10:29:19.965 [info] <0.276.0>@sibling_benchmark:get_counts:200 SiblingCount: 1, HistoryCounts: [37]
2015-01-09 10:29:20.232 [error] emulator Error in process <0.278.0> on node 'riak_test@127.0.0.1' with exit value: {{aws_error,{http_error,500,[],"<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request</body></html>"}},[{erlcloud_s3...
2015-01-09 10:29:20.233 [warning] <0.2.0>@riak_test_runner:rec_loop:132 sibling_benchmark failed: {{aws_error,{http_error,500,[],"<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request</body></html>"}},[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},{erlcloud_s3,put_object,6,[{file,"src/erlcloud_s3.erl"},{line,642}]},{sibling_benchmark,object_writer,2,[{file,"riak_test/tests/sibling_benchmark.erl"},{line,137}]}]}
2015-01-09 10:29:20.233 [error] <0.2.0>@riak_test_runner:execute:107
================ sibling_benchmark failure stack trace =====================
{{aws_error,{http_error,500,[],
"<html><head><title>500 Internal Server Error</title></head><body><h1>Internal Server Error</h1>The server encountered an error while processing this request</body></html>"}},
[{erlcloud_s3,s3_request,9,[{file,"src/erlcloud_s3.erl"},{line,898}]},
{erlcloud_s3,put_object,6,[{file,"src/erlcloud_s3.erl"},{line,642}]},
{sibling_benchmark,object_writer,2,
[{file,"riak_test/tests/sibling_benchmark.erl"},
{line,137}]}]}
============================================================================
2015-01-09 10:29:20.233 [notice] <0.2.0>@riak_test_runner:confirm:62 sibling_benchmark Test Run Complete
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment