Seems like its a ulimit issue?

Riak error log 2014-11-14

2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bear-0.1.3p1-0-gda820a1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/canola-2.0.0-0-g9bdfee8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cuttlefish-2.0.0-29-gead47a0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eper-0.78-0-g7222eca/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/et-1.4.4.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.195 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eunit-2.2.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.196 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/getopt-0.4.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/gs-1.5.15.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/hipe-3.10.2.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kvc-1.3.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager_syslog-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lucene_parser-1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/meck-0.8.1-0-g2b25a30/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.197 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mnesia-4.10/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.198 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/observer-1.3.1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.198 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/snmp-4.24.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.198 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/otp_mibs-1.0.8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.198 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riaknostic-2.0.0-0-g4e7daa5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.198 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sext-1.1p2-0-gf53f1bd/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.198 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syslog-1.0.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.199 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/tools-2.6.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.200 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webtool-0.8.9.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.200 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/wx-1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.200 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/xmerl-1.3.4/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.200 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erts-5.10.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:34.200 [error] emulator Error in process <0.11850.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:05:34.201 [error] <0.11874.0> CRASH REPORT Process <0.11874.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.201 [error] <0.11872.0> CRASH REPORT Process <0.11872.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.201 [error] <0.11873.0> CRASH REPORT Process <0.11873.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.201 [error] <0.11875.0> CRASH REPORT Process <0.11875.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.202 [error] <0.11876.0> CRASH REPORT Process <0.11876.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.202 [error] <0.11877.0> CRASH REPORT Process <0.11877.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.202 [error] <0.11880.0> CRASH REPORT Process <0.11880.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.202 [error] <0.11878.0> CRASH REPORT Process <0.11878.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.202 [error] <0.11879.0> CRASH REPORT Process <0.11879.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.203 [error] <0.11882.0> CRASH REPORT Process <0.11882.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.203 [error] <0.11881.0> CRASH REPORT Process <0.11881.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.203 [error] <0.11883.0> CRASH REPORT Process <0.11883.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.204 [error] <0.11884.0> CRASH REPORT Process <0.11884.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.204 [error] <0.11885.0> CRASH REPORT Process <0.11885.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.204 [error] <0.11886.0> CRASH REPORT Process <0.11886.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.205 [error] <0.11887.0> CRASH REPORT Process <0.11887.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.206 [error] <0.11888.0> CRASH REPORT Process <0.11888.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.208 [error] <0.11889.0> CRASH REPORT Process <0.11889.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
iak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.236 [error] <0.11921.0> CRASH REPORT Process <0.11921.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.236 [error] <0.11922.0> CRASH REPORT Process <0.11922.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.237 [error] <0.11923.0> CRASH REPORT Process <0.11923.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.239 [error] <0.11924.0> CRASH REPORT Process <0.11924.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.239 [error] <0.11925.0> CRASH REPORT Process <0.11925.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.241 [error] <0.11926.0> CRASH REPORT Process <0.11926.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.241 [error] <0.11927.0> CRASH REPORT Process <0.11927.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.242 [error] <0.11928.0> CRASH REPORT Process <0.11928.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.243 [error] <0.11929.0> CRASH REPORT Process <0.11929.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.245 [error] <0.11930.0> CRASH REPORT Process <0.11930.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 3282014-11-14 15:05:34.246 [error] <0.11931.0> CRASH REPORT Process <0.11931.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.247 [error] <0.11933.0> CRASH REPORT Process <0.11933.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.247 [error] <0.11934.0> CRASH REPORT Process <0.11934.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.250 [error] <0.11938.0> CRASH REPORT Process <0.11938.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.250 [error] <0.11937.0> CRASH REPORT Process <0.11937.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.252 [error] <0.11939.0> CRASH REPORT Process <0.11939.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.252 [error] <0.11940.0> CRASH REPORT Process <0.11940.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.253 [error] <0.11941.0> CRASH REPORT Process <0.11941.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.254 [error] <0.11942.0> CRASH REPORT Process <0.11942.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.256 [error] <0.11944.0> CRASH REPORT Process <0.11944.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.256 [error] <0.11943.0> CRASH REPORT Process <0.11943.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.260 [error] <0.11945.0> CRASH REPORT Process <0.11945.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.261 [error] <0.11946.0> CRASH REPORT Process <0.11946.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.262 [error] <0.11947.0> CRASH REPORT Process <0.11947.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.264 [error] <0.11948.0> CRASH REPORT Process <0.11948.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.265 [error] <0.11949.0> CRASH REPORT Process <0.11949.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:34.267 [error] <0.11950.0> CRASH REPORT Process <0.11950.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.651 [error] <0.11954.0> CRASH REPORT Process <0.11954.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.755 [error] <0.11955.0> CRASH REPORT Process <0.11955.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.818 [error] <0.11953.0> CRASH REPORT Process <0.11953.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.818 [error] emulator Error in process <0.11978.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:05:44.819 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho-patches. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.819 [error] <0.187.0> File operation error: emfile. Target: .. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.819 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kernel-2.16.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.819 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/stdlib-1.19.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.819 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syntax_tools-1.6.11/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.819 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/compiler-4.9.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.820 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/goldrush-0.1.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.822 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.822 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sasl-2.3.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.823 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/asn1-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.823 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/crypto-3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.823 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/public_key-0.20/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.823 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ssl-5.3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.823 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_sysmon-2.0.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.824 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/os_mon-2.2.13/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.824 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/runtime_tools-1.8.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.824 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlang_js-1.3.0-0-g07467d8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.824 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/inets-5.9.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.824 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mochiweb-1.5.1p6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.825 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webmachine-1.10.5-0-ge5f8233/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.825 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho_stats-1.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.825 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bitcask-1.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.825 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eleveldb-2.0.0-1-g6e0ff72/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.825 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/pbkdf2-2.0.0-0-g7076584/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.828 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/poolboy-0.8.1p2-0-g84d836a/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.828 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/folsom-0.7.4p4-0-ge80bd01/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.828 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_ensemble-2.0.0-1-gd66a102/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.829 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_core-2.0.0-7-g55d2676/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.829 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pipe-2.0.0-1-ge838b60/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.829 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sidejob-2.0.0-0-gc5aabba/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.829 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_dt-2.0.0-0-gc06820d/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.829 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/protobuffs-0.8.1p4-0-g5257dfe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.830 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pb-2.0.0.16-0-gfc18a9b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.830 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_api-2.0.0-4-g7c2b5ee/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.830 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_kv-2.0.0-12-g20c5237/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.830 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/merge_index-2.0.0-0-gb701dde/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_search-2.0.0-1-g2d69b2b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ibrowse-4.0.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bear-0.1.3p1-0-gda820a1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/canola-2.0.0-0-g9bdfee8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cuttlefish-2.0.0-29-gead47a0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.831 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eper-0.78-0-g7222eca/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/et-1.4.4.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eunit-2.2.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/getopt-0.4.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/gs-1.5.15.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/hipe-3.10.2.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kvc-1.3.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager_syslog-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lucene_parser-1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/meck-0.8.1-0-g2b25a30/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mnesia-4.10/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/observer-1.3.1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/snmp-4.24.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/otp_mibs-1.0.8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.832 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riaknostic-2.0.0-0-g4e7daa5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sext-1.1p2-0-gf53f1bd/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syslog-1.0.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/tools-2.6.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webtool-0.8.9.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/wx-1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/xmerl-1.3.4/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erts-5.10.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:44.833 [error] <0.12052.0> CRASH REPORT Process <0.12052.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.833 [error] <0.12053.0> CRASH REPORT Process <0.12053.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.833 [error] <0.12054.0> CRASH REPORT Process <0.12054.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.833 [error] <0.12055.0> CRASH REPORT Process <0.12055.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.834 [error] <0.12056.0> CRASH REPORT Process <0.12056.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.834 [error] <0.12057.0> CRASH REPORT Process <0.12057.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.834 [error] <0.12058.0> CRASH REPORT Process <0.12058.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.834 [error] <0.12059.0> CRASH REPORT Process <0.12059.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.834 [error] <0.12060.0> CRASH REPORT Process <0.12060.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.835 [error] <0.12061.0> CRASH REPORT Process <0.12061.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.835 [error] <0.12062.0> CRASH REPORT Process <0.12062.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.835 [error] <0.12063.0> CRASH REPORT Process <0.12063.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.835 [error] <0.12064.0> CRASH REPORT Process <0.12064.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.836 [error] <0.12065.0> CRASH REPORT Process <0.12065.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.836 [error] <0.12066.0> CRASH REPORT Process <0.12066.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.836 [error] <0.12067.0> CRASH REPORT Process <0.12067.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.836 [error] <0.12068.0> CRASH REPORT Process <0.12068.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.836 [error] <0.12069.0> CRASH REPORT Process <0.12069.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.836 [error] <0.12070.0> CRASH REPORT Process <0.12070.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.837 [error] <0.12071.0> CRASH REPORT Process <0.12071.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.837 [error] <0.12072.0> CRASH REPORT Process <0.12072.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.837 [error] <0.12073.0> CRASH REPORT Process <0.12073.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.837 [error] <0.12074.0> CRASH REPORT Process <0.12074.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.841 [error] <0.12105.0> CRASH REPORT Process <0.12105.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.841 [error] <0.12106.0> CRASH REPORT Process <0.12106.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12107.0> CRASH REPORT Process <0.12107.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12108.0> CRASH REPORT Process <0.12108.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12109.0> CRASH REPORT Process <0.12109.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12110.0> CRASH REPORT Process <0.12110.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12112.0> CRASH REPORT Process <0.12112.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12111.0> CRASH REPORT Process <0.12111.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.842 [error] <0.12113.0> CRASH REPORT Process <0.12113.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.843 [error] <0.12114.0> CRASH REPORT Process <0.12114.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.843 [error] <0.12115.0> CRASH REPORT Process <0.12115.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.843 [error] <0.12116.0> CRASH REPORT Process <0.12116.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.843 [error] <0.12117.0> CRASH REPORT Process <0.12117.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.843 [error] <0.12118.0> CRASH REPORT Process <0.12118.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.843 [error] <0.12119.0> CRASH REPORT Process <0.12119.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.844 [error] <0.12120.0> CRASH REPORT Process <0.12120.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.844 [error] <0.12121.0> CRASH REPORT Process <0.12121.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.844 [error] <0.12123.0> CRASH REPORT Process <0.12123.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12122.0> CRASH REPORT Process <0.12122.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12124.0> CRASH REPORT Process <0.12124.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12126.0> CRASH REPORT Process <0.12126.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12125.0> CRASH REPORT Process <0.12125.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12127.0> CRASH REPORT Process <0.12127.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12129.0> CRASH REPORT Process <0.12129.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] <0.12128.0> CRASH REPORT Process <0.12128.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:44.845 [error] emulator Error in process <0.11977.0> on node 'riak@kbmini0.local' with exit value: {{badmatch,{error,emfile}},[{cpu_sup,get_uint32_measurement,2,[{file,"cpu_sup.erl"},{line,223}]},{cpu_sup,measurement_server_loop,1,[{file,"cpu_sup.erl"},{line,585}]}]}


2014-11-14 15:05:44.845 [error] <0.12130.0> CRASH REPORT Process <0.12130.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.321 [error] <0.12156.0> CRASH REPORT Process <0.12156.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.322 [error] <0.12157.0> CRASH REPORT Process <0.12157.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.323 [error] <0.12159.0> CRASH REPORT Process <0.12159.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.323 [error] <0.12158.0> CRASH REPORT Process <0.12158.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.324 [error] emulator Error in process <0.12198.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:05:55.324 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho-patches. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.324 [error] <0.187.0> File operation error: emfile. Target: .. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.324 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kernel-2.16.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.325 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/stdlib-1.19.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.325 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syntax_tools-1.6.11/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.325 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/compiler-4.9.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.325 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/goldrush-0.1.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.325 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.326 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sasl-2.3.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.326 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/asn1-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.326 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/crypto-3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.326 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/public_key-0.20/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.326 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ssl-5.3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.327 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_sysmon-2.0.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.327 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/os_mon-2.2.13/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.327 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/runtime_tools-1.8.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.327 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlang_js-1.3.0-0-g07467d8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.327 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/inets-5.9.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.328 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mochiweb-1.5.1p6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.328 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webmachine-1.10.5-0-ge5f8233/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.328 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho_stats-1.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.328 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bitcask-1.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.328 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eleveldb-2.0.0-1-g6e0ff72/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.329 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/pbkdf2-2.0.0-0-g7076584/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.329 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/poolboy-0.8.1p2-0-g84d836a/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.330 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/folsom-0.7.4p4-0-ge80bd01/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.331 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_ensemble-2.0.0-1-gd66a102/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.331 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_core-2.0.0-7-g55d2676/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.331 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pipe-2.0.0-1-ge838b60/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.331 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sidejob-2.0.0-0-gc5aabba/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_dt-2.0.0-0-gc06820d/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/protobuffs-0.8.1p4-0-g5257dfe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pb-2.0.0.16-0-gfc18a9b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_api-2.0.0-4-g7c2b5ee/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_kv-2.0.0-12-g20c5237/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/merge_index-2.0.0-0-gb701dde/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_search-2.0.0-1-g2d69b2b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ibrowse-4.0.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bear-0.1.3p1-0-gda820a1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/canola-2.0.0-0-g9bdfee8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.332 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cuttlefish-2.0.0-29-gead47a0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eper-0.78-0-g7222eca/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/et-1.4.4.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eunit-2.2.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/getopt-0.4.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/gs-1.5.15.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/hipe-3.10.2.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kvc-1.3.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager_syslog-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lucene_parser-1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/meck-0.8.1-0-g2b25a30/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mnesia-4.10/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/observer-1.3.1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/snmp-4.24.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/otp_mibs-1.0.8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.333 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riaknostic-2.0.0-0-g4e7daa5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sext-1.1p2-0-gf53f1bd/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syslog-1.0.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/tools-2.6.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webtool-0.8.9.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/wx-1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/xmerl-1.3.4/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erts-5.10.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:05:55.334 [error] emulator Error in process <0.12244.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:05:55.334 [error] <0.12256.0> CRASH REPORT Process <0.12256.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.334 [error] <0.12258.0> CRASH REPORT Process <0.12258.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.335 [error] <0.12255.0> CRASH REPORT Process <0.12255.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.335 [error] <0.12257.0> CRASH REPORT Process <0.12257.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.336 [error] <0.12261.0> CRASH REPORT Process <0.12261.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.336 [error] <0.12260.0> CRASH REPORT Process <0.12260.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.338 [error] <0.12259.0> CRASH REPORT Process <0.12259.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.339 [error] <0.12262.0> CRASH REPORT Process <0.12262.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.340 [error] <0.12263.0> CRASH REPORT Process <0.12263.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.340 [error] <0.12264.0> CRASH REPORT Process <0.12264.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.343 [error] <0.12268.0> CRASH REPORT Process <0.12268.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.343 [error] <0.12266.0> CRASH REPORT Process <0.12266.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.343 [error] <0.12265.0> CRASH REPORT Process <0.12265.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.343 [error] <0.12267.0> CRASH REPORT Process <0.12267.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.344 [error] <0.12270.0> CRASH REPORT Process <0.12270.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.345 [error] <0.12271.0> CRASH REPORT Process <0.12271.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.345 [error] <0.12269.0> CRASH REPORT Process <0.12269.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.347 [error] <0.12272.0> CRASH REPORT Process <0.12272.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.380 [error] <0.12307.0> CRASH REPORT Process <0.12307.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.381 [error] <0.12309.0> CRASH REPORT Process <0.12309.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.381 [error] <0.12310.0> CRASH REPORT Process <0.12310.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.383 [error] <0.12311.0> CRASH REPORT Process <0.12311.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.383 [error] <0.12313.0> CRASH REPORT Process <0.12313.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.385 [error] <0.12315.0> CRASH REPORT Process <0.12315.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.385 [error] <0.12312.0> CRASH REPORT Process <0.12312.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.385 [error] <0.12314.0> CRASH REPORT Process <0.12314.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:05:55.388 [error] <0.12316.0> CRASH REPORT Process <0.12316.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.821 [error] <0.12317.0> CRASH REPORT Process <0.12317.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.889 [error] <0.12318.0> CRASH REPORT Process <0.12318.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.890 [error] <0.12324.0> CRASH REPORT Process <0.12324.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.890 [error] emulator Error in process <0.12353.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:06:04.890 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho-patches. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.890 [error] <0.187.0> File operation error: emfile. Target: .. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.890 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kernel-2.16.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/stdlib-1.19.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syntax_tools-1.6.11/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/compiler-4.9.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/goldrush-0.1.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sasl-2.3.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/asn1-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/crypto-3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.891 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/public_key-0.20/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ssl-5.3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_sysmon-2.0.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/os_mon-2.2.13/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/runtime_tools-1.8.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlang_js-1.3.0-0-g07467d8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/inets-5.9.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mochiweb-1.5.1p6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webmachine-1.10.5-0-ge5f8233/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.892 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho_stats-1.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bitcask-1.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eleveldb-2.0.0-1-g6e0ff72/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/pbkdf2-2.0.0-0-g7076584/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/poolboy-0.8.1p2-0-g84d836a/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/folsom-0.7.4p4-0-ge80bd01/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_ensemble-2.0.0-1-gd66a102/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_core-2.0.0-7-g55d2676/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pipe-2.0.0-1-ge838b60/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sidejob-2.0.0-0-gc5aabba/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_dt-2.0.0-0-gc06820d/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/protobuffs-0.8.1p4-0-g5257dfe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pb-2.0.0.16-0-gfc18a9b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.893 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_api-2.0.0-4-g7c2b5ee/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_kv-2.0.0-12-g20c5237/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/merge_index-2.0.0-0-gb701dde/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_search-2.0.0-1-g2d69b2b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ibrowse-4.0.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bear-0.1.3p1-0-gda820a1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/canola-2.0.0-0-g9bdfee8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.894 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cuttlefish-2.0.0-29-gead47a0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.895 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eper-0.78-0-g7222eca/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/et-1.4.4.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eunit-2.2.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/getopt-0.4.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/gs-1.5.15.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/hipe-3.10.2.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kvc-1.3.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager_syslog-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lucene_parser-1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/meck-0.8.1-0-g2b25a30/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mnesia-4.10/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.896 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/observer-1.3.1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.897 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/snmp-4.24.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.897 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/otp_mibs-1.0.8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.897 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riaknostic-2.0.0-0-g4e7daa5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.897 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sext-1.1p2-0-gf53f1bd/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.897 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syslog-1.0.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.897 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/tools-2.6.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.898 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webtool-0.8.9.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.898 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/wx-1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.898 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/xmerl-1.3.4/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.898 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erts-5.10.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:04.898 [error] emulator Error in process <0.12402.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:06:04.898 [error] <0.12403.0> CRASH REPORT Process <0.12403.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.898 [error] <0.12404.0> CRASH REPORT Process <0.12404.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.898 [error] <0.12405.0> CRASH REPORT Process <0.12405.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.898 [error] <0.12406.0> CRASH REPORT Process <0.12406.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.899 [error] <0.12407.0> CRASH REPORT Process <0.12407.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.900 [error] <0.12408.0> CRASH REPORT Process <0.12408.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.900 [error] <0.12409.0> CRASH REPORT Process <0.12409.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.900 [error] <0.12410.0> CRASH REPORT Process <0.12410.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.900 [error] <0.12411.0> CRASH REPORT Process <0.12411.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.900 [error] <0.12412.0> CRASH REPORT Process <0.12412.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.900 [error] <0.12413.0> CRASH REPORT Process <0.12413.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.902 [error] <0.12414.0> CRASH REPORT Process <0.12414.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.902 [error] <0.12415.0> CRASH REPORT Process <0.12415.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.902 [error] <0.12416.0> CRASH REPORT Process <0.12416.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.902 [error] <0.12417.0> CRASH REPORT Process <0.12417.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.902 [error] <0.12418.0> CRASH REPORT Process <0.12418.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12419.0> CRASH REPORT Process <0.12419.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12420.0> CRASH REPORT Process <0.12420.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12421.0> CRASH REPORT Process <0.12421.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12422.0> CRASH REPORT Process <0.12422.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12423.0> CRASH REPORT Process <0.12423.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12424.0> CRASH REPORT Process <0.12424.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.904 [error] <0.12425.0> CRASH REPORT Process <0.12425.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12426.0> CRASH REPORT Process <0.12426.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12427.0> CRASH REPORT Process <0.12427.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12428.0> CRASH REPORT Process <0.12428.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12429.0> CRASH REPORT Process <0.12429.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12431.0> CRASH REPORT Process <0.12431.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12432.0> CRASH REPORT Process <0.12432.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.905 [error] <0.12430.0> CRASH REPORT Process <0.12430.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12434.0> CRASH REPORT Process <0.12434.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12433.0> CRASH REPORT Process <0.12433.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12435.0> CRASH REPORT Process <0.12435.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12436.0> CRASH REPORT Process <0.12436.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12437.0> CRASH REPORT Process <0.12437.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12438.0> CRASH REPORT Process <0.12438.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12440.0> CRASH REPORT Process <0.12440.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12439.0> CRASH REPORT Process <0.12439.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.906 [error] <0.12441.0> CRASH REPORT Process <0.12441.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.914 [error] <0.12475.0> CRASH REPORT Process <0.12475.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12476.0> CRASH REPORT Process <0.12476.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12477.0> CRASH REPORT Process <0.12477.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12478.0> CRASH REPORT Process <0.12478.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12479.0> CRASH REPORT Process <0.12479.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12480.0> CRASH REPORT Process <0.12480.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12481.0> CRASH REPORT Process <0.12481.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12482.0> CRASH REPORT Process <0.12482.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.915 [error] <0.12483.0> CRASH REPORT Process <0.12483.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12484.0> CRASH REPORT Process <0.12484.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12485.0> CRASH REPORT Process <0.12485.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12486.0> CRASH REPORT Process <0.12486.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12487.0> CRASH REPORT Process <0.12487.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12488.0> CRASH REPORT Process <0.12488.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12489.0> CRASH REPORT Process <0.12489.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12490.0> CRASH REPORT Process <0.12490.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.916 [error] <0.12491.0> CRASH REPORT Process <0.12491.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.917 [error] <0.12492.0> CRASH REPORT Process <0.12492.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:04.919 [error] <0.12493.0> CRASH REPORT Process <0.12493.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:05.757 [error] <0.12522.0> CRASH REPORT Process <0.12522.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.150 [error] <0.12523.0> CRASH REPORT Process <0.12523.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.153 [error] <0.12524.0> CRASH REPORT Process <0.12524.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.154 [error] <0.12525.0> CRASH REPORT Process <0.12525.0> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.154 [error] emulator Error in process <0.12401.0> on node 'riak@kbmini0.local' with exit value: {{badmatch,{error,emfile}},[{cpu_sup,get_uint32_measurement,2,[{file,"cpu_sup.erl"},{line,223}]},{cpu_sup,measurement_server_loop,1,[{file,"cpu_sup.erl"},{line,585}]}]}


2014-11-14 15:06:16.155 [error] emulator Error in process <0.12572.0> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:06:16.155 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho-patches. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.155 [error] <0.187.0> File operation error: emfile. Target: .. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.155 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kernel-2.16.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.155 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/stdlib-1.19.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.155 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syntax_tools-1.6.11/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/compiler-4.9.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/goldrush-0.1.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sasl-2.3.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/asn1-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/crypto-3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.156 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/public_key-0.20/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.157 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ssl-5.3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.157 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_sysmon-2.0.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.157 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/os_mon-2.2.13/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.157 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/runtime_tools-1.8.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.157 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlang_js-1.3.0-0-g07467d8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.158 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/inets-5.9.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.158 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mochiweb-1.5.1p6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.158 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webmachine-1.10.5-0-ge5f8233/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.158 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho_stats-1.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.158 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bitcask-1.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.158 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eleveldb-2.0.0-1-g6e0ff72/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.159 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/pbkdf2-2.0.0-0-g7076584/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.159 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/poolboy-0.8.1p2-0-g84d836a/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.159 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/folsom-0.7.4p4-0-ge80bd01/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.159 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_ensemble-2.0.0-1-gd66a102/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.159 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_core-2.0.0-7-g55d2676/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.159 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pipe-2.0.0-1-ge838b60/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.160 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sidejob-2.0.0-0-gc5aabba/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.160 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_dt-2.0.0-0-gc06820d/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.160 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/protobuffs-0.8.1p4-0-g5257dfe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.160 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pb-2.0.0.16-0-gfc18a9b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.160 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_api-2.0.0-4-g7c2b5ee/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.160 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_kv-2.0.0-12-g20c5237/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.161 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/merge_index-2.0.0-0-gb701dde/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.162 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_search-2.0.0-1-g2d69b2b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.162 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ibrowse-4.0.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.162 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.162 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bear-0.1.3p1-0-gda820a1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/canola-2.0.0-0-g9bdfee8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cuttlefish-2.0.0-29-gead47a0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eper-0.78-0-g7222eca/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/et-1.4.4.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eunit-2.2.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/getopt-0.4.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.163 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/gs-1.5.15.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/hipe-3.10.2.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kvc-1.3.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager_syslog-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lucene_parser-1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/meck-0.8.1-0-g2b25a30/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mnesia-4.10/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/observer-1.3.1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/snmp-4.24.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/otp_mibs-1.0.8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riaknostic-2.0.0-0-g4e7daa5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sext-1.1p2-0-gf53f1bd/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syslog-1.0.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/tools-2.6.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webtool-0.8.9.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.164 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/wx-1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.165 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/xmerl-1.3.4/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.165 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erts-5.10.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:16.165 [error] emulator Error in process <0.13466.15> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:06:16.165 [error] <0.32283.16> CRASH REPORT Process <0.32283.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.166 [error] <0.32285.16> CRASH REPORT Process <0.32285.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.166 [error] <0.32286.16> CRASH REPORT Process <0.32286.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.167 [error] <0.32284.16> CRASH REPORT Process <0.32284.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.167 [error] <0.32289.16> CRASH REPORT Process <0.32289.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.167 [error] <0.32287.16> CRASH REPORT Process <0.32287.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.167 [error] <0.32290.16> CRASH REPORT Process <0.32290.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.167 [error] <0.32291.16> CRASH REPORT Process <0.32291.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.170 [error] <0.32294.16> CRASH REPORT Process <0.32294.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.171 [error] <0.32292.16> CRASH REPORT Process <0.32292.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.171 [error] <0.32293.16> CRASH REPORT Process <0.32293.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.171 [error] <0.32295.16> CRASH REPORT Process <0.32295.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.176 [error] <0.32296.16> CRASH REPORT Process <0.32296.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.177 [error] <0.32297.16> CRASH REPORT Process <0.32297.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.178 [error] <0.32298.16> CRASH REPORT Process <0.32298.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.179 [error] <0.32299.16> CRASH REPORT Process <0.32299.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.181 [error] <0.32301.16> CRASH REPORT Process <0.32301.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.181 [error] <0.32302.16> CRASH REPORT Process <0.32302.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.181 [error] <0.32300.16> CRASH REPORT Process <0.32300.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.185 [error] <0.32303.16> CRASH REPORT Process <0.32303.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.186 [error] <0.32305.16> CRASH REPORT Process <0.32305.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.186 [error] <0.32304.16> CRASH REPORT Process <0.32304.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.186 [error] <0.32306.16> CRASH REPORT Process <0.32306.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.188 [error] <0.32310.16> CRASH REPORT Process <0.32310.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.189 [error] <0.32307.16> CRASH REPORT Process <0.32307.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.240 [error] <0.32358.16> CRASH REPORT Process <0.32358.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.241 [error] <0.32359.16> CRASH REPORT Process <0.32359.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.242 [error] <0.32360.16> CRASH REPORT Process <0.32360.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:16.242 [error] <0.32361.16> CRASH REPORT Process <0.32361.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.702 [error] <0.32363.16> CRASH REPORT Process <0.32363.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.776 [error] <0.32362.16> CRASH REPORT Process <0.32362.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.776 [error] <0.32367.16> CRASH REPORT Process <0.32367.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.776 [error] emulator Error in process <0.32411.16> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 

2014-11-14 15:06:26.776 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho-patches. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: .. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kernel-2.16.3/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/stdlib-1.19.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syntax_tools-1.6.11/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/compiler-4.9.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/goldrush-0.1.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sasl-2.3.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/asn1-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.777 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/crypto-3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.778 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/public_key-0.20/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.778 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ssl-5.3.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.778 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_sysmon-2.0.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.778 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/os_mon-2.2.13/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.778 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/runtime_tools-1.8.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlang_js-1.3.0-0-g07467d8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/inets-5.9.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mochiweb-1.5.1p6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webmachine-1.10.5-0-ge5f8233/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho_stats-1.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bitcask-1.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.779 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eleveldb-2.0.0-1-g6e0ff72/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/pbkdf2-2.0.0-0-g7076584/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/poolboy-0.8.1p2-0-g84d836a/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/folsom-0.7.4p4-0-ge80bd01/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_ensemble-2.0.0-1-gd66a102/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_core-2.0.0-7-g55d2676/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pipe-2.0.0-1-ge838b60/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sidejob-2.0.0-0-gc5aabba/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_dt-2.0.0-0-gc06820d/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.780 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/protobuffs-0.8.1p4-0-g5257dfe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pb-2.0.0.16-0-gfc18a9b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_api-2.0.0-4-g7c2b5ee/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_kv-2.0.0-12-g20c5237/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/merge_index-2.0.0-0-gb701dde/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_search-2.0.0-1-g2d69b2b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ibrowse-4.0.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.781 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.782 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.783 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.783 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bear-0.1.3p1-0-gda820a1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.783 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/canola-2.0.0-0-g9bdfee8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.783 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cuttlefish-2.0.0-29-gead47a0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.783 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eper-0.78-0-g7222eca/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.783 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/et-1.4.4.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eunit-2.2.5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/getopt-0.4.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/gs-1.5.15.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/hipe-3.10.2.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kvc-1.3.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager_syslog-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lucene_parser-1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/meck-0.8.1-0-g2b25a30/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mnesia-4.10/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/observer-1.3.1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/snmp-4.24.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.784 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/otp_mibs-1.0.8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riaknostic-2.0.0-0-g4e7daa5/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sext-1.1p2-0-gf53f1bd/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syslog-1.0.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/tools-2.6.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webtool-0.8.9.2/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/wx-1.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/xmerl-1.3.4/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erts-5.10.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:26.785 [error] emulator Error in process <0.32457.16> on node 'riak@kbmini0.local' with exit value: {emfile,[{erlang,open_port,[{spawn,"\"/usr/lib/riak/lib/os_mon-2.2.13/priv/bin/cpu_sup\""},[stream]],[]},{os_mon,open_port,2,[{file,"os_mon.erl"},{line,88}]},{cpu_sup,start_portprogram,0,[{file,"cpu_sup.erl"},{line,767}]},{cpu_sup... 


2014-11-14 15:06:26.785 [error] <0.32463.16> CRASH REPORT Process <0.32463.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.785 [error] <0.32464.16> CRASH REPORT Process <0.32464.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.786 [error] <0.32465.16> CRASH REPORT Process <0.32465.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.786 [error] <0.32466.16> CRASH REPORT Process <0.32466.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32467.16> CRASH REPORT Process <0.32467.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32468.16> CRASH REPORT Process <0.32468.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32469.16> CRASH REPORT Process <0.32469.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32470.16> CRASH REPORT Process <0.32470.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32471.16> CRASH REPORT Process <0.32471.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32472.16> CRASH REPORT Process <0.32472.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.787 [error] <0.32473.16> CRASH REPORT Process <0.32473.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.788 [error] <0.32474.16> CRASH REPORT Process <0.32474.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.788 [error] <0.32475.16> CRASH REPORT Process <0.32475.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.789 [error] <0.32476.16> CRASH REPORT Process <0.32476.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.789 [error] <0.32477.16> CRASH REPORT Process <0.32477.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.789 [error] <0.32478.16> CRASH REPORT Process <0.32478.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.790 [error] <0.32479.16> CRASH REPORT Process <0.32479.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.790 [error] <0.32480.16> CRASH REPORT Process <0.32480.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.790 [error] <0.32481.16> CRASH REPORT Process <0.32481.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.790 [error] <0.32482.16> CRASH REPORT Process <0.32482.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.791 [error] <0.32483.16> CRASH REPORT Process <0.32483.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.791 [error] <0.32484.16> CRASH REPORT Process <0.32484.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.791 [error] <0.32485.16> CRASH REPORT Process <0.32485.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.791 [error] <0.32486.16> CRASH REPORT Process <0.32486.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.791 [error] <0.32487.16> CRASH REPORT Process <0.32487.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.792 [error] <0.32488.16> CRASH REPORT Process <0.32488.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.792 [error] <0.32489.16> CRASH REPORT Process <0.32489.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.792 [error] <0.32490.16> CRASH REPORT Process <0.32490.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.792 [error] <0.32491.16> CRASH REPORT Process <0.32491.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.793 [error] <0.32492.16> CRASH REPORT Process <0.32492.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.793 [error] <0.32493.16> CRASH REPORT Process <0.32493.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.793 [error] <0.32494.16> CRASH REPORT Process <0.32494.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.793 [error] <0.32495.16> CRASH REPORT Process <0.32495.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.793 [error] <0.32497.16> CRASH REPORT Process <0.32497.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.794 [error] <0.32496.16> CRASH REPORT Process <0.32496.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.794 [error] <0.32498.16> CRASH REPORT Process <0.32498.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.794 [error] <0.32499.16> CRASH REPORT Process <0.32499.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.794 [error] <0.32500.16> CRASH REPORT Process <0.32500.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.794 [error] <0.32504.16> CRASH REPORT Process <0.32504.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.794 [error] <0.32503.16> CRASH REPORT Process <0.32503.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.795 [error] <0.32505.16> CRASH REPORT Process <0.32505.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.795 [error] <0.32506.16> CRASH REPORT Process <0.32506.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.796 [error] <0.32507.16> CRASH REPORT Process <0.32507.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.796 [error] <0.32508.16> CRASH REPORT Process <0.32508.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.796 [error] <0.32509.16> CRASH REPORT Process <0.32509.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.796 [error] <0.32512.16> CRASH REPORT Process <0.32512.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:26.797 [error] <0.32510.16> CRASH REPORT Process <0.32510.16> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/228359630832953580969325755111919221821239459840/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:36.859 [error] <0.22478.20> CRASH REPORT Process <0.22478.20> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/296867520082839655260123481645494988367611297792/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:36.859 [error] <0.31470.20> CRASH REPORT Process <0.31470.20> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/0/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:36.859 [error] <0.31651.20> CRASH REPORT Process <0.31651.20> with 0 neighbours exited with reason: no match of right hand value {error,{db_open,"IO error: /var/lib/riak/anti_entropy/22835963083295358096932575511191922182123945984/LOCK: Too many open files"}} in hashtree:new_segment_store/2 line 525 in gen_server:init_it/6 line 328
2014-11-14 15:06:36.859 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho-patches. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.859 [error] <0.187.0> File operation error: emfile. Target: .. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.859 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/kernel-2.16.3/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.859 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/stdlib-1.19.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.859 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/syntax_tools-1.6.11/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/compiler-4.9.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/goldrush-0.1.6/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/lager-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sasl-2.3.3/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/asn1-2.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/crypto-3.1/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/public_key-0.20/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ssl-5.3.1/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_sysmon-2.0.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/os_mon-2.2.13/ebin. Function: list_dir. Process: riak_core_claimant.2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/runtime_tools-1.8.12/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlang_js-1.3.0-0-g07467d8/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/inets-5.9.6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/mochiweb-1.5.1p6/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/webmachine-1.10.5-0-ge5f8233/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.860 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/basho_stats-1.0.3/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/bitcask-1.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/eleveldb-2.0.0-1-g6e0ff72/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/pbkdf2-2.0.0-0-g7076584/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/poolboy-0.8.1p2-0-g84d836a/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/folsom-0.7.4p4-0-ge80bd01/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_ensemble-2.0.0-1-gd66a102/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_core-2.0.0-7-g55d2676/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pipe-2.0.0-1-ge838b60/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/sidejob-2.0.0-0-gc5aabba/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_dt-2.0.0-0-gc06820d/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/protobuffs-0.8.1p4-0-g5257dfe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_pb-2.0.0.16-0-gfc18a9b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_api-2.0.0-4-g7c2b5ee/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_kv-2.0.0-12-g20c5237/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/merge_index-2.0.0-0-gb701dde/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_search-2.0.0-1-g2d69b2b/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.861 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/ibrowse-4.0.1/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.862 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/yokozuna-2.0.0-1-g6ac3a63/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.862 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/cluster_info-2.0.0-0-g1fae829/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.862 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_control-2.0.0-1-gadc50dc/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.862 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/erlydtl-0.7.0/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 15:06:36.862 [error] <0.187.0> File operation error: emfile. Target: /usr/lib/riak/lib/riak_auth_mods-2.0.0-1-g9ae39fe/ebin. Function: list_dir. Process: riak_core_claimant.
2014-11-14 22:25:07.310 [error] emulator Error in process <0.5379.0> on node 'riak@kbmini0.local' with exit value: {badarg,[{eleveldb,async_get,[#Ref<0.0.1.63807>,<<0 bytes>>,<<40 bytes>>,[]],[]},{eleveldb,get,3,[{file,"src/eleveldb.erl"},{line,150}]},{hashtree,get_disk_bucket,3,[{file,"src/hashtree.erl"},{line,625}]},{hashtree,compare,6,[{file,"src/hashtree.erl"},{line,867}]},{lists,foldl... 


2014-11-14 23:05:12.496 [error] <0.1062.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271113">>} with error {shutdown,{gen_server,call,[yz_entropy_mgr,{get_tree,1027618338748291114361965898003636498195577569280},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.496 [error] <0.746.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271114">>} with error {shutdown,{gen_server,call,[yz_entropy_mgr,{get_tree,205523667749658222872393179600727299639115513856},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.497 [error] <0.747.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271115">>} with error {shutdown,{gen_server,call,[yz_entropy_mgr,{get_tree,274031556999544297163190906134303066185487351808},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.497 [error] <0.1058.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271113">>} with error {shutdown,{gen_server,call,[yz_entropy_mgr,{get_tree,1004782375664995756265033322492444576013453623296},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.497 [error] <0.748.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271115">>} with error {shutdown,{gen_server,call,[yz_entropy_mgr,{get_tree,296867520082839655260123481645494988367611297792},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.542 [error] <0.747.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271117">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,274031556999544297163190906134303066185487351808},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.544 [error] <0.748.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271117">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,296867520082839655260123481645494988367611297792},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.548 [error] <0.752.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271116">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,479555224749202520035584085735030365824602865664},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.585 [error] <0.591.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271119">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,936274486415109681974235595958868809467081785344},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.588 [error] <0.1035.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271118">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,844930634081928249586505293914101120738586001408},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.589 [error] <0.1034.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271118">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,822094670998632891489572718402909198556462055424},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]
2014-11-14 23:05:12.645 [error] <0.746.0>@yz_kv:index:215 failed to index object {<<"tv">>,<<"kbmini_141600271121">>} with error {noproc,{gen_server,call,[yz_entropy_mgr,{get_tree,205523667749658222872393179600727299639115513856},infinity]}} because [{gen_server,call,3,[{file,"gen_server.erl"},{line,188}]},{yz_kv,get_and_set_tree,1,[{file,"src/yz_kv.erl"},{line,425}]},{yz_kv,update_hashtree,4,[{file,"src/yz_kv.erl"},{line,313}]},{yz_kv,dont_index,5,[{file,"src/yz_kv.erl"},{line,236}]},{yz_kv,index,3,[{file,"src/yz_kv.erl"},{line,204}]},{riak_kv_vnode,actual_put,6,[{file,"src/riak_kv_vnode.erl"},{line,1419}]},{riak_kv_vnode,perform_put,3,[{file,"src/riak_kv_vnode.erl"},{line,1407}]},{riak_kv_vnode,do_put,7,[{file,"src/riak_kv_vnode.erl"},{line,1202}]}]