Skip to content

Instantly share code, notes, and snippets.

@stephenhenderson

stephenhenderson/error.1 Secret

Last active August 29, 2015 14:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save stephenhenderson/813e495dedcbf1727793 to your computer and use it in GitHub Desktop.
Save stephenhenderson/813e495dedcbf1727793 to your computer and use it in GitHub Desktop.
Download ZIP
Couchbase node failure logs
Raw
error.1
[error_logger:error,2014-06-04T21:49:01.107,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",1401918531096,[]}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:08.606,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.15680.1252>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 14182742003
neighbours:
[error_logger:error,2014-06-04T21:49:08.613,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.15680.1252>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:08.617,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:08.619,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26057.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30842
neighbours:
[error_logger:error,2014-06-04T21:49:08.635,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26057.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:16.132,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",1401918546116,[]}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:46.537,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26087.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 61223
neighbours:
[error_logger:error,2014-06-04T21:49:46.826,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26087.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:46.826,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:46.827,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26172.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30842
neighbours:
[error_logger:error,2014-06-04T21:49:46.827,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26172.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:46.827,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:46.827,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26213.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30858
neighbours:
[error_logger:error,2014-06-04T21:49:46.828,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26213.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:46.828,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:46.828,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26242.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30874
neighbours:
[error_logger:error,2014-06-04T21:49:46.828,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26242.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:46.828,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:46.829,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26283.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30890
neighbours:
[error_logger:error,2014-06-04T21:49:46.829,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26283.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:46.829,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:46.829,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26311.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30906
neighbours:
[error_logger:error,2014-06-04T21:49:46.829,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26311.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:49:46.977,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:49:47.531,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26353.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30922
neighbours:
[error_logger:error,2014-06-04T21:49:47.533,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26353.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:50:31.225,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",1401918621210,[]}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:50:49.151,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26381.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 4181
stack_size: 24
reductions: 274156
neighbours:
[stats:error,2014-06-04T21:50:49.155,ns_1@vp4.us-east.xxxxxx.net:<0.8691.0>:stats_collector:handle_info:106]Exception in stats collector: {exit,
{{{badmatch,{error,timeout}},
[{mc_client_binary,cmd_binary_vocal_recv,5},
{mc_client_binary,select_bucket,2},
{ns_memcached,ensure_bucket,2},
{ns_memcached,handle_info,2},
{gen_server,handle_msg,5},
{ns_memcached,init,1},
{gen_server,init_it,6},
{proc_lib,init_p_do_apply,3}]},
{gen_server,call,
['ns_memcached-visitorprofilestore',
{stats,<<>>},
180000]}},
[{gen_server,call,3},
{ns_memcached,do_call,3},
{stats_collector,grab_all_stats,1},
{stats_collector,handle_info,2},
{gen_server,handle_msg,5},
{proc_lib,init_p_do_apply,3}]}
[error_logger:error,2014-06-04T21:50:49.191,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26381.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:50:49.293,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:50:49.294,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26827.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30842
neighbours:
[error_logger:error,2014-06-04T21:50:49.294,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26827.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:50:49.296,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:50:49.296,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26855.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30858
neighbours:
[error_logger:error,2014-06-04T21:50:49.296,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26855.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:50:49.297,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:50:49.297,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26897.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30874
neighbours:
[error_logger:error,2014-06-04T21:50:49.297,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26897.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:50:49.297,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.15738.1252> terminating
** Last message in was check_config
** When Server state == {state,3,0,0,
{[],[]},
{[],[]},
{[],[]},
warmed,
{1399,590364,775098},
"visitorprofilestore",#Port<0.28037368>,
{interval,#Ref<0.0.2428.15180>},
[{<0.15850.1252>,#Ref<0.0.2428.15210>}]}
** Reason for termination ==
** {{badmatch,{error,timeout}},
[{mc_client_binary,cmd_binary_vocal_recv,5},
{mc_client_binary,select_bucket,2},
{ns_memcached,ensure_bucket,2},
{ns_memcached,handle_info,2},
{gen_server,handle_msg,5},
{ns_memcached,init,1},
{gen_server,init_it,6},
{proc_lib,init_p_do_apply,3}]}
[error_logger:error,2014-06-04T21:50:49.298,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ns_memcached:init/1
pid: <0.15738.1252>
registered_name: []
exception exit: {{badmatch,{error,timeout}},
[{mc_client_binary,cmd_binary_vocal_recv,5},
{mc_client_binary,select_bucket,2},
{ns_memcached,ensure_bucket,2},
{ns_memcached,handle_info,2},
{gen_server,handle_msg,5},
{ns_memcached,init,1},
{gen_server,init_it,6},
{proc_lib,init_p_do_apply,3}]}
in function gen_server:init_it/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'$gen_call',{<0.717.0>,#Ref<0.0.4692.254798>},connected},
{'$gen_call',{<0.717.0>,#Ref<0.0.4692.255402>},connected},
check_config,
{'$gen_call',{<0.717.0>,#Ref<0.0.4692.257183>},connected},
check_config,check_config,check_config,check_config,
{'$gen_call',{<0.717.0>,#Ref<0.0.4692.261623>},connected},
check_config,
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.244>},connected},
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.900>},connected},
check_config,
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.1536>},connected},
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.2176>},connected},
check_config,
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.2849>},connected},
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.3592>},connected},
check_config,
{'$gen_call',{<0.717.0>,#Ref<0.0.4693.4249>},connected},
check_config,check_config,check_config]
links: [<0.15850.1252>,<0.15852.1252>,<0.15853.1252>,<0.15851.1252>,
<0.298.0>,<0.8662.0>]
dictionary: []
trap_exit: true
status: running
heap_size: 832040
stack_size: 24
reductions: 2994487992
neighbours:
neighbour: [{pid,<0.15851.1252>},
{registered_name,[]},
{initial_call,{erlang,apply,['Argument__1','Argument__2']}},
{current_function,{mc_binary,recv_with_data,4}},
{ancestors,['ns_memcached-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',
<0.8661.0>]},
{messages,[]},
{links,[<0.15738.1252>,#Port<0.28037375>]},
{dictionary,[]},
{trap_exit,false},
{status,waiting},
{heap_size,28657},
{stack_size,39},
{reductions,99979684497}]
neighbour: [{pid,<0.15853.1252>},
{registered_name,[]},
{initial_call,{erlang,apply,['Argument__1','Argument__2']}},
{current_function,{mc_binary,recv_with_data,4}},
{ancestors,['ns_memcached-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',
<0.8661.0>]},
{messages,[]},
{links,[<0.15738.1252>,#Port<0.28037373>]},
{dictionary,[]},
{trap_exit,false},
{status,waiting},
{heap_size,28657},
{stack_size,39},
{reductions,326438045158}]
neighbour: [{pid,<0.15852.1252>},
{registered_name,[]},
{initial_call,{erlang,apply,['Argument__1','Argument__2']}},
{current_function,{mc_binary,recv_with_data,4}},
{ancestors,['ns_memcached-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',
<0.8661.0>]},
{messages,[]},
{links,[<0.15738.1252>,#Port<0.28037374>]},
{dictionary,[]},
{trap_exit,false},
{status,waiting},
{heap_size,28657},
{stack_size,39},
{reductions,252486131676}]
neighbour: [{pid,<0.15850.1252>},
{registered_name,[]},
{initial_call,{erlang,apply,['Argument__1','Argument__2']}},
{current_function,{gen,do_call,4}},
{ancestors,['ns_memcached-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',
<0.8661.0>]},
{messages,[]},
{links,[<0.15738.1252>,#Port<0.28037376>]},
{dictionary,[]},
{trap_exit,false},
{status,waiting},
{heap_size,196418},
{stack_size,24},
{reductions,18870}]
[error_logger:error,2014-06-04T21:51:26.816,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]Supervisor received unexpected message: {ack,<0.15738.1252>,
{error,
{{badmatch,{error,timeout}},
[{mc_client_binary,
cmd_binary_vocal_recv,5},
{mc_client_binary,select_bucket,2},
{ns_memcached,ensure_bucket,2},
{ns_memcached,handle_info,2},
{gen_server,handle_msg,5},
{ns_memcached,init,1},
{gen_server,init_it,6},
{proc_lib,init_p_do_apply,3}]}}}
[error_logger:error,2014-06-04T21:51:27.627,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {{badmatch,{error,timeout}},
[{mc_client_binary,cmd_binary_vocal_recv,5},
{mc_client_binary,select_bucket,2},
{ns_memcached,ensure_bucket,2},
{ns_memcached,handle_info,2},
{gen_server,handle_msg,5},
{ns_memcached,init,1},
{gen_server,init_it,6},
{proc_lib,init_p_do_apply,3}]}
Offender: [{pid,<0.15738.1252>},
{name,{ns_memcached,"visitorprofilestore"}},
{mfargs,{ns_memcached,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,86400000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:28.102,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,menelaus_sup}
Context: child_terminated
Reason: {{{badmatch,{error,timeout}},
[{mc_client_binary,cmd_binary_vocal_recv,5},
{mc_client_binary,select_bucket,2},
{ns_memcached,ensure_bucket,2},
{ns_memcached,handle_info,2},
{gen_server,handle_msg,5},
{ns_memcached,init,1},
{gen_server,init_it,6},
{proc_lib,init_p_do_apply,3}]},
{gen_server,call,
['ns_memcached-visitorprofilestore',topkeys,
180000]}}
Offender: [{pid,<0.15739.1252>},
{name,hot_keys_keeper},
{mfargs,{hot_keys_keeper,start_link,[]}},
{restart_type,permanent},
{shutdown,5000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:28.301,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27014.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.31464.2135>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.31464.2135>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.302,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27015.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.17060.1728>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.17060.1728>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.302,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27016.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.16656.1252>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.16656.1252>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.303,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27017.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.27755.2369>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.27755.2369>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.304,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27018.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.27754.2369>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.27754.2369>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.304,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27019.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.16657.1252>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.16657.1252>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.304,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27020.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.6622.2118>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.6622.2118>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.305,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27021.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.16655.1252>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.16655.1252>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.335,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27022.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.2564.2072>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.2564.2072>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.736,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:-confirm_sent_messages/1-fun-0-/0
pid: <0.27023.2439>
registered_name: []
exception error: no match of right hand side value {error,closed}
in function ebucketmigrator_srv:'-confirm_sent_messages/1-fun-0-'/3
ancestors: [<0.31911.1897>,'ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: []
links: [<0.31911.1897>]
dictionary: []
trap_exit: false
status: running
heap_size: 377
stack_size: 24
reductions: 766
neighbours:
[error_logger:error,2014-06-04T21:51:28.747,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",1401918651255,[]}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:51:28.760,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.26925.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 91684
neighbours:
[error_logger:error,2014-06-04T21:51:28.780,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.26925.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.281,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:51:29.295,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.27115.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30906
neighbours:
[error_logger:error,2014-06-04T21:51:29.295,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.27115.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.297,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:51:29.298,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.27161.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30922
neighbours:
[error_logger:error,2014-06-04T21:51:29.298,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.27161.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.300,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:51:29.301,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.27195.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30938
neighbours:
[error_logger:error,2014-06-04T21:51:29.301,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.27195.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.302,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:51:29.303,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.27242.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30954
neighbours:
[error_logger:error,2014-06-04T21:51:29.304,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.27242.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.317,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-06-04T21:51:29.318,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.27274.2439>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [refresh_stats]
links: [<0.8662.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 6765
stack_size: 24
reductions: 30970
neighbours:
[error_logger:error,2014-06-04T21:51:29.320,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.27274.2439>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.393,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.31464.2135> terminating
** Last message in was {tcp_closed,#Port<0.45510122>}
** When Server state == {state,#Port<0.45510120>,#Port<0.45510118>,
#Port<0.45510122>,#Port<0.45510119>,
<0.31465.2135>,<<>>,<<>>,
{set,10,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{"P",[],[],[],"<",
[1012],
[],[],
[1021],
";",
[1011,947],
[],[],
[1020],
[],
[1010,61]}}},
394909,false,false,0,
{1401,918651,322508},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.31464.2135>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.399,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.31464.2135>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.31465.2135>,killed},
{'EXIT',<0.27014.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.45510119>,<0.8679.0>,#Port<0.45510118>]
dictionary: []
trap_exit: true
status: running
heap_size: 2584
stack_size: 24
reductions: 36551720
neighbours:
[error_logger:error,2014-06-04T21:51:29.400,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.31464.2135>},
{name,{new_child_id,[59,60,61,80,947,1010,1011,1012,1020,
1021],
'ns_1@vp3.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.400,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.17060.1728> terminating
** Last message in was {tcp_closed,#Port<0.37137977>}
** When Server state == {state,#Port<0.37137976>,#Port<0.37137974>,
#Port<0.37137977>,#Port<0.37137975>,
<0.17061.1728>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[],
[1000],
[],
[974],
[977],
[996,852],
[],
[986],
[],[],[],
[854],
[1001],
[],[],
[978]}}},
1657691,false,false,0,
{1401,918632,548406},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.17060.1728>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.400,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.17060.1728>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.17061.1728>,killed},
{'EXIT',<0.27015.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.37137975>,<0.8679.0>,#Port<0.37137974>]
dictionary: []
trap_exit: true
status: running
heap_size: 1597
stack_size: 24
reductions: 91855201
neighbours:
[error_logger:error,2014-06-04T21:51:29.400,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.17060.1728>},
{name,{new_child_id,[852,854,974,977,978,986,996,1000,1001],
'ns_1@vp9.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.401,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.16656.1252> terminating
** Last message in was {tcp_closed,#Port<0.28037788>}
** When Server state == {state,#Port<0.28037784>,#Port<0.28037471>,
#Port<0.28037788>,#Port<0.28037475>,
<0.16686.1252>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[1013,407],
[],
[1003],
[],[],
[406],
[999],
[1018],
[415],
[],[],
[408],
[1017],
[],[],[]}}},
1481888,false,false,0,
{1401,918646,303735},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.16656.1252>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.401,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.16656.1252>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.16686.1252>,killed},
{'EXIT',<0.27016.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.28037475>,<0.8679.0>,#Port<0.28037471>]
dictionary: []
trap_exit: true
status: running
heap_size: 987
stack_size: 24
reductions: 140398454
neighbours:
[error_logger:error,2014-06-04T21:51:29.401,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.16656.1252>},
{name,{new_child_id,[406,407,408,415,999,1003,1013,1017,
1018],
'ns_1@vp7.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.401,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.27755.2369> terminating
** Last message in was {tcp_closed,#Port<0.49857139>}
** When Server state == {state,#Port<0.49857137>,#Port<0.49857134>,
#Port<0.49857139>,#Port<0.49857136>,
<0.27756.2369>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{"À",
[856],
[333],
[416],
[],"¿",[],[],[],[],[],[],
[857],
[414,334],
[],
[436]}}},
93754,false,false,0,
{1401,918639,172301},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.27755.2369>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.402,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.27755.2369>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.27756.2369>,killed},
{'EXIT',<0.27017.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.49857136>,<0.8679.0>,#Port<0.49857134>]
dictionary: []
trap_exit: true
status: running
heap_size: 2584
stack_size: 24
reductions: 9138480
neighbours:
[error_logger:error,2014-06-04T21:51:29.402,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.27755.2369>},
{name,{new_child_id,[191,192,333,334,414,416,436,856,857],
'ns_1@vp10.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.402,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.27754.2369> terminating
** Last message in was {tcp_closed,#Port<0.49857140>}
** When Server state == {state,#Port<0.49857138>,#Port<0.49857133>,
#Port<0.49857140>,#Port<0.49857135>,
<0.27757.2369>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[],
[282],
[],[],
[929],
"ÿ","¢",
[906],
[614],
[928,537],
[],[],
[283],
[],[],[]}}},
92340,false,false,0,
{1401,918641,542677},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.27754.2369>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.402,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.27754.2369>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.27757.2369>,killed},
{'EXIT',<0.27018.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.49857135>,<0.8679.0>,#Port<0.49857133>]
dictionary: []
trap_exit: true
status: running
heap_size: 1597
stack_size: 24
reductions: 8508218
neighbours:
[error_logger:error,2014-06-04T21:51:29.402,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.27754.2369>},
{name,{new_child_id,[162,255,282,283,537,614,906,928,929],
'ns_1@vp11.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.402,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.16657.1252> terminating
** Last message in was {tcp_closed,#Port<0.28037509>}
** When Server state == {state,#Port<0.28037507>,#Port<0.28037474>,
#Port<0.28037509>,#Port<0.28037477>,
<0.16664.1252>,<<>>,<<>>,
{set,10,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[965],
[],
[285],
[958],
[993],
[964],
[],
[284],
[957,287],
[],[],
[966],
[],
[286],
[],[]}}},
1661623,false,false,0,
{1401,918644,768389},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.16657.1252>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.403,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.16657.1252>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.16664.1252>,killed},
{'EXIT',<0.27019.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.28037477>,<0.8679.0>,#Port<0.28037474>]
dictionary: []
trap_exit: true
status: running
heap_size: 1597
stack_size: 24
reductions: 150486383
neighbours:
[error_logger:error,2014-06-04T21:51:29.403,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.16657.1252>},
{name,{new_child_id,[284,285,286,287,957,958,964,965,966,
993],
'ns_1@vp6.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.403,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.6622.2118> terminating
** Last message in was {tcp_closed,#Port<0.45006767>}
** When Server state == {state,#Port<0.45006766>,#Port<0.45006764>,
#Port<0.45006767>,#Port<0.45006765>,
<0.6623.2118>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[],[],
[795],
[798,288],
[],[],[],[],
[797],
[],
[819],
[671],
"D",
[796],
[799],
[]}}},
393983,false,false,0,
{1401,918649,438586},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.6622.2118>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.404,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.6622.2118>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.6623.2118>,killed},
{'EXIT',<0.27020.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.45006765>,<0.8679.0>,#Port<0.45006764>]
dictionary: []
trap_exit: true
status: running
heap_size: 1597
stack_size: 24
reductions: 37743111
neighbours:
[error_logger:error,2014-06-04T21:51:29.404,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.6622.2118>},
{name,{new_child_id,[68,288,671,795,796,797,798,799,819],
'ns_1@vp2.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.404,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.16655.1252> terminating
** Last message in was {tcp_closed,#Port<0.28037812>}
** When Server state == {state,#Port<0.28037811>,#Port<0.28037470>,
#Port<0.28037812>,#Port<0.28037473>,
<0.16701.1252>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[805,542],
[808],
[],[],[],
[804],
[807],
[778],
[],[],[],
[806],
[777],
[780],
[],[]}}},
1481745,false,false,0,
{1401,918649,369586},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.16655.1252>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.404,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.16655.1252>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.16701.1252>,killed},
{'EXIT',<0.27021.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.28037473>,<0.8679.0>,#Port<0.28037470>]
dictionary: []
trap_exit: true
status: running
heap_size: 1597
stack_size: 24
reductions: 140641432
neighbours:
[error_logger:error,2014-06-04T21:51:29.404,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.16655.1252>},
{name,{new_child_id,[542,777,778,780,804,805,806,807,808],
'ns_1@vp8.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.404,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.2564.2072> terminating
** Last message in was {tcp_closed,#Port<0.44030873>}
** When Server state == {state,#Port<0.44030872>,#Port<0.44030869>,
#Port<0.44030873>,#Port<0.44030870>,
<0.2565.2072>,<<>>,<<>>,
{set,9,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[],[],[],[],
[602],
[],[],
[874],
[],
[784,601,27],
[],[],[],[],
[783,273,26],
[356]}}},
450466,false,false,0,
{1401,918644,380097},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.2564.2072>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.405,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.2564.2072>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.2565.2072>,killed},
{'EXIT',<0.27022.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.44030870>,<0.8679.0>,#Port<0.44030869>]
dictionary: []
trap_exit: true
status: running
heap_size: 2584
stack_size: 24
reductions: 42934678
neighbours:
[error_logger:error,2014-06-04T21:51:29.405,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.2564.2072>},
{name,{new_child_id,[26,27,273,356,601,602,783,784,874],
'ns_1@vp1.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[error_logger:error,2014-06-04T21:51:29.405,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server <0.31911.1897> terminating
** Last message in was {tcp_closed,#Port<0.40922379>}
** When Server state == {state,#Port<0.40922378>,#Port<0.40922376>,
#Port<0.40922379>,#Port<0.40922377>,
<0.31912.1897>,<<>>,<<>>,
{set,10,16,16,8,80,48,
{[],[],[],[],[],[],[],[],[],[],[],[],[],
[],[],[]},
{{[],"£",
[134],
[],
[259,140],
[],[],[],[],
[139],
[142],
[],"¤",
[135],
[138],
[141]}}},
764085,false,false,0,
{1401,918651,321424},
not_started,undefined,
<<"replication_ns_1@vp4.us-east.xxxxxx.net">>,
<0.31911.1897>,
{had_backfill,false,undefined,[]},
completed,false}
** Reason for termination ==
** downstream_closed
[error_logger:error,2014-06-04T21:51:29.405,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: ebucketmigrator_srv:init/1
pid: <0.31911.1897>
registered_name: []
exception exit: downstream_closed
in function gen_server:terminate/6
ancestors: ['ns_vbm_new_sup-visitorprofilestore',
'single_bucket_sup-visitorprofilestore',<0.8661.0>]
messages: [{'EXIT',<0.31912.1897>,killed},
{'EXIT',<0.27023.2439>,{badmatch,{error,closed}}},
{check_for_timeout,15000}]
links: [#Port<0.40922377>,<0.8679.0>,#Port<0.40922376>]
dictionary: []
trap_exit: true
status: running
heap_size: 2584
stack_size: 24
reductions: 69650024
neighbours:
[error_logger:error,2014-06-04T21:51:29.405,ns_1@vp4.us-east.xxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'ns_vbm_new_sup-visitorprofilestore'}
Context: child_terminated
Reason: downstream_closed
Offender: [{pid,<0.31911.1897>},
{name,{new_child_id,[134,135,138,139,140,141,142,163,164,
259],
'ns_1@vp5.us-east.xxxxxx.net'}},
{mfargs,{ebucketmigrator_srv,start_link,undefined}},
{restart_type,temporary},
{shutdown,60000},
{child_type,worker}]
[ns_server:error,2014-06-04T21:53:19.754,ns_1@vp4.us-east.xxxxxx.net:<0.27348.2439>:ns_memcached:verify_report_long_call:294]call topkeys took too long: 584767 us
[ns_server:error,2014-06-04T21:54:25.232,ns_1@vp4.us-east.xxxxxx.net:<0.27348.2439>:ns_memcached:verify_report_long_call:294]call {stats,<<>>} took too long: 544290 us
[ns_server:error,2014-06-04T21:54:25.261,ns_1@vp4.us-east.xxxxxx.net:<0.27346.2439>:ns_memcached:verify_report_long_call:294]call topkeys took too long: 1031668 us
[ns_server:error,2014-06-04T21:59:40.773,ns_1@vp4.us-east.xxxxxx.net:ns_doctor<0.719.0>:ns_doctor:update_status:235]The following buckets became not ready on node 'ns_1@vp6.us-east.xxxxxx.net': ["visitorprofilestore"], those of them are active ["visitorprofilestore"]
Raw
info.log
[ns_server:info,2014-05-28T14:30:03.133,ns_1@vp2.us-east.xxxxxxxx.net:<0.26913.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:30:33.182,ns_1@vp2.us-east.xxxxxxxx.net:<0.27221.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:30:33.185,ns_1@vp2.us-east.xxxxxxxx.net:<0.27221.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:30:38.583,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp10.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:31:03.221,ns_1@vp2.us-east.xxxxxxxx.net:<0.27532.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:31:14.706,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp9.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:31:33.274,ns_1@vp2.us-east.xxxxxxxx.net:<0.27841.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:31:33.275,ns_1@vp2.us-east.xxxxxxxx.net:<0.27841.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:31:48.272,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp9.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:32:03.320,ns_1@vp2.us-east.xxxxxxxx.net:<0.28151.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:32:03.322,ns_1@vp2.us-east.xxxxxxxx.net:<0.28151.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:32:17.229,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp10.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:32:33.368,ns_1@vp2.us-east.xxxxxxxx.net:<0.28461.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:32:33.370,ns_1@vp2.us-east.xxxxxxxx.net:<0.28461.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:error,2014-05-28T14:32:57.212,ns_1@vp2.us-east.xxxxxxxx.net:<0.4567.850>:ns_memcached:verify_report_long_call:294]call topkeys took too long: 1117450 us
[ns_server:info,2014-05-28T14:33:03.400,ns_1@vp2.us-east.xxxxxxxx.net:<0.28770.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:33:03.402,ns_1@vp2.us-east.xxxxxxxx.net:<0.28770.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:33:10.022,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp6.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:33:33.452,ns_1@vp2.us-east.xxxxxxxx.net:<0.29079.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:33:33.454,ns_1@vp2.us-east.xxxxxxxx.net:<0.29079.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:33:40.931,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp5.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:34:03.491,ns_1@vp2.us-east.xxxxxxxx.net:<0.29389.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:34:03.493,ns_1@vp2.us-east.xxxxxxxx.net:<0.29389.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:34:10.607,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp11.us-east.xxxxxxxx.net'
[ns_server:info,2014-05-28T14:34:33.542,ns_1@vp2.us-east.xxxxxxxx.net:<0.29699.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:34:33.548,ns_1@vp2.us-east.xxxxxxxx.net:<0.29699.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:info,2014-05-28T14:34:38.383,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp4.us-east.xxxxxxxx.net'
[ns_server:error,2014-05-28T14:34:57.762,ns_1@vp2.us-east.xxxxxxxx.net:<0.4567.850>:ns_memcached:verify_report_long_call:294]call topkeys took too long: 1673706 us
[ns_server:info,2014-05-28T14:35:03.618,ns_1@vp2.us-east.xxxxxxxx.net:<0.30045.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:35:03.621,ns_1@vp2.us-east.xxxxxxxx.net:<0.30045.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:error,2014-05-28T14:35:14.964,ns_1@vp2.us-east.xxxxxxxx.net:ns_doctor<0.725.0>:ns_doctor:update_status:235]The following buckets became not ready on node 'ns_1@vp2.us-east.xxxxxxxx.net': ["visitorprofilestore"], those of them are active ["visitorprofilestore"]
[error_logger:error,2014-05-28T14:35:26.166,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",1401287716156,[]}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[ns_server:info,2014-05-28T14:35:36.113,ns_1@vp2.us-east.xxxxxxxx.net:ns_config_rep<0.676.0>:ns_config_rep:do_pull:341]Pulling config from: 'ns_1@vp7.us-east.xxxxxxxx.net'
[error_logger:error,2014-05-28T14:35:36.939,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.4519.850>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8595.0>]
messages: [refresh_stats]
links: [<0.8596.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 4181
stack_size: 24
reductions: 15176009322
neighbours:
[ns_server:info,2014-05-28T14:35:36.949,ns_1@vp2.us-east.xxxxxxxx.net:<0.30376.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[error_logger:error,2014-05-28T14:35:36.952,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.4519.850>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:info,2014-05-28T14:35:36.953,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================PROGRESS REPORT=========================
supervisor: {local,'single_bucket_sup-visitorprofilestore'}
started: [{pid,<0.30280.2117>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,
["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-05-28T14:35:36.954,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-05-28T14:35:36.955,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.30280.2117>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8595.0>]
messages: [refresh_stats]
links: [<0.8596.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 4181
stack_size: 24
reductions: 30909
neighbours:
[error_logger:error,2014-05-28T14:35:36.956,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.30280.2117>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[ns_server:info,2014-05-28T14:35:36.956,ns_1@vp2.us-east.xxxxxxxx.net:<0.30376.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[error_logger:info,2014-05-28T14:35:36.957,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================PROGRESS REPORT=========================
supervisor: {local,'single_bucket_sup-visitorprofilestore'}
started: [{pid,<0.30328.2117>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,
["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:error,2014-05-28T14:35:36.965,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_msg:76]** Generic server 'couch_stats_reader-visitorprofilestore' terminating
** Last message in was refresh_stats
** When Server state == {state,"visitorprofilestore",undefined,undefined}
** Reason for termination ==
** {timeout,{gen_server,call,
[dir_size,
{dir_size,"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
[error_logger:error,2014-05-28T14:35:36.983,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================CRASH REPORT=========================
crasher:
initial call: couch_stats_reader:init/1
pid: <0.30328.2117>
registered_name: 'couch_stats_reader-visitorprofilestore'
exception exit: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
in function gen_server:terminate/6
ancestors: ['single_bucket_sup-visitorprofilestore',<0.8595.0>]
messages: [refresh_stats]
links: [<0.8596.0>,<0.298.0>]
dictionary: []
trap_exit: false
status: running
heap_size: 4181
stack_size: 24
reductions: 30925
neighbours:
[error_logger:error,2014-05-28T14:35:36.983,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================SUPERVISOR REPORT=========================
Supervisor: {local,'single_bucket_sup-visitorprofilestore'}
Context: child_terminated
Reason: {timeout,
{gen_server,call,
[dir_size,
{dir_size,
"/opt/couchbase/var/lib/couchbase/data/visitorprofilestore"}]}}
Offender: [{pid,<0.30328.2117>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:info,2014-05-28T14:35:36.983,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================PROGRESS REPORT=========================
supervisor: {local,'single_bucket_sup-visitorprofilestore'}
started: [{pid,<0.30362.2117>},
{name,{couch_stats_reader,"visitorprofilestore"}},
{mfargs,
{couch_stats_reader,start_link,
["visitorprofilestore"]}},
{restart_type,permanent},
{shutdown,1000},
{child_type,worker}]
[error_logger:info,2014-05-28T14:35:48.757,ns_1@vp2.us-east.xxxxxxxx.net:error_logger<0.6.0>:ale_error_logger_handler:log_report:72]
=========================INFO REPORT=========================
alarm_handler: {set,{{disk_almost_full,"/"},[]}}
[ns_server:info,2014-05-28T14:35:50.134,ns_1@vp2.us-east.xxxxxxxx.net:<0.4547.850>:mc_connection:run_loop:202]mccouch connection was normally closed
[user:info,2014-05-28T14:35:50.135,ns_1@vp2.us-east.xxxxxxxx.net:ns_memcached-visitorprofilestore<0.4267.850>:ns_memcached:terminate:738]Control connection to memcached on 'ns_1@vp2.us-east.xxxxxxxx.net' disconnected: {{badmatch,
{error,
closed}},
[{mc_client_binary,
cmd_binary_vocal_recv,
5},
{mc_client_binary,
select_bucket,
2},
{ns_memcached,
ensure_bucket,
2},
{ns_memcached,
handle_info,
2},
{gen_server,
handle_msg,
5},
{ns_memcached,
init,
1},
{gen_server,
init_it,
6},
{proc_lib,
[ns_server:info,2014-05-28T14:36:07.050,ns_1@vp2.us-east.xxxxxxxx.net:<0.30829.2117>:compaction_daemon:try_to_cleanup_indexes:650]Cleaning up indexes for bucket `visitorprofilestore`
[ns_server:info,2014-05-28T14:36:07.058,ns_1@vp2.us-east.xxxxxxxx.net:<0.30829.2117>:compaction_daemon:spawn_bucket_compactor:609]Compacting bucket visitorprofilestore with config:
[{parallel_db_and_view_compaction,false},
{database_fragmentation_threshold,{30,undefined}},
{view_fragmentation_threshold,{30,undefined}}]
[ns_server:error,2014-05-28T14:36:09.452,ns_1@vp2.us-east.xxxxxxxx.net:ns_log<0.30711.2117>:ns_log:handle_info:222]unable to write log to "/opt/couchbase/var/lib/couchbase/ns_log": {error,
enospc}
[ns_server:error,2014-05-28T14:36:09.469,ns_1@vp2.us-east.xxxxxxxx.net:ns_log<0.30850.2117>:ns_log:read_logs:82]Couldn't load logs from "/opt/couchbase/var/lib/couchbase/ns_log". Apparently ns_logs file is corrupted
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment