Skip to content

Instantly share code, notes, and snippets.

@aggarwalShivani

aggarwalShivani/curator-istio-logs.txt

Created May 28, 2020 10:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save aggarwalShivani/c137c0baecf047087f30116d70959f61 to your computer and use it in GitHub Desktop.
Save aggarwalShivani/c137c0baecf047087f30116d70959f61 to your computer and use it in GitHub Desktop.
Download ZIP
Curator with istio
Raw
curator-istio-logs.txt
2020-05-28 10:05:20,531 DEBUG curator.cli run:110 Client and logging options validated.
2020-05-28 10:05:20,531 DEBUG curator.cli run:114 default_timeout = 60
2020-05-28 10:05:20,531 DEBUG curator.cli run:118 action_file: /etc/elasticsearch-curator/actions.yml
2020-05-28 10:05:20,589 DEBUG curator.cli run:120 action_config: {'actions': {1: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}}}
2020-05-28 10:05:20,590 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'actions': <class 'dict'>}
2020-05-28 10:05:20,590 DEBUG curator.validators.SchemaCheck __init__:27 "Actions File" config: {'actions': {1: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}}}
2020-05-28 10:05:20,590 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'action': Any(In(['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']), msg="action must be one of ['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']")}
2020-05-28 10:05:20,590 DEBUG curator.validators.SchemaCheck __init__:27 "action type" config: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}
2020-05-28 10:05:20,590 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'action': Any(In(['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']), msg="action must be one of ['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']"), 'description': Any(<class 'str'>, <class 'str'>, msg=None), 'options': <class 'dict'>, 'filters': <class 'list'>}
2020-05-28 10:05:20,590 DEBUG curator.validators.SchemaCheck __init__:27 "structure" config: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}
2020-05-28 10:05:20,593 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'allow_ilm_indices': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7fad6425c050>, msg=None), msg=None), 'continue_if_exception': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7fad6425cb00>, msg=None), msg=None), 'disable_action': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7fad6425ccb0>, msg=None), msg=None), 'ignore_empty_list': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7fad6425ce60>, msg=None), msg=None), 'timeout_override': Any(Coerce(int, msg=None), None, msg=None)}
2020-05-28 10:05:20,593 DEBUG curator.validators.SchemaCheck __init__:27 "options" config: {'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}
2020-05-28 10:05:20,593 DEBUG curator.validators.SchemaCheck __init__:26 Schema: <function Filters.<locals>.f at 0x7fad64274cb0>
2020-05-28 10:05:20,593 DEBUG curator.validators.SchemaCheck __init__:27 "filters" config: [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]
2020-05-28 10:05:20,593 DEBUG curator.defaults.filtertypes age:55 AGE FILTER = [{'direction': Any('older', 'younger', msg=None)}, {'unit': Any('seconds', 'minutes', 'hours', 'days', 'weeks', 'months', 'years', msg=None)}, {'unit_count': Coerce(int, msg=None)}, {'unit_count_pattern': Any(<class 'str'>, msg=None)}, {'epoch': Any(Coerce(int, msg=None), None, msg=None)}, {'exclude': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7fad6426f440>, msg=None), msg=None)}, {'source': Any('name', 'creation_date', 'field_stats', msg=None)}, {'stats_result': Any('min_value', 'max_value', msg=None)}, {'timestring': Any(<class 'str'>, msg=None)}]
2020-05-28 10:05:20,594 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'space', 'state']"), 'direction': Any('older', 'younger', msg=None), 'unit': Any('seconds', 'minutes', 'hours', 'days', 'weeks', 'months', 'years', msg=None), 'unit_count': Coerce(int, msg=None), 'unit_count_pattern': Any(<class 'str'>, msg=None), 'epoch': Any(Coerce(int, msg=None), None, msg=None), 'exclude': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7fad6426f440>, msg=None), msg=None), 'source': Any('name', 'creation_date', 'field_stats', msg=None), 'stats_result': Any('min_value', 'max_value', msg=None), 'timestring': Any(<class 'str'>, msg=None)}
2020-05-28 10:05:20,594 DEBUG curator.validators.SchemaCheck __init__:27 "filter" config: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}
2020-05-28 10:05:20,594 DEBUG curator.validators.filters f:48 Filter #0: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'epoch': None, 'stats_result': 'min_value', 'exclude': False}
2020-05-28 10:05:20,594 DEBUG curator.cli run:123 Full list of actions: {1: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True, 'allow_ilm_indices': False, 'timeout_override': None}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'epoch': None, 'stats_result': 'min_value', 'exclude': False}]}}
2020-05-28 10:05:20,594 DEBUG curator.cli run:128 action_disabled = False
2020-05-28 10:05:20,594 DEBUG curator.cli run:132 continue_if_exception = False
2020-05-28 10:05:20,594 DEBUG curator.cli run:134 timeout_override = None
2020-05-28 10:05:20,594 DEBUG curator.cli run:136 ignore_empty_list = True
2020-05-28 10:05:20,595 DEBUG curator.cli run:138 allow_ilm_indices = False
2020-05-28 10:05:20,595 INFO curator.cli run:148 Preparing Action ID: 1, "delete_indices"
2020-05-28 10:05:20,595 INFO curator.cli run:162 Creating client object and testing connection
2020-05-28 10:05:20,595 DEBUG curator.utils get_client:809 kwargs = {'hosts': ['elasticsearch'], 'master_only': False, 'port': 9200, 'ssl_no_validate': True, 'url_prefix': '', 'use_ssl': False, 'aws_sign_request': False, 'aws_key': None, 'aws_secret_key': None, 'certificate': None, 'client_key': None, 'http_auth': None, 'client_cert': None, 'aws_token': None, 'timeout': 60}
2020-05-28 10:05:20,595 DEBUG curator.utils get_client:871 Checking for AWS settings
2020-05-28 10:05:20,688 DEBUG curator.utils get_client:886 "requests_aws4auth" module present, but not used.
2020-05-28 10:05:20,688 INFO curator.utils get_client:903 Instantiating client object
2020-05-28 10:05:20,688 INFO curator.utils get_client:906 Testing client connectivity
2020-05-28 10:05:20,872 DEBUG urllib3.connectionpool _new_conn:205 Starting new HTTP connection (1): elasticsearch:9200
2020-05-28 10:05:20,891 WARNING elasticsearch log_request_fail:149 GET http://elasticsearch:9200/ [status:N/A request:0.203s]
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 159, in _new_conn
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 80, in create_connection
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 70, in create_connection
ConnectionRefusedError: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
File "/usr/local/lib/python3.7/http/client.py", line 1244, in request
File "/usr/local/lib/python3.7/http/client.py", line 1290, in _send_request
File "/usr/local/lib/python3.7/http/client.py", line 1239, in endheaders
File "/usr/local/lib/python3.7/http/client.py", line 1026, in _send_output
File "/usr/local/lib/python3.7/http/client.py", line 966, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 181, in connect
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 168, in _new_conn
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fad6420cfd0>: Failed to establish a new connection: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/retry.py", line 399, in increment
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad6420cfd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/elasticsearch/connection/http_requests.py", line 124, in perform_request
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 516, in send
requests.exceptions.ConnectionError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad6420cfd0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2020-05-28 10:05:20,893 DEBUG elasticsearch log_request_fail:160 > None
2020-05-28 10:05:20,894 DEBUG urllib3.connectionpool _new_conn:205 Starting new HTTP connection (2): elasticsearch:9200
2020-05-28 10:05:20,896 WARNING elasticsearch log_request_fail:149 GET http://elasticsearch:9200/ [status:N/A request:0.003s]
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 159, in _new_conn
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 80, in create_connection
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 70, in create_connection
ConnectionRefusedError: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
File "/usr/local/lib/python3.7/http/client.py", line 1244, in request
File "/usr/local/lib/python3.7/http/client.py", line 1290, in _send_request
File "/usr/local/lib/python3.7/http/client.py", line 1239, in endheaders
File "/usr/local/lib/python3.7/http/client.py", line 1026, in _send_output
File "/usr/local/lib/python3.7/http/client.py", line 966, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 181, in connect
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 168, in _new_conn
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fad642af150>: Failed to establish a new connection: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/retry.py", line 399, in increment
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642af150>: Failed to establish a new connection: [Errno 111] Connection refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/elasticsearch/connection/http_requests.py", line 124, in perform_request
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 516, in send
requests.exceptions.ConnectionError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642af150>: Failed to establish a new connection: [Errno 111] Connection refused'))
2020-05-28 10:05:20,897 DEBUG elasticsearch log_request_fail:160 > None
2020-05-28 10:05:20,898 DEBUG urllib3.connectionpool _new_conn:205 Starting new HTTP connection (3): elasticsearch:9200
2020-05-28 10:05:20,899 WARNING elasticsearch log_request_fail:149 GET http://elasticsearch:9200/ [status:N/A request:0.003s]
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 159, in _new_conn
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 80, in create_connection
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 70, in create_connection
ConnectionRefusedError: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
File "/usr/local/lib/python3.7/http/client.py", line 1244, in request
File "/usr/local/lib/python3.7/http/client.py", line 1290, in _send_request
File "/usr/local/lib/python3.7/http/client.py", line 1239, in endheaders
File "/usr/local/lib/python3.7/http/client.py", line 1026, in _send_output
File "/usr/local/lib/python3.7/http/client.py", line 966, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 181, in connect
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 168, in _new_conn
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fad642afb50>: Failed to establish a new connection: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/retry.py", line 399, in increment
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642afb50>: Failed to establish a new connection: [Errno 111] Connection refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/elasticsearch/connection/http_requests.py", line 124, in perform_request
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 516, in send
requests.exceptions.ConnectionError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642afb50>: Failed to establish a new connection: [Errno 111] Connection refused'))
2020-05-28 10:05:20,900 DEBUG elasticsearch log_request_fail:160 > None
2020-05-28 10:05:20,901 DEBUG urllib3.connectionpool _new_conn:205 Starting new HTTP connection (4): elasticsearch:9200
2020-05-28 10:05:20,903 WARNING elasticsearch log_request_fail:149 GET http://elasticsearch:9200/ [status:N/A request:0.003s]
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 159, in _new_conn
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 80, in create_connection
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/connection.py", line 70, in create_connection
ConnectionRefusedError: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 600, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 354, in _make_request
File "/usr/local/lib/python3.7/http/client.py", line 1244, in request
File "/usr/local/lib/python3.7/http/client.py", line 1290, in _send_request
File "/usr/local/lib/python3.7/http/client.py", line 1239, in endheaders
File "/usr/local/lib/python3.7/http/client.py", line 1026, in _send_output
File "/usr/local/lib/python3.7/http/client.py", line 966, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 181, in connect
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connection.py", line 168, in _new_conn
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fad642428d0>: Failed to establish a new connection: [Errno 111] Connection refused
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 449, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen
File "/opt/python/3.7.4/lib/python3.7/site-packages/urllib3/util/retry.py", line 399, in increment
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642428d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/python/3.7.4/lib/python3.7/site-packages/elasticsearch/connection/http_requests.py", line 124, in perform_request
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/sessions.py", line 646, in send
File "/opt/python/3.7.4/lib/python3.7/site-packages/requests/adapters.py", line 516, in send
requests.exceptions.ConnectionError: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642428d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2020-05-28 10:05:20,903 DEBUG elasticsearch log_request_fail:160 > None
2020-05-28 10:05:20,904 ERROR curator.utils get_client:915 HTTP N/A error: HTTPConnectionPool(host='elasticsearch', port=9200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fad642428d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2020-05-28 10:05:20,904 CRITICAL curator.utils get_client:923 Curator cannot proceed. Exiting.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment