Skip to content

Instantly share code, notes, and snippets.

@aggarwalShivani

aggarwalShivani/curator-istio-success-logs.txt

Created May 28, 2020 10:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save aggarwalShivani/c24c658066b1c8357ef2b2fdfa0b9118 to your computer and use it in GitHub Desktop.
Save aggarwalShivani/c24c658066b1c8357ef2b2fdfa0b9118 to your computer and use it in GitHub Desktop.
Download ZIP
Curator success logs with istio
Raw
curator-istio-success-logs.txt
2020-05-28 10:25:15,398 DEBUG curator.cli run:110 Client and logging options validated.
2020-05-28 10:25:15,398 DEBUG curator.cli run:114 default_timeout = 60
2020-05-28 10:25:15,399 DEBUG curator.cli run:118 action_file: /etc/elasticsearch-curator/actions.yml
2020-05-28 10:25:15,403 DEBUG curator.cli run:120 action_config: {'actions': {1: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}}}
2020-05-28 10:25:15,403 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'actions': <class 'dict'>}
2020-05-28 10:25:15,404 DEBUG curator.validators.SchemaCheck __init__:27 "Actions File" config: {'actions': {1: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}}}
2020-05-28 10:25:15,404 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'action': Any(In(['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']), msg="action must be one of ['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']")}
2020-05-28 10:25:15,404 DEBUG curator.validators.SchemaCheck __init__:27 "action type" config: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}
2020-05-28 10:25:15,404 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'action': Any(In(['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']), msg="action must be one of ['alias', 'allocation', 'close', 'cluster_routing', 'create_index', 'delete_indices', 'delete_snapshots', 'forcemerge', 'freeze', 'index_settings', 'open', 'reindex', 'replicas', 'restore', 'rollover', 'shrink', 'snapshot', 'unfreeze']"), 'description': Any(<class 'str'>, <class 'str'>, msg=None), 'options': <class 'dict'>, 'filters': <class 'list'>}
2020-05-28 10:25:15,404 DEBUG curator.validators.SchemaCheck __init__:27 "structure" config: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'timeout_override': None, 'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]}
2020-05-28 10:25:15,407 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'allow_ilm_indices': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7f5c6a58c050>, msg=None), msg=None), 'continue_if_exception': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7f5c6a58cb00>, msg=None), msg=None), 'disable_action': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7f5c6a58ccb0>, msg=None), msg=None), 'ignore_empty_list': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7f5c6a58ce60>, msg=None), msg=None), 'timeout_override': Any(Coerce(int, msg=None), None, msg=None)}
2020-05-28 10:25:15,407 DEBUG curator.validators.SchemaCheck __init__:27 "options" config: {'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True}
2020-05-28 10:25:15,407 DEBUG curator.validators.SchemaCheck __init__:26 Schema: <function Filters.<locals>.f at 0x7f5c6a5a3cb0>
2020-05-28 10:25:15,407 DEBUG curator.validators.SchemaCheck __init__:27 "filters" config: [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}]
2020-05-28 10:25:15,407 DEBUG curator.defaults.filtertypes age:55 AGE FILTER = [{'direction': Any('older', 'younger', msg=None)}, {'unit': Any('seconds', 'minutes', 'hours', 'days', 'weeks', 'months', 'years', msg=None)}, {'unit_count': Coerce(int, msg=None)}, {'unit_count_pattern': Any(<class 'str'>, msg=None)}, {'epoch': Any(Coerce(int, msg=None), None, msg=None)}, {'exclude': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7f5c6a59e440>, msg=None), msg=None)}, {'source': Any('name', 'creation_date', 'field_stats', msg=None)}, {'stats_result': Any('min_value', 'max_value', msg=None)}, {'timestring': Any(<class 'str'>, msg=None)}]
2020-05-28 10:25:15,408 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'space', 'state']"), 'direction': Any('older', 'younger', msg=None), 'unit': Any('seconds', 'minutes', 'hours', 'days', 'weeks', 'months', 'years', msg=None), 'unit_count': Coerce(int, msg=None), 'unit_count_pattern': Any(<class 'str'>, msg=None), 'epoch': Any(Coerce(int, msg=None), None, msg=None), 'exclude': Any(<class 'bool'>, All(Any(<class 'str'>, msg=None), <function Boolean at 0x7f5c6a59e440>, msg=None), msg=None), 'source': Any('name', 'creation_date', 'field_stats', msg=None), 'stats_result': Any('min_value', 'max_value', msg=None), 'timestring': Any(<class 'str'>, msg=None)}
2020-05-28 10:25:15,408 DEBUG curator.validators.SchemaCheck __init__:27 "filter" config: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3}
2020-05-28 10:25:15,408 DEBUG curator.validators.filters f:48 Filter #0: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}
2020-05-28 10:25:15,408 DEBUG curator.cli run:123 Full list of actions: {1: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {'continue_if_exception': False, 'disable_action': False, 'ignore_empty_list': True, 'allow_ilm_indices': False, 'timeout_override': None}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}]}}
2020-05-28 10:25:15,408 DEBUG curator.cli run:128 action_disabled = False
2020-05-28 10:25:15,408 DEBUG curator.cli run:132 continue_if_exception = False
2020-05-28 10:25:15,408 DEBUG curator.cli run:134 timeout_override = None
2020-05-28 10:25:15,408 DEBUG curator.cli run:136 ignore_empty_list = True
2020-05-28 10:25:15,408 DEBUG curator.cli run:138 allow_ilm_indices = False
2020-05-28 10:25:15,409 INFO curator.cli run:148 Preparing Action ID: 1, "delete_indices"
2020-05-28 10:25:15,409 INFO curator.cli run:162 Creating client object and testing connection
2020-05-28 10:25:15,409 DEBUG curator.utils get_client:809 kwargs = {'hosts': ['elasticsearch'], 'master_only': False, 'port': 9200, 'ssl_no_validate': True, 'url_prefix': '', 'use_ssl': False, 'aws_key': None, 'aws_token': None, 'http_auth': None, 'certificate': None, 'aws_secret_key': None, 'client_cert': None, 'aws_sign_request': False, 'client_key': None, 'timeout': 60}
2020-05-28 10:25:15,409 DEBUG curator.utils get_client:871 Checking for AWS settings
2020-05-28 10:25:15,501 DEBUG curator.utils get_client:886 "requests_aws4auth" module present, but not used.
2020-05-28 10:25:15,502 INFO curator.utils get_client:903 Instantiating client object
2020-05-28 10:25:15,503 INFO curator.utils get_client:906 Testing client connectivity
2020-05-28 10:25:15,505 DEBUG urllib3.connectionpool _new_conn:205 Starting new HTTP connection (1): elasticsearch:9200
2020-05-28 10:25:15,976 DEBUG urllib3.connectionpool _make_request:393 http://elasticsearch:9200 "GET / HTTP/1.1" 200 527
2020-05-28 10:25:15,979 INFO elasticsearch log_request_success:121 GET http://elasticsearch:9200/ [status:200 request:0.476s]
2020-05-28 10:25:15,979 DEBUG elasticsearch log_request_success:123 > None
2020-05-28 10:25:15,979 DEBUG elasticsearch log_request_success:124 < {
"name" : "es-belk-elasticsearch-client-559745dd87-j95v5",
"cluster_name" : "shiv-es",
"cluster_uuid" : "SMYA06nJSrCcLVCavGydgA",
"version" : {
"number" : "7.0.1",
"build_flavor" : "oss",
"build_type" : "rpm",
"build_hash" : "e4efcb5",
"build_date" : "2019-04-29T12:56:03.145736Z",
"build_snapshot" : false,
"lucene_version" : "8.0.0",
"minimum_wire_compatibility_version" : "6.7.0",
"minimum_index_compatibility_version" : "6.0.0-beta1"
},
"tagline" : "You Know, for Search"
}
2020-05-28 10:25:15,980 DEBUG curator.utils get_client:907 Cluster info: {'name': 'es-belk-elasticsearch-client-559745dd87-j95v5', 'cluster_name': 'shiv-es', 'cluster_uuid': 'SMYA06nJSrCcLVCavGydgA', 'version': {'number': '7.0.1', 'build_flavor': 'oss', 'build_type': 'rpm', 'build_hash': 'e4efcb5', 'build_date': '2019-04-29T12:56:03.145736Z', 'build_snapshot': False, 'lucene_version': '8.0.0', 'minimum_wire_compatibility_version': '6.7.0', 'minimum_index_compatibility_version': '6.0.0-beta1'}, 'tagline': 'You Know, for Search'}
2020-05-28 10:25:15,980 INFO curator.utils get_client:908 Successfully created Elasticsearch client object with provided settings
2020-05-28 10:25:15,981 DEBUG curator.utils get_client:932 Checking Elasticsearch endpoint version...
2020-05-28 10:25:15,985 DEBUG urllib3.connectionpool _make_request:393 http://elasticsearch:9200 "GET / HTTP/1.1" 200 527
2020-05-28 10:25:15,985 INFO elasticsearch log_request_success:121 GET http://elasticsearch:9200/ [status:200 request:0.005s]
2020-05-28 10:25:15,986 DEBUG elasticsearch log_request_success:123 > None
2020-05-28 10:25:15,986 DEBUG elasticsearch log_request_success:124 < {
"name" : "es-belk-elasticsearch-client-559745dd87-j95v5",
"cluster_name" : "shiv-es",
"cluster_uuid" : "SMYA06nJSrCcLVCavGydgA",
"version" : {
"number" : "7.0.1",
"build_flavor" : "oss",
"build_type" : "rpm",
"build_hash" : "e4efcb5",
"build_date" : "2019-04-29T12:56:03.145736Z",
"build_snapshot" : false,
"lucene_version" : "8.0.0",
"minimum_wire_compatibility_version" : "6.7.0",
"minimum_index_compatibility_version" : "6.0.0-beta1"
},
"tagline" : "You Know, for Search"
}
2020-05-28 10:25:15,987 DEBUG curator.utils check_version:693 Detected Elasticsearch version 7.0.1
2020-05-28 10:25:15,987 DEBUG curator.utils get_client:951 Not verifying local master status (master_only: false)
2020-05-28 10:25:15,987 INFO curator.cli run:194 Trying Action ID: 1, "delete_indices": Delete indices older than 7 (based on index name)
2020-05-28 10:25:15,987 DEBUG curator.cli process_action:46 Configuration dictionary: {'action': 'delete_indices', 'description': 'Delete indices older than 7 (based on index name)', 'options': {}, 'filters': [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}, {'filtertype': 'ilm'}]}
2020-05-28 10:25:15,988 DEBUG curator.cli process_action:47 kwargs: {'master_timeout': 60, 'dry_run': False}
2020-05-28 10:25:15,988 DEBUG curator.cli process_action:52 opts: {}
2020-05-28 10:25:15,988 DEBUG curator.cli process_action:64 Action kwargs: {'master_timeout': 60}
2020-05-28 10:25:15,988 DEBUG curator.cli process_action:93 Running "DELETE_INDICES"
2020-05-28 10:25:15,989 DEBUG curator.indexlist __get_indices:65 Getting all indices
2020-05-28 10:25:16,025 DEBUG urllib3.connectionpool _make_request:393 http://elasticsearch:9200 "GET /_all/_settings?expand_wildcards=open%2Cclosed HTTP/1.1" 200 2
2020-05-28 10:25:16,026 INFO elasticsearch log_request_success:121 GET http://elasticsearch:9200/_all/_settings?expand_wildcards=open%2Cclosed [status:200 request:0.037s]
2020-05-28 10:25:16,026 DEBUG elasticsearch log_request_success:123 > None
2020-05-28 10:25:16,026 DEBUG elasticsearch log_request_success:124 < {}
2020-05-28 10:25:16,031 DEBUG urllib3.connectionpool _make_request:393 http://elasticsearch:9200 "GET / HTTP/1.1" 200 527
2020-05-28 10:25:16,032 INFO elasticsearch log_request_success:121 GET http://elasticsearch:9200/ [status:200 request:0.005s]
2020-05-28 10:25:16,032 DEBUG elasticsearch log_request_success:123 > None
2020-05-28 10:25:16,033 DEBUG elasticsearch log_request_success:124 < {
"name" : "es-belk-elasticsearch-client-559745dd87-j95v5",
"cluster_name" : "shiv-es",
"cluster_uuid" : "SMYA06nJSrCcLVCavGydgA",
"version" : {
"number" : "7.0.1",
"build_flavor" : "oss",
"build_type" : "rpm",
"build_hash" : "e4efcb5",
"build_date" : "2019-04-29T12:56:03.145736Z",
"build_snapshot" : false,
"lucene_version" : "8.0.0",
"minimum_wire_compatibility_version" : "6.7.0",
"minimum_index_compatibility_version" : "6.0.0-beta1"
},
"tagline" : "You Know, for Search"
}
2020-05-28 10:25:16,033 DEBUG curator.utils get_indices:648 Detected Elasticsearch version 7.0.1
2020-05-28 10:25:16,033 DEBUG curator.utils get_indices:650 All indices: []
2020-05-28 10:25:16,034 DEBUG curator.indexlist iterate_filters:1218 Iterating over a list of filters
2020-05-28 10:25:16,034 DEBUG curator.indexlist iterate_filters:1224 All filters: [{'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}, {'filtertype': 'ilm'}]
2020-05-28 10:25:16,034 DEBUG curator.indexlist iterate_filters:1226 Top of the loop: []
2020-05-28 10:25:16,034 DEBUG curator.indexlist iterate_filters:1227 Un-parsed filter args: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}
2020-05-28 10:25:16,036 DEBUG curator.validators.SchemaCheck __init__:26 Schema: {'aliases': Any(<class 'list'>, <class 'str'>, msg=None), 'allocation_type': Any(<class 'str'>, msg=None), 'count': Coerce(int, msg=None), 'date_from': Any(None, <class 'str'>, msg=None), 'date_from_format': Any(None, <class 'str'>, msg=None), 'date_to': Any(None, <class 'str'>, msg=None), 'date_to_format': Any(None, <class 'str'>, msg=None), 'direction': Any(<class 'str'>, msg=None), 'disk_space': <class 'float'>, 'epoch': Any(Coerce(int, msg=None), None, msg=None), 'exclude': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'field': Any(None, <class 'str'>, msg=None), 'intersect': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'key': Any(<class 'str'>, msg=None), 'kind': Any(<class 'str'>, msg=None), 'max_num_segments': Coerce(int, msg=None), 'number_of_shards': Coerce(int, msg=None), 'pattern': Any(<class 'str'>, msg=None), 'period_type': Any(<class 'str'>, msg=None), 'reverse': Any(None, <class 'bool'>, <class 'int'>, <class 'str'>, msg=None), 'range_from': Coerce(int, msg=None), 'range_to': Coerce(int, msg=None), 'shard_filter_behavior': Any(<class 'str'>, msg=None), 'source': Any(<class 'str'>, msg=None), 'state': Any(<class 'str'>, msg=None), 'stats_result': Any(None, <class 'str'>, msg=None), 'timestring': Any(None, <class 'str'>, msg=None), 'threshold_behavior': Any(<class 'str'>, msg=None), 'unit': Any(<class 'str'>, msg=None), 'unit_count': Coerce(int, msg=None), 'unit_count_pattern': Any(<class 'str'>, msg=None), 'use_age': <function Boolean at 0x7f5c6a5bf950>, 'value': Any(<class 'int'>, <class 'float'>, <class 'bool'>, <class 'str'>, msg=None), 'week_starts_on': Any(None, <class 'str'>, msg=None), 'filtertype': Any(In(['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'space', 'state']), msg="filtertype must be one of ['age', 'alias', 'allocated', 'closed', 'count', 'empty', 'forcemerged', 'ilm', 'kibana', 'none', 'opened', 'pattern', 'period', 'shards', 'space', 'state']")}
2020-05-28 10:25:16,036 DEBUG curator.validators.SchemaCheck __init__:27 "filter" config: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}
2020-05-28 10:25:16,037 DEBUG curator.indexlist iterate_filters:1234 Parsed filter args: {'filtertype': 'age', 'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}
2020-05-28 10:25:16,037 DEBUG curator.indexlist iterate_filters:1243 Filter args: {'source': 'name', 'direction': 'older', 'timestring': '%Y.%m.%d', 'unit': 'days', 'unit_count': 3, 'stats_result': 'min_value', 'epoch': None, 'exclude': False}
2020-05-28 10:25:16,037 DEBUG curator.indexlist iterate_filters:1244 Pre-instance: []
2020-05-28 10:25:16,037 DEBUG curator.indexlist filter_by_age:490 Filtering indices by age
2020-05-28 10:25:16,038 DEBUG curator.indexlist _get_name_based_ages:280 Getting ages of indices by "name"
2020-05-28 10:25:16,038 DEBUG curator.indexlist empty_list_check:226 Checking for empty list
2020-05-28 10:25:16,038 INFO curator.cli run:202 Skipping action "delete_indices" due to empty list: <class 'curator.exceptions.NoIndices'>
2020-05-28 10:25:16,038 INFO curator.cli run:223 Action ID: 1, "delete_indices" completed.
2020-05-28 10:25:16,038 INFO curator.cli run:224 Job completed.
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 2 100 2 0 0 364 0 --:--:-- --:--:-- --:--:-- 400
OKdone
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment