Last active
October 6, 2017 12:15
-
-
Save mbukatov/8e0b65dcd1e30bf0c5fcbe9092fc5d7f to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # rpm -qa | egrep '(gevent|etcd|tendrl|urllib|requests)' | sort; rpm -q python | |
| etcd-3.2.5-1.el7.x86_64 | |
| python-etcd-0.4.5-1.noarch | |
| python-gevent-1.0-3.el7.x86_64 | |
| python-requests-2.6.0-1.el7_1.noarch | |
| python-urllib3-1.10.2-3.el7.noarch | |
| rubygem-etcd-0.3.0-1.el7.centos.noarch | |
| tendrl-api-1.5.2-20171006T095605.71ea692.noarch | |
| tendrl-commons-1.5.2-20171004T104238.6d5ffef.noarch | |
| tendrl-node-agent-1.5.2-20171006T091456.1d7451f.noarch | |
| python-2.7.5-58.el7.x86_64 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| --- | |
| etcd_port: 2379 | |
| etcd_connection: 10.34.108.90 | |
| # Enable etcd SSL TLS cert based auth options | |
| etcd_ca_cert_file: /etc/pki/tls/certs/ca-usmqe.crt | |
| etcd_cert_file: /etc/pki/tls/certs/etcd.crt | |
| etcd_key_file: /etc/pki/tls/private/etcd.key | |
| log_cfg_path: /etc/tendrl/node-agent/node-agent_logging.yaml | |
| log_level: DEBUG | |
| package_source_type: rpm | |
| logging_socket_path: /var/run/tendrl/message.sock | |
| message_retention_time: 172800 # default 2 days(2*24*60*60) | |
| alert_retention_time: 172800 # default 2 days(2*24*60*60) | |
| glusterfs_repo: https://buildlogs.centos.org/centos/7/storage/x86_64/gluster-3.9/ | |
| with_internal_profiling: False | |
| graphite_host: 10.34.108.90 | |
| graphite_port: 2003 | |
| sync_interval: 180 | |
| tags: | |
| - tendrl/node |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # cat /etc/redhat-release | |
| CentOS Linux release 7.4.1708 (Core) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| -- Logs begin at Fri 2017-10-06 11:43:11 UTC, end at Fri 2017-10-06 12:06:07 UTC. -- | |
| Oct 06 12:02:56 mbukatov-usm1-server.example.com systemd[1]: Started A python agent local to every managed storage node in the sds cluster. | |
| Oct 06 12:02:56 mbukatov-usm1-server.example.com systemd[1]: Starting A python agent local to every managed storage node in the sds cluster... | |
| Oct 06 12:02:56 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: Creating namespace.node_agent from source tendrl.node_agentnamespace.node_agent created!Finding objects in namespace.node_agent.objectsRegistering object namespace.node_agent.objects.ClusterAlertCountersFinding atoms in namespace.node_agent.objects.ClusterAlertCounters.atomsFinding flows in namespace.node_agent.objects.ClusterAlertCounters.flowsRegistering object namespace.node_agent.objects.ClusterMessageFinding atoms in namespace.node_agent.objects.ClusterMessage.atomsFinding flows in namespace.node_agent.objects.ClusterMessage.flowsRegistering object namespace.node_agent.objects.CompiledDefinitionsFinding atoms in namespace.node_agent.objects.CompiledDefinitions.atomsFinding flows in namespace.node_agent.objects.CompiledDefinitions.flowsRegistering object namespace.node_agent.objects.ConfigFinding atoms in namespace.node_agent.objects.Config.atomsFinding flows in namespace.node_agent.objects.Config.flowsRegistering object namespace.node_agent.objects.DefinitionFinding atoms in namespace.node_agent.objects.Definition.atomsFinding flows in namespace.node_agent.objects.Definition.flowsRegistering object namespace.node_agent.objects.GlobalNetworkFinding atoms in namespace.node_agent.objects.GlobalNetwork.atomsFinding flows in namespace.node_agent.objects.GlobalNetwork.flowsRegistering object namespace.node_agent.objects.MessageFinding atoms in namespace.node_agent.objects.Message.atomsFinding flows in namespace.node_agent.objects.Message.flowsRegistering object namespace.node_agent.objects.NodeAlertCountersFinding atoms in namespace.node_agent.objects.NodeAlertCounters.atomsFinding flows in namespace.node_agent.objects.NodeAlertCounters.flowsRegistering object namespace.node_agent.objects.NodeMessageFinding atoms in namespace.node_agent.objects.NodeMessage.atomsFinding flows in namespace.node_agent.objects.NodeMessage.flowsRegistering object namespace.node_agent.objects.NotificationMessageFinding atoms in namespace.node_agent.objects.NotificationMessage.atomsFinding flows in namespace.node_agent.objects.Notificati | |
| Oct 06 12:02:56 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: onMessage.flowsFinding flows in namespace.node_agent.flowsRegistering flow namespace.node_agent.flows.GenerateJournalMappingSetup Tendrl definitions (.yml)for namespace.node_agentValidating registered (.py) flows in namespace.node_agent.flowsValidating defined (.yml) flows in namespace.node_agent.flowsValidating registered (.py) objects in namespace.node_agent.objectsValidating defined (.yml) objects in namespace.node_agent.objectsSetup Config for namespace.node_agentSetup central store clients for namespace.node_agentCreating namespace.tendrl from source tendrl.commonsnamespace.tendrl created!Finding objects in namespace.tendrl.objectsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.BlockDeviceFinding atoms in namespace.tendrl.objects.BlockDevice.atomsFinding flows in namespace.tendrl.objects.BlockDevice.flowsRegistering object namespace.tendrl.objects.ClusterFinding atoms in namespace.tendrl.objects.Cluster.atomsRegistering atom namespace.tendrl.objects.Cluster.atoms.CheckClusterAvailableRegistering atom namespace.tendrl.objects.Cluster.atoms.ConfigureMonitoringRegistering atom namespace.tendrl.objects.Cluster.atoms.CreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportCreatedClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.IntimateImportRegistering atom namespace.tendrl.objects.Cluster.atoms.PersistClusterDetailsAfterCreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidCreateClusterParamsRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidImportClusterParamsFinding flows in namespace.tendrl.objects.Cluster.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.ClusterAlertFinding atoms in namespace. | |
| Oct 06 12:02:56 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: tendrl.objects.ClusterAlert.atomsFinding flows in namespace.tendrl.objects.ClusterAlert.flowsRegistering object namespace.tendrl.objects.ClusterNodeContextFinding atoms in namespace.tendrl.objects.ClusterNodeContext.atomsFinding flows in namespace.tendrl.objects.ClusterNodeContext.flowsRegistering object namespace.tendrl.objects.ClusterTendrlContextFinding atoms in namespace.tendrl.objects.ClusterTendrlContext.atomsFinding flows in namespace.tendrl.objects.ClusterTendrlContext.flowsRegistering object namespace.tendrl.objects.CpuFinding atoms in namespace.tendrl.objects.Cpu.atomsFinding flows in namespace.tendrl.objects.Cpu.flowsRegistering object namespace.tendrl.objects.DefinitionFinding atoms in namespace.tendrl.objects.Definition.atomsFinding flows in namespace.tendrl.objects.Definition.flowsRegistering object namespace.tendrl.objects.DetectedClusterFinding atoms in namespace.tendrl.objects.DetectedCluster.atomsFinding flows in namespace.tendrl.objects.DetectedCluster.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.JobFinding atoms in namespace.tendrl.objects.Job.atomsFinding flows in namespace.tendrl.objects.Job.flowsRegistering object namespace.tendrl.objects.MemoryFinding atoms in namespace.tendrl.objects.Memory.atomsFinding flows in namespace.tendrl.objects.Memory.flowsRegistering object namespace.tendrl.objects.NodeFinding atoms in namespace.tendrl.objects.Node.atomsRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CheckNodeUpRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CmdRegistering atom namespace.tendrl.objects.Node.atoms.IsNodeTendrlManagedFinding flows in namespace.tendrl.objects.Node.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.ten | |
| Oct 06 12:02:56 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: drl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NodeAlertFinding atoms in namespace.tendrl.objects.NodeAlert.atomsFinding flows in namespace.tendrl.objects.NodeAlert.flowsRegistering object namespace.tendrl.objects.NodeContextFinding atoms in namespace.tendrl.objects.NodeContext.atomsFinding flows in namespace.tendrl.objects.NodeContext.flowsRegistering object namespace.tendrl.objects.NodeNetworkFinding atoms in namespace.tendrl.objects.NodeNetwork.atomsFinding flows in namespace.tendrl.objects.NodeNetwork.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NotificationOnlyAlertFinding atoms in namespace.tendrl.objects.NotificationOnlyAlert.atomsFinding flows in namespace.tendrl.objects.NotificationOnlyAlert.flowsRegistering object namespace.tendrl.objects.OsFinding atoms in namespace.tendrl.objects.Os.atomsFinding flows in namespace.tendrl.objects.Os.flowsRegistering object namespace.tendrl.objects.PlatformFinding atoms in namespace.tendrl.objects.Platform.atomsFinding flows in namespace.tendrl.objects.Platform.flowsRegistering object namespace.tendrl.objects.ServiceFinding atoms in namespace.tendrl.objects.Service.atomsRegistering atom namespace.tendrl.objects.Service.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Service.atoms.CheckServiceStatusFinding flows in namespace.tendrl.objects.Service.flowsRegistering object namespace.tendrl.objects.TendrlContextFinding atoms in namespace.tendrl.objects.TendrlContext.atomsFinding flows in namespace.tendrl.objects.TendrlContext.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.VirtualDiskFinding atoms in namespace.tendrl.objects.VirtualDisk.atomsFinding flows in namespace.tendrl.objects.VirtualDisk.flowsFinding flows in namespace.tendrl.flowsRe | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: gistering flow namespace.tendrl.flows.AuthorizeSshKeyRegistering flow namespace.tendrl.flows.CreateClusterRegistering flow namespace.tendrl.flows.ExpandClusterRegistering flow namespace.tendrl.flows.ImportClusterRegistering flow namespace.tendrl.flows.SetupSshSetup Tendrl definitions (.yml)for namespace.tendrlValidating registered (.py) flows in namespace.tendrl.flowsValidating defined (.yml) flows in namespace.tendrl.flowsValidating registered (.py) objects in namespace.tendrl.objectsValidating defined (.yml) objects in namespace.tendrl.objectsSetup NodeContext for namespace.tendrlLoad definitions (.yml) for namespace.tendrl.objects.NodeContextmessage: Registered Node (4a4a971a-b3ce-4ba1-821c-ff36077f727f)Starting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-age[6039]: Starting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: Unexpected request failure, re-raising. | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: Traceback (most recent call last): | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: params=params, timeout=timeout) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: preload_content=False) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: **urlopen_kw) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: body=body, headers=headers) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: self._validate_conn(conn) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: conn.connect() | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: _context=self) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-age[6039]: Unexpected request failure, re-raising. | |
| Traceback (most recent call last): | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| params=params, timeout=timeout) | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| preload_content=False) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| return self.urlopen(method, url, **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| response = conn.urlopen(method, u.request_uri, **kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| body=body, headers=headers) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| self._validate_conn(conn) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| conn.connect() | |
| File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| ssl_version=resolved_ssl_version) | |
| File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| return context.wrap_socket(sock, server_hostname=server_hostname) | |
| File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| _context=self) | |
| TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: Traceback (most recent call last): | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/bin/tendrl-node-agent", line 9, in <module> | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: load_entry_point('tendrl-node-agent==1.5.2', 'console_scripts', 'tendrl-node-agent')() | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/tendrl/node_agent/manager/__init__.py", line 42, in main | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: TendrlNS() | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 45, in __init__ | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: self.setup_common_objects() | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 297, in setup_common_objects | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: self.current_ns.objects.NodeContext() | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/tendrl/commons/objects/node_context/__init__.py", line 34, in __init__ | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: self.node_id).value | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 597, in read | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: timeout=timeout) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: params=params, timeout=timeout) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: preload_content=False) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: **urlopen_kw) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: body=body, headers=headers) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: self._validate_conn(conn) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: conn.connect() | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: _context=self) | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6039]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service: main process exited, code=exited, status=1/FAILURE | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com systemd[1]: Unit tendrl-node-agent.service entered failed state. | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service failed. | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service holdoff time over, scheduling restart. | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com systemd[1]: Started A python agent local to every managed storage node in the sds cluster. | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com systemd[1]: Starting A python agent local to every managed storage node in the sds cluster... | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: Creating namespace.node_agent from source tendrl.node_agentnamespace.node_agent created!Finding objects in namespace.node_agent.objectsRegistering object namespace.node_agent.objects.ClusterAlertCountersFinding atoms in namespace.node_agent.objects.ClusterAlertCounters.atomsFinding flows in namespace.node_agent.objects.ClusterAlertCounters.flowsRegistering object namespace.node_agent.objects.ClusterMessageFinding atoms in namespace.node_agent.objects.ClusterMessage.atomsFinding flows in namespace.node_agent.objects.ClusterMessage.flowsRegistering object namespace.node_agent.objects.CompiledDefinitionsFinding atoms in namespace.node_agent.objects.CompiledDefinitions.atomsFinding flows in namespace.node_agent.objects.CompiledDefinitions.flowsRegistering object namespace.node_agent.objects.ConfigFinding atoms in namespace.node_agent.objects.Config.atomsFinding flows in namespace.node_agent.objects.Config.flowsRegistering object namespace.node_agent.objects.DefinitionFinding atoms in namespace.node_agent.objects.Definition.atomsFinding flows in namespace.node_agent.objects.Definition.flowsRegistering object namespace.node_agent.objects.GlobalNetworkFinding atoms in namespace.node_agent.objects.GlobalNetwork.atomsFinding flows in namespace.node_agent.objects.GlobalNetwork.flowsRegistering object namespace.node_agent.objects.MessageFinding atoms in namespace.node_agent.objects.Message.atomsFinding flows in namespace.node_agent.objects.Message.flowsRegistering object namespace.node_agent.objects.NodeAlertCountersFinding atoms in namespace.node_agent.objects.NodeAlertCounters.atomsFinding flows in namespace.node_agent.objects.NodeAlertCounters.flowsRegistering object namespace.node_agent.objects.NodeMessageFinding atoms in namespace.node_agent.objects.NodeMessage.atomsFinding flows in namespace.node_agent.objects.NodeMessage.flowsRegistering object namespace.node_agent.objects.NotificationMessageFinding atoms in namespace.node_agent.objects.NotificationMessage.atomsFinding flows in namespace.node_agent.objects.Notificati | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: onMessage.flowsFinding flows in namespace.node_agent.flowsRegistering flow namespace.node_agent.flows.GenerateJournalMappingSetup Tendrl definitions (.yml)for namespace.node_agentValidating registered (.py) flows in namespace.node_agent.flowsValidating defined (.yml) flows in namespace.node_agent.flowsValidating registered (.py) objects in namespace.node_agent.objectsValidating defined (.yml) objects in namespace.node_agent.objectsSetup Config for namespace.node_agentSetup central store clients for namespace.node_agentCreating namespace.tendrl from source tendrl.commonsnamespace.tendrl created!Finding objects in namespace.tendrl.objectsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.BlockDeviceFinding atoms in namespace.tendrl.objects.BlockDevice.atomsFinding flows in namespace.tendrl.objects.BlockDevice.flowsRegistering object namespace.tendrl.objects.ClusterFinding atoms in namespace.tendrl.objects.Cluster.atomsRegistering atom namespace.tendrl.objects.Cluster.atoms.CheckClusterAvailableRegistering atom namespace.tendrl.objects.Cluster.atoms.ConfigureMonitoringRegistering atom namespace.tendrl.objects.Cluster.atoms.CreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportCreatedClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.IntimateImportRegistering atom namespace.tendrl.objects.Cluster.atoms.PersistClusterDetailsAfterCreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidCreateClusterParamsRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidImportClusterParamsFinding flows in namespace.tendrl.objects.Cluster.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.ClusterAlertFinding atoms in namespace. | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: tendrl.objects.ClusterAlert.atomsFinding flows in namespace.tendrl.objects.ClusterAlert.flowsRegistering object namespace.tendrl.objects.ClusterNodeContextFinding atoms in namespace.tendrl.objects.ClusterNodeContext.atomsFinding flows in namespace.tendrl.objects.ClusterNodeContext.flowsRegistering object namespace.tendrl.objects.ClusterTendrlContextFinding atoms in namespace.tendrl.objects.ClusterTendrlContext.atomsFinding flows in namespace.tendrl.objects.ClusterTendrlContext.flowsRegistering object namespace.tendrl.objects.CpuFinding atoms in namespace.tendrl.objects.Cpu.atomsFinding flows in namespace.tendrl.objects.Cpu.flowsRegistering object namespace.tendrl.objects.DefinitionFinding atoms in namespace.tendrl.objects.Definition.atomsFinding flows in namespace.tendrl.objects.Definition.flowsRegistering object namespace.tendrl.objects.DetectedClusterFinding atoms in namespace.tendrl.objects.DetectedCluster.atomsFinding flows in namespace.tendrl.objects.DetectedCluster.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.JobFinding atoms in namespace.tendrl.objects.Job.atomsFinding flows in namespace.tendrl.objects.Job.flowsRegistering object namespace.tendrl.objects.MemoryFinding atoms in namespace.tendrl.objects.Memory.atomsFinding flows in namespace.tendrl.objects.Memory.flowsRegistering object namespace.tendrl.objects.NodeFinding atoms in namespace.tendrl.objects.Node.atomsRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CheckNodeUpRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CmdRegistering atom namespace.tendrl.objects.Node.atoms.IsNodeTendrlManagedFinding flows in namespace.tendrl.objects.Node.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.ten | |
| Oct 06 12:02:57 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: drl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NodeAlertFinding atoms in namespace.tendrl.objects.NodeAlert.atomsFinding flows in namespace.tendrl.objects.NodeAlert.flowsRegistering object namespace.tendrl.objects.NodeContextFinding atoms in namespace.tendrl.objects.NodeContext.atomsFinding flows in namespace.tendrl.objects.NodeContext.flowsRegistering object namespace.tendrl.objects.NodeNetworkFinding atoms in namespace.tendrl.objects.NodeNetwork.atomsFinding flows in namespace.tendrl.objects.NodeNetwork.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NotificationOnlyAlertFinding atoms in namespace.tendrl.objects.NotificationOnlyAlert.atomsFinding flows in namespace.tendrl.objects.NotificationOnlyAlert.flowsRegistering object namespace.tendrl.objects.OsFinding atoms in namespace.tendrl.objects.Os.atomsFinding flows in namespace.tendrl.objects.Os.flowsRegistering object namespace.tendrl.objects.PlatformFinding atoms in namespace.tendrl.objects.Platform.atomsFinding flows in namespace.tendrl.objects.Platform.flowsRegistering object namespace.tendrl.objects.ServiceFinding atoms in namespace.tendrl.objects.Service.atomsRegistering atom namespace.tendrl.objects.Service.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Service.atoms.CheckServiceStatusFinding flows in namespace.tendrl.objects.Service.flowsRegistering object namespace.tendrl.objects.TendrlContextFinding atoms in namespace.tendrl.objects.TendrlContext.atomsFinding flows in namespace.tendrl.objects.TendrlContext.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.VirtualDiskFinding atoms in namespace.tendrl.objects.VirtualDisk.atomsFinding flows in namespace.tendrl.objects.VirtualDisk.flowsFinding flows in namespace.tendrl.flowsRe | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: gistering flow namespace.tendrl.flows.AuthorizeSshKeyRegistering flow namespace.tendrl.flows.CreateClusterRegistering flow namespace.tendrl.flows.ExpandClusterRegistering flow namespace.tendrl.flows.ImportClusterRegistering flow namespace.tendrl.flows.SetupSshSetup Tendrl definitions (.yml)for namespace.tendrlValidating registered (.py) flows in namespace.tendrl.flowsValidating defined (.yml) flows in namespace.tendrl.flowsValidating registered (.py) objects in namespace.tendrl.objectsValidating defined (.yml) objects in namespace.tendrl.objectsSetup NodeContext for namespace.tendrlLoad definitions (.yml) for namespace.tendrl.objects.NodeContextStarting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-age[6116]: Starting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-age[6116]: Unexpected request failure, re-raising. | |
| Traceback (most recent call last): | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| params=params, timeout=timeout) | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| preload_content=False) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| return self.urlopen(method, url, **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| response = conn.urlopen(method, u.request_uri, **kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| body=body, headers=headers) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| self._validate_conn(conn) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| conn.connect() | |
| File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| ssl_version=resolved_ssl_version) | |
| File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| return context.wrap_socket(sock, server_hostname=server_hostname) | |
| File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| _context=self) | |
| TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: Unexpected request failure, re-raising. | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: Traceback (most recent call last): | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: params=params, timeout=timeout) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: preload_content=False) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: **urlopen_kw) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: body=body, headers=headers) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: self._validate_conn(conn) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: conn.connect() | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: _context=self) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: Traceback (most recent call last): | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/bin/tendrl-node-agent", line 9, in <module> | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: load_entry_point('tendrl-node-agent==1.5.2', 'console_scripts', 'tendrl-node-agent')() | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/tendrl/node_agent/manager/__init__.py", line 42, in main | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: TendrlNS() | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 45, in __init__ | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: self.setup_common_objects() | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 297, in setup_common_objects | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: self.current_ns.objects.NodeContext() | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/tendrl/commons/objects/node_context/__init__.py", line 34, in __init__ | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: self.node_id).value | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 597, in read | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: timeout=timeout) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: params=params, timeout=timeout) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: preload_content=False) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: **urlopen_kw) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: body=body, headers=headers) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: self._validate_conn(conn) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: conn.connect() | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: _context=self) | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com tendrl-node-agent[6116]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service: main process exited, code=exited, status=1/FAILURE | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com systemd[1]: Unit tendrl-node-agent.service entered failed state. | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service failed. | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service holdoff time over, scheduling restart. | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com systemd[1]: Started A python agent local to every managed storage node in the sds cluster. | |
| Oct 06 12:02:58 mbukatov-usm1-server.example.com systemd[1]: Starting A python agent local to every managed storage node in the sds cluster... | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: Creating namespace.node_agent from source tendrl.node_agentnamespace.node_agent created!Finding objects in namespace.node_agent.objectsRegistering object namespace.node_agent.objects.ClusterAlertCountersFinding atoms in namespace.node_agent.objects.ClusterAlertCounters.atomsFinding flows in namespace.node_agent.objects.ClusterAlertCounters.flowsRegistering object namespace.node_agent.objects.ClusterMessageFinding atoms in namespace.node_agent.objects.ClusterMessage.atomsFinding flows in namespace.node_agent.objects.ClusterMessage.flowsRegistering object namespace.node_agent.objects.CompiledDefinitionsFinding atoms in namespace.node_agent.objects.CompiledDefinitions.atomsFinding flows in namespace.node_agent.objects.CompiledDefinitions.flowsRegistering object namespace.node_agent.objects.ConfigFinding atoms in namespace.node_agent.objects.Config.atomsFinding flows in namespace.node_agent.objects.Config.flowsRegistering object namespace.node_agent.objects.DefinitionFinding atoms in namespace.node_agent.objects.Definition.atomsFinding flows in namespace.node_agent.objects.Definition.flowsRegistering object namespace.node_agent.objects.GlobalNetworkFinding atoms in namespace.node_agent.objects.GlobalNetwork.atomsFinding flows in namespace.node_agent.objects.GlobalNetwork.flowsRegistering object namespace.node_agent.objects.MessageFinding atoms in namespace.node_agent.objects.Message.atomsFinding flows in namespace.node_agent.objects.Message.flowsRegistering object namespace.node_agent.objects.NodeAlertCountersFinding atoms in namespace.node_agent.objects.NodeAlertCounters.atomsFinding flows in namespace.node_agent.objects.NodeAlertCounters.flowsRegistering object namespace.node_agent.objects.NodeMessageFinding atoms in namespace.node_agent.objects.NodeMessage.atomsFinding flows in namespace.node_agent.objects.NodeMessage.flowsRegistering object namespace.node_agent.objects.NotificationMessageFinding atoms in namespace.node_agent.objects.NotificationMessage.atomsFinding flows in namespace.node_agent.objects.Notificati | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: onMessage.flowsFinding flows in namespace.node_agent.flowsRegistering flow namespace.node_agent.flows.GenerateJournalMappingSetup Tendrl definitions (.yml)for namespace.node_agentValidating registered (.py) flows in namespace.node_agent.flowsValidating defined (.yml) flows in namespace.node_agent.flowsValidating registered (.py) objects in namespace.node_agent.objectsValidating defined (.yml) objects in namespace.node_agent.objectsSetup Config for namespace.node_agentSetup central store clients for namespace.node_agentCreating namespace.tendrl from source tendrl.commonsnamespace.tendrl created!Finding objects in namespace.tendrl.objectsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.BlockDeviceFinding atoms in namespace.tendrl.objects.BlockDevice.atomsFinding flows in namespace.tendrl.objects.BlockDevice.flowsRegistering object namespace.tendrl.objects.ClusterFinding atoms in namespace.tendrl.objects.Cluster.atomsRegistering atom namespace.tendrl.objects.Cluster.atoms.CheckClusterAvailableRegistering atom namespace.tendrl.objects.Cluster.atoms.ConfigureMonitoringRegistering atom namespace.tendrl.objects.Cluster.atoms.CreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportCreatedClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.IntimateImportRegistering atom namespace.tendrl.objects.Cluster.atoms.PersistClusterDetailsAfterCreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidCreateClusterParamsRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidImportClusterParamsFinding flows in namespace.tendrl.objects.Cluster.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.ClusterAlertFinding atoms in namespace. | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: tendrl.objects.ClusterAlert.atomsFinding flows in namespace.tendrl.objects.ClusterAlert.flowsRegistering object namespace.tendrl.objects.ClusterNodeContextFinding atoms in namespace.tendrl.objects.ClusterNodeContext.atomsFinding flows in namespace.tendrl.objects.ClusterNodeContext.flowsRegistering object namespace.tendrl.objects.ClusterTendrlContextFinding atoms in namespace.tendrl.objects.ClusterTendrlContext.atomsFinding flows in namespace.tendrl.objects.ClusterTendrlContext.flowsRegistering object namespace.tendrl.objects.CpuFinding atoms in namespace.tendrl.objects.Cpu.atomsFinding flows in namespace.tendrl.objects.Cpu.flowsRegistering object namespace.tendrl.objects.DefinitionFinding atoms in namespace.tendrl.objects.Definition.atomsFinding flows in namespace.tendrl.objects.Definition.flowsRegistering object namespace.tendrl.objects.DetectedClusterFinding atoms in namespace.tendrl.objects.DetectedCluster.atomsFinding flows in namespace.tendrl.objects.DetectedCluster.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.JobFinding atoms in namespace.tendrl.objects.Job.atomsFinding flows in namespace.tendrl.objects.Job.flowsRegistering object namespace.tendrl.objects.MemoryFinding atoms in namespace.tendrl.objects.Memory.atomsFinding flows in namespace.tendrl.objects.Memory.flowsRegistering object namespace.tendrl.objects.NodeFinding atoms in namespace.tendrl.objects.Node.atomsRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CheckNodeUpRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CmdRegistering atom namespace.tendrl.objects.Node.atoms.IsNodeTendrlManagedFinding flows in namespace.tendrl.objects.Node.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.ten | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: drl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NodeAlertFinding atoms in namespace.tendrl.objects.NodeAlert.atomsFinding flows in namespace.tendrl.objects.NodeAlert.flowsRegistering object namespace.tendrl.objects.NodeContextFinding atoms in namespace.tendrl.objects.NodeContext.atomsFinding flows in namespace.tendrl.objects.NodeContext.flowsRegistering object namespace.tendrl.objects.NodeNetworkFinding atoms in namespace.tendrl.objects.NodeNetwork.atomsFinding flows in namespace.tendrl.objects.NodeNetwork.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NotificationOnlyAlertFinding atoms in namespace.tendrl.objects.NotificationOnlyAlert.atomsFinding flows in namespace.tendrl.objects.NotificationOnlyAlert.flowsRegistering object namespace.tendrl.objects.OsFinding atoms in namespace.tendrl.objects.Os.atomsFinding flows in namespace.tendrl.objects.Os.flowsRegistering object namespace.tendrl.objects.PlatformFinding atoms in namespace.tendrl.objects.Platform.atomsFinding flows in namespace.tendrl.objects.Platform.flowsRegistering object namespace.tendrl.objects.ServiceFinding atoms in namespace.tendrl.objects.Service.atomsRegistering atom namespace.tendrl.objects.Service.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Service.atoms.CheckServiceStatusFinding flows in namespace.tendrl.objects.Service.flowsRegistering object namespace.tendrl.objects.TendrlContextFinding atoms in namespace.tendrl.objects.TendrlContext.atomsFinding flows in namespace.tendrl.objects.TendrlContext.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.VirtualDiskFinding atoms in namespace.tendrl.objects.VirtualDisk.atomsFinding flows in namespace.tendrl.objects.VirtualDisk.flowsFinding flows in namespace.tendrl.flowsRe | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: gistering flow namespace.tendrl.flows.AuthorizeSshKeyRegistering flow namespace.tendrl.flows.CreateClusterRegistering flow namespace.tendrl.flows.ExpandClusterRegistering flow namespace.tendrl.flows.ImportClusterRegistering flow namespace.tendrl.flows.SetupSshSetup Tendrl definitions (.yml)for namespace.tendrlValidating registered (.py) flows in namespace.tendrl.flowsValidating defined (.yml) flows in namespace.tendrl.flowsValidating registered (.py) objects in namespace.tendrl.objectsValidating defined (.yml) objects in namespace.tendrl.objectsSetup NodeContext for namespace.tendrlLoad definitions (.yml) for namespace.tendrl.objects.NodeContextStarting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-age[6128]: Starting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-age[6128]: Unexpected request failure, re-raising. | |
| Traceback (most recent call last): | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| params=params, timeout=timeout) | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| preload_content=False) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| return self.urlopen(method, url, **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| response = conn.urlopen(method, u.request_uri, **kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| body=body, headers=headers) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| self._validate_conn(conn) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| conn.connect() | |
| File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| ssl_version=resolved_ssl_version) | |
| File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| return context.wrap_socket(sock, server_hostname=server_hostname) | |
| File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| _context=self) | |
| TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: Unexpected request failure, re-raising. | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: Traceback (most recent call last): | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: params=params, timeout=timeout) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: preload_content=False) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: **urlopen_kw) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: body=body, headers=headers) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: self._validate_conn(conn) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: conn.connect() | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: _context=self) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: Traceback (most recent call last): | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/bin/tendrl-node-agent", line 9, in <module> | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: load_entry_point('tendrl-node-agent==1.5.2', 'console_scripts', 'tendrl-node-agent')() | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/tendrl/node_agent/manager/__init__.py", line 42, in main | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: TendrlNS() | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 45, in __init__ | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: self.setup_common_objects() | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 297, in setup_common_objects | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: self.current_ns.objects.NodeContext() | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/tendrl/commons/objects/node_context/__init__.py", line 34, in __init__ | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: self.node_id).value | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 597, in read | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: timeout=timeout) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: params=params, timeout=timeout) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: preload_content=False) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: **urlopen_kw) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: body=body, headers=headers) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: self._validate_conn(conn) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: conn.connect() | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: _context=self) | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com tendrl-node-agent[6128]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service: main process exited, code=exited, status=1/FAILURE | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com systemd[1]: Unit tendrl-node-agent.service entered failed state. | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service failed. | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service holdoff time over, scheduling restart. | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com systemd[1]: Started A python agent local to every managed storage node in the sds cluster. | |
| Oct 06 12:02:59 mbukatov-usm1-server.example.com systemd[1]: Starting A python agent local to every managed storage node in the sds cluster... | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: Creating namespace.node_agent from source tendrl.node_agentnamespace.node_agent created!Finding objects in namespace.node_agent.objectsRegistering object namespace.node_agent.objects.ClusterAlertCountersFinding atoms in namespace.node_agent.objects.ClusterAlertCounters.atomsFinding flows in namespace.node_agent.objects.ClusterAlertCounters.flowsRegistering object namespace.node_agent.objects.ClusterMessageFinding atoms in namespace.node_agent.objects.ClusterMessage.atomsFinding flows in namespace.node_agent.objects.ClusterMessage.flowsRegistering object namespace.node_agent.objects.CompiledDefinitionsFinding atoms in namespace.node_agent.objects.CompiledDefinitions.atomsFinding flows in namespace.node_agent.objects.CompiledDefinitions.flowsRegistering object namespace.node_agent.objects.ConfigFinding atoms in namespace.node_agent.objects.Config.atomsFinding flows in namespace.node_agent.objects.Config.flowsRegistering object namespace.node_agent.objects.DefinitionFinding atoms in namespace.node_agent.objects.Definition.atomsFinding flows in namespace.node_agent.objects.Definition.flowsRegistering object namespace.node_agent.objects.GlobalNetworkFinding atoms in namespace.node_agent.objects.GlobalNetwork.atomsFinding flows in namespace.node_agent.objects.GlobalNetwork.flowsRegistering object namespace.node_agent.objects.MessageFinding atoms in namespace.node_agent.objects.Message.atomsFinding flows in namespace.node_agent.objects.Message.flowsRegistering object namespace.node_agent.objects.NodeAlertCountersFinding atoms in namespace.node_agent.objects.NodeAlertCounters.atomsFinding flows in namespace.node_agent.objects.NodeAlertCounters.flowsRegistering object namespace.node_agent.objects.NodeMessageFinding atoms in namespace.node_agent.objects.NodeMessage.atomsFinding flows in namespace.node_agent.objects.NodeMessage.flowsRegistering object namespace.node_agent.objects.NotificationMessageFinding atoms in namespace.node_agent.objects.NotificationMessage.atomsFinding flows in namespace.node_agent.objects.Notificati | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: onMessage.flowsFinding flows in namespace.node_agent.flowsRegistering flow namespace.node_agent.flows.GenerateJournalMappingSetup Tendrl definitions (.yml)for namespace.node_agentValidating registered (.py) flows in namespace.node_agent.flowsValidating defined (.yml) flows in namespace.node_agent.flowsValidating registered (.py) objects in namespace.node_agent.objectsValidating defined (.yml) objects in namespace.node_agent.objectsSetup Config for namespace.node_agentSetup central store clients for namespace.node_agentCreating namespace.tendrl from source tendrl.commonsnamespace.tendrl created!Finding objects in namespace.tendrl.objectsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.BlockDeviceFinding atoms in namespace.tendrl.objects.BlockDevice.atomsFinding flows in namespace.tendrl.objects.BlockDevice.flowsRegistering object namespace.tendrl.objects.ClusterFinding atoms in namespace.tendrl.objects.Cluster.atomsRegistering atom namespace.tendrl.objects.Cluster.atoms.CheckClusterAvailableRegistering atom namespace.tendrl.objects.Cluster.atoms.ConfigureMonitoringRegistering atom namespace.tendrl.objects.Cluster.atoms.CreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportCreatedClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.IntimateImportRegistering atom namespace.tendrl.objects.Cluster.atoms.PersistClusterDetailsAfterCreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidCreateClusterParamsRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidImportClusterParamsFinding flows in namespace.tendrl.objects.Cluster.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.ClusterAlertFinding atoms in namespace. | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: tendrl.objects.ClusterAlert.atomsFinding flows in namespace.tendrl.objects.ClusterAlert.flowsRegistering object namespace.tendrl.objects.ClusterNodeContextFinding atoms in namespace.tendrl.objects.ClusterNodeContext.atomsFinding flows in namespace.tendrl.objects.ClusterNodeContext.flowsRegistering object namespace.tendrl.objects.ClusterTendrlContextFinding atoms in namespace.tendrl.objects.ClusterTendrlContext.atomsFinding flows in namespace.tendrl.objects.ClusterTendrlContext.flowsRegistering object namespace.tendrl.objects.CpuFinding atoms in namespace.tendrl.objects.Cpu.atomsFinding flows in namespace.tendrl.objects.Cpu.flowsRegistering object namespace.tendrl.objects.DefinitionFinding atoms in namespace.tendrl.objects.Definition.atomsFinding flows in namespace.tendrl.objects.Definition.flowsRegistering object namespace.tendrl.objects.DetectedClusterFinding atoms in namespace.tendrl.objects.DetectedCluster.atomsFinding flows in namespace.tendrl.objects.DetectedCluster.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.JobFinding atoms in namespace.tendrl.objects.Job.atomsFinding flows in namespace.tendrl.objects.Job.flowsRegistering object namespace.tendrl.objects.MemoryFinding atoms in namespace.tendrl.objects.Memory.atomsFinding flows in namespace.tendrl.objects.Memory.flowsRegistering object namespace.tendrl.objects.NodeFinding atoms in namespace.tendrl.objects.Node.atomsRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CheckNodeUpRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CmdRegistering atom namespace.tendrl.objects.Node.atoms.IsNodeTendrlManagedFinding flows in namespace.tendrl.objects.Node.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.ten | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: drl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NodeAlertFinding atoms in namespace.tendrl.objects.NodeAlert.atomsFinding flows in namespace.tendrl.objects.NodeAlert.flowsRegistering object namespace.tendrl.objects.NodeContextFinding atoms in namespace.tendrl.objects.NodeContext.atomsFinding flows in namespace.tendrl.objects.NodeContext.flowsRegistering object namespace.tendrl.objects.NodeNetworkFinding atoms in namespace.tendrl.objects.NodeNetwork.atomsFinding flows in namespace.tendrl.objects.NodeNetwork.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NotificationOnlyAlertFinding atoms in namespace.tendrl.objects.NotificationOnlyAlert.atomsFinding flows in namespace.tendrl.objects.NotificationOnlyAlert.flowsRegistering object namespace.tendrl.objects.OsFinding atoms in namespace.tendrl.objects.Os.atomsFinding flows in namespace.tendrl.objects.Os.flowsRegistering object namespace.tendrl.objects.PlatformFinding atoms in namespace.tendrl.objects.Platform.atomsFinding flows in namespace.tendrl.objects.Platform.flowsRegistering object namespace.tendrl.objects.ServiceFinding atoms in namespace.tendrl.objects.Service.atomsRegistering atom namespace.tendrl.objects.Service.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Service.atoms.CheckServiceStatusFinding flows in namespace.tendrl.objects.Service.flowsRegistering object namespace.tendrl.objects.TendrlContextFinding atoms in namespace.tendrl.objects.TendrlContext.atomsFinding flows in namespace.tendrl.objects.TendrlContext.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.VirtualDiskFinding atoms in namespace.tendrl.objects.VirtualDisk.atomsFinding flows in namespace.tendrl.objects.VirtualDisk.flowsFinding flows in namespace.tendrl.flowsRe | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: gistering flow namespace.tendrl.flows.AuthorizeSshKeyRegistering flow namespace.tendrl.flows.CreateClusterRegistering flow namespace.tendrl.flows.ExpandClusterRegistering flow namespace.tendrl.flows.ImportClusterRegistering flow namespace.tendrl.flows.SetupSshSetup Tendrl definitions (.yml)for namespace.tendrlValidating registered (.py) flows in namespace.tendrl.flowsValidating defined (.yml) flows in namespace.tendrl.flowsValidating registered (.py) objects in namespace.tendrl.objectsValidating defined (.yml) objects in namespace.tendrl.objectsSetup NodeContext for namespace.tendrlLoad definitions (.yml) for namespace.tendrl.objects.NodeContextStarting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-age[6140]: Starting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: Unexpected request failure, re-raising. | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: Traceback (most recent call last): | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: params=params, timeout=timeout) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: preload_content=False) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: **urlopen_kw) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: body=body, headers=headers) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: self._validate_conn(conn) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: conn.connect() | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: _context=self) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-age[6140]: Unexpected request failure, re-raising. | |
| Traceback (most recent call last): | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| params=params, timeout=timeout) | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| preload_content=False) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| return self.urlopen(method, url, **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| response = conn.urlopen(method, u.request_uri, **kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| body=body, headers=headers) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| self._validate_conn(conn) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| conn.connect() | |
| File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| ssl_version=resolved_ssl_version) | |
| File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| return context.wrap_socket(sock, server_hostname=server_hostname) | |
| File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| _context=self) | |
| TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: Traceback (most recent call last): | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/bin/tendrl-node-agent", line 9, in <module> | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: load_entry_point('tendrl-node-agent==1.5.2', 'console_scripts', 'tendrl-node-agent')() | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/tendrl/node_agent/manager/__init__.py", line 42, in main | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: TendrlNS() | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 45, in __init__ | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: self.setup_common_objects() | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 297, in setup_common_objects | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: self.current_ns.objects.NodeContext() | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/tendrl/commons/objects/node_context/__init__.py", line 34, in __init__ | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: self.node_id).value | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 597, in read | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: timeout=timeout) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: params=params, timeout=timeout) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: preload_content=False) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: **urlopen_kw) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: body=body, headers=headers) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: self._validate_conn(conn) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: conn.connect() | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: _context=self) | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com tendrl-node-agent[6140]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service: main process exited, code=exited, status=1/FAILURE | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com systemd[1]: Unit tendrl-node-agent.service entered failed state. | |
| Oct 06 12:03:00 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service failed. | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service holdoff time over, scheduling restart. | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com systemd[1]: Started A python agent local to every managed storage node in the sds cluster. | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com systemd[1]: Starting A python agent local to every managed storage node in the sds cluster... | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: Creating namespace.node_agent from source tendrl.node_agentnamespace.node_agent created!Finding objects in namespace.node_agent.objectsRegistering object namespace.node_agent.objects.ClusterAlertCountersFinding atoms in namespace.node_agent.objects.ClusterAlertCounters.atomsFinding flows in namespace.node_agent.objects.ClusterAlertCounters.flowsRegistering object namespace.node_agent.objects.ClusterMessageFinding atoms in namespace.node_agent.objects.ClusterMessage.atomsFinding flows in namespace.node_agent.objects.ClusterMessage.flowsRegistering object namespace.node_agent.objects.CompiledDefinitionsFinding atoms in namespace.node_agent.objects.CompiledDefinitions.atomsFinding flows in namespace.node_agent.objects.CompiledDefinitions.flowsRegistering object namespace.node_agent.objects.ConfigFinding atoms in namespace.node_agent.objects.Config.atomsFinding flows in namespace.node_agent.objects.Config.flowsRegistering object namespace.node_agent.objects.DefinitionFinding atoms in namespace.node_agent.objects.Definition.atomsFinding flows in namespace.node_agent.objects.Definition.flowsRegistering object namespace.node_agent.objects.GlobalNetworkFinding atoms in namespace.node_agent.objects.GlobalNetwork.atomsFinding flows in namespace.node_agent.objects.GlobalNetwork.flowsRegistering object namespace.node_agent.objects.MessageFinding atoms in namespace.node_agent.objects.Message.atomsFinding flows in namespace.node_agent.objects.Message.flowsRegistering object namespace.node_agent.objects.NodeAlertCountersFinding atoms in namespace.node_agent.objects.NodeAlertCounters.atomsFinding flows in namespace.node_agent.objects.NodeAlertCounters.flowsRegistering object namespace.node_agent.objects.NodeMessageFinding atoms in namespace.node_agent.objects.NodeMessage.atomsFinding flows in namespace.node_agent.objects.NodeMessage.flowsRegistering object namespace.node_agent.objects.NotificationMessageFinding atoms in namespace.node_agent.objects.NotificationMessage.atomsFinding flows in namespace.node_agent.objects.Notificati | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: onMessage.flowsFinding flows in namespace.node_agent.flowsRegistering flow namespace.node_agent.flows.GenerateJournalMappingSetup Tendrl definitions (.yml)for namespace.node_agentValidating registered (.py) flows in namespace.node_agent.flowsValidating defined (.yml) flows in namespace.node_agent.flowsValidating registered (.py) objects in namespace.node_agent.objectsValidating defined (.yml) objects in namespace.node_agent.objectsSetup Config for namespace.node_agentSetup central store clients for namespace.node_agentCreating namespace.tendrl from source tendrl.commonsnamespace.tendrl created!Finding objects in namespace.tendrl.objectsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.BlockDeviceFinding atoms in namespace.tendrl.objects.BlockDevice.atomsFinding flows in namespace.tendrl.objects.BlockDevice.flowsRegistering object namespace.tendrl.objects.ClusterFinding atoms in namespace.tendrl.objects.Cluster.atomsRegistering atom namespace.tendrl.objects.Cluster.atoms.CheckClusterAvailableRegistering atom namespace.tendrl.objects.Cluster.atoms.ConfigureMonitoringRegistering atom namespace.tendrl.objects.Cluster.atoms.CreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportCreatedClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.IntimateImportRegistering atom namespace.tendrl.objects.Cluster.atoms.PersistClusterDetailsAfterCreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidCreateClusterParamsRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidImportClusterParamsFinding flows in namespace.tendrl.objects.Cluster.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.ClusterAlertFinding atoms in namespace. | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: tendrl.objects.ClusterAlert.atomsFinding flows in namespace.tendrl.objects.ClusterAlert.flowsRegistering object namespace.tendrl.objects.ClusterNodeContextFinding atoms in namespace.tendrl.objects.ClusterNodeContext.atomsFinding flows in namespace.tendrl.objects.ClusterNodeContext.flowsRegistering object namespace.tendrl.objects.ClusterTendrlContextFinding atoms in namespace.tendrl.objects.ClusterTendrlContext.atomsFinding flows in namespace.tendrl.objects.ClusterTendrlContext.flowsRegistering object namespace.tendrl.objects.CpuFinding atoms in namespace.tendrl.objects.Cpu.atomsFinding flows in namespace.tendrl.objects.Cpu.flowsRegistering object namespace.tendrl.objects.DefinitionFinding atoms in namespace.tendrl.objects.Definition.atomsFinding flows in namespace.tendrl.objects.Definition.flowsRegistering object namespace.tendrl.objects.DetectedClusterFinding atoms in namespace.tendrl.objects.DetectedCluster.atomsFinding flows in namespace.tendrl.objects.DetectedCluster.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.JobFinding atoms in namespace.tendrl.objects.Job.atomsFinding flows in namespace.tendrl.objects.Job.flowsRegistering object namespace.tendrl.objects.MemoryFinding atoms in namespace.tendrl.objects.Memory.atomsFinding flows in namespace.tendrl.objects.Memory.flowsRegistering object namespace.tendrl.objects.NodeFinding atoms in namespace.tendrl.objects.Node.atomsRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CheckNodeUpRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CmdRegistering atom namespace.tendrl.objects.Node.atoms.IsNodeTendrlManagedFinding flows in namespace.tendrl.objects.Node.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.ten | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: drl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NodeAlertFinding atoms in namespace.tendrl.objects.NodeAlert.atomsFinding flows in namespace.tendrl.objects.NodeAlert.flowsRegistering object namespace.tendrl.objects.NodeContextFinding atoms in namespace.tendrl.objects.NodeContext.atomsFinding flows in namespace.tendrl.objects.NodeContext.flowsRegistering object namespace.tendrl.objects.NodeNetworkFinding atoms in namespace.tendrl.objects.NodeNetwork.atomsFinding flows in namespace.tendrl.objects.NodeNetwork.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NotificationOnlyAlertFinding atoms in namespace.tendrl.objects.NotificationOnlyAlert.atomsFinding flows in namespace.tendrl.objects.NotificationOnlyAlert.flowsRegistering object namespace.tendrl.objects.OsFinding atoms in namespace.tendrl.objects.Os.atomsFinding flows in namespace.tendrl.objects.Os.flowsRegistering object namespace.tendrl.objects.PlatformFinding atoms in namespace.tendrl.objects.Platform.atomsFinding flows in namespace.tendrl.objects.Platform.flowsRegistering object namespace.tendrl.objects.ServiceFinding atoms in namespace.tendrl.objects.Service.atomsRegistering atom namespace.tendrl.objects.Service.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Service.atoms.CheckServiceStatusFinding flows in namespace.tendrl.objects.Service.flowsRegistering object namespace.tendrl.objects.TendrlContextFinding atoms in namespace.tendrl.objects.TendrlContext.atomsFinding flows in namespace.tendrl.objects.TendrlContext.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.VirtualDiskFinding atoms in namespace.tendrl.objects.VirtualDisk.atomsFinding flows in namespace.tendrl.objects.VirtualDisk.flowsFinding flows in namespace.tendrl.flowsRe | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: gistering flow namespace.tendrl.flows.AuthorizeSshKeyRegistering flow namespace.tendrl.flows.CreateClusterRegistering flow namespace.tendrl.flows.ExpandClusterRegistering flow namespace.tendrl.flows.ImportClusterRegistering flow namespace.tendrl.flows.SetupSshSetup Tendrl definitions (.yml)for namespace.tendrlValidating registered (.py) flows in namespace.tendrl.flowsValidating defined (.yml) flows in namespace.tendrl.flowsValidating registered (.py) objects in namespace.tendrl.objectsValidating defined (.yml) objects in namespace.tendrl.objectsSetup NodeContext for namespace.tendrlLoad definitions (.yml) for namespace.tendrl.objects.NodeContextStarting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:03:01 mbukatov-usm1-server.example.com tendrl-node-age[6186]: Starting new HTTPS connection (1): 10.34.108.90 | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-age[6186]: Unexpected request failure, re-raising. | |
| Traceback (most recent call last): | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| params=params, timeout=timeout) | |
| File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| preload_content=False) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| return self.urlopen(method, url, **urlopen_kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| response = conn.urlopen(method, u.request_uri, **kw) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| body=body, headers=headers) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| self._validate_conn(conn) | |
| File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| conn.connect() | |
| File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| ssl_version=resolved_ssl_version) | |
| File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| return context.wrap_socket(sock, server_hostname=server_hostname) | |
| File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| _context=self) | |
| TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: Unexpected request failure, re-raising. | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: Traceback (most recent call last): | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: params=params, timeout=timeout) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: preload_content=False) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: **urlopen_kw) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: body=body, headers=headers) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: self._validate_conn(conn) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: conn.connect() | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: _context=self) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: Traceback (most recent call last): | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/bin/tendrl-node-agent", line 9, in <module> | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: load_entry_point('tendrl-node-agent==1.5.2', 'console_scripts', 'tendrl-node-agent')() | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/tendrl/node_agent/manager/__init__.py", line 42, in main | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: TendrlNS() | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 45, in __init__ | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: self.setup_common_objects() | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 297, in setup_common_objects | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: self.current_ns.objects.NodeContext() | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/tendrl/commons/objects/node_context/__init__.py", line 34, in __init__ | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: self.node_id).value | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 597, in read | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: timeout=timeout) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 855, in wrapper | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: params=params, timeout=timeout) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 923, in api_execute | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: preload_content=False) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 68, in request | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: **urlopen_kw) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/request.py", line 81, in request_encode_url | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: return self.urlopen(method, url, **urlopen_kw) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/poolmanager.py", line 247, in urlopen | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: response = conn.urlopen(method, u.request_uri, **kw) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 544, in urlopen | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: body=body, headers=headers) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 341, in _make_request | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: self._validate_conn(conn) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connectionpool.py", line 762, in _validate_conn | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: conn.connect() | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/connection.py", line 238, in connect | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: ssl_version=resolved_ssl_version) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib/python2.7/site-packages/urllib3/util/ssl_.py", line 256, in ssl_wrap_socket | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: return context.wrap_socket(sock, server_hostname=server_hostname) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: File "/usr/lib64/python2.7/ssl.py", line 350, in wrap_socket | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: _context=self) | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com tendrl-node-agent[6186]: TypeError: __init__() got an unexpected keyword argument 'server_hostname' | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service: main process exited, code=exited, status=1/FAILURE | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: Unit tendrl-node-agent.service entered failed state. | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service failed. | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service holdoff time over, scheduling restart. | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: start request repeated too quickly for tendrl-node-agent.service | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: Failed to start A python agent local to every managed storage node in the sds cluster. | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: Unit tendrl-node-agent.service entered failed state. | |
| Oct 06 12:03:02 mbukatov-usm1-server.example.com systemd[1]: tendrl-node-agent.service failed. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment