Skip to content

Instantly share code, notes, and snippets.

@mbukatov
Created October 11, 2017 11:44
Show Gist options
  • Save mbukatov/5fbe762e691ba7de8ba740b6135c5dc9 to your computer and use it in GitHub Desktop.
Save mbukatov/5fbe762e691ba7de8ba740b6135c5dc9 to your computer and use it in GitHub Desktop.
tendrl-node-agent.journal
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: Starting A python agent local to every managed storage node in the sds cluster...
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: Creating namespace.node_agent from source tendrl.node_agentnamespace.node_agent created!Finding objects in namespace.node_agent.objectsRegistering object namespace.node_agent.objects.ClusterAlertCountersFinding atoms in namespace.node_agent.objects.ClusterAlertCounters.atomsFinding flows in namespace.node_agent.objects.ClusterAlertCounters.flowsRegistering object namespace.node_agent.objects.ClusterMessageFinding atoms in namespace.node_agent.objects.ClusterMessage.atomsFinding flows in namespace.node_agent.objects.ClusterMessage.flowsRegistering object namespace.node_agent.objects.CompiledDefinitionsFinding atoms in namespace.node_agent.objects.CompiledDefinitions.atomsFinding flows in namespace.node_agent.objects.CompiledDefinitions.flowsRegistering object namespace.node_agent.objects.ConfigFinding atoms in namespace.node_agent.objects.Config.atomsFinding flows in namespace.node_agent.objects.Config.flowsRegistering object namespace.node_agent.objects.DefinitionFinding atoms in namespace.node_agent.objects.Definition.atomsFinding flows in namespace.node_agent.objects.Definition.flowsRegistering object namespace.node_agent.objects.GlobalNetworkFinding atoms in namespace.node_agent.objects.GlobalNetwork.atomsFinding flows in namespace.node_agent.objects.GlobalNetwork.flowsRegistering object namespace.node_agent.objects.MessageFinding atoms in namespace.node_agent.objects.Message.atomsFinding flows in namespace.node_agent.objects.Message.flowsRegistering object namespace.node_agent.objects.NodeAlertCountersFinding atoms in namespace.node_agent.objects.NodeAlertCounters.atomsFinding flows in namespace.node_agent.objects.NodeAlertCounters.flowsRegistering object namespace.node_agent.objects.NodeMessageFinding atoms in namespace.node_agent.objects.NodeMessage.atomsFinding flows in namespace.node_agent.objects.NodeMessage.flowsRegistering object namespace.node_agent.objects.NotificationMessageFinding atoms in namespace.node_agent.objects.NotificationMessage.atomsFinding flows in namespace.node_agent.objects.Notificati
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: onMessage.flowsFinding flows in namespace.node_agent.flowsRegistering flow namespace.node_agent.flows.GenerateJournalMappingSetup Tendrl definitions (.yml)for namespace.node_agentValidating registered (.py) flows in namespace.node_agent.flowsValidating defined (.yml) flows in namespace.node_agent.flowsValidating registered (.py) objects in namespace.node_agent.objectsValidating defined (.yml) objects in namespace.node_agent.objectsSetup Config for namespace.node_agentSetup central store clients for namespace.node_agentCreating namespace.tendrl from source tendrl.commonsnamespace.tendrl created!Finding objects in namespace.tendrl.objectsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.BlockDeviceFinding atoms in namespace.tendrl.objects.BlockDevice.atomsFinding flows in namespace.tendrl.objects.BlockDevice.flowsRegistering object namespace.tendrl.objects.ClusterFinding atoms in namespace.tendrl.objects.Cluster.atomsRegistering atom namespace.tendrl.objects.Cluster.atoms.CheckClusterAvailableRegistering atom namespace.tendrl.objects.Cluster.atoms.ConfigureMonitoringRegistering atom namespace.tendrl.objects.Cluster.atoms.CreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.ImportCreatedClusterRegistering atom namespace.tendrl.objects.Cluster.atoms.IntimateImportRegistering atom namespace.tendrl.objects.Cluster.atoms.PersistClusterDetailsAfterCreateRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidCreateClusterParamsRegistering atom namespace.tendrl.objects.Cluster.atoms.ValidImportClusterParamsFinding flows in namespace.tendrl.objects.Cluster.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.ClusterAlertFinding atoms in namespace.
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: tendrl.objects.ClusterAlert.atomsFinding flows in namespace.tendrl.objects.ClusterAlert.flowsRegistering object namespace.tendrl.objects.ClusterNodeContextFinding atoms in namespace.tendrl.objects.ClusterNodeContext.atomsFinding flows in namespace.tendrl.objects.ClusterNodeContext.flowsRegistering object namespace.tendrl.objects.ClusterTendrlContextFinding atoms in namespace.tendrl.objects.ClusterTendrlContext.atomsFinding flows in namespace.tendrl.objects.ClusterTendrlContext.flowsRegistering object namespace.tendrl.objects.CpuFinding atoms in namespace.tendrl.objects.Cpu.atomsFinding flows in namespace.tendrl.objects.Cpu.flowsRegistering object namespace.tendrl.objects.DefinitionFinding atoms in namespace.tendrl.objects.Definition.atomsFinding flows in namespace.tendrl.objects.Definition.flowsRegistering object namespace.tendrl.objects.DetectedClusterFinding atoms in namespace.tendrl.objects.DetectedCluster.atomsFinding flows in namespace.tendrl.objects.DetectedCluster.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.JobFinding atoms in namespace.tendrl.objects.Job.atomsFinding flows in namespace.tendrl.objects.Job.flowsRegistering object namespace.tendrl.objects.MemoryFinding atoms in namespace.tendrl.objects.Memory.atomsFinding flows in namespace.tendrl.objects.Memory.flowsRegistering object namespace.tendrl.objects.NodeFinding atoms in namespace.tendrl.objects.Node.atomsRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CheckNodeUpRegistering atom namespace.tendrl.objects.Node.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Node.atoms.CmdRegistering atom namespace.tendrl.objects.Node.atoms.IsNodeTendrlManagedFinding flows in namespace.tendrl.objects.Node.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.ten
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: drl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NodeAlertFinding atoms in namespace.tendrl.objects.NodeAlert.atomsFinding flows in namespace.tendrl.objects.NodeAlert.flowsRegistering object namespace.tendrl.objects.NodeContextFinding atoms in namespace.tendrl.objects.NodeContext.atomsFinding flows in namespace.tendrl.objects.NodeContext.flowsRegistering object namespace.tendrl.objects.NodeNetworkFinding atoms in namespace.tendrl.objects.NodeNetwork.atomsFinding flows in namespace.tendrl.objects.NodeNetwork.flowsRegistering object namespace.tendrl.objects.AlertFinding atoms in namespace.tendrl.objects.Alert.atomsFinding flows in namespace.tendrl.objects.Alert.flowsRegistering object namespace.tendrl.objects.NotificationOnlyAlertFinding atoms in namespace.tendrl.objects.NotificationOnlyAlert.atomsFinding flows in namespace.tendrl.objects.NotificationOnlyAlert.flowsRegistering object namespace.tendrl.objects.OsFinding atoms in namespace.tendrl.objects.Os.atomsFinding flows in namespace.tendrl.objects.Os.flowsRegistering object namespace.tendrl.objects.PlatformFinding atoms in namespace.tendrl.objects.Platform.atomsFinding flows in namespace.tendrl.objects.Platform.flowsRegistering object namespace.tendrl.objects.ServiceFinding atoms in namespace.tendrl.objects.Service.atomsRegistering atom namespace.tendrl.objects.Service.atoms.BaseAtomRegistering atom namespace.tendrl.objects.Service.atoms.CheckServiceStatusFinding flows in namespace.tendrl.objects.Service.flowsRegistering object namespace.tendrl.objects.TendrlContextFinding atoms in namespace.tendrl.objects.TendrlContext.atomsFinding flows in namespace.tendrl.objects.TendrlContext.flowsRegistering object namespace.tendrl.objects.DiskFinding atoms in namespace.tendrl.objects.Disk.atomsFinding flows in namespace.tendrl.objects.Disk.flowsRegistering object namespace.tendrl.objects.VirtualDiskFinding atoms in namespace.tendrl.objects.VirtualDisk.atomsFinding flows in namespace.tendrl.objects.VirtualDisk.flowsFinding flows in namespace.tendrl.flowsRe
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: gistering flow namespace.tendrl.flows.AuthorizeSshKeyRegistering flow namespace.tendrl.flows.ConfigureMonitoringRegistering flow namespace.tendrl.flows.CreateClusterRegistering flow namespace.tendrl.flows.ExpandClusterRegistering flow namespace.tendrl.flows.ImportClusterRegistering flow namespace.tendrl.flows.SetupSshSetup Tendrl definitions (.yml)for namespace.tendrlValidating registered (.py) flows in namespace.tendrl.flowsValidating defined (.yml) flows in namespace.tendrl.flowsValidating registered (.py) objects in namespace.tendrl.objectsValidating defined (.yml) objects in namespace.tendrl.objectsSetup NodeContext for namespace.tendrlLoad definitions (.yml) for namespace.tendrl.objects.NodeContextStarting new HTTPS connection (1): 10.37.169.90
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-age[5520]: Starting new HTTPS connection (1): 10.37.169.90
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: Request to server https://10.37.169.90:2379 failed: SSLError(CertificateError("hostname '10.37.169.90' doesn't match either of 'mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com', 'mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com'",),)
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-age[5520]: Request to server https://10.37.169.90:2379 failed: SSLError(CertificateError("hostname '10.37.169.90' doesn't match either of 'mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com', 'mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com'",),)
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: Traceback (most recent call last):
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/bin/tendrl-node-agent", line 9, in <module>
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: load_entry_point('tendrl-node-agent==1.5.2', 'console_scripts', 'tendrl-node-agent')()
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/lib/python2.7/site-packages/tendrl/node_agent/manager/__init__.py", line 41, in main
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: TendrlNS()
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 45, in __init__
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: self.setup_common_objects()
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/lib/python2.7/site-packages/tendrl/commons/__init__.py", line 300, in setup_common_objects
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: self.current_ns.objects.NodeContext()
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/lib/python2.7/site-packages/tendrl/commons/objects/node_context/__init__.py", line 34, in __init__
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: self.node_id).value
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 597, in read
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: timeout=timeout)
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: File "/usr/lib/python2.7/site-packages/etcd/client.py", line 893, in wrapper
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: cause=e
Oct 11 11:33:29 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com tendrl-node-agent[5520]: etcd.EtcdConnectionFailed: Connection to etcd failed due to SSLError(CertificateError("hostname '10.37.169.90' doesn't match either of 'mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com', 'mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com'",),)
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: tendrl-node-agent.service: main process exited, code=exited, status=1/FAILURE
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: Unit tendrl-node-agent.service entered failed state.
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: tendrl-node-agent.service failed.
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: tendrl-node-agent.service holdoff time over, scheduling restart.
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: start request repeated too quickly for tendrl-node-agent.service
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: Failed to start A python agent local to every managed storage node in the sds cluster.
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: Unit tendrl-node-agent.service entered failed state.
Oct 11 11:33:30 mbukatov-usm1-server.usmqe.lab.eng.brq.redhat.com systemd[1]: tendrl-node-agent.service failed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment