Skip to content

Instantly share code, notes, and snippets.

@edoatley

edoatley/gist:c04bbcee8aae67e493df51cc8dd7dfa3 Secret

Created August 3, 2022 07:46
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save edoatley/c04bbcee8aae67e493df51cc8dd7dfa3 to your computer and use it in GitHub Desktop.
Save edoatley/c04bbcee8aae67e493df51cc8dd7dfa3 to your computer and use it in GitHub Desktop.
Download ZIP
percona-mongodb-qa-rs0-0-backup-agent.log
Raw
gistfile1.txt
+ '[' pbm-agent = pbm-agent ']'
++ mktemp
+ OUT=/tmp/tmp.Qst8J6VXXR
++ mktemp
+ OUT_CFG=/tmp/tmp.XPLWdvdpYw
+ timeout=5
+ for i in '{1..10}'
+ '[' '' ']'
+ set +o xtrace
2022-08-03T06:50:45.693+0000 I NETWORK [js] Starting new replica set monitor for rs0/localhost:27017
2022-08-03T06:50:45.693+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to localhost:27017
2022-08-03T06:50:45.694+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:45.694+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 1 checks in a row.
2022-08-03T06:50:46.194+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:46.194+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 2 checks in a row.
2022-08-03T06:50:46.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:46.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 3 checks in a row.
2022-08-03T06:50:47.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:47.193+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 4 checks in a row.
2022-08-03T06:50:47.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:47.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 5 checks in a row.
2022-08-03T06:50:48.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:48.193+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 6 checks in a row.
2022-08-03T06:50:48.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:48.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 7 checks in a row.
2022-08-03T06:50:49.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:49.193+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 8 checks in a row.
2022-08-03T06:50:49.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:49.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 9 checks in a row.
2022-08-03T06:50:50.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:50.193+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 10 checks in a row.
2022-08-03T06:50:50.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:50.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 11 checks in a row.
2022-08-03T06:50:51.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:51.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:52.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:52.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:53.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:53.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:54.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:54.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:55.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:55.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:55.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 21 checks in a row.
2022-08-03T06:50:56.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:56.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:57.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:57.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:58.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:58.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:59.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:50:59.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:00.193+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:00.693+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:00.693+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 31 checks in a row.
2022-08-03T06:51:00.693+0000 E QUERY [js] Error: connect failed to replica set rs0/localhost:27017 :
connect@src/mongo/shell/mongo.js:353:17
@(connect):3:6
2022-08-03T06:51:00.695+0000 F - [main] exception: connect failed
2022-08-03T06:51:00.695+0000 E - [main] exiting with code 1
+ exit_status=0
++ grep -E '^([0-9]+)$' /tmp/tmp.Qst8J6VXXR
+ rs_size=
+ [[ 0 == 0 ]]
+ [[ '' -ge 1 ]]
+ sleep 5
+ for i in '{1..10}'
+ '[' '' ']'
+ set +o xtrace
2022-08-03T06:51:05.762+0000 I NETWORK [js] Starting new replica set monitor for rs0/localhost:27017
2022-08-03T06:51:05.762+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to localhost:27017
2022-08-03T06:51:05.763+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:05.763+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 1 checks in a row.
2022-08-03T06:51:06.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:06.262+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 2 checks in a row.
2022-08-03T06:51:06.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:06.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 3 checks in a row.
2022-08-03T06:51:07.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:07.262+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 4 checks in a row.
2022-08-03T06:51:07.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:07.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 5 checks in a row.
2022-08-03T06:51:08.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:08.262+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 6 checks in a row.
2022-08-03T06:51:08.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:08.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 7 checks in a row.
2022-08-03T06:51:09.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:09.262+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 8 checks in a row.
2022-08-03T06:51:09.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:09.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 9 checks in a row.
2022-08-03T06:51:10.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:10.262+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 10 checks in a row.
2022-08-03T06:51:10.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:10.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 11 checks in a row.
2022-08-03T06:51:11.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:11.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:12.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:12.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:13.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:13.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:14.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:14.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:15.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:15.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:15.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 21 checks in a row.
2022-08-03T06:51:16.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:16.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:17.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:17.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:18.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:18.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:19.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:19.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:20.262+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:20.762+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-08-03T06:51:20.762+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 31 checks in a row.
2022-08-03T06:51:20.762+0000 E QUERY [js] Error: connect failed to replica set rs0/localhost:27017 :
connect@src/mongo/shell/mongo.js:353:17
@(connect):3:6
2022-08-03T06:51:20.764+0000 F - [main] exception: connect failed
2022-08-03T06:51:20.764+0000 E - [main] exiting with code 1
+ exit_status=0
++ grep -E '^([0-9]+)$' /tmp/tmp.Qst8J6VXXR
+ rs_size=
+ [[ 0 == 0 ]]
+ [[ '' -ge 1 ]]
+ sleep 10
+ for i in '{1..10}'
+ '[' '' ']'
+ set +o xtrace
2022-08-03T06:51:30.843+0000 I NETWORK [js] Starting new replica set monitor for rs0/localhost:27017
2022-08-03T06:51:30.843+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to localhost:27017
2022-08-03T06:51:30.845+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Confirmed replica set for rs0 is rs0/percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:30.845+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:30.845+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Confirmed replica set for rs0 is rs0/percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:30.847+0000 I NETWORK [js] Marking host percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017 as failed :: caused by :: Location40659: can't connect to new replica set master [percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017], err: AuthenticationFailed: Authentication failed.
2022-08-03T06:51:30.847+0000 E QUERY [js] Error: can't connect to new replica set master [percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017], err: AuthenticationFailed: Authentication failed. :
connect@src/mongo/shell/mongo.js:353:17
@(connect):3:6
2022-08-03T06:51:30.848+0000 F - [main] exception: connect failed
2022-08-03T06:51:30.849+0000 E - [main] exiting with code 1
+ exit_status=0
++ grep -E '^([0-9]+)$' /tmp/tmp.Qst8J6VXXR
+ rs_size=
+ [[ 0 == 0 ]]
+ [[ '' -ge 1 ]]
+ sleep 15
+ for i in '{1..10}'
+ '[' '' ']'
+ set +o xtrace
2022-08-03T06:51:45.916+0000 I NETWORK [js] Starting new replica set monitor for rs0/localhost:27017
2022-08-03T06:51:45.916+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to localhost:27017
2022-08-03T06:51:45.917+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Confirmed replica set for rs0 is rs0/percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017,percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017,percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:45.917+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:45.917+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:45.917+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:45.919+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Confirmed replica set for rs0 is rs0/percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017,percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017,percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
3
+ exit_status=0
++ grep -E '^([0-9]+)$' /tmp/tmp.Qst8J6VXXR
+ rs_size=3
+ [[ 0 == 0 ]]
+ [[ 3 -ge 1 ]]
+ break
+ rm /tmp/tmp.Qst8J6VXXR
+ exec pbm-agent
2022-08-03T06:51:45.000+0000 I pbm-agent:
Version: 1.6.1
Platform: linux/amd64
GitCommit: ec060aa090b6702b0f5938685fc88bbfa309660b
GitBranch: release-1.6.1
BuildTime: 2021-12-08_16:40_UTC
GoVersion: go1.16.11
2022-08-03T06:51:45.000+0000 I node: rs0/percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017
2022-08-03T06:51:45.000+0000 I listening for the commands
2022-08-03T06:51:45.000+0000 I starting PITR routine
2022-08-03T06:51:50.000+0000 W [agentCheckup] get current storage status: query mongo: mongo: no documents in result
2022-08-03T06:51:50.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:51:55.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:00.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:05.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:10.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:15.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:20.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:25.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:30.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:35.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:40.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:45.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:50.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:52:55.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:00.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:05.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:10.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:15.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:20.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:25.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:30.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:35.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:40.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:45.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:50.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:53:55.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:00.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:05.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:10.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:15.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:20.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:25.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:30.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:35.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:40.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:45.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:50.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:54:55.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:00.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:05.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:10.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:15.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:20.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:25.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:30.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:35.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:40.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:45.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:50.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:55:55.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:56:00.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:56:05.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:56:10.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: mongo: no documents in result
2022-08-03T06:56:28.000+0000 I got command restore [name: 2022-08-03T06:56:27.562621809Z, backup name: 2022-08-02T09:05:59Z] <ts: 1659509787>
2022-08-03T06:56:28.000+0000 I got epoch {1659509775 2}
2022-08-03T06:56:28.000+0000 I [restore/2022-08-02T09:05:59Z] restore started
2022-08-03T06:56:28.000+0000 D [restore/2022-08-02T09:05:59Z] waiting for 'starting' status
2022-08-03T06:56:30.000+0000 D [restore/2022-08-02T09:05:59Z] waiting for 'running' status
2022-08-03T06:56:31.582+0000 Setting num cpus to 20
2022-08-03T06:56:31.595+0000 connected to node type: replset
2022-08-03T06:56:31.603+0000 archive prelude search.savedSearch
2022-08-03T06:56:31.603+0000 archive prelude search.uploaderConfig
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmLockOp
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmLock
2022-08-03T06:56:31.603+0000 archive prelude mandr.cedexCode
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmCmd
2022-08-03T06:56:31.603+0000 archive prelude config.image_collection
2022-08-03T06:56:31.603+0000 archive prelude customerportal.Company
2022-08-03T06:56:31.603+0000 archive prelude customerportal.User
2022-08-03T06:56:31.603+0000 archive prelude search.savedSearchHistory
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmPITRChunks
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmLog
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmAgents
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmRUsers
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmRRoles
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmBackups
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmConfig
2022-08-03T06:56:31.603+0000 archive prelude search.modelCheck
2022-08-03T06:56:31.603+0000 archive prelude admin.system.profile
2022-08-03T06:56:31.603+0000 archive prelude admin.pbmOpLog
2022-08-03T06:56:31.603+0000 archive prelude search.searchPageConfiguration
2022-08-03T06:56:31.603+0000 archive prelude admin.system.users
2022-08-03T06:56:31.603+0000 archive prelude admin.system.roles
2022-08-03T06:56:31.603+0000 archive prelude admin.system.version
2022-08-03T06:56:31.603+0000 archive format version "0.1"
2022-08-03T06:56:31.603+0000 archive server version "4.4.10-11"
2022-08-03T06:56:31.603+0000 archive tool version "0.0.1"
2022-08-03T06:56:31.603+0000 setting number of parallel collections to number of parallel collections in archive (10)
2022-08-03T06:56:31.604+0000 preparing collections to restore from
2022-08-03T06:56:31.604+0000 found collection search.savedSearch bson to restore to search.savedSearch
2022-08-03T06:56:31.604+0000 found collection metadata from search.savedSearch to restore to search.savedSearch
2022-08-03T06:56:31.604+0000 adding intent for search.savedSearch
2022-08-03T06:56:31.604+0000 found collection search.uploaderConfig bson to restore to search.uploaderConfig
2022-08-03T06:56:31.604+0000 found collection metadata from search.uploaderConfig to restore to search.uploaderConfig
2022-08-03T06:56:31.604+0000 adding intent for search.uploaderConfig
2022-08-03T06:56:31.604+0000 found collection search.savedSearchHistory bson to restore to search.savedSearchHistory
2022-08-03T06:56:31.604+0000 found collection metadata from search.savedSearchHistory to restore to search.savedSearchHistory
2022-08-03T06:56:31.604+0000 adding intent for search.savedSearchHistory
2022-08-03T06:56:31.604+0000 found collection search.modelCheck bson to restore to search.modelCheck
2022-08-03T06:56:31.604+0000 found collection metadata from search.modelCheck to restore to search.modelCheck
2022-08-03T06:56:31.604+0000 adding intent for search.modelCheck
2022-08-03T06:56:31.604+0000 found collection search.searchPageConfiguration bson to restore to search.searchPageConfiguration
2022-08-03T06:56:31.604+0000 found collection metadata from search.searchPageConfiguration to restore to search.searchPageConfiguration
2022-08-03T06:56:31.604+0000 adding intent for search.searchPageConfiguration
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmLockOp, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmLockOp metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmLock, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmLock metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmCmd, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmCmd metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmPITRChunks, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmPITRChunks metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmLog, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmLog metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmAgents, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmAgents metadata, it is excluded
2022-08-03T06:56:31.604+0000 found collection admin.pbmRUsers bson to restore to admin.pbmRUsers
2022-08-03T06:56:31.604+0000 found collection metadata from admin.pbmRUsers to restore to admin.pbmRUsers
2022-08-03T06:56:31.604+0000 adding intent for admin.pbmRUsers
2022-08-03T06:56:31.604+0000 found collection admin.pbmRRoles bson to restore to admin.pbmRRoles
2022-08-03T06:56:31.604+0000 found collection metadata from admin.pbmRRoles to restore to admin.pbmRRoles
2022-08-03T06:56:31.604+0000 adding intent for admin.pbmRRoles
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmBackups, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmBackups metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmConfig, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmConfig metadata, it is excluded
2022-08-03T06:56:31.604+0000 skipping restore of system.profile collection in admin
2022-08-03T06:56:31.604+0000 skipping restore of system.profile metadata
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmOpLog, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.pbmOpLog metadata, it is excluded
2022-08-03T06:56:31.604+0000 found collection admin.system.users bson to restore to admin.system.users
2022-08-03T06:56:31.604+0000 found collection metadata from admin.system.users to restore to admin.system.users
2022-08-03T06:56:31.604+0000 adding intent for admin.system.users
2022-08-03T06:56:31.604+0000 found collection admin.system.roles bson to restore to admin.system.roles
2022-08-03T06:56:31.604+0000 found collection metadata from admin.system.roles to restore to admin.system.roles
2022-08-03T06:56:31.604+0000 adding intent for admin.system.roles
2022-08-03T06:56:31.604+0000 skipping restoring admin.system.version, it is excluded
2022-08-03T06:56:31.604+0000 skipping restoring admin.system.version metadata, it is excluded
2022-08-03T06:56:31.604+0000 found collection mandr.cedexCode bson to restore to mandr.cedexCode
2022-08-03T06:56:31.604+0000 found collection metadata from mandr.cedexCode to restore to mandr.cedexCode
2022-08-03T06:56:31.604+0000 adding intent for mandr.cedexCode
2022-08-03T06:56:31.604+0000 found collection config.image_collection bson to restore to config.image_collection
2022-08-03T06:56:31.604+0000 found collection metadata from config.image_collection to restore to config.image_collection
2022-08-03T06:56:31.604+0000 adding intent for config.image_collection
2022-08-03T06:56:31.604+0000 found collection customerportal.Company bson to restore to customerportal.Company
2022-08-03T06:56:31.604+0000 found collection metadata from customerportal.Company to restore to customerportal.Company
2022-08-03T06:56:31.604+0000 adding intent for customerportal.Company
2022-08-03T06:56:31.604+0000 found collection customerportal.User bson to restore to customerportal.User
2022-08-03T06:56:31.604+0000 found collection metadata from customerportal.User to restore to customerportal.User
2022-08-03T06:56:31.604+0000 adding intent for customerportal.User
2022-08-03T06:56:31.608+0000 received search.searchPageConfiguration from namespaceChan
2022-08-03T06:56:31.608+0000 first non special collection search.searchPageConfiguration found. The demultiplexer will handle it and the remainder
2022-08-03T06:56:31.608+0000 reading metadata for search.uploaderConfig from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for admin.pbmRRoles from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for mandr.cedexCode from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for config.image_collection from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for customerportal.User from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for search.savedSearch from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for search.savedSearchHistory from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for search.modelCheck from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for search.searchPageConfiguration from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for admin.pbmRUsers from archive on stdin
2022-08-03T06:56:31.608+0000 reading metadata for customerportal.Company from archive on stdin
2022-08-03T06:56:31.608+0000 restoring up to 10 collections in parallel
2022-08-03T06:56:31.609+0000 collection search.searchPageConfiguration doesn't exist, skipping drop command
2022-08-03T06:56:31.609+0000 creating collection search.searchPageConfiguration with no metadata
2022-08-03T06:56:31.643+0000 restoring search.searchPageConfiguration from archive on stdin
2022-08-03T06:56:31.643+0000 using 10 insertion workers
2022-08-03T06:56:31.748+0000 finished restoring search.searchPageConfiguration (13 documents, 0 failures)
2022-08-03T06:56:31.749+0000 collection admin.pbmRUsers doesn't exist, skipping drop command
2022-08-03T06:56:31.749+0000 creating collection admin.pbmRUsers with no metadata
2022-08-03T06:56:31.780+0000 restoring admin.pbmRUsers from archive on stdin
2022-08-03T06:56:31.781+0000 using 10 insertion workers
2022-08-03T06:56:31.883+0000 finished restoring admin.pbmRUsers (4 documents, 0 failures)
2022-08-03T06:56:31.886+0000 collection customerportal.User doesn't exist, skipping drop command
2022-08-03T06:56:31.886+0000 creating collection customerportal.User with no metadata
2022-08-03T06:56:31.964+0000 restoring customerportal.User from archive on stdin
2022-08-03T06:56:31.966+0000 using 10 insertion workers
2022-08-03T06:56:32.126+0000 finished restoring customerportal.User (88 documents, 0 failures)
2022-08-03T06:56:32.126+0000 collection admin.pbmRRoles doesn't exist, skipping drop command
2022-08-03T06:56:32.126+0000 creating collection admin.pbmRRoles with no metadata
2022-08-03T06:56:32.164+0000 restoring admin.pbmRRoles from archive on stdin
2022-08-03T06:56:32.164+0000 using 10 insertion workers
2022-08-03T06:56:32.266+0000 finished restoring admin.pbmRRoles (1 document, 0 failures)
2022-08-03T06:56:32.267+0000 collection customerportal.Company doesn't exist, skipping drop command
2022-08-03T06:56:32.267+0000 creating collection customerportal.Company with no metadata
2022-08-03T06:56:32.292+0000 restoring customerportal.Company from archive on stdin
2022-08-03T06:56:32.294+0000 using 10 insertion workers
2022-08-03T06:56:32.297+0000 collection search.savedSearch doesn't exist, skipping drop command
2022-08-03T06:56:32.297+0000 creating collection search.savedSearch with no metadata
2022-08-03T06:56:32.324+0000 restoring search.savedSearch from archive on stdin
2022-08-03T06:56:32.326+0000 using 10 insertion workers
2022-08-03T06:56:32.330+0000 collection mandr.cedexCode doesn't exist, skipping drop command
2022-08-03T06:56:32.330+0000 creating collection mandr.cedexCode with no metadata
2022-08-03T06:56:32.355+0000 restoring mandr.cedexCode from archive on stdin
2022-08-03T06:56:32.355+0000 using 10 insertion workers
2022-08-03T06:56:32.430+0000 finished restoring search.savedSearch (3 documents, 0 failures)
2022-08-03T06:56:32.430+0000 collection search.uploaderConfig doesn't exist, skipping drop command
2022-08-03T06:56:32.430+0000 creating collection search.uploaderConfig with no metadata
2022-08-03T06:56:32.456+0000 restoring search.uploaderConfig from archive on stdin
2022-08-03T06:56:32.456+0000 using 10 insertion workers
2022-08-03T06:56:32.509+0000 finished restoring customerportal.Company (39 documents, 0 failures)
2022-08-03T06:56:32.511+0000 collection search.savedSearchHistory doesn't exist, skipping drop command
2022-08-03T06:56:32.511+0000 creating collection search.savedSearchHistory with no metadata
2022-08-03T06:56:32.545+0000 restoring search.savedSearchHistory from archive on stdin
2022-08-03T06:56:32.546+0000 using 10 insertion workers
2022-08-03T06:56:32.579+0000 finished restoring mandr.cedexCode (1093 documents, 0 failures)
2022-08-03T06:56:32.584+0000 finished restoring search.uploaderConfig (8 documents, 0 failures)
2022-08-03T06:56:32.648+0000 finished restoring search.savedSearchHistory (1 document, 0 failures)
2022-08-03T06:56:32.649+0000 dropping collection config.image_collection before restoring
2022-08-03T06:56:32.652+0000 creating collection config.image_collection with no metadata
2022-08-03T06:56:32.682+0000 restoring config.image_collection from archive on stdin
2022-08-03T06:56:32.682+0000 using 10 insertion workers
2022-08-03T06:56:32.784+0000 finished restoring config.image_collection (0 documents, 0 failures)
2022-08-03T06:56:32.784+0000 collection search.modelCheck doesn't exist, skipping drop command
2022-08-03T06:56:32.784+0000 creating collection search.modelCheck with no metadata
2022-08-03T06:56:32.816+0000 restoring search.modelCheck from archive on stdin
2022-08-03T06:56:32.816+0000 using 10 insertion workers
2022-08-03T06:56:34.595+0000 search.modelCheck 5.92MB
2022-08-03T06:56:37.595+0000 search.modelCheck 13.6MB
2022-08-03T06:56:40.595+0000 search.modelCheck 20.0MB
2022-08-03T06:56:43.595+0000 search.modelCheck 29.2MB
2022-08-03T06:56:46.595+0000 search.modelCheck 38.2MB
2022-08-03T06:56:49.595+0000 search.modelCheck 46.6MB
2022-08-03T06:56:52.595+0000 search.modelCheck 55.7MB
2022-08-03T06:56:55.595+0000 search.modelCheck 64.3MB
2022-08-03T06:56:58.595+0000 search.modelCheck 72.9MB
2022-08-03T06:57:01.595+0000 search.modelCheck 81.1MB
2022-08-03T06:57:04.595+0000 search.modelCheck 90.1MB
2022-08-03T06:57:07.596+0000 search.modelCheck 96.8MB
2022-08-03T06:57:10.595+0000 search.modelCheck 103MB
2022-08-03T06:57:13.595+0000 search.modelCheck 113MB
2022-08-03T06:57:16.594+0000 search.modelCheck 120MB
2022-08-03T06:57:19.595+0000 search.modelCheck 130MB
2022-08-03T06:57:22.595+0000 search.modelCheck 140MB
2022-08-03T06:57:25.595+0000 search.modelCheck 147MB
2022-08-03T06:57:28.595+0000 search.modelCheck 153MB
2022-08-03T06:57:31.596+0000 search.modelCheck 162MB
2022-08-03T06:57:34.595+0000 search.modelCheck 171MB
2022-08-03T06:57:37.595+0000 search.modelCheck 178MB
2022-08-03T06:57:40.595+0000 search.modelCheck 187MB
2022-08-03T06:57:43.595+0000 search.modelCheck 196MB
2022-08-03T06:57:46.595+0000 search.modelCheck 205MB
2022-08-03T06:57:49.596+0000 search.modelCheck 213MB
2022-08-03T06:57:52.594+0000 search.modelCheck 223MB
2022-08-03T06:57:52.000+0000 W [restore/2022-08-02T09:05:59Z] io.copy: context deadline exceeded (Client.Timeout or context cancellation while reading body)
2022-08-03T06:57:52.000+0000 W [restore/2022-08-02T09:05:59Z] got context deadline exceeded (Client.Timeout or context cancellation while reading body), try to reconnect in 1s
2022-08-03T06:57:54.000+0000 I [restore/2022-08-02T09:05:59Z] session recreated, resuming download
2022-08-03T06:57:55.595+0000 search.modelCheck 231MB
2022-08-03T06:57:58.596+0000 search.modelCheck 238MB
2022-08-03T06:58:01.595+0000 search.modelCheck 247MB
2022-08-03T06:58:04.595+0000 search.modelCheck 255MB
2022-08-03T06:58:07.595+0000 search.modelCheck 262MB
2022-08-03T06:58:10.595+0000 search.modelCheck 271MB
2022-08-03T06:58:13.595+0000 search.modelCheck 279MB
2022-08-03T06:58:16.595+0000 search.modelCheck 285MB
2022-08-03T06:58:19.595+0000 search.modelCheck 286MB
2022-08-03T06:58:22.595+0000 search.modelCheck 287MB
2022-08-03T06:58:25.595+0000 search.modelCheck 289MB
2022-08-03T06:58:28.595+0000 search.modelCheck 291MB
2022-08-03T06:58:31.595+0000 search.modelCheck 291MB
2022-08-03T06:58:34.595+0000 search.modelCheck 300MB
2022-08-03T06:58:37.595+0000 search.modelCheck 308MB
2022-08-03T06:58:40.595+0000 search.modelCheck 318MB
2022-08-03T06:58:43.595+0000 search.modelCheck 326MB
2022-08-03T06:58:46.595+0000 search.modelCheck 335MB
2022-08-03T06:58:49.595+0000 search.modelCheck 344MB
2022-08-03T06:58:52.595+0000 search.modelCheck 352MB
2022-08-03T06:58:54.000+0000 W [restore/2022-08-02T09:05:59Z] io.copy: context deadline exceeded (Client.Timeout or context cancellation while reading body)
2022-08-03T06:58:54.000+0000 W [restore/2022-08-02T09:05:59Z] got context deadline exceeded (Client.Timeout or context cancellation while reading body), try to reconnect in 2s
2022-08-03T06:58:55.595+0000 search.modelCheck 359MB
2022-08-03T06:58:56.000+0000 I [restore/2022-08-02T09:05:59Z] session recreated, resuming download
2022-08-03T06:58:58.595+0000 search.modelCheck 365MB
2022-08-03T06:59:01.595+0000 search.modelCheck 371MB
2022-08-03T06:59:04.595+0000 search.modelCheck 380MB
2022-08-03T06:59:07.595+0000 search.modelCheck 390MB
2022-08-03T06:59:10.595+0000 search.modelCheck 397MB
2022-08-03T06:59:13.594+0000 search.modelCheck 406MB
2022-08-03T06:59:16.595+0000 search.modelCheck 415MB
2022-08-03T06:59:19.596+0000 search.modelCheck 424MB
2022-08-03T06:59:22.595+0000 search.modelCheck 432MB
2022-08-03T06:59:25.595+0000 search.modelCheck 441MB
2022-08-03T06:59:26.903+0000 search.modelCheck 444MB
2022-08-03T06:59:26.903+0000 finished restoring search.modelCheck (2737031 documents, 0 failures)
2022-08-03T06:59:26.903+0000 demux finishing (err:<nil>)
2022-08-03T06:59:26.903+0000 building indexes up to 10 collections in parallel
2022-08-03T06:59:26.903+0000 no indexes to restore for collection search.savedSearch
2022-08-03T06:59:26.903+0000 no indexes to restore for collection admin.pbmRUsers
2022-08-03T06:59:26.903+0000 no indexes to restore for collection admin.pbmRRoles
2022-08-03T06:59:26.903+0000 no indexes to restore for collection search.searchPageConfiguration
2022-08-03T06:59:26.903+0000 restoring indexes for collection search.modelCheck from metadata
2022-08-03T06:59:26.903+0000 index: &idx.IndexDocument{Options:primitive.M{"name":"model-check-lookup", "v":2}, Key:primitive.D{primitive.E{Key:"indexPrefix", Value:1}, primitive.E{Key:"resourceTypeName", Value:1}, primitive.E{Key:"entityId", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2022-08-03T06:59:26.903+0000 run create Index command for indexes: model-check-lookup
2022-08-03T06:59:26.903+0000 no indexes to restore for collection search.savedSearchHistory
2022-08-03T06:59:26.903+0000 no indexes to restore for collection mandr.cedexCode
2022-08-03T06:59:26.903+0000 no indexes to restore for collection search.uploaderConfig
2022-08-03T06:59:26.903+0000 no indexes to restore for collection config.image_collection
2022-08-03T06:59:26.903+0000 no indexes to restore for collection customerportal.User
2022-08-03T06:59:26.903+0000 no indexes to restore for collection customerportal.Company
2022-08-03T07:00:00.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:00:30 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:00.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:00:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 587894 }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 495202 }, ] }
2022/08/03 07:00:33 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 587894 }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 495202 }, ] }
2022-08-03T07:00:03.000+0000 E [restore/2022-08-02T09:05:59Z] send heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 587894 }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 495202 }, ] }
2022/08/03 07:00:33 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:03.000+0000 E [restore/2022-08-02T09:05:59Z] send heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 587894 }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 495202 }, ] }
2022-08-03T07:00:29.000+0000 E [restore/2022-08-02T09:05:59Z] mark restore as failed `mongorestore: restore mongo dump (successes: 2738281 / fails: 0): search.modelCheck: error creating indexes for search.modelCheck: createIndex error: connection(localhost:27017[-22]) socket was unexpectedly closed: EOF`: set backup state: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:00:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 558339 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:29.000+0000 E [restore/2022-08-02T09:05:59Z] mark restore as failed `mongorestore: restore mongo dump (successes: 2738281 / fails: 0): search.modelCheck: error creating indexes for search.modelCheck: createIndex error: connection(localhost:27017[-22]) socket was unexpectedly closed: EOF`: set backup state: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:00:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:01:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 558339 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:00:59.000+0000 E [agentCheckup] check node connection: connection() error occured during connection handshake: auth error: unable to authenticate using mechanism "SCRAM-SHA-256": (KeyNotFound) Cache Reader No keys found for HMAC that is valid for time: { ts: Timestamp(1659509966, 10501) } with id: 7127538969771769862
2022/08/03 07:01:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:59.000+0000 E [agentCheckup] check node connection: connection() error occured during connection handshake: auth error: unable to authenticate using mechanism "SCRAM-SHA-256": (KeyNotFound) Cache Reader No keys found for HMAC that is valid for time: { ts: Timestamp(1659509966, 10501) } with id: 7127538969771769862
2022-08-03T07:00:59.000+0000 E [restore/2022-08-02T09:05:59Z] restore: mongorestore: restore mongo dump (successes: 2738281 / fails: 0): search.modelCheck: error creating indexes for search.modelCheck: createIndex error: connection(localhost:27017[-22]) socket was unexpectedly closed: EOF
2022/08/03 07:01:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:00:59.000+0000 E [restore/2022-08-02T09:05:59Z] restore: mongorestore: restore mongo dump (successes: 2738281 / fails: 0): search.modelCheck: error creating indexes for search.modelCheck: createIndex error: connection(localhost:27017[-22]) socket was unexpectedly closed: EOF
2022-08-03T07:01:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 558339 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:01:33 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:01:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 558339 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:01:03.000+0000 E [restore/2022-08-02T09:05:59Z] send heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 558339 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:01:33 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:01:03.000+0000 E [restore/2022-08-02T09:05:59Z] send heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 558339 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:01:29.000+0000 D [restore/2022-08-02T09:05:59Z] releasing lock
2022/08/03 07:01:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:01:29.000+0000 D [restore/2022-08-02T09:05:59Z] releasing lock
2022-08-03T07:01:59.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:02:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:01:59.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:02:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 46077515 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:02:33 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:02:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 46077515 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:02:29.000+0000 E [restore/2022-08-02T09:05:59Z] release lock: deleteOne: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:02:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }, <nil>, entry: 2022-08-03T07:02:29.000+0000 E [restore/2022-08-02T09:05:59Z] release lock: deleteOne: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:02:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:03:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }, <nil>, entry: 2022-08-03T07:02:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:02:59.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }
2022/08/03 07:03:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:02:59.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }
2022-08-03T07:03:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }
2022/08/03 07:03:33 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:03:03.000+0000 E [restore] send lock heartbeat: read cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }
2022-08-03T07:03:29.000+0000 E listening commands: watch the cmd stream: connection(percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017[-10]) socket was unexpectedly closed: EOF
2022/08/03 07:03:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:03:29.000+0000 E listening commands: watch the cmd stream: connection(percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017[-10]) socket was unexpectedly closed: EOF
2022-08-03T07:03:59.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:04:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:03:59.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:04:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:04:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:04:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:04:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:05:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:04:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:04:59.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:05:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 622069 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:04:59.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:05:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:05:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:05:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:05:59.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:06:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:05:59.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:06:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 622069 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:06:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:06:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Average RTT: 622069 }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:06:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:07:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:06:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:06:59.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:07:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:06:59.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:07:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:07:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:07:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:07:59.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:08:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:07:59.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:08:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:08:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:08:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:08:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:09:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:08:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:08:59.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:09:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:08:59.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:09:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:09:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:09:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:09:59.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:10:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:09:59.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:10:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:10:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:10:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:10:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:11:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:10:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:10:59.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:11:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:10:59.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:11:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:11:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:11:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:11:59.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:12:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:11:59.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:12:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:12:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:12:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:12:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:13:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:12:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:12:59.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:13:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:12:59.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:13:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:13:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:13:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:13:59.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:14:29 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:13:59.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:14:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:14:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:14:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:14:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:15:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:14:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:14:36.000+0000 E [agentCheckup] check node connection: connection() error occured during connection handshake: auth error: unable to authenticate using mechanism "SCRAM-SHA-256": (KeyNotFound) Cache Reader No keys found for HMAC that is valid for time: { ts: Timestamp(1659509966, 10501) } with id: 7127538969771769862
2022/08/03 07:15:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:14:36.000+0000 E [agentCheckup] check node connection: connection() error occured during connection handshake: auth error: unable to authenticate using mechanism "SCRAM-SHA-256": (KeyNotFound) Cache Reader No keys found for HMAC that is valid for time: { ts: Timestamp(1659509966, 10501) } with id: 7127538969771769862
2022-08-03T07:15:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:15:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:15:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:15:36.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:16:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:15:36.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:16:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:16:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:16:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:16:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:17:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:16:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:16:36.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:17:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:16:36.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:17:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:17:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:17:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:17:36.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:18:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:17:36.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:18:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:18:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:18:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:18:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:19:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:18:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:18:36.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:19:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:18:36.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:19:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:19:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:19:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:19:36.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:20:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:19:36.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:20:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:20:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:20:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:20:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:21:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:20:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:20:36.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:21:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:20:36.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:21:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:21:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:21:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:21:36.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:22:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:21:36.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:22:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:22:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:22:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:22:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:23:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:22:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:22:36.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:23:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:22:36.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:23:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:23:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:23:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:23:36.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:24:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:23:36.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:24:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:24:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: RSSecondary, Tag sets: serviceName=percona-mongodb-qa, Average RTT: 33087849 }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }, <nil>, entry: 2022-08-03T07:24:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:24:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:25:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.129.2.124:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:24:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:24:36.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:25:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:24:36.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:25:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:25:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:25:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:25:36.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:26:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:25:36.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:26:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:26:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:26:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:26:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:27:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:26:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:26:36.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:27:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:26:36.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:27:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:27:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:27:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:27:36.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:28:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:27:36.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:28:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:28:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:28:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:28:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:29:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:28:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:28:36.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:29:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:28:36.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:29:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:29:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:29:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:29:36.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:30:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:29:36.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:30:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:30:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:30:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:30:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:31:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:30:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:30:36.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.129.2.124:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:31:06 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:30:36.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.129.2.124:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:31:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:31:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:31:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:31:31.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: connection() error occured during connection handshake: auth error: unable to authenticate using mechanism "SCRAM-SHA-256": (KeyNotFound) Cache Reader No keys found for HMAC that is valid for time: { ts: Timestamp(1659509966, 10501) } with id: 7127538969771769862
2022/08/03 07:32:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:31:31.000+0000 E [agentCheckup] get replSetGetStatus: get replset status: run mongo command replSetGetStatus: connection() error occured during connection handshake: auth error: unable to authenticate using mechanism "SCRAM-SHA-256": (KeyNotFound) Cache Reader No keys found for HMAC that is valid for time: { ts: Timestamp(1659509966, 10501) } with id: 7127538969771769862
2022-08-03T07:32:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:32:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:32:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:32:31.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:33:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:32:31.000+0000 E [agentCheckup] get NodeInfo: run mongo command: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:32:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:33:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:32:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:33:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:33:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:33:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:33:31.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:34:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:33:31.000+0000 E [agentCheckup] set status: get cluster time: void read: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:34:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:34:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:34:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:34:31.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:35:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:34:31.000+0000 E [agentCheckup] check PBM connection: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:34:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:35:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:34:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:35:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:35:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }, <nil>, entry: 2022-08-03T07:35:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:35:31.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022/08/03 07:36:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }, <nil>, entry: 2022-08-03T07:35:31.000+0000 E [agentCheckup] check node connection: server selection error: server selection timeout, current topology: { Type: Single, Servers: [{ Addr: localhost:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp [::1]:27017: connect: connection refused }, ] }
2022-08-03T07:36:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:36:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:36:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:36:31.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:37:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:36:31.000+0000 W [agentCheckup] get current storage status: query mongo: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:36:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }
2022/08/03 07:37:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:36:31.000+0000 E [pitr] init: get conf: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.128.2.174:27017: connect: connection refused }, ] }
2022-08-03T07:37:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:37:59 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:37:29.000+0000 E listening commands: watch the cmd stream: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022-08-03T07:37:31.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
2022/08/03 07:38:01 [ERROR] wrting log: db: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }, <nil>, entry: 2022-08-03T07:37:31.000+0000 E [agentCheckup] check storage connection: unable to get storage: get config: get: server selection error: server selection timeout, current topology: { Type: ReplicaSetNoPrimary, Servers: [{ Addr: percona-mongodb-qa-rs0-0.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp 10.131.1.228:27017: connect: connection refused }, { Addr: percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-1.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, { Addr: percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local:27017, Type: Unknown, Last error: connection() error occured during connection handshake: dial tcp: lookup percona-mongodb-qa-rs0-2.percona-mongodb-qa-rs0.percona-mongodb.svc.cluster.local: no such host }, ] }
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment