Skip to content

Instantly share code, notes, and snippets.

@brainslush
Created June 8, 2022 07:53
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save brainslush/98b2bb81c2b32efae0b74322b670944c to your computer and use it in GitHub Desktop.
Save brainslush/98b2bb81c2b32efae0b74322b670944c to your computer and use it in GitHub Desktop.
MongoDB Backup Agent error
+ '[' pbm-agent = pbm-agent ']'
++ mktemp
+ OUT=/tmp/tmp.EoyW9vUsAj
++ mktemp
+ OUT_CFG=/tmp/tmp.5kqennvrjq
+ timeout=5
+ for i in '{1..10}'
+ '[' '' ']'
+ set +o xtrace
2022-06-08T07:43:52.901+0000 I NETWORK [js] Starting new replica set monitor for rs0/localhost:27017
2022-06-08T07:43:52.901+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to localhost:27017
2022-06-08T07:43:52.905+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:52.905+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 1 checks in a row.
2022-06-08T07:43:53.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:53.401+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 2 checks in a row.
2022-06-08T07:43:53.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:53.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 3 checks in a row.
2022-06-08T07:43:54.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:54.401+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 4 checks in a row.
2022-06-08T07:43:54.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:54.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 5 checks in a row.
2022-06-08T07:43:55.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:55.401+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 6 checks in a row.
2022-06-08T07:43:55.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:55.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 7 checks in a row.
2022-06-08T07:43:56.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:56.401+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 8 checks in a row.
2022-06-08T07:43:56.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:56.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 9 checks in a row.
2022-06-08T07:43:57.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:57.401+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 10 checks in a row.
2022-06-08T07:43:57.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:57.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 11 checks in a row.
2022-06-08T07:43:58.402+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:58.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:59.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:43:59.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:00.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:00.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:01.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:01.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:02.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:02.901+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:02.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Cannot reach any nodes for set rs0. Please check network connectivity and the status of the set. This has happened for 21 checks in a row.
2022-06-08T07:44:03.401+0000 W NETWORK [ReplicaSetMonitor-TaskExecutor] Unable to reach primary for set rs0
2022-06-08T07:44:03.901+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Confirmed replica set for rs0 is rs0/some-db-rs0-0.mongo-database.svc.cluster.local:27017
2022-06-08T07:44:03.901+0000 I CONNPOOL [ReplicaSetMonitor-TaskExecutor] Connecting to some-db-rs0-0.mongo-database.svc.cluster.local:27017
2022-06-08T07:44:03.915+0000 I NETWORK [ReplicaSetMonitor-TaskExecutor] Confirmed replica set for rs0 is rs0/some-db-rs0-0.mongo-database.svc.cluster.local:27017
1
+ exit_status=0
++ grep -E '^([0-9]+)$' /tmp/tmp.EoyW9vUsAj
+ rs_size=1
+ [[ 0 == 0 ]]
+ [[ 1 -ge 1 ]]
+ break
+ rm /tmp/tmp.EoyW9vUsAj
+ exec pbm-agent
2022-06-08T07:44:03.000+0000 I pbm-agent:
Version: 1.8.0
Platform: linux/amd64
GitCommit: 4cddf585136d5b0791c4723468858ac6910015f7
GitBranch: main
BuildTime: 2022-06-07_12:38_UTC
GoVersion: go1.16.15
2022-06-08T07:44:04.000+0000 I node: rs0/some-db-rs0-0.mongo-database.svc.cluster.local:27017
2022-06-08T07:44:03.000+0000 I starting PITR routine
2022-06-08T07:44:04.000+0000 I listening for the commands
2022-06-08T07:44:33.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:33.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:33.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:38.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:43.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:48.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:53.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:44:58.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:03.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:09.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:13.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:18.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:23.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:28.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:33.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:38.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:43.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:48.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:53.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:45:58.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:03.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:09.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:13.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:18.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:23.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:28.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:33.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:38.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:43.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:48.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:53.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:46:59.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:03.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:09.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:13.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:18.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:23.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:28.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:33.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:38.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:43.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:48.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:53.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:47:58.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:48:03.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:48:08.000+0000 I got command backup [name: 2022-06-08T07:48:07Z, compression: gzip (level: 6)] <ts: 1654674487>
2022-06-08T07:48:08.000+0000 I got epoch {1654674474 1}
2022-06-08T07:48:08.000+0000 E [backup/2022-06-08T07:48:07Z] node check: get node status: not found
2022-06-08T07:48:09.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:48:13.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:48:18.000+0000 E [agentCheckup] get replSetGetStatus: not found
2022-06-08T07:48:23.000+0000 E [agentCheckup] get replSetGetStatus: not found
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment