Created
June 25, 2020 06:37
-
-
Save shashank855/775a15d645c9e0eb306e306317c15101 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| d2iq@rack2:~$ kubectl logs -f litmus-velero-backup-restore-zwcrl-g6mkm -n litmus | |
| ansible-playbook 2.7.3 | |
| config file = None | |
| configured module search path = [u'/root/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules'] | |
| ansible python module location = /usr/local/lib/python2.7/dist-packages/ansible | |
| executable location = /usr/local/bin/ansible-playbook | |
| python version = 2.7.17 (default, Apr 15 2020, 17:20:14) [GCC 7.5.0] | |
| No config file found; using defaults | |
| /etc/ansible/hosts did not meet host_list requirements, check plugin documentation if this is unexpected | |
| /etc/ansible/hosts did not meet script requirements, check plugin documentation if this is unexpected | |
| PLAYBOOK: test.yml ************************************************************* | |
| 1 plays in ./experiments/functional/backup_and_restore/test.yml | |
| PLAY [localhost] *************************************************************** | |
| 2020-06-25T06:26:54.651979 (delta: 0.042561) elapsed: 0.042561 ******** | |
| =============================================================================== | |
| TASK [Gathering Facts] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:1 | |
| 2020-06-25T06:26:54.677843 (delta: 0.025828) elapsed: 0.068425 ******** | |
| ok: [127.0.0.1] | |
| META: ran handlers | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:12 | |
| 2020-06-25T06:27:02.124833 (delta: 7.44697) elapsed: 7.515415 ********* | |
| included: /utils/fcm/create_testname.yml for 127.0.0.1 | |
| TASK [Record test instance/run ID] ********************************************* | |
| task path: /utils/fcm/create_testname.yml:3 | |
| 2020-06-25T06:27:02.193182 (delta: 0.068318) elapsed: 7.583764 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Construct testname appended with runID] ********************************** | |
| task path: /utils/fcm/create_testname.yml:7 | |
| 2020-06-25T06:27:02.243609 (delta: 0.050379) elapsed: 7.634191 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:15 | |
| 2020-06-25T06:27:02.296859 (delta: 0.053219) elapsed: 7.687441 ******** | |
| included: /utils/fcm/update_litmus_result_resource.yml for 127.0.0.1 | |
| TASK [Generate the litmus result CR to reflect SOT (Start of Test)] ************ | |
| task path: /utils/fcm/update_litmus_result_resource.yml:3 | |
| 2020-06-25T06:27:02.374467 (delta: 0.077575) elapsed: 7.765049 ******** | |
| changed: [127.0.0.1] => {"changed": true, "checksum": "cb23761ee0ecfea3a093f94c0443739c777b3007", "dest": "./litmus-result.yaml", "gid": 0, "group": "root", "md5sum": "0da5664e16958d4f3c263662ebe36b5c", "mode": "0644", "owner": "root", "size": 422, "src": "/root/.ansible/tmp/ansible-tmp-1593066422.41-35404301145742/source", "state": "file", "uid": 0} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:14 | |
| 2020-06-25T06:27:02.892199 (delta: 0.517704) elapsed: 8.282781 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat litmus-result.yaml", "delta": "0:00:00.776459", "end": "2020-06-25 06:27:03.908295", "rc": 0, "start": "2020-06-25 06:27:03.131836", "stderr": "", "stderr_lines": [], "stdout": "---\napiVersion: litmus.io/v1alpha1\nkind: LitmusResult\nmetadata:\n\n # name of the litmus testcase\n name: velero-backup-restore \nspec:\n\n # holds information on the testcase\n testMetadata:\n app: \n chaostype: \n\n # holds the state of testcase, manually updated by json merge patch\n # result is the useful value today, but anticipate phase use in future \n testStatus: \n phase: in-progress \n result: none ", "stdout_lines": ["---", "apiVersion: litmus.io/v1alpha1", "kind: LitmusResult", "metadata:", "", " # name of the litmus testcase", " name: velero-backup-restore ", "spec:", "", " # holds information on the testcase", " testMetadata:", " app: ", " chaostype: ", "", " # holds the state of testcase, manually updated by json merge patch", " # result is the useful value today, but anticipate phase use in future ", " testStatus: ", " phase: in-progress ", " result: none "]} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:17 | |
| 2020-06-25T06:27:03.958838 (delta: 1.066606) elapsed: 9.34942 ********* | |
| changed: [127.0.0.1] => {"changed": true, "failed_when_result": false, "method": "create", "result": {"apiVersion": "litmus.io/v1alpha1", "kind": "LitmusResult", "metadata": {"creationTimestamp": "2020-06-25T06:27:04Z", "generation": 1, "name": "velero-backup-restore", "resourceVersion": "270870", "selfLink": "/apis/litmus.io/v1alpha1/litmusresults/velero-backup-restore", "uid": "76cd180d-4057-43ae-9202-847be8bda1f2"}, "spec": {"testMetadata": {"app": null, "chaostype": null}, "testStatus": {"phase": "in-progress", "result": "none"}}}} | |
| TASK [Generate the litmus result CR to reflect EOT (End of Test)] ************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:27 | |
| 2020-06-25T06:27:04.791716 (delta: 0.832849) elapsed: 10.182298 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:38 | |
| 2020-06-25T06:27:04.837682 (delta: 0.045923) elapsed: 10.228264 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:41 | |
| 2020-06-25T06:27:04.884764 (delta: 0.047049) elapsed: 10.275346 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify that the AUT is running] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:19 | |
| 2020-06-25T06:27:04.927701 (delta: 0.042895) elapsed: 10.318283 ******* | |
| included: /utils/k8s/check_deployment_status.yml for 127.0.0.1 | |
| TASK [Check the pod status] **************************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:8 | |
| 2020-06-25T06:27:05.005795 (delta: 0.078046) elapsed: 10.396377 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:status.phase", "delta": "0:00:01.021615", "end": "2020-06-25 06:27:06.174018", "rc": 0, "start": "2020-06-25 06:27:05.152403", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [obtain the number of replicas.] ****************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:22 | |
| 2020-06-25T06:27:06.221079 (delta: 1.215237) elapsed: 11.611661 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the ready replica count and compare with the replica count.] ****** | |
| task path: /utils/k8s/check_deployment_status.yml:29 | |
| 2020-06-25T06:27:06.269457 (delta: 0.048345) elapsed: 11.660039 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:22 | |
| 2020-06-25T06:27:06.318949 (delta: 0.049459) elapsed: 11.709531 ******* | |
| included: /experiments/functional/backup_and_restore/setup_dependency.yml for 127.0.0.1 | |
| TASK [Downloading velero binary] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:1 | |
| 2020-06-25T06:27:06.466656 (delta: 0.147675) elapsed: 11.857238 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "c5fe9de752d3152b32326ff2dab02198f9274868", "dest": "./velero-v1.4.0-linux-amd64.tar.gz", "gid": 0, "group": "root", "md5sum": "acb7e7184de6c45f4b88d71333115c7d", "mode": "0644", "msg": "OK (23832176 bytes)", "owner": "root", "size": 23832176, "src": "/root/.ansible/tmp/ansible-tmp-1593066426.51-91520691137004/tmp4LWNOB", "state": "file", "status_code": 200, "uid": 0, "url": "https://github.com/vmware-tanzu/velero/releases/download/v1.4.0/velero-v1.4.0-linux-amd64.tar.gz"} | |
| TASK [Installing velero inside litmus container] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:11 | |
| 2020-06-25T06:27:12.970388 (delta: 6.503702) elapsed: 18.36097 ******** | |
| [WARNING]: Consider using the unarchive module rather than running tar. If | |
| you need to use command because unarchive is insufficient you can add | |
| warn=False to this command task or set command_warnings=False in ansible.cfg to | |
| get rid of this message. | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "tar -xvf velero-v1.4.0-linux-amd64.tar.gz\n mv velero-v1.4.0-linux-amd64/velero /usr/local/bin/", "delta": "0:00:01.147221", "end": "2020-06-25 06:27:14.273089", "rc": 0, "start": "2020-06-25 06:27:13.125868", "stderr": "", "stderr_lines": [], "stdout": "velero-v1.4.0-linux-amd64/LICENSE\nvelero-v1.4.0-linux-amd64/examples/README.md\nvelero-v1.4.0-linux-amd64/examples/minio\nvelero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app\nvelero-v1.4.0-linux-amd64/examples/nginx-app/README.md\nvelero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml\nvelero-v1.4.0-linux-amd64/velero", "stdout_lines": ["velero-v1.4.0-linux-amd64/LICENSE", "velero-v1.4.0-linux-amd64/examples/README.md", "velero-v1.4.0-linux-amd64/examples/minio", "velero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app", "velero-v1.4.0-linux-amd64/examples/nginx-app/README.md", "velero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml", "velero-v1.4.0-linux-amd64/velero"]} | |
| TASK [Checking the velero version] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:16 | |
| 2020-06-25T06:27:14.316697 (delta: 1.346277) elapsed: 19.707279 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero version", "delta": "0:00:00.730747", "end": "2020-06-25 06:27:15.208332", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:14.477585", "stderr": "", "stderr_lines": [], "stdout": "Client:\n\tVersion: v1.4.0\n\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392\n<error getting server version: namespaces \"velero\" not found>", "stdout_lines": ["Client:", "\tVersion: v1.4.0", "\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392", "<error getting server version: namespaces \"velero\" not found>"]} | |
| TASK [Replacing Profile name in credential file] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:21 | |
| 2020-06-25T06:27:15.264347 (delta: 0.947611) elapsed: 20.654929 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing minio s3-bucket] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:30 | |
| 2020-06-25T06:27:15.314786 (delta: 0.050377) elapsed: 20.705368 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for minio pod status] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:33 | |
| 2020-06-25T06:27:15.366090 (delta: 0.051256) elapsed: 20.756672 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for minio job to create bucket] ********************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:40 | |
| 2020-06-25T06:27:15.415489 (delta: 0.049366) elapsed: 20.806071 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching service account key.json from configmap] ************************ | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:51 | |
| 2020-06-25T06:27:15.462010 (delta: 0.046491) elapsed: 20.852592 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cm gcp-key -n litmus -o jsonpath='{.data.key\\.json}' > ./key.json", "delta": "0:00:00.749906", "end": "2020-06-25 06:27:16.361887", "rc": 0, "start": "2020-06-25 06:27:15.611981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Authenticating using gcp service account] ******************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:54 | |
| 2020-06-25T06:27:16.405081 (delta: 0.943039) elapsed: 21.795663 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud auth activate-service-account --key-file key.json", "delta": "0:00:01.405389", "end": "2020-06-25 06:27:17.955478", "rc": 0, "start": "2020-06-25 06:27:16.550089", "stderr": "Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]", "stderr_lines": ["Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]"], "stdout": "", "stdout_lines": []} | |
| TASK [Setting up the project ID] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:57 | |
| 2020-06-25T06:27:17.999600 (delta: 1.594482) elapsed: 23.390182 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud config set project openebs-ci", "delta": "0:00:02.626419", "end": "2020-06-25 06:27:20.774683", "rc": 0, "start": "2020-06-25 06:27:18.148264", "stderr": "Updated property [core/project].", "stderr_lines": ["Updated property [core/project]."], "stdout": "", "stdout_lines": []} | |
| TASK [Deleting GCP bucket if exist] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:60 | |
| 2020-06-25T06:27:20.822552 (delta: 2.822894) elapsed: 26.213134 ******* | |
| fatal: [127.0.0.1]: FAILED! => {"changed": true, "cmd": "gsutil rm -r gs://e2e-gcp-bucket", "delta": "0:00:02.569143", "end": "2020-06-25 06:27:23.543148", "msg": "non-zero return code", "rc": 1, "start": "2020-06-25 06:27:20.974005", "stderr": "BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist.", "stderr_lines": ["BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist."], "stdout": "", "stdout_lines": []} | |
| ...ignoring | |
| TASK [Creating gcp bucket] ***************************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:66 | |
| 2020-06-25T06:27:23.587756 (delta: 2.765161) elapsed: 28.978338 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gsutil mb gs://e2e-gcp-bucket/", "delta": "0:00:02.725371", "end": "2020-06-25 06:27:26.453327", "rc": 0, "start": "2020-06-25 06:27:23.727956", "stderr": "Creating gs://e2e-gcp-bucket/...", "stderr_lines": ["Creating gs://e2e-gcp-bucket/..."], "stdout": "", "stdout_lines": []} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:75 | |
| 2020-06-25T06:27:26.498168 (delta: 2.910369) elapsed: 31.88875 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:86 | |
| 2020-06-25T06:27:26.547529 (delta: 0.049329) elapsed: 31.938111 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:102 | |
| 2020-06-25T06:27:26.598274 (delta: 0.050713) elapsed: 31.988856 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:112 | |
| 2020-06-25T06:27:26.647864 (delta: 0.049556) elapsed: 32.038446 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:127 | |
| 2020-06-25T06:27:26.698422 (delta: 0.050527) elapsed: 32.089004 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Replacing Restic Image in patch.yml] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:136 | |
| 2020-06-25T06:27:26.750037 (delta: 0.051582) elapsed: 32.140619 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:142 | |
| 2020-06-25T06:27:26.804908 (delta: 0.054821) elapsed: 32.19549 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the number of compute nodes] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:149 | |
| 2020-06-25T06:27:26.856863 (delta: 0.051919) elapsed: 32.247445 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the status of restic demonset pods] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:153 | |
| 2020-06-25T06:27:26.907468 (delta: 0.050553) elapsed: 32.29805 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:166 | |
| 2020-06-25T06:27:26.957366 (delta: 0.049866) elapsed: 32.347948 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:176 | |
| 2020-06-25T06:27:27.017307 (delta: 0.059907) elapsed: 32.407889 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:191 | |
| 2020-06-25T06:27:27.073152 (delta: 0.055813) elapsed: 32.463734 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:200 | |
| 2020-06-25T06:27:27.131408 (delta: 0.058206) elapsed: 32.52199 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero install --provider gcp --plugins velero/velero-plugin-for-gcp:v1.0.0 --bucket e2e-gcp-bucket --use-volume-snapshots=false --secret-file ./key.json", "delta": "0:00:02.461571", "end": "2020-06-25 06:27:29.744220", "rc": 0, "start": "2020-06-25 06:27:27.282649", "stderr": "", "stderr_lines": [], "stdout": "CustomResourceDefinition/backups.velero.io: attempting to create resource\nCustomResourceDefinition/backups.velero.io: already exists, proceeding\nCustomResourceDefinition/backups.velero.io: created\nCustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource\nCustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding\nCustomResourceDefinition/backupstoragelocations.velero.io: created\nCustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource\nCustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding\nCustomResourceDefinition/deletebackuprequests.velero.io: created\nCustomResourceDefinition/downloadrequests.velero.io: attempting to create resource\nCustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/downloadrequests.velero.io: created\nCustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumebackups.velero.io: created\nCustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumerestores.velero.io: created\nCustomResourceDefinition/resticrepositories.velero.io: attempting to create resource\nCustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding\nCustomResourceDefinition/resticrepositories.velero.io: created\nCustomResourceDefinition/restores.velero.io: attempting to create resource\nCustomResourceDefinition/restores.velero.io: already exists, proceeding\nCustomResourceDefinition/restores.velero.io: created\nCustomResourceDefinition/schedules.velero.io: attempting to create resource\nCustomResourceDefinition/schedules.velero.io: already exists, proceeding\nCustomResourceDefinition/schedules.velero.io: created\nCustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource\nCustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/serverstatusrequests.velero.io: created\nCustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource\nCustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding\nCustomResourceDefinition/volumesnapshotlocations.velero.io: created\nWaiting for resources to be ready in cluster...\nNamespace/velero: attempting to create resource\nNamespace/velero: created\nClusterRoleBinding/velero: attempting to create resource\nClusterRoleBinding/velero: created\nServiceAccount/velero: attempting to create resource\nServiceAccount/velero: created\nSecret/cloud-credentials: attempting to create resource\nSecret/cloud-credentials: created\nBackupStorageLocation/default: attempting to create resource\nBackupStorageLocation/default: created\nDeployment/velero: attempting to create resource\nDeployment/velero: created\nVelero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status.", "stdout_lines": ["CustomResourceDefinition/backups.velero.io: attempting to create resource", "CustomResourceDefinition/backups.velero.io: already exists, proceeding", "CustomResourceDefinition/backups.velero.io: created", "CustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource", "CustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding", "CustomResourceDefinition/backupstoragelocations.velero.io: created", "CustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource", "CustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding", "CustomResourceDefinition/deletebackuprequests.velero.io: created", "CustomResourceDefinition/downloadrequests.velero.io: attempting to create resource", "CustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/downloadrequests.velero.io: created", "CustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumebackups.velero.io: created", "CustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumerestores.velero.io: created", "CustomResourceDefinition/resticrepositories.velero.io: attempting to create resource", "CustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding", "CustomResourceDefinition/resticrepositories.velero.io: created", "CustomResourceDefinition/restores.velero.io: attempting to create resource", "CustomResourceDefinition/restores.velero.io: already exists, proceeding", "CustomResourceDefinition/restores.velero.io: created", "CustomResourceDefinition/schedules.velero.io: attempting to create resource", "CustomResourceDefinition/schedules.velero.io: already exists, proceeding", "CustomResourceDefinition/schedules.velero.io: created", "CustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource", "CustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/serverstatusrequests.velero.io: created", "CustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource", "CustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding", "CustomResourceDefinition/volumesnapshotlocations.velero.io: created", "Waiting for resources to be ready in cluster...", "Namespace/velero: attempting to create resource", "Namespace/velero: created", "ClusterRoleBinding/velero: attempting to create resource", "ClusterRoleBinding/velero: created", "ServiceAccount/velero: attempting to create resource", "ServiceAccount/velero: created", "Secret/cloud-credentials: attempting to create resource", "Secret/cloud-credentials: created", "BackupStorageLocation/default: attempting to create resource", "BackupStorageLocation/default: created", "Deployment/velero: attempting to create resource", "Deployment/velero: created", "Velero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status."]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:214 | |
| 2020-06-25T06:27:29.791377 (delta: 2.659935) elapsed: 35.181959 ******* | |
| FAILED - RETRYING: Checking for velero server status (20 retries left). | |
| FAILED - RETRYING: Checking for velero server status (19 retries left). | |
| FAILED - RETRYING: Checking for velero server status (18 retries left). | |
| changed: [127.0.0.1] => {"attempts": 4, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.795918", "end": "2020-06-25 06:27:48.502162", "rc": 0, "start": "2020-06-25 06:27:47.706244", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Replacing profile spec in volumesnapshotlocation.yml] ******************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:223 | |
| 2020-06-25T06:27:48.554189 (delta: 18.762776) elapsed: 53.944771 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:230 | |
| 2020-06-25T06:27:48.610388 (delta: 0.056164) elapsed: 54.00097 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:236 | |
| 2020-06-25T06:27:48.665117 (delta: 0.054696) elapsed: 54.055699 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl apply -f gcp-volume-snapshot-location.yml", "delta": "0:00:00.972762", "end": "2020-06-25 06:27:49.787382", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:48.814620", "stderr": "", "stderr_lines": [], "stdout": "volumesnapshotlocation.velero.io/gcp-bucket created", "stdout_lines": ["volumesnapshotlocation.velero.io/gcp-bucket created"]} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:242 | |
| 2020-06-25T06:27:49.840817 (delta: 1.175665) elapsed: 55.231399 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing development image of OpenEBS velero-plugin] ******************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:248 | |
| 2020-06-25T06:27:49.897878 (delta: 0.057028) elapsed: 55.28846 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero plugin add openebs/velero-plugin:ci", "delta": "0:00:00.876597", "end": "2020-06-25 06:27:50.931150", "rc": 0, "start": "2020-06-25 06:27:50.054553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Waiting for new velero server pod to come up] **************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:252 | |
| 2020-06-25T06:27:50.982054 (delta: 1.084143) elapsed: 56.372636 ******* | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (20 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (19 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (18 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (17 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (16 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod -n velero --no-headers -l deploy=velero | wc -l", "delta": "0:00:00.989954", "end": "2020-06-25 06:28:21.926413", "rc": 0, "start": "2020-06-25 06:28:20.936459", "stderr": "", "stderr_lines": [], "stdout": "1", "stdout_lines": ["1"]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:261 | |
| 2020-06-25T06:28:21.983155 (delta: 31.00106) elapsed: 87.373737 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.934707", "end": "2020-06-25 06:28:23.056345", "rc": 0, "start": "2020-06-25 06:28:22.121638", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Checking for velero server container status] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:268 | |
| 2020-06-25T06:28:23.113763 (delta: 1.130558) elapsed: 88.504345 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.containerStatuses[0].ready}'", "delta": "0:00:00.967407", "end": "2020-06-25 06:28:24.223946", "rc": 0, "start": "2020-06-25 06:28:23.256539", "stderr": "", "stderr_lines": [], "stdout": "true", "stdout_lines": ["true"]} | |
| TASK [Get Application pod details] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:24 | |
| 2020-06-25T06:28:24.277814 (delta: 1.163985) elapsed: 89.668396 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.794854", "end": "2020-06-25 06:28:25.217326", "rc": 0, "start": "2020-06-25 06:28:24.422472", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-vmn8l", "stdout_lines": ["percona-7c6969cf78-vmn8l"]} | |
| TASK [Create new database in the mysql] **************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:28 | |
| 2020-06-25T06:28:25.267296 (delta: 0.98945) elapsed: 90.657878 ******** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:28:25.383522 (delta: 0.116192) elapsed: 90.774104 ******* | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create database backup;'", "delta": "0:00:01.167503", "end": "2020-06-25 06:28:26.707218", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "rc": 0, "start": "2020-06-25 06:28:25.539715", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "delta": "0:00:01.286102", "end": "2020-06-25 06:28:28.129293", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "rc": 0, "start": "2020-06-25 06:28:26.843191", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "delta": "0:00:00.961560", "end": "2020-06-25 06:28:29.242626", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "rc": 0, "start": "2020-06-25 06:28:28.281066", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:28:29.291844 (delta: 3.90829) elapsed: 94.682426 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:28:29.335031 (delta: 0.043148) elapsed: 94.725613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:28:29.378993 (delta: 0.043927) elapsed: 94.769575 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:28:29.421331 (delta: 0.042306) elapsed: 94.811913 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Get the container status of application.] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:51 | |
| 2020-06-25T06:28:29.465277 (delta: 0.043912) elapsed: 94.855859 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Check if db is ready for connections] ************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:61 | |
| 2020-06-25T06:28:29.506968 (delta: 0.041658) elapsed: 94.89755 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for the Corrupted tables] *************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:68 | |
| 2020-06-25T06:28:29.551934 (delta: 0.044933) elapsed: 94.942516 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify mysql data persistence] ******************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:77 | |
| 2020-06-25T06:28:29.595600 (delta: 0.043615) elapsed: 94.986182 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Delete/drop MySQL database] ********************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:90 | |
| 2020-06-25T06:28:29.637299 (delta: 0.041665) elapsed: 95.027881 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify successful db delete] ********************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:98 | |
| 2020-06-25T06:28:29.681284 (delta: 0.043951) elapsed: 95.071866 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application mount point] ************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:40 | |
| 2020-06-25T06:28:29.723895 (delta: 0.042577) elapsed: 95.114477 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Writing data on application mount point] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:45 | |
| 2020-06-25T06:28:29.774516 (delta: 0.050586) elapsed: 95.165098 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application deployment name] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:52 | |
| 2020-06-25T06:28:29.829231 (delta: 0.05468) elapsed: 95.219813 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching the volume name of application] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:56 | |
| 2020-06-25T06:28:29.877264 (delta: 0.047998) elapsed: 95.267846 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Annotating the application pod] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:61 | |
| 2020-06-25T06:28:29.927650 (delta: 0.05035) elapsed: 95.318232 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup for the provided application] **************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:66 | |
| 2020-06-25T06:28:29.975647 (delta: 0.047945) elapsed: 95.366229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:30.153731 (delta: 0.178049) elapsed: 95.544313 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:30.208755 (delta: 0.054997) elapsed: 95.599337 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero backup create percona-backup --include-namespaces=app-percona-csi --snapshot-volumes --volume-snapshot-locations=gcp-bucket", "delta": "0:00:00.762984", "end": "2020-06-25 06:28:31.123022", "rc": 0, "start": "2020-06-25 06:28:30.360038", "stderr": "", "stderr_lines": [], "stdout": "Backup request \"percona-backup\" submitted successfully.\nRun `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details.", "stdout_lines": ["Backup request \"percona-backup\" submitted successfully.", "Run `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details."]} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:31.172031 (delta: 0.963226) elapsed: 96.562613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:31.225986 (delta: 0.053811) elapsed: 96.616568 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:31.289287 (delta: 0.063264) elapsed: 96.679869 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:31.345350 (delta: 0.056006) elapsed: 96.735932 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:31.389658 (delta: 0.044267) elapsed: 96.78024 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:31.433499 (delta: 0.043805) elapsed: 96.824081 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:28:31.479518 (delta: 0.045983) elapsed: 96.8701 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:28:31.522464 (delta: 0.042912) elapsed: 96.913046 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:28:31.568668 (delta: 0.04617) elapsed: 96.95925 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:28:31.624925 (delta: 0.056222) elapsed: 97.015507 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:28:31.686480 (delta: 0.061515) elapsed: 97.077062 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:28:31.733581 (delta: 0.047046) elapsed: 97.124163 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:28:31.790562 (delta: 0.05694) elapsed: 97.181144 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:75 | |
| 2020-06-25T06:28:31.851578 (delta: 0.060963) elapsed: 97.24216 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the backup name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:79 | |
| 2020-06-25T06:28:31.906991 (delta: 0.055362) elapsed: 97.297573 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:83 | |
| 2020-06-25T06:28:31.957242 (delta: 0.050204) elapsed: 97.347824 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:90 | |
| 2020-06-25T06:28:32.007047 (delta: 0.049757) elapsed: 97.397629 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for completed backup] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:95 | |
| 2020-06-25T06:28:32.060182 (delta: 0.0531) elapsed: 97.450764 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the base backup name] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:102 | |
| 2020-06-25T06:28:32.109735 (delta: 0.049515) elapsed: 97.500317 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of backup] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:108 | |
| 2020-06-25T06:28:32.161647 (delta: 0.051862) elapsed: 97.552229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:32.290429 (delta: 0.128743) elapsed: 97.681011 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:32.333229 (delta: 0.042766) elapsed: 97.723811 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:32.378833 (delta: 0.045568) elapsed: 97.769415 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:32.422233 (delta: 0.043363) elapsed: 97.812815 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:32.464751 (delta: 0.042483) elapsed: 97.855333 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:32.513763 (delta: 0.048965) elapsed: 97.904345 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:32.558227 (delta: 0.044411) elapsed: 97.948809 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:32.604590 (delta: 0.04633) elapsed: 97.995172 ******** | |
| FAILED - RETRYING: Getting the state of Backup (100 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (99 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (98 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (97 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (96 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get backup percona-backup -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.999175", "end": "2020-06-25 06:29:03.889667", "rc": 0, "start": "2020-06-25 06:29:02.890492", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:03.946478 (delta: 31.341852) elapsed: 129.33706 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:03.991455 (delta: 0.044942) elapsed: 129.382037 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:04.035862 (delta: 0.044373) elapsed: 129.426444 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:04.082631 (delta: 0.046736) elapsed: 129.473213 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:04.127378 (delta: 0.044713) elapsed: 129.51796 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:04.171571 (delta: 0.044156) elapsed: 129.562153 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:04.215981 (delta: 0.044365) elapsed: 129.606563 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verifying for local snaphot deletion] ************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:115 | |
| 2020-06-25T06:29:04.259414 (delta: 0.043394) elapsed: 129.649996 ****** | |
| included: /experiments/functional/backup_and_restore/additional_verification.yml for 127.0.0.1 | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:4 | |
| 2020-06-25T06:29:04.398569 (delta: 0.13912) elapsed: 129.789151 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.756255", "end": "2020-06-25 06:29:05.298383", "rc": 0, "start": "2020-06-25 06:29:04.542128", "stderr": "", "stderr_lines": [], "stdout": "pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor backup name] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:8 | |
| 2020-06-25T06:29:05.344283 (delta: 0.945679) elapsed: 130.734865 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get cstorbackup -n app-percona-csi | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.717512", "end": "2020-06-25 06:29:06.206557", "rc": 0, "start": "2020-06-25 06:29:05.489045", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor pool UID] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:15 | |
| 2020-06-25T06:29:06.255406 (delta: 0.911087) elapsed: 131.645988 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cstorbackup percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -n app-percona-csi -o jsonpath='{.metadata.labels.cstorpool\\.openebs\\.io/uid}'", "delta": "0:00:00.733727", "end": "2020-06-25 06:29:07.130608", "rc": 0, "start": "2020-06-25 06:29:06.396881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the CVR name from the corresponding pool uid] ******************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:19 | |
| 2020-06-25T06:29:07.184672 (delta: 0.92923) elapsed: 132.575254 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l cstorpool.openebs.io/uid=,cstorvolume.openebs.io/name=pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -o jsonpath='{.items[*].metadata.name}'", "delta": "0:00:00.743689", "end": "2020-06-25 06:29:08.133069", "rc": 0, "start": "2020-06-25 06:29:07.389380", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the cstor pool label from cvr] *********************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:23 | |
| 2020-06-25T06:29:08.178094 (delta: 0.993386) elapsed: 133.568676 ****** | |
| TASK [Geting the pool pod name corresponding to the label] ********************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:29 | |
| 2020-06-25T06:29:08.223360 (delta: 0.045214) elapsed: 133.613942 ****** | |
| TASK [Deleting the cstor pool pod] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:37 | |
| 2020-06-25T06:29:08.270044 (delta: 0.046649) elapsed: 133.660626 ****** | |
| TASK [Verifying whether local snapshot is deleted] ***************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:48 | |
| 2020-06-25T06:29:08.320524 (delta: 0.050429) elapsed: 133.711106 ****** | |
| TASK [Getting maya-pai-server pod name] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:61 | |
| 2020-06-25T06:29:08.368566 (delta: 0.048007) elapsed: 133.759148 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting the maya-api-server pod] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:65 | |
| 2020-06-25T06:29:08.415911 (delta: 0.047309) elapsed: 133.806493 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting Application] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:124 | |
| 2020-06-25T06:29:08.463334 (delta: 0.047389) elapsed: 133.853916 ****** | |
| ^C | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-vmn8l 0/1 Terminating 0 6m22s | |
| d2iq@rack2:~$ kubectl logs -f litmus-velero-backup-restore-zwcrl-g6mkm -n litmus | |
| ansible-playbook 2.7.3 | |
| config file = None | |
| configured module search path = [u'/root/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules'] | |
| ansible python module location = /usr/local/lib/python2.7/dist-packages/ansible | |
| executable location = /usr/local/bin/ansible-playbook | |
| python version = 2.7.17 (default, Apr 15 2020, 17:20:14) [GCC 7.5.0] | |
| No config file found; using defaults | |
| /etc/ansible/hosts did not meet host_list requirements, check plugin documentation if this is unexpected | |
| /etc/ansible/hosts did not meet script requirements, check plugin documentation if this is unexpected | |
| PLAYBOOK: test.yml ************************************************************* | |
| 1 plays in ./experiments/functional/backup_and_restore/test.yml | |
| PLAY [localhost] *************************************************************** | |
| 2020-06-25T06:26:54.651979 (delta: 0.042561) elapsed: 0.042561 ******** | |
| =============================================================================== | |
| TASK [Gathering Facts] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:1 | |
| 2020-06-25T06:26:54.677843 (delta: 0.025828) elapsed: 0.068425 ******** | |
| ok: [127.0.0.1] | |
| META: ran handlers | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:12 | |
| 2020-06-25T06:27:02.124833 (delta: 7.44697) elapsed: 7.515415 ********* | |
| included: /utils/fcm/create_testname.yml for 127.0.0.1 | |
| TASK [Record test instance/run ID] ********************************************* | |
| task path: /utils/fcm/create_testname.yml:3 | |
| 2020-06-25T06:27:02.193182 (delta: 0.068318) elapsed: 7.583764 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Construct testname appended with runID] ********************************** | |
| task path: /utils/fcm/create_testname.yml:7 | |
| 2020-06-25T06:27:02.243609 (delta: 0.050379) elapsed: 7.634191 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:15 | |
| 2020-06-25T06:27:02.296859 (delta: 0.053219) elapsed: 7.687441 ******** | |
| included: /utils/fcm/update_litmus_result_resource.yml for 127.0.0.1 | |
| TASK [Generate the litmus result CR to reflect SOT (Start of Test)] ************ | |
| task path: /utils/fcm/update_litmus_result_resource.yml:3 | |
| 2020-06-25T06:27:02.374467 (delta: 0.077575) elapsed: 7.765049 ******** | |
| changed: [127.0.0.1] => {"changed": true, "checksum": "cb23761ee0ecfea3a093f94c0443739c777b3007", "dest": "./litmus-result.yaml", "gid": 0, "group": "root", "md5sum": "0da5664e16958d4f3c263662ebe36b5c", "mode": "0644", "owner": "root", "size": 422, "src": "/root/.ansible/tmp/ansible-tmp-1593066422.41-35404301145742/source", "state": "file", "uid": 0} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:14 | |
| 2020-06-25T06:27:02.892199 (delta: 0.517704) elapsed: 8.282781 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat litmus-result.yaml", "delta": "0:00:00.776459", "end": "2020-06-25 06:27:03.908295", "rc": 0, "start": "2020-06-25 06:27:03.131836", "stderr": "", "stderr_lines": [], "stdout": "---\napiVersion: litmus.io/v1alpha1\nkind: LitmusResult\nmetadata:\n\n # name of the litmus testcase\n name: velero-backup-restore \nspec:\n\n # holds information on the testcase\n testMetadata:\n app: \n chaostype: \n\n # holds the state of testcase, manually updated by json merge patch\n # result is the useful value today, but anticipate phase use in future \n testStatus: \n phase: in-progress \n result: none ", "stdout_lines": ["---", "apiVersion: litmus.io/v1alpha1", "kind: LitmusResult", "metadata:", "", " # name of the litmus testcase", " name: velero-backup-restore ", "spec:", "", " # holds information on the testcase", " testMetadata:", " app: ", " chaostype: ", "", " # holds the state of testcase, manually updated by json merge patch", " # result is the useful value today, but anticipate phase use in future ", " testStatus: ", " phase: in-progress ", " result: none "]} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:17 | |
| 2020-06-25T06:27:03.958838 (delta: 1.066606) elapsed: 9.34942 ********* | |
| changed: [127.0.0.1] => {"changed": true, "failed_when_result": false, "method": "create", "result": {"apiVersion": "litmus.io/v1alpha1", "kind": "LitmusResult", "metadata": {"creationTimestamp": "2020-06-25T06:27:04Z", "generation": 1, "name": "velero-backup-restore", "resourceVersion": "270870", "selfLink": "/apis/litmus.io/v1alpha1/litmusresults/velero-backup-restore", "uid": "76cd180d-4057-43ae-9202-847be8bda1f2"}, "spec": {"testMetadata": {"app": null, "chaostype": null}, "testStatus": {"phase": "in-progress", "result": "none"}}}} | |
| TASK [Generate the litmus result CR to reflect EOT (End of Test)] ************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:27 | |
| 2020-06-25T06:27:04.791716 (delta: 0.832849) elapsed: 10.182298 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:38 | |
| 2020-06-25T06:27:04.837682 (delta: 0.045923) elapsed: 10.228264 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:41 | |
| 2020-06-25T06:27:04.884764 (delta: 0.047049) elapsed: 10.275346 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify that the AUT is running] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:19 | |
| 2020-06-25T06:27:04.927701 (delta: 0.042895) elapsed: 10.318283 ******* | |
| included: /utils/k8s/check_deployment_status.yml for 127.0.0.1 | |
| TASK [Check the pod status] **************************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:8 | |
| 2020-06-25T06:27:05.005795 (delta: 0.078046) elapsed: 10.396377 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:status.phase", "delta": "0:00:01.021615", "end": "2020-06-25 06:27:06.174018", "rc": 0, "start": "2020-06-25 06:27:05.152403", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [obtain the number of replicas.] ****************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:22 | |
| 2020-06-25T06:27:06.221079 (delta: 1.215237) elapsed: 11.611661 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the ready replica count and compare with the replica count.] ****** | |
| task path: /utils/k8s/check_deployment_status.yml:29 | |
| 2020-06-25T06:27:06.269457 (delta: 0.048345) elapsed: 11.660039 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:22 | |
| 2020-06-25T06:27:06.318949 (delta: 0.049459) elapsed: 11.709531 ******* | |
| included: /experiments/functional/backup_and_restore/setup_dependency.yml for 127.0.0.1 | |
| TASK [Downloading velero binary] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:1 | |
| 2020-06-25T06:27:06.466656 (delta: 0.147675) elapsed: 11.857238 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "c5fe9de752d3152b32326ff2dab02198f9274868", "dest": "./velero-v1.4.0-linux-amd64.tar.gz", "gid": 0, "group": "root", "md5sum": "acb7e7184de6c45f4b88d71333115c7d", "mode": "0644", "msg": "OK (23832176 bytes)", "owner": "root", "size": 23832176, "src": "/root/.ansible/tmp/ansible-tmp-1593066426.51-91520691137004/tmp4LWNOB", "state": "file", "status_code": 200, "uid": 0, "url": "https://github.com/vmware-tanzu/velero/releases/download/v1.4.0/velero-v1.4.0-linux-amd64.tar.gz"} | |
| TASK [Installing velero inside litmus container] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:11 | |
| 2020-06-25T06:27:12.970388 (delta: 6.503702) elapsed: 18.36097 ******** | |
| [WARNING]: Consider using the unarchive module rather than running tar. If | |
| you need to use command because unarchive is insufficient you can add | |
| warn=False to this command task or set command_warnings=False in ansible.cfg to | |
| get rid of this message. | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "tar -xvf velero-v1.4.0-linux-amd64.tar.gz\n mv velero-v1.4.0-linux-amd64/velero /usr/local/bin/", "delta": "0:00:01.147221", "end": "2020-06-25 06:27:14.273089", "rc": 0, "start": "2020-06-25 06:27:13.125868", "stderr": "", "stderr_lines": [], "stdout": "velero-v1.4.0-linux-amd64/LICENSE\nvelero-v1.4.0-linux-amd64/examples/README.md\nvelero-v1.4.0-linux-amd64/examples/minio\nvelero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app\nvelero-v1.4.0-linux-amd64/examples/nginx-app/README.md\nvelero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml\nvelero-v1.4.0-linux-amd64/velero", "stdout_lines": ["velero-v1.4.0-linux-amd64/LICENSE", "velero-v1.4.0-linux-amd64/examples/README.md", "velero-v1.4.0-linux-amd64/examples/minio", "velero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app", "velero-v1.4.0-linux-amd64/examples/nginx-app/README.md", "velero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml", "velero-v1.4.0-linux-amd64/velero"]} | |
| TASK [Checking the velero version] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:16 | |
| 2020-06-25T06:27:14.316697 (delta: 1.346277) elapsed: 19.707279 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero version", "delta": "0:00:00.730747", "end": "2020-06-25 06:27:15.208332", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:14.477585", "stderr": "", "stderr_lines": [], "stdout": "Client:\n\tVersion: v1.4.0\n\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392\n<error getting server version: namespaces \"velero\" not found>", "stdout_lines": ["Client:", "\tVersion: v1.4.0", "\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392", "<error getting server version: namespaces \"velero\" not found>"]} | |
| TASK [Replacing Profile name in credential file] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:21 | |
| 2020-06-25T06:27:15.264347 (delta: 0.947611) elapsed: 20.654929 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing minio s3-bucket] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:30 | |
| 2020-06-25T06:27:15.314786 (delta: 0.050377) elapsed: 20.705368 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for minio pod status] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:33 | |
| 2020-06-25T06:27:15.366090 (delta: 0.051256) elapsed: 20.756672 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for minio job to create bucket] ********************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:40 | |
| 2020-06-25T06:27:15.415489 (delta: 0.049366) elapsed: 20.806071 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching service account key.json from configmap] ************************ | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:51 | |
| 2020-06-25T06:27:15.462010 (delta: 0.046491) elapsed: 20.852592 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cm gcp-key -n litmus -o jsonpath='{.data.key\\.json}' > ./key.json", "delta": "0:00:00.749906", "end": "2020-06-25 06:27:16.361887", "rc": 0, "start": "2020-06-25 06:27:15.611981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Authenticating using gcp service account] ******************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:54 | |
| 2020-06-25T06:27:16.405081 (delta: 0.943039) elapsed: 21.795663 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud auth activate-service-account --key-file key.json", "delta": "0:00:01.405389", "end": "2020-06-25 06:27:17.955478", "rc": 0, "start": "2020-06-25 06:27:16.550089", "stderr": "Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]", "stderr_lines": ["Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]"], "stdout": "", "stdout_lines": []} | |
| TASK [Setting up the project ID] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:57 | |
| 2020-06-25T06:27:17.999600 (delta: 1.594482) elapsed: 23.390182 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud config set project openebs-ci", "delta": "0:00:02.626419", "end": "2020-06-25 06:27:20.774683", "rc": 0, "start": "2020-06-25 06:27:18.148264", "stderr": "Updated property [core/project].", "stderr_lines": ["Updated property [core/project]."], "stdout": "", "stdout_lines": []} | |
| TASK [Deleting GCP bucket if exist] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:60 | |
| 2020-06-25T06:27:20.822552 (delta: 2.822894) elapsed: 26.213134 ******* | |
| fatal: [127.0.0.1]: FAILED! => {"changed": true, "cmd": "gsutil rm -r gs://e2e-gcp-bucket", "delta": "0:00:02.569143", "end": "2020-06-25 06:27:23.543148", "msg": "non-zero return code", "rc": 1, "start": "2020-06-25 06:27:20.974005", "stderr": "BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist.", "stderr_lines": ["BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist."], "stdout": "", "stdout_lines": []} | |
| ...ignoring | |
| TASK [Creating gcp bucket] ***************************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:66 | |
| 2020-06-25T06:27:23.587756 (delta: 2.765161) elapsed: 28.978338 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gsutil mb gs://e2e-gcp-bucket/", "delta": "0:00:02.725371", "end": "2020-06-25 06:27:26.453327", "rc": 0, "start": "2020-06-25 06:27:23.727956", "stderr": "Creating gs://e2e-gcp-bucket/...", "stderr_lines": ["Creating gs://e2e-gcp-bucket/..."], "stdout": "", "stdout_lines": []} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:75 | |
| 2020-06-25T06:27:26.498168 (delta: 2.910369) elapsed: 31.88875 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:86 | |
| 2020-06-25T06:27:26.547529 (delta: 0.049329) elapsed: 31.938111 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:102 | |
| 2020-06-25T06:27:26.598274 (delta: 0.050713) elapsed: 31.988856 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:112 | |
| 2020-06-25T06:27:26.647864 (delta: 0.049556) elapsed: 32.038446 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:127 | |
| 2020-06-25T06:27:26.698422 (delta: 0.050527) elapsed: 32.089004 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Replacing Restic Image in patch.yml] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:136 | |
| 2020-06-25T06:27:26.750037 (delta: 0.051582) elapsed: 32.140619 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:142 | |
| 2020-06-25T06:27:26.804908 (delta: 0.054821) elapsed: 32.19549 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the number of compute nodes] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:149 | |
| 2020-06-25T06:27:26.856863 (delta: 0.051919) elapsed: 32.247445 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the status of restic demonset pods] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:153 | |
| 2020-06-25T06:27:26.907468 (delta: 0.050553) elapsed: 32.29805 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:166 | |
| 2020-06-25T06:27:26.957366 (delta: 0.049866) elapsed: 32.347948 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:176 | |
| 2020-06-25T06:27:27.017307 (delta: 0.059907) elapsed: 32.407889 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:191 | |
| 2020-06-25T06:27:27.073152 (delta: 0.055813) elapsed: 32.463734 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:200 | |
| 2020-06-25T06:27:27.131408 (delta: 0.058206) elapsed: 32.52199 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero install --provider gcp --plugins velero/velero-plugin-for-gcp:v1.0.0 --bucket e2e-gcp-bucket --use-volume-snapshots=false --secret-file ./key.json", "delta": "0:00:02.461571", "end": "2020-06-25 06:27:29.744220", "rc": 0, "start": "2020-06-25 06:27:27.282649", "stderr": "", "stderr_lines": [], "stdout": "CustomResourceDefinition/backups.velero.io: attempting to create resource\nCustomResourceDefinition/backups.velero.io: already exists, proceeding\nCustomResourceDefinition/backups.velero.io: created\nCustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource\nCustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding\nCustomResourceDefinition/backupstoragelocations.velero.io: created\nCustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource\nCustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding\nCustomResourceDefinition/deletebackuprequests.velero.io: created\nCustomResourceDefinition/downloadrequests.velero.io: attempting to create resource\nCustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/downloadrequests.velero.io: created\nCustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumebackups.velero.io: created\nCustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumerestores.velero.io: created\nCustomResourceDefinition/resticrepositories.velero.io: attempting to create resource\nCustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding\nCustomResourceDefinition/resticrepositories.velero.io: created\nCustomResourceDefinition/restores.velero.io: attempting to create resource\nCustomResourceDefinition/restores.velero.io: already exists, proceeding\nCustomResourceDefinition/restores.velero.io: created\nCustomResourceDefinition/schedules.velero.io: attempting to create resource\nCustomResourceDefinition/schedules.velero.io: already exists, proceeding\nCustomResourceDefinition/schedules.velero.io: created\nCustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource\nCustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/serverstatusrequests.velero.io: created\nCustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource\nCustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding\nCustomResourceDefinition/volumesnapshotlocations.velero.io: created\nWaiting for resources to be ready in cluster...\nNamespace/velero: attempting to create resource\nNamespace/velero: created\nClusterRoleBinding/velero: attempting to create resource\nClusterRoleBinding/velero: created\nServiceAccount/velero: attempting to create resource\nServiceAccount/velero: created\nSecret/cloud-credentials: attempting to create resource\nSecret/cloud-credentials: created\nBackupStorageLocation/default: attempting to create resource\nBackupStorageLocation/default: created\nDeployment/velero: attempting to create resource\nDeployment/velero: created\nVelero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status.", "stdout_lines": ["CustomResourceDefinition/backups.velero.io: attempting to create resource", "CustomResourceDefinition/backups.velero.io: already exists, proceeding", "CustomResourceDefinition/backups.velero.io: created", "CustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource", "CustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding", "CustomResourceDefinition/backupstoragelocations.velero.io: created", "CustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource", "CustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding", "CustomResourceDefinition/deletebackuprequests.velero.io: created", "CustomResourceDefinition/downloadrequests.velero.io: attempting to create resource", "CustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/downloadrequests.velero.io: created", "CustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumebackups.velero.io: created", "CustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumerestores.velero.io: created", "CustomResourceDefinition/resticrepositories.velero.io: attempting to create resource", "CustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding", "CustomResourceDefinition/resticrepositories.velero.io: created", "CustomResourceDefinition/restores.velero.io: attempting to create resource", "CustomResourceDefinition/restores.velero.io: already exists, proceeding", "CustomResourceDefinition/restores.velero.io: created", "CustomResourceDefinition/schedules.velero.io: attempting to create resource", "CustomResourceDefinition/schedules.velero.io: already exists, proceeding", "CustomResourceDefinition/schedules.velero.io: created", "CustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource", "CustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/serverstatusrequests.velero.io: created", "CustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource", "CustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding", "CustomResourceDefinition/volumesnapshotlocations.velero.io: created", "Waiting for resources to be ready in cluster...", "Namespace/velero: attempting to create resource", "Namespace/velero: created", "ClusterRoleBinding/velero: attempting to create resource", "ClusterRoleBinding/velero: created", "ServiceAccount/velero: attempting to create resource", "ServiceAccount/velero: created", "Secret/cloud-credentials: attempting to create resource", "Secret/cloud-credentials: created", "BackupStorageLocation/default: attempting to create resource", "BackupStorageLocation/default: created", "Deployment/velero: attempting to create resource", "Deployment/velero: created", "Velero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status."]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:214 | |
| 2020-06-25T06:27:29.791377 (delta: 2.659935) elapsed: 35.181959 ******* | |
| FAILED - RETRYING: Checking for velero server status (20 retries left). | |
| FAILED - RETRYING: Checking for velero server status (19 retries left). | |
| FAILED - RETRYING: Checking for velero server status (18 retries left). | |
| changed: [127.0.0.1] => {"attempts": 4, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.795918", "end": "2020-06-25 06:27:48.502162", "rc": 0, "start": "2020-06-25 06:27:47.706244", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Replacing profile spec in volumesnapshotlocation.yml] ******************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:223 | |
| 2020-06-25T06:27:48.554189 (delta: 18.762776) elapsed: 53.944771 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:230 | |
| 2020-06-25T06:27:48.610388 (delta: 0.056164) elapsed: 54.00097 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:236 | |
| 2020-06-25T06:27:48.665117 (delta: 0.054696) elapsed: 54.055699 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl apply -f gcp-volume-snapshot-location.yml", "delta": "0:00:00.972762", "end": "2020-06-25 06:27:49.787382", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:48.814620", "stderr": "", "stderr_lines": [], "stdout": "volumesnapshotlocation.velero.io/gcp-bucket created", "stdout_lines": ["volumesnapshotlocation.velero.io/gcp-bucket created"]} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:242 | |
| 2020-06-25T06:27:49.840817 (delta: 1.175665) elapsed: 55.231399 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing development image of OpenEBS velero-plugin] ******************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:248 | |
| 2020-06-25T06:27:49.897878 (delta: 0.057028) elapsed: 55.28846 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero plugin add openebs/velero-plugin:ci", "delta": "0:00:00.876597", "end": "2020-06-25 06:27:50.931150", "rc": 0, "start": "2020-06-25 06:27:50.054553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Waiting for new velero server pod to come up] **************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:252 | |
| 2020-06-25T06:27:50.982054 (delta: 1.084143) elapsed: 56.372636 ******* | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (20 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (19 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (18 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (17 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (16 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod -n velero --no-headers -l deploy=velero | wc -l", "delta": "0:00:00.989954", "end": "2020-06-25 06:28:21.926413", "rc": 0, "start": "2020-06-25 06:28:20.936459", "stderr": "", "stderr_lines": [], "stdout": "1", "stdout_lines": ["1"]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:261 | |
| 2020-06-25T06:28:21.983155 (delta: 31.00106) elapsed: 87.373737 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.934707", "end": "2020-06-25 06:28:23.056345", "rc": 0, "start": "2020-06-25 06:28:22.121638", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Checking for velero server container status] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:268 | |
| 2020-06-25T06:28:23.113763 (delta: 1.130558) elapsed: 88.504345 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.containerStatuses[0].ready}'", "delta": "0:00:00.967407", "end": "2020-06-25 06:28:24.223946", "rc": 0, "start": "2020-06-25 06:28:23.256539", "stderr": "", "stderr_lines": [], "stdout": "true", "stdout_lines": ["true"]} | |
| TASK [Get Application pod details] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:24 | |
| 2020-06-25T06:28:24.277814 (delta: 1.163985) elapsed: 89.668396 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.794854", "end": "2020-06-25 06:28:25.217326", "rc": 0, "start": "2020-06-25 06:28:24.422472", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-vmn8l", "stdout_lines": ["percona-7c6969cf78-vmn8l"]} | |
| TASK [Create new database in the mysql] **************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:28 | |
| 2020-06-25T06:28:25.267296 (delta: 0.98945) elapsed: 90.657878 ******** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:28:25.383522 (delta: 0.116192) elapsed: 90.774104 ******* | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create database backup;'", "delta": "0:00:01.167503", "end": "2020-06-25 06:28:26.707218", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "rc": 0, "start": "2020-06-25 06:28:25.539715", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "delta": "0:00:01.286102", "end": "2020-06-25 06:28:28.129293", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "rc": 0, "start": "2020-06-25 06:28:26.843191", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "delta": "0:00:00.961560", "end": "2020-06-25 06:28:29.242626", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "rc": 0, "start": "2020-06-25 06:28:28.281066", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:28:29.291844 (delta: 3.90829) elapsed: 94.682426 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:28:29.335031 (delta: 0.043148) elapsed: 94.725613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:28:29.378993 (delta: 0.043927) elapsed: 94.769575 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:28:29.421331 (delta: 0.042306) elapsed: 94.811913 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Get the container status of application.] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:51 | |
| 2020-06-25T06:28:29.465277 (delta: 0.043912) elapsed: 94.855859 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Check if db is ready for connections] ************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:61 | |
| 2020-06-25T06:28:29.506968 (delta: 0.041658) elapsed: 94.89755 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for the Corrupted tables] *************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:68 | |
| 2020-06-25T06:28:29.551934 (delta: 0.044933) elapsed: 94.942516 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify mysql data persistence] ******************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:77 | |
| 2020-06-25T06:28:29.595600 (delta: 0.043615) elapsed: 94.986182 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Delete/drop MySQL database] ********************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:90 | |
| 2020-06-25T06:28:29.637299 (delta: 0.041665) elapsed: 95.027881 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify successful db delete] ********************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:98 | |
| 2020-06-25T06:28:29.681284 (delta: 0.043951) elapsed: 95.071866 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application mount point] ************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:40 | |
| 2020-06-25T06:28:29.723895 (delta: 0.042577) elapsed: 95.114477 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Writing data on application mount point] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:45 | |
| 2020-06-25T06:28:29.774516 (delta: 0.050586) elapsed: 95.165098 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application deployment name] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:52 | |
| 2020-06-25T06:28:29.829231 (delta: 0.05468) elapsed: 95.219813 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching the volume name of application] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:56 | |
| 2020-06-25T06:28:29.877264 (delta: 0.047998) elapsed: 95.267846 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Annotating the application pod] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:61 | |
| 2020-06-25T06:28:29.927650 (delta: 0.05035) elapsed: 95.318232 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup for the provided application] **************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:66 | |
| 2020-06-25T06:28:29.975647 (delta: 0.047945) elapsed: 95.366229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:30.153731 (delta: 0.178049) elapsed: 95.544313 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:30.208755 (delta: 0.054997) elapsed: 95.599337 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero backup create percona-backup --include-namespaces=app-percona-csi --snapshot-volumes --volume-snapshot-locations=gcp-bucket", "delta": "0:00:00.762984", "end": "2020-06-25 06:28:31.123022", "rc": 0, "start": "2020-06-25 06:28:30.360038", "stderr": "", "stderr_lines": [], "stdout": "Backup request \"percona-backup\" submitted successfully.\nRun `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details.", "stdout_lines": ["Backup request \"percona-backup\" submitted successfully.", "Run `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details."]} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:31.172031 (delta: 0.963226) elapsed: 96.562613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:31.225986 (delta: 0.053811) elapsed: 96.616568 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:31.289287 (delta: 0.063264) elapsed: 96.679869 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:31.345350 (delta: 0.056006) elapsed: 96.735932 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:31.389658 (delta: 0.044267) elapsed: 96.78024 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:31.433499 (delta: 0.043805) elapsed: 96.824081 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:28:31.479518 (delta: 0.045983) elapsed: 96.8701 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:28:31.522464 (delta: 0.042912) elapsed: 96.913046 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:28:31.568668 (delta: 0.04617) elapsed: 96.95925 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:28:31.624925 (delta: 0.056222) elapsed: 97.015507 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:28:31.686480 (delta: 0.061515) elapsed: 97.077062 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:28:31.733581 (delta: 0.047046) elapsed: 97.124163 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:28:31.790562 (delta: 0.05694) elapsed: 97.181144 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:75 | |
| 2020-06-25T06:28:31.851578 (delta: 0.060963) elapsed: 97.24216 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the backup name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:79 | |
| 2020-06-25T06:28:31.906991 (delta: 0.055362) elapsed: 97.297573 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:83 | |
| 2020-06-25T06:28:31.957242 (delta: 0.050204) elapsed: 97.347824 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:90 | |
| 2020-06-25T06:28:32.007047 (delta: 0.049757) elapsed: 97.397629 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for completed backup] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:95 | |
| 2020-06-25T06:28:32.060182 (delta: 0.0531) elapsed: 97.450764 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the base backup name] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:102 | |
| 2020-06-25T06:28:32.109735 (delta: 0.049515) elapsed: 97.500317 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of backup] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:108 | |
| 2020-06-25T06:28:32.161647 (delta: 0.051862) elapsed: 97.552229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:32.290429 (delta: 0.128743) elapsed: 97.681011 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:32.333229 (delta: 0.042766) elapsed: 97.723811 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:32.378833 (delta: 0.045568) elapsed: 97.769415 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:32.422233 (delta: 0.043363) elapsed: 97.812815 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:32.464751 (delta: 0.042483) elapsed: 97.855333 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:32.513763 (delta: 0.048965) elapsed: 97.904345 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:32.558227 (delta: 0.044411) elapsed: 97.948809 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:32.604590 (delta: 0.04633) elapsed: 97.995172 ******** | |
| FAILED - RETRYING: Getting the state of Backup (100 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (99 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (98 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (97 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (96 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get backup percona-backup -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.999175", "end": "2020-06-25 06:29:03.889667", "rc": 0, "start": "2020-06-25 06:29:02.890492", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:03.946478 (delta: 31.341852) elapsed: 129.33706 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:03.991455 (delta: 0.044942) elapsed: 129.382037 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:04.035862 (delta: 0.044373) elapsed: 129.426444 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:04.082631 (delta: 0.046736) elapsed: 129.473213 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:04.127378 (delta: 0.044713) elapsed: 129.51796 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:04.171571 (delta: 0.044156) elapsed: 129.562153 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:04.215981 (delta: 0.044365) elapsed: 129.606563 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verifying for local snaphot deletion] ************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:115 | |
| 2020-06-25T06:29:04.259414 (delta: 0.043394) elapsed: 129.649996 ****** | |
| included: /experiments/functional/backup_and_restore/additional_verification.yml for 127.0.0.1 | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:4 | |
| 2020-06-25T06:29:04.398569 (delta: 0.13912) elapsed: 129.789151 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.756255", "end": "2020-06-25 06:29:05.298383", "rc": 0, "start": "2020-06-25 06:29:04.542128", "stderr": "", "stderr_lines": [], "stdout": "pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor backup name] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:8 | |
| 2020-06-25T06:29:05.344283 (delta: 0.945679) elapsed: 130.734865 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get cstorbackup -n app-percona-csi | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.717512", "end": "2020-06-25 06:29:06.206557", "rc": 0, "start": "2020-06-25 06:29:05.489045", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor pool UID] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:15 | |
| 2020-06-25T06:29:06.255406 (delta: 0.911087) elapsed: 131.645988 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cstorbackup percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -n app-percona-csi -o jsonpath='{.metadata.labels.cstorpool\\.openebs\\.io/uid}'", "delta": "0:00:00.733727", "end": "2020-06-25 06:29:07.130608", "rc": 0, "start": "2020-06-25 06:29:06.396881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the CVR name from the corresponding pool uid] ******************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:19 | |
| 2020-06-25T06:29:07.184672 (delta: 0.92923) elapsed: 132.575254 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l cstorpool.openebs.io/uid=,cstorvolume.openebs.io/name=pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -o jsonpath='{.items[*].metadata.name}'", "delta": "0:00:00.743689", "end": "2020-06-25 06:29:08.133069", "rc": 0, "start": "2020-06-25 06:29:07.389380", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the cstor pool label from cvr] *********************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:23 | |
| 2020-06-25T06:29:08.178094 (delta: 0.993386) elapsed: 133.568676 ****** | |
| TASK [Geting the pool pod name corresponding to the label] ********************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:29 | |
| 2020-06-25T06:29:08.223360 (delta: 0.045214) elapsed: 133.613942 ****** | |
| TASK [Deleting the cstor pool pod] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:37 | |
| 2020-06-25T06:29:08.270044 (delta: 0.046649) elapsed: 133.660626 ****** | |
| TASK [Verifying whether local snapshot is deleted] ***************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:48 | |
| 2020-06-25T06:29:08.320524 (delta: 0.050429) elapsed: 133.711106 ****** | |
| TASK [Getting maya-pai-server pod name] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:61 | |
| 2020-06-25T06:29:08.368566 (delta: 0.048007) elapsed: 133.759148 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting the maya-api-server pod] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:65 | |
| 2020-06-25T06:29:08.415911 (delta: 0.047309) elapsed: 133.806493 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting Application] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:124 | |
| 2020-06-25T06:29:08.463334 (delta: 0.047389) elapsed: 133.853916 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl delete pvc,deploy,svc --all -n app-percona-csi\n kubectl delete ns app-percona-csi", "delta": "0:00:18.673774", "end": "2020-06-25 06:29:27.323723", "rc": 0, "start": "2020-06-25 06:29:08.649949", "stderr": "", "stderr_lines": [], "stdout": "persistentvolumeclaim \"percona-mysql-claim\" deleted\ndeployment.extensions \"percona\" deleted\nservice \"percona-mysql\" deleted\nnamespace \"app-percona-csi\" deleted", "stdout_lines": ["persistentvolumeclaim \"percona-mysql-claim\" deleted", "deployment.extensions \"percona\" deleted", "service \"percona-mysql\" deleted", "namespace \"app-percona-csi\" deleted"]} | |
| TASK [Checking whether namespace is deleted] *********************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:129 | |
| 2020-06-25T06:29:27.367621 (delta: 18.904252) elapsed: 152.758203 ***** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get ns --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.757975", "end": "2020-06-25 06:29:28.274808", "rc": 0, "start": "2020-06-25 06:29:27.516833", "stderr": "", "stderr_lines": [], "stdout": "aman\ncert-manager\ndefault\nkommander\nkube-node-lease\nkube-public\nkube-system\nkubeaddons\nlitmus\nmaya-system\nopenebs\ntest\nvelero", "stdout_lines": ["aman", "cert-manager", "default", "kommander", "kube-node-lease", "kube-public", "kube-system", "kubeaddons", "litmus", "maya-system", "openebs", "test", "velero"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:146 | |
| 2020-06-25T06:29:28.326285 (delta: 0.958626) elapsed: 153.716867 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:28.424891 (delta: 0.09857) elapsed: 153.815473 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:28.475800 (delta: 0.050874) elapsed: 153.866382 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:28.527512 (delta: 0.051658) elapsed: 153.918094 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:28.595238 (delta: 0.067688) elapsed: 153.98582 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:28.654806 (delta: 0.05951) elapsed: 154.045388 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:28.706974 (delta: 0.05213) elapsed: 154.097556 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:28.763097 (delta: 0.056085) elapsed: 154.153679 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:28.813252 (delta: 0.050116) elapsed: 154.203834 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:28.869591 (delta: 0.056288) elapsed: 154.260173 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl create ns app-percona-csi", "delta": "0:00:00.921844", "end": "2020-06-25 06:29:29.953692", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:29:29.031848", "stderr": "", "stderr_lines": [], "stdout": "namespace/app-percona-csi created", "stdout_lines": ["namespace/app-percona-csi created"]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:30.003989 (delta: 1.134361) elapsed: 155.394571 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero restore create --from-backup percona-backup --restore-volumes=true", "delta": "0:00:00.742141", "end": "2020-06-25 06:29:30.905695", "rc": 0, "start": "2020-06-25 06:29:30.163554", "stderr": "", "stderr_lines": [], "stdout": "Restore request \"percona-backup-20200625062930\" submitted successfully.\nRun `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details.", "stdout_lines": ["Restore request \"percona-backup-20200625062930\" submitted successfully.", "Run `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details."]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:30.957816 (delta: 0.953795) elapsed: 156.348398 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.013633 (delta: 0.055776) elapsed: 156.404215 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:31.071681 (delta: 0.057998) elapsed: 156.462263 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:31.127733 (delta: 0.056011) elapsed: 156.518315 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:31.187804 (delta: 0.06001) elapsed: 156.578386 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:152 | |
| 2020-06-25T06:29:31.238816 (delta: 0.050976) elapsed: 156.629398 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:31.344329 (delta: 0.105478) elapsed: 156.734911 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:31.398928 (delta: 0.054557) elapsed: 156.78951 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:31.454105 (delta: 0.055131) elapsed: 156.844687 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:31.505860 (delta: 0.051716) elapsed: 156.896442 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:31.555513 (delta: 0.049619) elapsed: 156.946095 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:31.606027 (delta: 0.050479) elapsed: 156.996609 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:31.658945 (delta: 0.052881) elapsed: 157.049527 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:31.720250 (delta: 0.0612) elapsed: 157.110832 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:31.782094 (delta: 0.061792) elapsed: 157.172676 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:31.836390 (delta: 0.054256) elapsed: 157.226972 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:31.887438 (delta: 0.051008) elapsed: 157.27802 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.945602 (delta: 0.058112) elapsed: 157.336184 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:32.003396 (delta: 0.057743) elapsed: 157.393978 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:32.055557 (delta: 0.052096) elapsed: 157.446139 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero get restore | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.680082", "end": "2020-06-25 06:29:32.894615", "rc": 0, "start": "2020-06-25 06:29:32.214533", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-20200625062930", "stdout_lines": ["percona-backup-20200625062930"]} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:32.940140 (delta: 0.884546) elapsed: 158.330722 ****** | |
| FAILED - RETRYING: Checking the restore status (60 retries left). | |
| FAILED - RETRYING: Checking the restore status (59 retries left). | |
| FAILED - RETRYING: Checking the restore status (58 retries left). | |
| FAILED - RETRYING: Checking the restore status (57 retries left). | |
| ^C | |
| d2iq@rack2:~$ velero restore get | |
| NAME BACKUP STATUS WARNINGS ERRORS CREATED SELECTOR | |
| percona-backup-20200625062930 percona-backup Completed 2 0 2020-06-25 11:59:30 +0530 IST <none> | |
| d2iq@rack2:~$ kubectl logs -f litmus-velero-backup-restore-zwcrl-g6mkm -n litmus | |
| ansible-playbook 2.7.3 | |
| config file = None | |
| configured module search path = [u'/root/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules'] | |
| ansible python module location = /usr/local/lib/python2.7/dist-packages/ansible | |
| executable location = /usr/local/bin/ansible-playbook | |
| python version = 2.7.17 (default, Apr 15 2020, 17:20:14) [GCC 7.5.0] | |
| No config file found; using defaults | |
| /etc/ansible/hosts did not meet host_list requirements, check plugin documentation if this is unexpected | |
| /etc/ansible/hosts did not meet script requirements, check plugin documentation if this is unexpected | |
| PLAYBOOK: test.yml ************************************************************* | |
| 1 plays in ./experiments/functional/backup_and_restore/test.yml | |
| PLAY [localhost] *************************************************************** | |
| 2020-06-25T06:26:54.651979 (delta: 0.042561) elapsed: 0.042561 ******** | |
| =============================================================================== | |
| TASK [Gathering Facts] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:1 | |
| 2020-06-25T06:26:54.677843 (delta: 0.025828) elapsed: 0.068425 ******** | |
| ok: [127.0.0.1] | |
| META: ran handlers | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:12 | |
| 2020-06-25T06:27:02.124833 (delta: 7.44697) elapsed: 7.515415 ********* | |
| included: /utils/fcm/create_testname.yml for 127.0.0.1 | |
| TASK [Record test instance/run ID] ********************************************* | |
| task path: /utils/fcm/create_testname.yml:3 | |
| 2020-06-25T06:27:02.193182 (delta: 0.068318) elapsed: 7.583764 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Construct testname appended with runID] ********************************** | |
| task path: /utils/fcm/create_testname.yml:7 | |
| 2020-06-25T06:27:02.243609 (delta: 0.050379) elapsed: 7.634191 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:15 | |
| 2020-06-25T06:27:02.296859 (delta: 0.053219) elapsed: 7.687441 ******** | |
| included: /utils/fcm/update_litmus_result_resource.yml for 127.0.0.1 | |
| TASK [Generate the litmus result CR to reflect SOT (Start of Test)] ************ | |
| task path: /utils/fcm/update_litmus_result_resource.yml:3 | |
| 2020-06-25T06:27:02.374467 (delta: 0.077575) elapsed: 7.765049 ******** | |
| changed: [127.0.0.1] => {"changed": true, "checksum": "cb23761ee0ecfea3a093f94c0443739c777b3007", "dest": "./litmus-result.yaml", "gid": 0, "group": "root", "md5sum": "0da5664e16958d4f3c263662ebe36b5c", "mode": "0644", "owner": "root", "size": 422, "src": "/root/.ansible/tmp/ansible-tmp-1593066422.41-35404301145742/source", "state": "file", "uid": 0} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:14 | |
| 2020-06-25T06:27:02.892199 (delta: 0.517704) elapsed: 8.282781 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat litmus-result.yaml", "delta": "0:00:00.776459", "end": "2020-06-25 06:27:03.908295", "rc": 0, "start": "2020-06-25 06:27:03.131836", "stderr": "", "stderr_lines": [], "stdout": "---\napiVersion: litmus.io/v1alpha1\nkind: LitmusResult\nmetadata:\n\n # name of the litmus testcase\n name: velero-backup-restore \nspec:\n\n # holds information on the testcase\n testMetadata:\n app: \n chaostype: \n\n # holds the state of testcase, manually updated by json merge patch\n # result is the useful value today, but anticipate phase use in future \n testStatus: \n phase: in-progress \n result: none ", "stdout_lines": ["---", "apiVersion: litmus.io/v1alpha1", "kind: LitmusResult", "metadata:", "", " # name of the litmus testcase", " name: velero-backup-restore ", "spec:", "", " # holds information on the testcase", " testMetadata:", " app: ", " chaostype: ", "", " # holds the state of testcase, manually updated by json merge patch", " # result is the useful value today, but anticipate phase use in future ", " testStatus: ", " phase: in-progress ", " result: none "]} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:17 | |
| 2020-06-25T06:27:03.958838 (delta: 1.066606) elapsed: 9.34942 ********* | |
| changed: [127.0.0.1] => {"changed": true, "failed_when_result": false, "method": "create", "result": {"apiVersion": "litmus.io/v1alpha1", "kind": "LitmusResult", "metadata": {"creationTimestamp": "2020-06-25T06:27:04Z", "generation": 1, "name": "velero-backup-restore", "resourceVersion": "270870", "selfLink": "/apis/litmus.io/v1alpha1/litmusresults/velero-backup-restore", "uid": "76cd180d-4057-43ae-9202-847be8bda1f2"}, "spec": {"testMetadata": {"app": null, "chaostype": null}, "testStatus": {"phase": "in-progress", "result": "none"}}}} | |
| TASK [Generate the litmus result CR to reflect EOT (End of Test)] ************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:27 | |
| 2020-06-25T06:27:04.791716 (delta: 0.832849) elapsed: 10.182298 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:38 | |
| 2020-06-25T06:27:04.837682 (delta: 0.045923) elapsed: 10.228264 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:41 | |
| 2020-06-25T06:27:04.884764 (delta: 0.047049) elapsed: 10.275346 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify that the AUT is running] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:19 | |
| 2020-06-25T06:27:04.927701 (delta: 0.042895) elapsed: 10.318283 ******* | |
| included: /utils/k8s/check_deployment_status.yml for 127.0.0.1 | |
| TASK [Check the pod status] **************************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:8 | |
| 2020-06-25T06:27:05.005795 (delta: 0.078046) elapsed: 10.396377 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:status.phase", "delta": "0:00:01.021615", "end": "2020-06-25 06:27:06.174018", "rc": 0, "start": "2020-06-25 06:27:05.152403", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [obtain the number of replicas.] ****************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:22 | |
| 2020-06-25T06:27:06.221079 (delta: 1.215237) elapsed: 11.611661 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the ready replica count and compare with the replica count.] ****** | |
| task path: /utils/k8s/check_deployment_status.yml:29 | |
| 2020-06-25T06:27:06.269457 (delta: 0.048345) elapsed: 11.660039 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:22 | |
| 2020-06-25T06:27:06.318949 (delta: 0.049459) elapsed: 11.709531 ******* | |
| included: /experiments/functional/backup_and_restore/setup_dependency.yml for 127.0.0.1 | |
| TASK [Downloading velero binary] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:1 | |
| 2020-06-25T06:27:06.466656 (delta: 0.147675) elapsed: 11.857238 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "c5fe9de752d3152b32326ff2dab02198f9274868", "dest": "./velero-v1.4.0-linux-amd64.tar.gz", "gid": 0, "group": "root", "md5sum": "acb7e7184de6c45f4b88d71333115c7d", "mode": "0644", "msg": "OK (23832176 bytes)", "owner": "root", "size": 23832176, "src": "/root/.ansible/tmp/ansible-tmp-1593066426.51-91520691137004/tmp4LWNOB", "state": "file", "status_code": 200, "uid": 0, "url": "https://github.com/vmware-tanzu/velero/releases/download/v1.4.0/velero-v1.4.0-linux-amd64.tar.gz"} | |
| TASK [Installing velero inside litmus container] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:11 | |
| 2020-06-25T06:27:12.970388 (delta: 6.503702) elapsed: 18.36097 ******** | |
| [WARNING]: Consider using the unarchive module rather than running tar. If | |
| you need to use command because unarchive is insufficient you can add | |
| warn=False to this command task or set command_warnings=False in ansible.cfg to | |
| get rid of this message. | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "tar -xvf velero-v1.4.0-linux-amd64.tar.gz\n mv velero-v1.4.0-linux-amd64/velero /usr/local/bin/", "delta": "0:00:01.147221", "end": "2020-06-25 06:27:14.273089", "rc": 0, "start": "2020-06-25 06:27:13.125868", "stderr": "", "stderr_lines": [], "stdout": "velero-v1.4.0-linux-amd64/LICENSE\nvelero-v1.4.0-linux-amd64/examples/README.md\nvelero-v1.4.0-linux-amd64/examples/minio\nvelero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app\nvelero-v1.4.0-linux-amd64/examples/nginx-app/README.md\nvelero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml\nvelero-v1.4.0-linux-amd64/velero", "stdout_lines": ["velero-v1.4.0-linux-amd64/LICENSE", "velero-v1.4.0-linux-amd64/examples/README.md", "velero-v1.4.0-linux-amd64/examples/minio", "velero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app", "velero-v1.4.0-linux-amd64/examples/nginx-app/README.md", "velero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml", "velero-v1.4.0-linux-amd64/velero"]} | |
| TASK [Checking the velero version] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:16 | |
| 2020-06-25T06:27:14.316697 (delta: 1.346277) elapsed: 19.707279 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero version", "delta": "0:00:00.730747", "end": "2020-06-25 06:27:15.208332", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:14.477585", "stderr": "", "stderr_lines": [], "stdout": "Client:\n\tVersion: v1.4.0\n\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392\n<error getting server version: namespaces \"velero\" not found>", "stdout_lines": ["Client:", "\tVersion: v1.4.0", "\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392", "<error getting server version: namespaces \"velero\" not found>"]} | |
| TASK [Replacing Profile name in credential file] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:21 | |
| 2020-06-25T06:27:15.264347 (delta: 0.947611) elapsed: 20.654929 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing minio s3-bucket] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:30 | |
| 2020-06-25T06:27:15.314786 (delta: 0.050377) elapsed: 20.705368 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for minio pod status] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:33 | |
| 2020-06-25T06:27:15.366090 (delta: 0.051256) elapsed: 20.756672 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for minio job to create bucket] ********************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:40 | |
| 2020-06-25T06:27:15.415489 (delta: 0.049366) elapsed: 20.806071 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching service account key.json from configmap] ************************ | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:51 | |
| 2020-06-25T06:27:15.462010 (delta: 0.046491) elapsed: 20.852592 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cm gcp-key -n litmus -o jsonpath='{.data.key\\.json}' > ./key.json", "delta": "0:00:00.749906", "end": "2020-06-25 06:27:16.361887", "rc": 0, "start": "2020-06-25 06:27:15.611981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Authenticating using gcp service account] ******************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:54 | |
| 2020-06-25T06:27:16.405081 (delta: 0.943039) elapsed: 21.795663 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud auth activate-service-account --key-file key.json", "delta": "0:00:01.405389", "end": "2020-06-25 06:27:17.955478", "rc": 0, "start": "2020-06-25 06:27:16.550089", "stderr": "Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]", "stderr_lines": ["Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]"], "stdout": "", "stdout_lines": []} | |
| TASK [Setting up the project ID] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:57 | |
| 2020-06-25T06:27:17.999600 (delta: 1.594482) elapsed: 23.390182 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud config set project openebs-ci", "delta": "0:00:02.626419", "end": "2020-06-25 06:27:20.774683", "rc": 0, "start": "2020-06-25 06:27:18.148264", "stderr": "Updated property [core/project].", "stderr_lines": ["Updated property [core/project]."], "stdout": "", "stdout_lines": []} | |
| TASK [Deleting GCP bucket if exist] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:60 | |
| 2020-06-25T06:27:20.822552 (delta: 2.822894) elapsed: 26.213134 ******* | |
| fatal: [127.0.0.1]: FAILED! => {"changed": true, "cmd": "gsutil rm -r gs://e2e-gcp-bucket", "delta": "0:00:02.569143", "end": "2020-06-25 06:27:23.543148", "msg": "non-zero return code", "rc": 1, "start": "2020-06-25 06:27:20.974005", "stderr": "BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist.", "stderr_lines": ["BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist."], "stdout": "", "stdout_lines": []} | |
| ...ignoring | |
| TASK [Creating gcp bucket] ***************************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:66 | |
| 2020-06-25T06:27:23.587756 (delta: 2.765161) elapsed: 28.978338 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gsutil mb gs://e2e-gcp-bucket/", "delta": "0:00:02.725371", "end": "2020-06-25 06:27:26.453327", "rc": 0, "start": "2020-06-25 06:27:23.727956", "stderr": "Creating gs://e2e-gcp-bucket/...", "stderr_lines": ["Creating gs://e2e-gcp-bucket/..."], "stdout": "", "stdout_lines": []} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:75 | |
| 2020-06-25T06:27:26.498168 (delta: 2.910369) elapsed: 31.88875 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:86 | |
| 2020-06-25T06:27:26.547529 (delta: 0.049329) elapsed: 31.938111 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:102 | |
| 2020-06-25T06:27:26.598274 (delta: 0.050713) elapsed: 31.988856 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:112 | |
| 2020-06-25T06:27:26.647864 (delta: 0.049556) elapsed: 32.038446 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:127 | |
| 2020-06-25T06:27:26.698422 (delta: 0.050527) elapsed: 32.089004 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Replacing Restic Image in patch.yml] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:136 | |
| 2020-06-25T06:27:26.750037 (delta: 0.051582) elapsed: 32.140619 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:142 | |
| 2020-06-25T06:27:26.804908 (delta: 0.054821) elapsed: 32.19549 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the number of compute nodes] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:149 | |
| 2020-06-25T06:27:26.856863 (delta: 0.051919) elapsed: 32.247445 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the status of restic demonset pods] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:153 | |
| 2020-06-25T06:27:26.907468 (delta: 0.050553) elapsed: 32.29805 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:166 | |
| 2020-06-25T06:27:26.957366 (delta: 0.049866) elapsed: 32.347948 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:176 | |
| 2020-06-25T06:27:27.017307 (delta: 0.059907) elapsed: 32.407889 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:191 | |
| 2020-06-25T06:27:27.073152 (delta: 0.055813) elapsed: 32.463734 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:200 | |
| 2020-06-25T06:27:27.131408 (delta: 0.058206) elapsed: 32.52199 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero install --provider gcp --plugins velero/velero-plugin-for-gcp:v1.0.0 --bucket e2e-gcp-bucket --use-volume-snapshots=false --secret-file ./key.json", "delta": "0:00:02.461571", "end": "2020-06-25 06:27:29.744220", "rc": 0, "start": "2020-06-25 06:27:27.282649", "stderr": "", "stderr_lines": [], "stdout": "CustomResourceDefinition/backups.velero.io: attempting to create resource\nCustomResourceDefinition/backups.velero.io: already exists, proceeding\nCustomResourceDefinition/backups.velero.io: created\nCustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource\nCustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding\nCustomResourceDefinition/backupstoragelocations.velero.io: created\nCustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource\nCustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding\nCustomResourceDefinition/deletebackuprequests.velero.io: created\nCustomResourceDefinition/downloadrequests.velero.io: attempting to create resource\nCustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/downloadrequests.velero.io: created\nCustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumebackups.velero.io: created\nCustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumerestores.velero.io: created\nCustomResourceDefinition/resticrepositories.velero.io: attempting to create resource\nCustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding\nCustomResourceDefinition/resticrepositories.velero.io: created\nCustomResourceDefinition/restores.velero.io: attempting to create resource\nCustomResourceDefinition/restores.velero.io: already exists, proceeding\nCustomResourceDefinition/restores.velero.io: created\nCustomResourceDefinition/schedules.velero.io: attempting to create resource\nCustomResourceDefinition/schedules.velero.io: already exists, proceeding\nCustomResourceDefinition/schedules.velero.io: created\nCustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource\nCustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/serverstatusrequests.velero.io: created\nCustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource\nCustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding\nCustomResourceDefinition/volumesnapshotlocations.velero.io: created\nWaiting for resources to be ready in cluster...\nNamespace/velero: attempting to create resource\nNamespace/velero: created\nClusterRoleBinding/velero: attempting to create resource\nClusterRoleBinding/velero: created\nServiceAccount/velero: attempting to create resource\nServiceAccount/velero: created\nSecret/cloud-credentials: attempting to create resource\nSecret/cloud-credentials: created\nBackupStorageLocation/default: attempting to create resource\nBackupStorageLocation/default: created\nDeployment/velero: attempting to create resource\nDeployment/velero: created\nVelero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status.", "stdout_lines": ["CustomResourceDefinition/backups.velero.io: attempting to create resource", "CustomResourceDefinition/backups.velero.io: already exists, proceeding", "CustomResourceDefinition/backups.velero.io: created", "CustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource", "CustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding", "CustomResourceDefinition/backupstoragelocations.velero.io: created", "CustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource", "CustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding", "CustomResourceDefinition/deletebackuprequests.velero.io: created", "CustomResourceDefinition/downloadrequests.velero.io: attempting to create resource", "CustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/downloadrequests.velero.io: created", "CustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumebackups.velero.io: created", "CustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumerestores.velero.io: created", "CustomResourceDefinition/resticrepositories.velero.io: attempting to create resource", "CustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding", "CustomResourceDefinition/resticrepositories.velero.io: created", "CustomResourceDefinition/restores.velero.io: attempting to create resource", "CustomResourceDefinition/restores.velero.io: already exists, proceeding", "CustomResourceDefinition/restores.velero.io: created", "CustomResourceDefinition/schedules.velero.io: attempting to create resource", "CustomResourceDefinition/schedules.velero.io: already exists, proceeding", "CustomResourceDefinition/schedules.velero.io: created", "CustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource", "CustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/serverstatusrequests.velero.io: created", "CustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource", "CustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding", "CustomResourceDefinition/volumesnapshotlocations.velero.io: created", "Waiting for resources to be ready in cluster...", "Namespace/velero: attempting to create resource", "Namespace/velero: created", "ClusterRoleBinding/velero: attempting to create resource", "ClusterRoleBinding/velero: created", "ServiceAccount/velero: attempting to create resource", "ServiceAccount/velero: created", "Secret/cloud-credentials: attempting to create resource", "Secret/cloud-credentials: created", "BackupStorageLocation/default: attempting to create resource", "BackupStorageLocation/default: created", "Deployment/velero: attempting to create resource", "Deployment/velero: created", "Velero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status."]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:214 | |
| 2020-06-25T06:27:29.791377 (delta: 2.659935) elapsed: 35.181959 ******* | |
| FAILED - RETRYING: Checking for velero server status (20 retries left). | |
| FAILED - RETRYING: Checking for velero server status (19 retries left). | |
| FAILED - RETRYING: Checking for velero server status (18 retries left). | |
| changed: [127.0.0.1] => {"attempts": 4, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.795918", "end": "2020-06-25 06:27:48.502162", "rc": 0, "start": "2020-06-25 06:27:47.706244", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Replacing profile spec in volumesnapshotlocation.yml] ******************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:223 | |
| 2020-06-25T06:27:48.554189 (delta: 18.762776) elapsed: 53.944771 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:230 | |
| 2020-06-25T06:27:48.610388 (delta: 0.056164) elapsed: 54.00097 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:236 | |
| 2020-06-25T06:27:48.665117 (delta: 0.054696) elapsed: 54.055699 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl apply -f gcp-volume-snapshot-location.yml", "delta": "0:00:00.972762", "end": "2020-06-25 06:27:49.787382", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:48.814620", "stderr": "", "stderr_lines": [], "stdout": "volumesnapshotlocation.velero.io/gcp-bucket created", "stdout_lines": ["volumesnapshotlocation.velero.io/gcp-bucket created"]} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:242 | |
| 2020-06-25T06:27:49.840817 (delta: 1.175665) elapsed: 55.231399 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing development image of OpenEBS velero-plugin] ******************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:248 | |
| 2020-06-25T06:27:49.897878 (delta: 0.057028) elapsed: 55.28846 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero plugin add openebs/velero-plugin:ci", "delta": "0:00:00.876597", "end": "2020-06-25 06:27:50.931150", "rc": 0, "start": "2020-06-25 06:27:50.054553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Waiting for new velero server pod to come up] **************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:252 | |
| 2020-06-25T06:27:50.982054 (delta: 1.084143) elapsed: 56.372636 ******* | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (20 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (19 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (18 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (17 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (16 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod -n velero --no-headers -l deploy=velero | wc -l", "delta": "0:00:00.989954", "end": "2020-06-25 06:28:21.926413", "rc": 0, "start": "2020-06-25 06:28:20.936459", "stderr": "", "stderr_lines": [], "stdout": "1", "stdout_lines": ["1"]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:261 | |
| 2020-06-25T06:28:21.983155 (delta: 31.00106) elapsed: 87.373737 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.934707", "end": "2020-06-25 06:28:23.056345", "rc": 0, "start": "2020-06-25 06:28:22.121638", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Checking for velero server container status] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:268 | |
| 2020-06-25T06:28:23.113763 (delta: 1.130558) elapsed: 88.504345 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.containerStatuses[0].ready}'", "delta": "0:00:00.967407", "end": "2020-06-25 06:28:24.223946", "rc": 0, "start": "2020-06-25 06:28:23.256539", "stderr": "", "stderr_lines": [], "stdout": "true", "stdout_lines": ["true"]} | |
| TASK [Get Application pod details] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:24 | |
| 2020-06-25T06:28:24.277814 (delta: 1.163985) elapsed: 89.668396 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.794854", "end": "2020-06-25 06:28:25.217326", "rc": 0, "start": "2020-06-25 06:28:24.422472", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-vmn8l", "stdout_lines": ["percona-7c6969cf78-vmn8l"]} | |
| TASK [Create new database in the mysql] **************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:28 | |
| 2020-06-25T06:28:25.267296 (delta: 0.98945) elapsed: 90.657878 ******** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:28:25.383522 (delta: 0.116192) elapsed: 90.774104 ******* | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create database backup;'", "delta": "0:00:01.167503", "end": "2020-06-25 06:28:26.707218", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "rc": 0, "start": "2020-06-25 06:28:25.539715", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "delta": "0:00:01.286102", "end": "2020-06-25 06:28:28.129293", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "rc": 0, "start": "2020-06-25 06:28:26.843191", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "delta": "0:00:00.961560", "end": "2020-06-25 06:28:29.242626", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "rc": 0, "start": "2020-06-25 06:28:28.281066", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:28:29.291844 (delta: 3.90829) elapsed: 94.682426 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:28:29.335031 (delta: 0.043148) elapsed: 94.725613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:28:29.378993 (delta: 0.043927) elapsed: 94.769575 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:28:29.421331 (delta: 0.042306) elapsed: 94.811913 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Get the container status of application.] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:51 | |
| 2020-06-25T06:28:29.465277 (delta: 0.043912) elapsed: 94.855859 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Check if db is ready for connections] ************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:61 | |
| 2020-06-25T06:28:29.506968 (delta: 0.041658) elapsed: 94.89755 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for the Corrupted tables] *************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:68 | |
| 2020-06-25T06:28:29.551934 (delta: 0.044933) elapsed: 94.942516 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify mysql data persistence] ******************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:77 | |
| 2020-06-25T06:28:29.595600 (delta: 0.043615) elapsed: 94.986182 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Delete/drop MySQL database] ********************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:90 | |
| 2020-06-25T06:28:29.637299 (delta: 0.041665) elapsed: 95.027881 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify successful db delete] ********************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:98 | |
| 2020-06-25T06:28:29.681284 (delta: 0.043951) elapsed: 95.071866 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application mount point] ************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:40 | |
| 2020-06-25T06:28:29.723895 (delta: 0.042577) elapsed: 95.114477 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Writing data on application mount point] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:45 | |
| 2020-06-25T06:28:29.774516 (delta: 0.050586) elapsed: 95.165098 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application deployment name] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:52 | |
| 2020-06-25T06:28:29.829231 (delta: 0.05468) elapsed: 95.219813 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching the volume name of application] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:56 | |
| 2020-06-25T06:28:29.877264 (delta: 0.047998) elapsed: 95.267846 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Annotating the application pod] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:61 | |
| 2020-06-25T06:28:29.927650 (delta: 0.05035) elapsed: 95.318232 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup for the provided application] **************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:66 | |
| 2020-06-25T06:28:29.975647 (delta: 0.047945) elapsed: 95.366229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:30.153731 (delta: 0.178049) elapsed: 95.544313 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:30.208755 (delta: 0.054997) elapsed: 95.599337 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero backup create percona-backup --include-namespaces=app-percona-csi --snapshot-volumes --volume-snapshot-locations=gcp-bucket", "delta": "0:00:00.762984", "end": "2020-06-25 06:28:31.123022", "rc": 0, "start": "2020-06-25 06:28:30.360038", "stderr": "", "stderr_lines": [], "stdout": "Backup request \"percona-backup\" submitted successfully.\nRun `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details.", "stdout_lines": ["Backup request \"percona-backup\" submitted successfully.", "Run `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details."]} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:31.172031 (delta: 0.963226) elapsed: 96.562613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:31.225986 (delta: 0.053811) elapsed: 96.616568 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:31.289287 (delta: 0.063264) elapsed: 96.679869 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:31.345350 (delta: 0.056006) elapsed: 96.735932 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:31.389658 (delta: 0.044267) elapsed: 96.78024 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:31.433499 (delta: 0.043805) elapsed: 96.824081 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:28:31.479518 (delta: 0.045983) elapsed: 96.8701 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:28:31.522464 (delta: 0.042912) elapsed: 96.913046 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:28:31.568668 (delta: 0.04617) elapsed: 96.95925 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:28:31.624925 (delta: 0.056222) elapsed: 97.015507 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:28:31.686480 (delta: 0.061515) elapsed: 97.077062 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:28:31.733581 (delta: 0.047046) elapsed: 97.124163 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:28:31.790562 (delta: 0.05694) elapsed: 97.181144 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:75 | |
| 2020-06-25T06:28:31.851578 (delta: 0.060963) elapsed: 97.24216 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the backup name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:79 | |
| 2020-06-25T06:28:31.906991 (delta: 0.055362) elapsed: 97.297573 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:83 | |
| 2020-06-25T06:28:31.957242 (delta: 0.050204) elapsed: 97.347824 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:90 | |
| 2020-06-25T06:28:32.007047 (delta: 0.049757) elapsed: 97.397629 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for completed backup] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:95 | |
| 2020-06-25T06:28:32.060182 (delta: 0.0531) elapsed: 97.450764 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the base backup name] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:102 | |
| 2020-06-25T06:28:32.109735 (delta: 0.049515) elapsed: 97.500317 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of backup] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:108 | |
| 2020-06-25T06:28:32.161647 (delta: 0.051862) elapsed: 97.552229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:32.290429 (delta: 0.128743) elapsed: 97.681011 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:32.333229 (delta: 0.042766) elapsed: 97.723811 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:32.378833 (delta: 0.045568) elapsed: 97.769415 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:32.422233 (delta: 0.043363) elapsed: 97.812815 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:32.464751 (delta: 0.042483) elapsed: 97.855333 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:32.513763 (delta: 0.048965) elapsed: 97.904345 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:32.558227 (delta: 0.044411) elapsed: 97.948809 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:32.604590 (delta: 0.04633) elapsed: 97.995172 ******** | |
| FAILED - RETRYING: Getting the state of Backup (100 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (99 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (98 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (97 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (96 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get backup percona-backup -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.999175", "end": "2020-06-25 06:29:03.889667", "rc": 0, "start": "2020-06-25 06:29:02.890492", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:03.946478 (delta: 31.341852) elapsed: 129.33706 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:03.991455 (delta: 0.044942) elapsed: 129.382037 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:04.035862 (delta: 0.044373) elapsed: 129.426444 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:04.082631 (delta: 0.046736) elapsed: 129.473213 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:04.127378 (delta: 0.044713) elapsed: 129.51796 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:04.171571 (delta: 0.044156) elapsed: 129.562153 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:04.215981 (delta: 0.044365) elapsed: 129.606563 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verifying for local snaphot deletion] ************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:115 | |
| 2020-06-25T06:29:04.259414 (delta: 0.043394) elapsed: 129.649996 ****** | |
| included: /experiments/functional/backup_and_restore/additional_verification.yml for 127.0.0.1 | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:4 | |
| 2020-06-25T06:29:04.398569 (delta: 0.13912) elapsed: 129.789151 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.756255", "end": "2020-06-25 06:29:05.298383", "rc": 0, "start": "2020-06-25 06:29:04.542128", "stderr": "", "stderr_lines": [], "stdout": "pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor backup name] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:8 | |
| 2020-06-25T06:29:05.344283 (delta: 0.945679) elapsed: 130.734865 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get cstorbackup -n app-percona-csi | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.717512", "end": "2020-06-25 06:29:06.206557", "rc": 0, "start": "2020-06-25 06:29:05.489045", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor pool UID] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:15 | |
| 2020-06-25T06:29:06.255406 (delta: 0.911087) elapsed: 131.645988 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cstorbackup percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -n app-percona-csi -o jsonpath='{.metadata.labels.cstorpool\\.openebs\\.io/uid}'", "delta": "0:00:00.733727", "end": "2020-06-25 06:29:07.130608", "rc": 0, "start": "2020-06-25 06:29:06.396881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the CVR name from the corresponding pool uid] ******************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:19 | |
| 2020-06-25T06:29:07.184672 (delta: 0.92923) elapsed: 132.575254 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l cstorpool.openebs.io/uid=,cstorvolume.openebs.io/name=pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -o jsonpath='{.items[*].metadata.name}'", "delta": "0:00:00.743689", "end": "2020-06-25 06:29:08.133069", "rc": 0, "start": "2020-06-25 06:29:07.389380", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the cstor pool label from cvr] *********************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:23 | |
| 2020-06-25T06:29:08.178094 (delta: 0.993386) elapsed: 133.568676 ****** | |
| TASK [Geting the pool pod name corresponding to the label] ********************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:29 | |
| 2020-06-25T06:29:08.223360 (delta: 0.045214) elapsed: 133.613942 ****** | |
| TASK [Deleting the cstor pool pod] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:37 | |
| 2020-06-25T06:29:08.270044 (delta: 0.046649) elapsed: 133.660626 ****** | |
| TASK [Verifying whether local snapshot is deleted] ***************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:48 | |
| 2020-06-25T06:29:08.320524 (delta: 0.050429) elapsed: 133.711106 ****** | |
| TASK [Getting maya-pai-server pod name] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:61 | |
| 2020-06-25T06:29:08.368566 (delta: 0.048007) elapsed: 133.759148 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting the maya-api-server pod] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:65 | |
| 2020-06-25T06:29:08.415911 (delta: 0.047309) elapsed: 133.806493 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting Application] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:124 | |
| 2020-06-25T06:29:08.463334 (delta: 0.047389) elapsed: 133.853916 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl delete pvc,deploy,svc --all -n app-percona-csi\n kubectl delete ns app-percona-csi", "delta": "0:00:18.673774", "end": "2020-06-25 06:29:27.323723", "rc": 0, "start": "2020-06-25 06:29:08.649949", "stderr": "", "stderr_lines": [], "stdout": "persistentvolumeclaim \"percona-mysql-claim\" deleted\ndeployment.extensions \"percona\" deleted\nservice \"percona-mysql\" deleted\nnamespace \"app-percona-csi\" deleted", "stdout_lines": ["persistentvolumeclaim \"percona-mysql-claim\" deleted", "deployment.extensions \"percona\" deleted", "service \"percona-mysql\" deleted", "namespace \"app-percona-csi\" deleted"]} | |
| TASK [Checking whether namespace is deleted] *********************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:129 | |
| 2020-06-25T06:29:27.367621 (delta: 18.904252) elapsed: 152.758203 ***** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get ns --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.757975", "end": "2020-06-25 06:29:28.274808", "rc": 0, "start": "2020-06-25 06:29:27.516833", "stderr": "", "stderr_lines": [], "stdout": "aman\ncert-manager\ndefault\nkommander\nkube-node-lease\nkube-public\nkube-system\nkubeaddons\nlitmus\nmaya-system\nopenebs\ntest\nvelero", "stdout_lines": ["aman", "cert-manager", "default", "kommander", "kube-node-lease", "kube-public", "kube-system", "kubeaddons", "litmus", "maya-system", "openebs", "test", "velero"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:146 | |
| 2020-06-25T06:29:28.326285 (delta: 0.958626) elapsed: 153.716867 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:28.424891 (delta: 0.09857) elapsed: 153.815473 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:28.475800 (delta: 0.050874) elapsed: 153.866382 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:28.527512 (delta: 0.051658) elapsed: 153.918094 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:28.595238 (delta: 0.067688) elapsed: 153.98582 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:28.654806 (delta: 0.05951) elapsed: 154.045388 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:28.706974 (delta: 0.05213) elapsed: 154.097556 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:28.763097 (delta: 0.056085) elapsed: 154.153679 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:28.813252 (delta: 0.050116) elapsed: 154.203834 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:28.869591 (delta: 0.056288) elapsed: 154.260173 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl create ns app-percona-csi", "delta": "0:00:00.921844", "end": "2020-06-25 06:29:29.953692", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:29:29.031848", "stderr": "", "stderr_lines": [], "stdout": "namespace/app-percona-csi created", "stdout_lines": ["namespace/app-percona-csi created"]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:30.003989 (delta: 1.134361) elapsed: 155.394571 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero restore create --from-backup percona-backup --restore-volumes=true", "delta": "0:00:00.742141", "end": "2020-06-25 06:29:30.905695", "rc": 0, "start": "2020-06-25 06:29:30.163554", "stderr": "", "stderr_lines": [], "stdout": "Restore request \"percona-backup-20200625062930\" submitted successfully.\nRun `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details.", "stdout_lines": ["Restore request \"percona-backup-20200625062930\" submitted successfully.", "Run `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details."]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:30.957816 (delta: 0.953795) elapsed: 156.348398 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.013633 (delta: 0.055776) elapsed: 156.404215 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:31.071681 (delta: 0.057998) elapsed: 156.462263 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:31.127733 (delta: 0.056011) elapsed: 156.518315 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:31.187804 (delta: 0.06001) elapsed: 156.578386 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:152 | |
| 2020-06-25T06:29:31.238816 (delta: 0.050976) elapsed: 156.629398 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:31.344329 (delta: 0.105478) elapsed: 156.734911 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:31.398928 (delta: 0.054557) elapsed: 156.78951 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:31.454105 (delta: 0.055131) elapsed: 156.844687 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:31.505860 (delta: 0.051716) elapsed: 156.896442 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:31.555513 (delta: 0.049619) elapsed: 156.946095 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:31.606027 (delta: 0.050479) elapsed: 156.996609 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:31.658945 (delta: 0.052881) elapsed: 157.049527 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:31.720250 (delta: 0.0612) elapsed: 157.110832 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:31.782094 (delta: 0.061792) elapsed: 157.172676 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:31.836390 (delta: 0.054256) elapsed: 157.226972 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:31.887438 (delta: 0.051008) elapsed: 157.27802 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.945602 (delta: 0.058112) elapsed: 157.336184 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:32.003396 (delta: 0.057743) elapsed: 157.393978 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:32.055557 (delta: 0.052096) elapsed: 157.446139 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero get restore | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.680082", "end": "2020-06-25 06:29:32.894615", "rc": 0, "start": "2020-06-25 06:29:32.214533", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-20200625062930", "stdout_lines": ["percona-backup-20200625062930"]} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:32.940140 (delta: 0.884546) elapsed: 158.330722 ****** | |
| FAILED - RETRYING: Checking the restore status (60 retries left). | |
| FAILED - RETRYING: Checking the restore status (59 retries left). | |
| FAILED - RETRYING: Checking the restore status (58 retries left). | |
| FAILED - RETRYING: Checking the restore status (57 retries left). | |
| changed: [127.0.0.1] => {"attempts": 5, "changed": true, "cmd": "kubectl get restore percona-backup-20200625062930 -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.786878", "end": "2020-06-25 06:29:57.867818", "rc": 0, "start": "2020-06-25 06:29:57.080940", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:162 | |
| 2020-06-25T06:29:57.926367 (delta: 24.986173) elapsed: 183.316949 ***** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:168 | |
| 2020-06-25T06:29:57.987229 (delta: 0.060826) elapsed: 183.377811 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:180 | |
| 2020-06-25T06:29:58.048209 (delta: 0.060946) elapsed: 183.438791 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.945068", "end": "2020-06-25 06:29:59.157534", "rc": 0, "start": "2020-06-25 06:29:58.212466", "stderr": "", "stderr_lines": [], "stdout": "pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "stdout_lines": ["pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"]} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:184 | |
| 2020-06-25T06:29:59.203070 (delta: 1.154825) elapsed: 184.593652 ****** | |
| included: /experiments/functional/backup_and_restore/cstor_post_restore.yml for 127.0.0.1 | |
| TASK [Getting the target IP] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:2 | |
| 2020-06-25T06:29:59.315315 (delta: 0.112211) elapsed: 184.705897 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get svc -n openebs --no-headers -l openebs.io/persistent-volume=pvc-78e1a852-40c8-4489-bb95-0f0066398c2d -o jsonpath='{.items[0].spec.clusterIP}'", "delta": "0:00:00.775021", "end": "2020-06-25 06:30:00.248726", "rc": 0, "start": "2020-06-25 06:29:59.473705", "stderr": "", "stderr_lines": [], "stdout": "11.0.50.166", "stdout_lines": ["11.0.50.166"]} | |
| TASK [Getting the CVR name from the corresponding PV] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:11 | |
| 2020-06-25T06:30:00.301403 (delta: 0.986053) elapsed: 185.691985 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Geting the CSP name corresponding to CVR] ******************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:15 | |
| 2020-06-25T06:30:00.360648 (delta: 0.059207) elapsed: 185.75123 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the pool pod name] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:20 | |
| 2020-06-25T06:30:00.420531 (delta: 0.059847) elapsed: 185.811113 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the volume name inside cstor pool] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:25 | |
| 2020-06-25T06:30:00.479725 (delta: 0.059154) elapsed: 185.870307 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Assigning the cstor-pool volume name to variable] ************************ | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:30 | |
| 2020-06-25T06:30:00.542960 (delta: 0.063175) elapsed: 185.933542 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Setting target IP for volume inside cstor pool] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:34 | |
| 2020-06-25T06:30:00.602407 (delta: 0.05941) elapsed: 185.992989 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the CVR name from the corresponding PV] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:44 | |
| 2020-06-25T06:30:00.662537 (delta: 0.060093) elapsed: 186.053119 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l openebs.io/persistent-volume=pvc-78e1a852-40c8-4489-bb95-0f0066398c2d -o jsonpath='{range.items[*]}{.metadata.labels.cstorpoolinstance\\.openebs\\.io/name}{\"\\n\"}{end}'", "delta": "0:00:00.772113", "end": "2020-06-25 06:30:01.599426", "rc": 0, "start": "2020-06-25 06:30:00.827313", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b\ncstor-cspc-disk-pool-8vvv\ncstor-cspc-disk-pool-cj5m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b", "cstor-cspc-disk-pool-8vvv", "cstor-cspc-disk-pool-cj5m"]} | |
| TASK [Geting the CSPI name corresponding to CVR] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:48 | |
| 2020-06-25T06:30:01.651403 (delta: 0.988829) elapsed: 187.041985 ****** | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-6n9b) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-6n9b -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.760993", "end": "2020-06-25 06:30:02.596045", "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:01.835052", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b", "stdout_lines": ["cstor-cspc-disk-pool-6n9b"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-8vvv) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-8vvv -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.933590", "end": "2020-06-25 06:30:03.687847", "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:02.754257", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv", "stdout_lines": ["cstor-cspc-disk-pool-8vvv"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-cj5m) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-cj5m -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.857139", "end": "2020-06-25 06:30:04.699592", "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:03.842453", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m", "stdout_lines": ["cstor-cspc-disk-pool-cj5m"]} | |
| TASK [Getting the pool pod name] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:53 | |
| 2020-06-25T06:30:04.750022 (delta: 3.098579) elapsed: 190.140604 ****** | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-6n9b) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-8vvv) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-cj5m) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]} | |
| TASK [Getting the volume name inside cstor pool] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:58 | |
| 2020-06-25T06:30:07.749874 (delta: 2.999814) elapsed: 193.140456 ****** | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m', '_ansible_item_result': True, u'delta': u'0:00:00.937403', 'stdout_lines': [u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m'], '_ansible_item_label': u'cstor-cspc-disk-pool-6n9b', u'end': u'2020-06-25 06:30:05.870226', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-6n9b', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:04.932823', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.229101", "end": "2020-06-25 06:30:09.162558", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]}, "rc": 0, "start": "2020-06-25 06:30:07.933457", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m', '_ansible_item_result': True, u'delta': u'0:00:00.702313', 'stdout_lines': [u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m'], '_ansible_item_label': u'cstor-cspc-disk-pool-8vvv', u'end': u'2020-06-25 06:30:06.726757', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-8vvv', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:06.024444', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.238007", "end": "2020-06-25 06:30:10.556976", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]}, "rc": 0, "start": "2020-06-25 06:30:09.318969", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45', '_ansible_item_result': True, u'delta': u'0:00:00.797214', 'stdout_lines': [u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45'], '_ansible_item_label': u'cstor-cspc-disk-pool-cj5m', u'end': u'2020-06-25 06:30:07.694743', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-cj5m', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:06.897529', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.001806", "end": "2020-06-25 06:30:11.732631", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]}, "rc": 0, "start": "2020-06-25 06:30:10.730825", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| TASK [Assigning the cstor-pool volume name to variable] ************************ | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:63 | |
| 2020-06-25T06:30:11.784506 (delta: 4.034584) elapsed: 197.175088 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat ./cstor-vol", "delta": "0:00:00.813204", "end": "2020-06-25 06:30:12.748013", "rc": 0, "start": "2020-06-25 06:30:11.934809", "stderr": "", "stderr_lines": [], "stdout": "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d\ncstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d\ncstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "stdout_lines": ["cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"]} | |
| TASK [Setting target IP for volume inside cstor pool] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:67 | |
| 2020-06-25T06:30:12.797896 (delta: 1.013352) elapsed: 198.188478 ****** | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m', '_ansible_item_result': True, u'delta': u'0:00:00.937403', 'stdout_lines': [u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m'], '_ansible_item_label': u'cstor-cspc-disk-pool-6n9b', u'end': u'2020-06-25 06:30:05.870226', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:04.932823', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-6n9b', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.064015", "end": "2020-06-25 06:30:14.063360", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-6n9b", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:12.999345", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m', '_ansible_item_result': True, u'delta': u'0:00:00.702313', 'stdout_lines': [u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m'], '_ansible_item_label': u'cstor-cspc-disk-pool-8vvv', u'end': u'2020-06-25 06:30:06.726757', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:06.024444', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-8vvv', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.007217", "end": "2020-06-25 06:30:15.233190", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-8vvv", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:14.225973", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45', '_ansible_item_result': True, u'delta': u'0:00:00.797214', 'stdout_lines': [u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45'], '_ansible_item_label': u'cstor-cspc-disk-pool-cj5m', u'end': u'2020-06-25 06:30:07.694743', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:06.897529', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-cj5m', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.035342", "end": "2020-06-25 06:30:16.424346", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-cj5m", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:15.389004", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:193 | |
| 2020-06-25T06:30:16.480647 (delta: 3.682718) elapsed: 201.871229 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:197 | |
| 2020-06-25T06:30:16.538368 (delta: 0.057686) elapsed: 201.92895 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for application to be in running state] ************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:208 | |
| 2020-06-25T06:30:16.593237 (delta: 0.054835) elapsed: 201.983819 ****** | |
| FAILED - RETRYING: Waiting for application to be in running state (30 retries left). | |
| ^C | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-vmn8l 0/1 ContainerCreating 0 35s | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-vmn8l 0/1 ContainerCreating 0 52s | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-vmn8l 0/1 ContainerCreating 0 53s | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-vmn8l 1/1 Running 0 54s | |
| d2iq@rack2:~$ kubectl logs -f litmus-velero-backup-restore-zwcrl-g6mkm -n litmus | |
| ansible-playbook 2.7.3 | |
| config file = None | |
| configured module search path = [u'/root/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules'] | |
| ansible python module location = /usr/local/lib/python2.7/dist-packages/ansible | |
| executable location = /usr/local/bin/ansible-playbook | |
| python version = 2.7.17 (default, Apr 15 2020, 17:20:14) [GCC 7.5.0] | |
| No config file found; using defaults | |
| /etc/ansible/hosts did not meet host_list requirements, check plugin documentation if this is unexpected | |
| /etc/ansible/hosts did not meet script requirements, check plugin documentation if this is unexpected | |
| PLAYBOOK: test.yml ************************************************************* | |
| 1 plays in ./experiments/functional/backup_and_restore/test.yml | |
| PLAY [localhost] *************************************************************** | |
| 2020-06-25T06:26:54.651979 (delta: 0.042561) elapsed: 0.042561 ******** | |
| =============================================================================== | |
| TASK [Gathering Facts] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:1 | |
| 2020-06-25T06:26:54.677843 (delta: 0.025828) elapsed: 0.068425 ******** | |
| ok: [127.0.0.1] | |
| META: ran handlers | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:12 | |
| 2020-06-25T06:27:02.124833 (delta: 7.44697) elapsed: 7.515415 ********* | |
| included: /utils/fcm/create_testname.yml for 127.0.0.1 | |
| TASK [Record test instance/run ID] ********************************************* | |
| task path: /utils/fcm/create_testname.yml:3 | |
| 2020-06-25T06:27:02.193182 (delta: 0.068318) elapsed: 7.583764 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Construct testname appended with runID] ********************************** | |
| task path: /utils/fcm/create_testname.yml:7 | |
| 2020-06-25T06:27:02.243609 (delta: 0.050379) elapsed: 7.634191 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:15 | |
| 2020-06-25T06:27:02.296859 (delta: 0.053219) elapsed: 7.687441 ******** | |
| included: /utils/fcm/update_litmus_result_resource.yml for 127.0.0.1 | |
| TASK [Generate the litmus result CR to reflect SOT (Start of Test)] ************ | |
| task path: /utils/fcm/update_litmus_result_resource.yml:3 | |
| 2020-06-25T06:27:02.374467 (delta: 0.077575) elapsed: 7.765049 ******** | |
| changed: [127.0.0.1] => {"changed": true, "checksum": "cb23761ee0ecfea3a093f94c0443739c777b3007", "dest": "./litmus-result.yaml", "gid": 0, "group": "root", "md5sum": "0da5664e16958d4f3c263662ebe36b5c", "mode": "0644", "owner": "root", "size": 422, "src": "/root/.ansible/tmp/ansible-tmp-1593066422.41-35404301145742/source", "state": "file", "uid": 0} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:14 | |
| 2020-06-25T06:27:02.892199 (delta: 0.517704) elapsed: 8.282781 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat litmus-result.yaml", "delta": "0:00:00.776459", "end": "2020-06-25 06:27:03.908295", "rc": 0, "start": "2020-06-25 06:27:03.131836", "stderr": "", "stderr_lines": [], "stdout": "---\napiVersion: litmus.io/v1alpha1\nkind: LitmusResult\nmetadata:\n\n # name of the litmus testcase\n name: velero-backup-restore \nspec:\n\n # holds information on the testcase\n testMetadata:\n app: \n chaostype: \n\n # holds the state of testcase, manually updated by json merge patch\n # result is the useful value today, but anticipate phase use in future \n testStatus: \n phase: in-progress \n result: none ", "stdout_lines": ["---", "apiVersion: litmus.io/v1alpha1", "kind: LitmusResult", "metadata:", "", " # name of the litmus testcase", " name: velero-backup-restore ", "spec:", "", " # holds information on the testcase", " testMetadata:", " app: ", " chaostype: ", "", " # holds the state of testcase, manually updated by json merge patch", " # result is the useful value today, but anticipate phase use in future ", " testStatus: ", " phase: in-progress ", " result: none "]} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:17 | |
| 2020-06-25T06:27:03.958838 (delta: 1.066606) elapsed: 9.34942 ********* | |
| changed: [127.0.0.1] => {"changed": true, "failed_when_result": false, "method": "create", "result": {"apiVersion": "litmus.io/v1alpha1", "kind": "LitmusResult", "metadata": {"creationTimestamp": "2020-06-25T06:27:04Z", "generation": 1, "name": "velero-backup-restore", "resourceVersion": "270870", "selfLink": "/apis/litmus.io/v1alpha1/litmusresults/velero-backup-restore", "uid": "76cd180d-4057-43ae-9202-847be8bda1f2"}, "spec": {"testMetadata": {"app": null, "chaostype": null}, "testStatus": {"phase": "in-progress", "result": "none"}}}} | |
| TASK [Generate the litmus result CR to reflect EOT (End of Test)] ************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:27 | |
| 2020-06-25T06:27:04.791716 (delta: 0.832849) elapsed: 10.182298 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:38 | |
| 2020-06-25T06:27:04.837682 (delta: 0.045923) elapsed: 10.228264 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:41 | |
| 2020-06-25T06:27:04.884764 (delta: 0.047049) elapsed: 10.275346 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify that the AUT is running] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:19 | |
| 2020-06-25T06:27:04.927701 (delta: 0.042895) elapsed: 10.318283 ******* | |
| included: /utils/k8s/check_deployment_status.yml for 127.0.0.1 | |
| TASK [Check the pod status] **************************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:8 | |
| 2020-06-25T06:27:05.005795 (delta: 0.078046) elapsed: 10.396377 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:status.phase", "delta": "0:00:01.021615", "end": "2020-06-25 06:27:06.174018", "rc": 0, "start": "2020-06-25 06:27:05.152403", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [obtain the number of replicas.] ****************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:22 | |
| 2020-06-25T06:27:06.221079 (delta: 1.215237) elapsed: 11.611661 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the ready replica count and compare with the replica count.] ****** | |
| task path: /utils/k8s/check_deployment_status.yml:29 | |
| 2020-06-25T06:27:06.269457 (delta: 0.048345) elapsed: 11.660039 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:22 | |
| 2020-06-25T06:27:06.318949 (delta: 0.049459) elapsed: 11.709531 ******* | |
| included: /experiments/functional/backup_and_restore/setup_dependency.yml for 127.0.0.1 | |
| TASK [Downloading velero binary] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:1 | |
| 2020-06-25T06:27:06.466656 (delta: 0.147675) elapsed: 11.857238 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "c5fe9de752d3152b32326ff2dab02198f9274868", "dest": "./velero-v1.4.0-linux-amd64.tar.gz", "gid": 0, "group": "root", "md5sum": "acb7e7184de6c45f4b88d71333115c7d", "mode": "0644", "msg": "OK (23832176 bytes)", "owner": "root", "size": 23832176, "src": "/root/.ansible/tmp/ansible-tmp-1593066426.51-91520691137004/tmp4LWNOB", "state": "file", "status_code": 200, "uid": 0, "url": "https://github.com/vmware-tanzu/velero/releases/download/v1.4.0/velero-v1.4.0-linux-amd64.tar.gz"} | |
| TASK [Installing velero inside litmus container] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:11 | |
| 2020-06-25T06:27:12.970388 (delta: 6.503702) elapsed: 18.36097 ******** | |
| [WARNING]: Consider using the unarchive module rather than running tar. If | |
| you need to use command because unarchive is insufficient you can add | |
| warn=False to this command task or set command_warnings=False in ansible.cfg to | |
| get rid of this message. | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "tar -xvf velero-v1.4.0-linux-amd64.tar.gz\n mv velero-v1.4.0-linux-amd64/velero /usr/local/bin/", "delta": "0:00:01.147221", "end": "2020-06-25 06:27:14.273089", "rc": 0, "start": "2020-06-25 06:27:13.125868", "stderr": "", "stderr_lines": [], "stdout": "velero-v1.4.0-linux-amd64/LICENSE\nvelero-v1.4.0-linux-amd64/examples/README.md\nvelero-v1.4.0-linux-amd64/examples/minio\nvelero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app\nvelero-v1.4.0-linux-amd64/examples/nginx-app/README.md\nvelero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml\nvelero-v1.4.0-linux-amd64/velero", "stdout_lines": ["velero-v1.4.0-linux-amd64/LICENSE", "velero-v1.4.0-linux-amd64/examples/README.md", "velero-v1.4.0-linux-amd64/examples/minio", "velero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app", "velero-v1.4.0-linux-amd64/examples/nginx-app/README.md", "velero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml", "velero-v1.4.0-linux-amd64/velero"]} | |
| TASK [Checking the velero version] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:16 | |
| 2020-06-25T06:27:14.316697 (delta: 1.346277) elapsed: 19.707279 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero version", "delta": "0:00:00.730747", "end": "2020-06-25 06:27:15.208332", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:14.477585", "stderr": "", "stderr_lines": [], "stdout": "Client:\n\tVersion: v1.4.0\n\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392\n<error getting server version: namespaces \"velero\" not found>", "stdout_lines": ["Client:", "\tVersion: v1.4.0", "\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392", "<error getting server version: namespaces \"velero\" not found>"]} | |
| TASK [Replacing Profile name in credential file] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:21 | |
| 2020-06-25T06:27:15.264347 (delta: 0.947611) elapsed: 20.654929 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing minio s3-bucket] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:30 | |
| 2020-06-25T06:27:15.314786 (delta: 0.050377) elapsed: 20.705368 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for minio pod status] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:33 | |
| 2020-06-25T06:27:15.366090 (delta: 0.051256) elapsed: 20.756672 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for minio job to create bucket] ********************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:40 | |
| 2020-06-25T06:27:15.415489 (delta: 0.049366) elapsed: 20.806071 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching service account key.json from configmap] ************************ | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:51 | |
| 2020-06-25T06:27:15.462010 (delta: 0.046491) elapsed: 20.852592 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cm gcp-key -n litmus -o jsonpath='{.data.key\\.json}' > ./key.json", "delta": "0:00:00.749906", "end": "2020-06-25 06:27:16.361887", "rc": 0, "start": "2020-06-25 06:27:15.611981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Authenticating using gcp service account] ******************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:54 | |
| 2020-06-25T06:27:16.405081 (delta: 0.943039) elapsed: 21.795663 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud auth activate-service-account --key-file key.json", "delta": "0:00:01.405389", "end": "2020-06-25 06:27:17.955478", "rc": 0, "start": "2020-06-25 06:27:16.550089", "stderr": "Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]", "stderr_lines": ["Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]"], "stdout": "", "stdout_lines": []} | |
| TASK [Setting up the project ID] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:57 | |
| 2020-06-25T06:27:17.999600 (delta: 1.594482) elapsed: 23.390182 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud config set project openebs-ci", "delta": "0:00:02.626419", "end": "2020-06-25 06:27:20.774683", "rc": 0, "start": "2020-06-25 06:27:18.148264", "stderr": "Updated property [core/project].", "stderr_lines": ["Updated property [core/project]."], "stdout": "", "stdout_lines": []} | |
| TASK [Deleting GCP bucket if exist] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:60 | |
| 2020-06-25T06:27:20.822552 (delta: 2.822894) elapsed: 26.213134 ******* | |
| fatal: [127.0.0.1]: FAILED! => {"changed": true, "cmd": "gsutil rm -r gs://e2e-gcp-bucket", "delta": "0:00:02.569143", "end": "2020-06-25 06:27:23.543148", "msg": "non-zero return code", "rc": 1, "start": "2020-06-25 06:27:20.974005", "stderr": "BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist.", "stderr_lines": ["BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist."], "stdout": "", "stdout_lines": []} | |
| ...ignoring | |
| TASK [Creating gcp bucket] ***************************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:66 | |
| 2020-06-25T06:27:23.587756 (delta: 2.765161) elapsed: 28.978338 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gsutil mb gs://e2e-gcp-bucket/", "delta": "0:00:02.725371", "end": "2020-06-25 06:27:26.453327", "rc": 0, "start": "2020-06-25 06:27:23.727956", "stderr": "Creating gs://e2e-gcp-bucket/...", "stderr_lines": ["Creating gs://e2e-gcp-bucket/..."], "stdout": "", "stdout_lines": []} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:75 | |
| 2020-06-25T06:27:26.498168 (delta: 2.910369) elapsed: 31.88875 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:86 | |
| 2020-06-25T06:27:26.547529 (delta: 0.049329) elapsed: 31.938111 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:102 | |
| 2020-06-25T06:27:26.598274 (delta: 0.050713) elapsed: 31.988856 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:112 | |
| 2020-06-25T06:27:26.647864 (delta: 0.049556) elapsed: 32.038446 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:127 | |
| 2020-06-25T06:27:26.698422 (delta: 0.050527) elapsed: 32.089004 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Replacing Restic Image in patch.yml] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:136 | |
| 2020-06-25T06:27:26.750037 (delta: 0.051582) elapsed: 32.140619 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:142 | |
| 2020-06-25T06:27:26.804908 (delta: 0.054821) elapsed: 32.19549 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the number of compute nodes] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:149 | |
| 2020-06-25T06:27:26.856863 (delta: 0.051919) elapsed: 32.247445 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the status of restic demonset pods] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:153 | |
| 2020-06-25T06:27:26.907468 (delta: 0.050553) elapsed: 32.29805 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:166 | |
| 2020-06-25T06:27:26.957366 (delta: 0.049866) elapsed: 32.347948 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:176 | |
| 2020-06-25T06:27:27.017307 (delta: 0.059907) elapsed: 32.407889 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:191 | |
| 2020-06-25T06:27:27.073152 (delta: 0.055813) elapsed: 32.463734 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:200 | |
| 2020-06-25T06:27:27.131408 (delta: 0.058206) elapsed: 32.52199 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero install --provider gcp --plugins velero/velero-plugin-for-gcp:v1.0.0 --bucket e2e-gcp-bucket --use-volume-snapshots=false --secret-file ./key.json", "delta": "0:00:02.461571", "end": "2020-06-25 06:27:29.744220", "rc": 0, "start": "2020-06-25 06:27:27.282649", "stderr": "", "stderr_lines": [], "stdout": "CustomResourceDefinition/backups.velero.io: attempting to create resource\nCustomResourceDefinition/backups.velero.io: already exists, proceeding\nCustomResourceDefinition/backups.velero.io: created\nCustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource\nCustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding\nCustomResourceDefinition/backupstoragelocations.velero.io: created\nCustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource\nCustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding\nCustomResourceDefinition/deletebackuprequests.velero.io: created\nCustomResourceDefinition/downloadrequests.velero.io: attempting to create resource\nCustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/downloadrequests.velero.io: created\nCustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumebackups.velero.io: created\nCustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumerestores.velero.io: created\nCustomResourceDefinition/resticrepositories.velero.io: attempting to create resource\nCustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding\nCustomResourceDefinition/resticrepositories.velero.io: created\nCustomResourceDefinition/restores.velero.io: attempting to create resource\nCustomResourceDefinition/restores.velero.io: already exists, proceeding\nCustomResourceDefinition/restores.velero.io: created\nCustomResourceDefinition/schedules.velero.io: attempting to create resource\nCustomResourceDefinition/schedules.velero.io: already exists, proceeding\nCustomResourceDefinition/schedules.velero.io: created\nCustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource\nCustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/serverstatusrequests.velero.io: created\nCustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource\nCustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding\nCustomResourceDefinition/volumesnapshotlocations.velero.io: created\nWaiting for resources to be ready in cluster...\nNamespace/velero: attempting to create resource\nNamespace/velero: created\nClusterRoleBinding/velero: attempting to create resource\nClusterRoleBinding/velero: created\nServiceAccount/velero: attempting to create resource\nServiceAccount/velero: created\nSecret/cloud-credentials: attempting to create resource\nSecret/cloud-credentials: created\nBackupStorageLocation/default: attempting to create resource\nBackupStorageLocation/default: created\nDeployment/velero: attempting to create resource\nDeployment/velero: created\nVelero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status.", "stdout_lines": ["CustomResourceDefinition/backups.velero.io: attempting to create resource", "CustomResourceDefinition/backups.velero.io: already exists, proceeding", "CustomResourceDefinition/backups.velero.io: created", "CustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource", "CustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding", "CustomResourceDefinition/backupstoragelocations.velero.io: created", "CustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource", "CustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding", "CustomResourceDefinition/deletebackuprequests.velero.io: created", "CustomResourceDefinition/downloadrequests.velero.io: attempting to create resource", "CustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/downloadrequests.velero.io: created", "CustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumebackups.velero.io: created", "CustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumerestores.velero.io: created", "CustomResourceDefinition/resticrepositories.velero.io: attempting to create resource", "CustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding", "CustomResourceDefinition/resticrepositories.velero.io: created", "CustomResourceDefinition/restores.velero.io: attempting to create resource", "CustomResourceDefinition/restores.velero.io: already exists, proceeding", "CustomResourceDefinition/restores.velero.io: created", "CustomResourceDefinition/schedules.velero.io: attempting to create resource", "CustomResourceDefinition/schedules.velero.io: already exists, proceeding", "CustomResourceDefinition/schedules.velero.io: created", "CustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource", "CustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/serverstatusrequests.velero.io: created", "CustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource", "CustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding", "CustomResourceDefinition/volumesnapshotlocations.velero.io: created", "Waiting for resources to be ready in cluster...", "Namespace/velero: attempting to create resource", "Namespace/velero: created", "ClusterRoleBinding/velero: attempting to create resource", "ClusterRoleBinding/velero: created", "ServiceAccount/velero: attempting to create resource", "ServiceAccount/velero: created", "Secret/cloud-credentials: attempting to create resource", "Secret/cloud-credentials: created", "BackupStorageLocation/default: attempting to create resource", "BackupStorageLocation/default: created", "Deployment/velero: attempting to create resource", "Deployment/velero: created", "Velero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status."]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:214 | |
| 2020-06-25T06:27:29.791377 (delta: 2.659935) elapsed: 35.181959 ******* | |
| FAILED - RETRYING: Checking for velero server status (20 retries left). | |
| FAILED - RETRYING: Checking for velero server status (19 retries left). | |
| FAILED - RETRYING: Checking for velero server status (18 retries left). | |
| changed: [127.0.0.1] => {"attempts": 4, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.795918", "end": "2020-06-25 06:27:48.502162", "rc": 0, "start": "2020-06-25 06:27:47.706244", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Replacing profile spec in volumesnapshotlocation.yml] ******************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:223 | |
| 2020-06-25T06:27:48.554189 (delta: 18.762776) elapsed: 53.944771 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:230 | |
| 2020-06-25T06:27:48.610388 (delta: 0.056164) elapsed: 54.00097 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:236 | |
| 2020-06-25T06:27:48.665117 (delta: 0.054696) elapsed: 54.055699 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl apply -f gcp-volume-snapshot-location.yml", "delta": "0:00:00.972762", "end": "2020-06-25 06:27:49.787382", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:48.814620", "stderr": "", "stderr_lines": [], "stdout": "volumesnapshotlocation.velero.io/gcp-bucket created", "stdout_lines": ["volumesnapshotlocation.velero.io/gcp-bucket created"]} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:242 | |
| 2020-06-25T06:27:49.840817 (delta: 1.175665) elapsed: 55.231399 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing development image of OpenEBS velero-plugin] ******************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:248 | |
| 2020-06-25T06:27:49.897878 (delta: 0.057028) elapsed: 55.28846 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero plugin add openebs/velero-plugin:ci", "delta": "0:00:00.876597", "end": "2020-06-25 06:27:50.931150", "rc": 0, "start": "2020-06-25 06:27:50.054553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Waiting for new velero server pod to come up] **************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:252 | |
| 2020-06-25T06:27:50.982054 (delta: 1.084143) elapsed: 56.372636 ******* | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (20 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (19 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (18 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (17 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (16 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod -n velero --no-headers -l deploy=velero | wc -l", "delta": "0:00:00.989954", "end": "2020-06-25 06:28:21.926413", "rc": 0, "start": "2020-06-25 06:28:20.936459", "stderr": "", "stderr_lines": [], "stdout": "1", "stdout_lines": ["1"]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:261 | |
| 2020-06-25T06:28:21.983155 (delta: 31.00106) elapsed: 87.373737 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.934707", "end": "2020-06-25 06:28:23.056345", "rc": 0, "start": "2020-06-25 06:28:22.121638", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Checking for velero server container status] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:268 | |
| 2020-06-25T06:28:23.113763 (delta: 1.130558) elapsed: 88.504345 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.containerStatuses[0].ready}'", "delta": "0:00:00.967407", "end": "2020-06-25 06:28:24.223946", "rc": 0, "start": "2020-06-25 06:28:23.256539", "stderr": "", "stderr_lines": [], "stdout": "true", "stdout_lines": ["true"]} | |
| TASK [Get Application pod details] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:24 | |
| 2020-06-25T06:28:24.277814 (delta: 1.163985) elapsed: 89.668396 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.794854", "end": "2020-06-25 06:28:25.217326", "rc": 0, "start": "2020-06-25 06:28:24.422472", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-vmn8l", "stdout_lines": ["percona-7c6969cf78-vmn8l"]} | |
| TASK [Create new database in the mysql] **************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:28 | |
| 2020-06-25T06:28:25.267296 (delta: 0.98945) elapsed: 90.657878 ******** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:28:25.383522 (delta: 0.116192) elapsed: 90.774104 ******* | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create database backup;'", "delta": "0:00:01.167503", "end": "2020-06-25 06:28:26.707218", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "rc": 0, "start": "2020-06-25 06:28:25.539715", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "delta": "0:00:01.286102", "end": "2020-06-25 06:28:28.129293", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "rc": 0, "start": "2020-06-25 06:28:26.843191", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "delta": "0:00:00.961560", "end": "2020-06-25 06:28:29.242626", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "rc": 0, "start": "2020-06-25 06:28:28.281066", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:28:29.291844 (delta: 3.90829) elapsed: 94.682426 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:28:29.335031 (delta: 0.043148) elapsed: 94.725613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:28:29.378993 (delta: 0.043927) elapsed: 94.769575 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:28:29.421331 (delta: 0.042306) elapsed: 94.811913 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Get the container status of application.] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:51 | |
| 2020-06-25T06:28:29.465277 (delta: 0.043912) elapsed: 94.855859 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Check if db is ready for connections] ************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:61 | |
| 2020-06-25T06:28:29.506968 (delta: 0.041658) elapsed: 94.89755 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for the Corrupted tables] *************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:68 | |
| 2020-06-25T06:28:29.551934 (delta: 0.044933) elapsed: 94.942516 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify mysql data persistence] ******************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:77 | |
| 2020-06-25T06:28:29.595600 (delta: 0.043615) elapsed: 94.986182 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Delete/drop MySQL database] ********************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:90 | |
| 2020-06-25T06:28:29.637299 (delta: 0.041665) elapsed: 95.027881 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify successful db delete] ********************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:98 | |
| 2020-06-25T06:28:29.681284 (delta: 0.043951) elapsed: 95.071866 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application mount point] ************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:40 | |
| 2020-06-25T06:28:29.723895 (delta: 0.042577) elapsed: 95.114477 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Writing data on application mount point] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:45 | |
| 2020-06-25T06:28:29.774516 (delta: 0.050586) elapsed: 95.165098 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application deployment name] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:52 | |
| 2020-06-25T06:28:29.829231 (delta: 0.05468) elapsed: 95.219813 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching the volume name of application] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:56 | |
| 2020-06-25T06:28:29.877264 (delta: 0.047998) elapsed: 95.267846 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Annotating the application pod] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:61 | |
| 2020-06-25T06:28:29.927650 (delta: 0.05035) elapsed: 95.318232 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup for the provided application] **************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:66 | |
| 2020-06-25T06:28:29.975647 (delta: 0.047945) elapsed: 95.366229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:30.153731 (delta: 0.178049) elapsed: 95.544313 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:30.208755 (delta: 0.054997) elapsed: 95.599337 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero backup create percona-backup --include-namespaces=app-percona-csi --snapshot-volumes --volume-snapshot-locations=gcp-bucket", "delta": "0:00:00.762984", "end": "2020-06-25 06:28:31.123022", "rc": 0, "start": "2020-06-25 06:28:30.360038", "stderr": "", "stderr_lines": [], "stdout": "Backup request \"percona-backup\" submitted successfully.\nRun `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details.", "stdout_lines": ["Backup request \"percona-backup\" submitted successfully.", "Run `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details."]} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:31.172031 (delta: 0.963226) elapsed: 96.562613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:31.225986 (delta: 0.053811) elapsed: 96.616568 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:31.289287 (delta: 0.063264) elapsed: 96.679869 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:31.345350 (delta: 0.056006) elapsed: 96.735932 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:31.389658 (delta: 0.044267) elapsed: 96.78024 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:31.433499 (delta: 0.043805) elapsed: 96.824081 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:28:31.479518 (delta: 0.045983) elapsed: 96.8701 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:28:31.522464 (delta: 0.042912) elapsed: 96.913046 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:28:31.568668 (delta: 0.04617) elapsed: 96.95925 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:28:31.624925 (delta: 0.056222) elapsed: 97.015507 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:28:31.686480 (delta: 0.061515) elapsed: 97.077062 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:28:31.733581 (delta: 0.047046) elapsed: 97.124163 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:28:31.790562 (delta: 0.05694) elapsed: 97.181144 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:75 | |
| 2020-06-25T06:28:31.851578 (delta: 0.060963) elapsed: 97.24216 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the backup name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:79 | |
| 2020-06-25T06:28:31.906991 (delta: 0.055362) elapsed: 97.297573 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:83 | |
| 2020-06-25T06:28:31.957242 (delta: 0.050204) elapsed: 97.347824 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:90 | |
| 2020-06-25T06:28:32.007047 (delta: 0.049757) elapsed: 97.397629 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for completed backup] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:95 | |
| 2020-06-25T06:28:32.060182 (delta: 0.0531) elapsed: 97.450764 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the base backup name] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:102 | |
| 2020-06-25T06:28:32.109735 (delta: 0.049515) elapsed: 97.500317 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of backup] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:108 | |
| 2020-06-25T06:28:32.161647 (delta: 0.051862) elapsed: 97.552229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:32.290429 (delta: 0.128743) elapsed: 97.681011 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:32.333229 (delta: 0.042766) elapsed: 97.723811 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:32.378833 (delta: 0.045568) elapsed: 97.769415 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:32.422233 (delta: 0.043363) elapsed: 97.812815 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:32.464751 (delta: 0.042483) elapsed: 97.855333 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:32.513763 (delta: 0.048965) elapsed: 97.904345 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:32.558227 (delta: 0.044411) elapsed: 97.948809 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:32.604590 (delta: 0.04633) elapsed: 97.995172 ******** | |
| FAILED - RETRYING: Getting the state of Backup (100 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (99 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (98 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (97 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (96 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get backup percona-backup -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.999175", "end": "2020-06-25 06:29:03.889667", "rc": 0, "start": "2020-06-25 06:29:02.890492", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:03.946478 (delta: 31.341852) elapsed: 129.33706 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:03.991455 (delta: 0.044942) elapsed: 129.382037 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:04.035862 (delta: 0.044373) elapsed: 129.426444 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:04.082631 (delta: 0.046736) elapsed: 129.473213 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:04.127378 (delta: 0.044713) elapsed: 129.51796 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:04.171571 (delta: 0.044156) elapsed: 129.562153 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:04.215981 (delta: 0.044365) elapsed: 129.606563 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verifying for local snaphot deletion] ************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:115 | |
| 2020-06-25T06:29:04.259414 (delta: 0.043394) elapsed: 129.649996 ****** | |
| included: /experiments/functional/backup_and_restore/additional_verification.yml for 127.0.0.1 | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:4 | |
| 2020-06-25T06:29:04.398569 (delta: 0.13912) elapsed: 129.789151 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.756255", "end": "2020-06-25 06:29:05.298383", "rc": 0, "start": "2020-06-25 06:29:04.542128", "stderr": "", "stderr_lines": [], "stdout": "pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor backup name] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:8 | |
| 2020-06-25T06:29:05.344283 (delta: 0.945679) elapsed: 130.734865 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get cstorbackup -n app-percona-csi | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.717512", "end": "2020-06-25 06:29:06.206557", "rc": 0, "start": "2020-06-25 06:29:05.489045", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor pool UID] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:15 | |
| 2020-06-25T06:29:06.255406 (delta: 0.911087) elapsed: 131.645988 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cstorbackup percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -n app-percona-csi -o jsonpath='{.metadata.labels.cstorpool\\.openebs\\.io/uid}'", "delta": "0:00:00.733727", "end": "2020-06-25 06:29:07.130608", "rc": 0, "start": "2020-06-25 06:29:06.396881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the CVR name from the corresponding pool uid] ******************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:19 | |
| 2020-06-25T06:29:07.184672 (delta: 0.92923) elapsed: 132.575254 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l cstorpool.openebs.io/uid=,cstorvolume.openebs.io/name=pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -o jsonpath='{.items[*].metadata.name}'", "delta": "0:00:00.743689", "end": "2020-06-25 06:29:08.133069", "rc": 0, "start": "2020-06-25 06:29:07.389380", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the cstor pool label from cvr] *********************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:23 | |
| 2020-06-25T06:29:08.178094 (delta: 0.993386) elapsed: 133.568676 ****** | |
| TASK [Geting the pool pod name corresponding to the label] ********************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:29 | |
| 2020-06-25T06:29:08.223360 (delta: 0.045214) elapsed: 133.613942 ****** | |
| TASK [Deleting the cstor pool pod] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:37 | |
| 2020-06-25T06:29:08.270044 (delta: 0.046649) elapsed: 133.660626 ****** | |
| TASK [Verifying whether local snapshot is deleted] ***************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:48 | |
| 2020-06-25T06:29:08.320524 (delta: 0.050429) elapsed: 133.711106 ****** | |
| TASK [Getting maya-pai-server pod name] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:61 | |
| 2020-06-25T06:29:08.368566 (delta: 0.048007) elapsed: 133.759148 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting the maya-api-server pod] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:65 | |
| 2020-06-25T06:29:08.415911 (delta: 0.047309) elapsed: 133.806493 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting Application] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:124 | |
| 2020-06-25T06:29:08.463334 (delta: 0.047389) elapsed: 133.853916 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl delete pvc,deploy,svc --all -n app-percona-csi\n kubectl delete ns app-percona-csi", "delta": "0:00:18.673774", "end": "2020-06-25 06:29:27.323723", "rc": 0, "start": "2020-06-25 06:29:08.649949", "stderr": "", "stderr_lines": [], "stdout": "persistentvolumeclaim \"percona-mysql-claim\" deleted\ndeployment.extensions \"percona\" deleted\nservice \"percona-mysql\" deleted\nnamespace \"app-percona-csi\" deleted", "stdout_lines": ["persistentvolumeclaim \"percona-mysql-claim\" deleted", "deployment.extensions \"percona\" deleted", "service \"percona-mysql\" deleted", "namespace \"app-percona-csi\" deleted"]} | |
| TASK [Checking whether namespace is deleted] *********************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:129 | |
| 2020-06-25T06:29:27.367621 (delta: 18.904252) elapsed: 152.758203 ***** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get ns --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.757975", "end": "2020-06-25 06:29:28.274808", "rc": 0, "start": "2020-06-25 06:29:27.516833", "stderr": "", "stderr_lines": [], "stdout": "aman\ncert-manager\ndefault\nkommander\nkube-node-lease\nkube-public\nkube-system\nkubeaddons\nlitmus\nmaya-system\nopenebs\ntest\nvelero", "stdout_lines": ["aman", "cert-manager", "default", "kommander", "kube-node-lease", "kube-public", "kube-system", "kubeaddons", "litmus", "maya-system", "openebs", "test", "velero"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:146 | |
| 2020-06-25T06:29:28.326285 (delta: 0.958626) elapsed: 153.716867 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:28.424891 (delta: 0.09857) elapsed: 153.815473 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:28.475800 (delta: 0.050874) elapsed: 153.866382 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:28.527512 (delta: 0.051658) elapsed: 153.918094 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:28.595238 (delta: 0.067688) elapsed: 153.98582 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:28.654806 (delta: 0.05951) elapsed: 154.045388 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:28.706974 (delta: 0.05213) elapsed: 154.097556 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:28.763097 (delta: 0.056085) elapsed: 154.153679 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:28.813252 (delta: 0.050116) elapsed: 154.203834 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:28.869591 (delta: 0.056288) elapsed: 154.260173 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl create ns app-percona-csi", "delta": "0:00:00.921844", "end": "2020-06-25 06:29:29.953692", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:29:29.031848", "stderr": "", "stderr_lines": [], "stdout": "namespace/app-percona-csi created", "stdout_lines": ["namespace/app-percona-csi created"]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:30.003989 (delta: 1.134361) elapsed: 155.394571 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero restore create --from-backup percona-backup --restore-volumes=true", "delta": "0:00:00.742141", "end": "2020-06-25 06:29:30.905695", "rc": 0, "start": "2020-06-25 06:29:30.163554", "stderr": "", "stderr_lines": [], "stdout": "Restore request \"percona-backup-20200625062930\" submitted successfully.\nRun `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details.", "stdout_lines": ["Restore request \"percona-backup-20200625062930\" submitted successfully.", "Run `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details."]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:30.957816 (delta: 0.953795) elapsed: 156.348398 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.013633 (delta: 0.055776) elapsed: 156.404215 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:31.071681 (delta: 0.057998) elapsed: 156.462263 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:31.127733 (delta: 0.056011) elapsed: 156.518315 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:31.187804 (delta: 0.06001) elapsed: 156.578386 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:152 | |
| 2020-06-25T06:29:31.238816 (delta: 0.050976) elapsed: 156.629398 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:31.344329 (delta: 0.105478) elapsed: 156.734911 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:31.398928 (delta: 0.054557) elapsed: 156.78951 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:31.454105 (delta: 0.055131) elapsed: 156.844687 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:31.505860 (delta: 0.051716) elapsed: 156.896442 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:31.555513 (delta: 0.049619) elapsed: 156.946095 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:31.606027 (delta: 0.050479) elapsed: 156.996609 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:31.658945 (delta: 0.052881) elapsed: 157.049527 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:31.720250 (delta: 0.0612) elapsed: 157.110832 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:31.782094 (delta: 0.061792) elapsed: 157.172676 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:31.836390 (delta: 0.054256) elapsed: 157.226972 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:31.887438 (delta: 0.051008) elapsed: 157.27802 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.945602 (delta: 0.058112) elapsed: 157.336184 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:32.003396 (delta: 0.057743) elapsed: 157.393978 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:32.055557 (delta: 0.052096) elapsed: 157.446139 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero get restore | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.680082", "end": "2020-06-25 06:29:32.894615", "rc": 0, "start": "2020-06-25 06:29:32.214533", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-20200625062930", "stdout_lines": ["percona-backup-20200625062930"]} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:32.940140 (delta: 0.884546) elapsed: 158.330722 ****** | |
| FAILED - RETRYING: Checking the restore status (60 retries left). | |
| FAILED - RETRYING: Checking the restore status (59 retries left). | |
| FAILED - RETRYING: Checking the restore status (58 retries left). | |
| FAILED - RETRYING: Checking the restore status (57 retries left). | |
| changed: [127.0.0.1] => {"attempts": 5, "changed": true, "cmd": "kubectl get restore percona-backup-20200625062930 -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.786878", "end": "2020-06-25 06:29:57.867818", "rc": 0, "start": "2020-06-25 06:29:57.080940", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:162 | |
| 2020-06-25T06:29:57.926367 (delta: 24.986173) elapsed: 183.316949 ***** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:168 | |
| 2020-06-25T06:29:57.987229 (delta: 0.060826) elapsed: 183.377811 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:180 | |
| 2020-06-25T06:29:58.048209 (delta: 0.060946) elapsed: 183.438791 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.945068", "end": "2020-06-25 06:29:59.157534", "rc": 0, "start": "2020-06-25 06:29:58.212466", "stderr": "", "stderr_lines": [], "stdout": "pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "stdout_lines": ["pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"]} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:184 | |
| 2020-06-25T06:29:59.203070 (delta: 1.154825) elapsed: 184.593652 ****** | |
| included: /experiments/functional/backup_and_restore/cstor_post_restore.yml for 127.0.0.1 | |
| TASK [Getting the target IP] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:2 | |
| 2020-06-25T06:29:59.315315 (delta: 0.112211) elapsed: 184.705897 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get svc -n openebs --no-headers -l openebs.io/persistent-volume=pvc-78e1a852-40c8-4489-bb95-0f0066398c2d -o jsonpath='{.items[0].spec.clusterIP}'", "delta": "0:00:00.775021", "end": "2020-06-25 06:30:00.248726", "rc": 0, "start": "2020-06-25 06:29:59.473705", "stderr": "", "stderr_lines": [], "stdout": "11.0.50.166", "stdout_lines": ["11.0.50.166"]} | |
| TASK [Getting the CVR name from the corresponding PV] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:11 | |
| 2020-06-25T06:30:00.301403 (delta: 0.986053) elapsed: 185.691985 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Geting the CSP name corresponding to CVR] ******************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:15 | |
| 2020-06-25T06:30:00.360648 (delta: 0.059207) elapsed: 185.75123 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the pool pod name] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:20 | |
| 2020-06-25T06:30:00.420531 (delta: 0.059847) elapsed: 185.811113 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the volume name inside cstor pool] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:25 | |
| 2020-06-25T06:30:00.479725 (delta: 0.059154) elapsed: 185.870307 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Assigning the cstor-pool volume name to variable] ************************ | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:30 | |
| 2020-06-25T06:30:00.542960 (delta: 0.063175) elapsed: 185.933542 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Setting target IP for volume inside cstor pool] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:34 | |
| 2020-06-25T06:30:00.602407 (delta: 0.05941) elapsed: 185.992989 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the CVR name from the corresponding PV] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:44 | |
| 2020-06-25T06:30:00.662537 (delta: 0.060093) elapsed: 186.053119 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l openebs.io/persistent-volume=pvc-78e1a852-40c8-4489-bb95-0f0066398c2d -o jsonpath='{range.items[*]}{.metadata.labels.cstorpoolinstance\\.openebs\\.io/name}{\"\\n\"}{end}'", "delta": "0:00:00.772113", "end": "2020-06-25 06:30:01.599426", "rc": 0, "start": "2020-06-25 06:30:00.827313", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b\ncstor-cspc-disk-pool-8vvv\ncstor-cspc-disk-pool-cj5m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b", "cstor-cspc-disk-pool-8vvv", "cstor-cspc-disk-pool-cj5m"]} | |
| TASK [Geting the CSPI name corresponding to CVR] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:48 | |
| 2020-06-25T06:30:01.651403 (delta: 0.988829) elapsed: 187.041985 ****** | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-6n9b) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-6n9b -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.760993", "end": "2020-06-25 06:30:02.596045", "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:01.835052", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b", "stdout_lines": ["cstor-cspc-disk-pool-6n9b"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-8vvv) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-8vvv -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.933590", "end": "2020-06-25 06:30:03.687847", "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:02.754257", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv", "stdout_lines": ["cstor-cspc-disk-pool-8vvv"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-cj5m) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-cj5m -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.857139", "end": "2020-06-25 06:30:04.699592", "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:03.842453", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m", "stdout_lines": ["cstor-cspc-disk-pool-cj5m"]} | |
| TASK [Getting the pool pod name] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:53 | |
| 2020-06-25T06:30:04.750022 (delta: 3.098579) elapsed: 190.140604 ****** | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-6n9b) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-8vvv) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-cj5m) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]} | |
| TASK [Getting the volume name inside cstor pool] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:58 | |
| 2020-06-25T06:30:07.749874 (delta: 2.999814) elapsed: 193.140456 ****** | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m', '_ansible_item_result': True, u'delta': u'0:00:00.937403', 'stdout_lines': [u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m'], '_ansible_item_label': u'cstor-cspc-disk-pool-6n9b', u'end': u'2020-06-25 06:30:05.870226', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-6n9b', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:04.932823', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.229101", "end": "2020-06-25 06:30:09.162558", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]}, "rc": 0, "start": "2020-06-25 06:30:07.933457", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m', '_ansible_item_result': True, u'delta': u'0:00:00.702313', 'stdout_lines': [u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m'], '_ansible_item_label': u'cstor-cspc-disk-pool-8vvv', u'end': u'2020-06-25 06:30:06.726757', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-8vvv', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:06.024444', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.238007", "end": "2020-06-25 06:30:10.556976", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]}, "rc": 0, "start": "2020-06-25 06:30:09.318969", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45', '_ansible_item_result': True, u'delta': u'0:00:00.797214', 'stdout_lines': [u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45'], '_ansible_item_label': u'cstor-cspc-disk-pool-cj5m', u'end': u'2020-06-25 06:30:07.694743', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-cj5m', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:06.897529', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.001806", "end": "2020-06-25 06:30:11.732631", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]}, "rc": 0, "start": "2020-06-25 06:30:10.730825", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| TASK [Assigning the cstor-pool volume name to variable] ************************ | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:63 | |
| 2020-06-25T06:30:11.784506 (delta: 4.034584) elapsed: 197.175088 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat ./cstor-vol", "delta": "0:00:00.813204", "end": "2020-06-25 06:30:12.748013", "rc": 0, "start": "2020-06-25 06:30:11.934809", "stderr": "", "stderr_lines": [], "stdout": "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d\ncstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d\ncstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "stdout_lines": ["cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"]} | |
| TASK [Setting target IP for volume inside cstor pool] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:67 | |
| 2020-06-25T06:30:12.797896 (delta: 1.013352) elapsed: 198.188478 ****** | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m', '_ansible_item_result': True, u'delta': u'0:00:00.937403', 'stdout_lines': [u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m'], '_ansible_item_label': u'cstor-cspc-disk-pool-6n9b', u'end': u'2020-06-25 06:30:05.870226', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:04.932823', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-6n9b', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.064015", "end": "2020-06-25 06:30:14.063360", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-6n9b", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:12.999345", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m', '_ansible_item_result': True, u'delta': u'0:00:00.702313', 'stdout_lines': [u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m'], '_ansible_item_label': u'cstor-cspc-disk-pool-8vvv', u'end': u'2020-06-25 06:30:06.726757', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:06.024444', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-8vvv', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.007217", "end": "2020-06-25 06:30:15.233190", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-8vvv", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:14.225973", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45', '_ansible_item_result': True, u'delta': u'0:00:00.797214', 'stdout_lines': [u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45'], '_ansible_item_label': u'cstor-cspc-disk-pool-cj5m', u'end': u'2020-06-25 06:30:07.694743', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:06.897529', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-cj5m', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.035342", "end": "2020-06-25 06:30:16.424346", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-cj5m", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:15.389004", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:193 | |
| 2020-06-25T06:30:16.480647 (delta: 3.682718) elapsed: 201.871229 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:197 | |
| 2020-06-25T06:30:16.538368 (delta: 0.057686) elapsed: 201.92895 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for application to be in running state] ************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:208 | |
| 2020-06-25T06:30:16.593237 (delta: 0.054835) elapsed: 201.983819 ****** | |
| FAILED - RETRYING: Waiting for application to be in running state (30 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (29 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (28 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (27 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (26 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod percona-7c6969cf78-vmn8l -n app-percona-csi -o jsonpath='{.status.phase}'", "delta": "0:00:00.755026", "end": "2020-06-25 06:30:47.382712", "rc": 0, "start": "2020-06-25 06:30:46.627686", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Verifying Data persistense] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:215 | |
| 2020-06-25T06:30:47.438523 (delta: 30.845234) elapsed: 232.829105 ***** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:30:47.534411 (delta: 0.095852) elapsed: 232.924993 ****** | |
| skipping: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "skip_reason": "Conditional result was False"} | |
| skipping: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "skip_reason": "Conditional result was False"} | |
| skipping: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "skip_reason": "Conditional result was False"} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:30:47.617913 (delta: 0.083453) elapsed: 233.008495 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl delete pod percona-7c6969cf78-vmn8l -n app-percona-csi", "delta": "0:00:06.920902", "end": "2020-06-25 06:30:54.696798", "rc": 0, "start": "2020-06-25 06:30:47.775896", "stderr": "", "stderr_lines": [], "stdout": "pod \"percona-7c6969cf78-vmn8l\" deleted", "stdout_lines": ["pod \"percona-7c6969cf78-vmn8l\" deleted"]} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:30:54.742820 (delta: 7.12487) elapsed: 240.133402 ******* | |
| [WARNING]: when statements should not include jinja2 templating delimiters | |
| such as {{ }} or {% %}. Found: "{{ pod_name }}" not in podstatus.stdout | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi", "delta": "0:00:00.716209", "end": "2020-06-25 06:30:55.672069", "rc": 0, "start": "2020-06-25 06:30:54.955860", "stderr": "", "stderr_lines": [], "stdout": "NAME READY STATUS RESTARTS AGE\npercona-7c6969cf78-ht7r7 0/1 ContainerCreating 0 7s", "stdout_lines": ["NAME READY STATUS RESTARTS AGE", "percona-7c6969cf78-ht7r7 0/1 ContainerCreating 0 7s"]} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:30:55.728650 (delta: 0.985793) elapsed: 241.119232 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona -o jsonpath='{.items[].metadata.name}'", "delta": "0:00:00.882975", "end": "2020-06-25 06:30:56.769052", "rc": 0, "start": "2020-06-25 06:30:55.886077", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-ht7r7", "stdout_lines": ["percona-7c6969cf78-ht7r7"]} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:30:56.816825 (delta: 1.088138) elapsed: 242.207407 ****** | |
| FAILED - RETRYING: Checking application pod is in running state (150 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (149 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (148 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (147 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (146 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (145 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (144 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (143 retries left). | |
| ^C | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-ht7r7 0/1 ContainerCreating 0 35s | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-ht7r7 0/1 ContainerCreating 0 37s | |
| d2iq@rack2:~$ kubectl get po -n app-percona-csi | |
| NAME READY STATUS RESTARTS AGE | |
| percona-7c6969cf78-ht7r7 1/1 Running 0 55s | |
| d2iq@rack2:~$ kubectl logs -f litmus-velero-backup-restore-zwcrl-g6mkm -n litmus | |
| ansible-playbook 2.7.3 | |
| config file = None | |
| configured module search path = [u'/root/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules'] | |
| ansible python module location = /usr/local/lib/python2.7/dist-packages/ansible | |
| executable location = /usr/local/bin/ansible-playbook | |
| python version = 2.7.17 (default, Apr 15 2020, 17:20:14) [GCC 7.5.0] | |
| No config file found; using defaults | |
| /etc/ansible/hosts did not meet host_list requirements, check plugin documentation if this is unexpected | |
| /etc/ansible/hosts did not meet script requirements, check plugin documentation if this is unexpected | |
| PLAYBOOK: test.yml ************************************************************* | |
| 1 plays in ./experiments/functional/backup_and_restore/test.yml | |
| PLAY [localhost] *************************************************************** | |
| 2020-06-25T06:26:54.651979 (delta: 0.042561) elapsed: 0.042561 ******** | |
| =============================================================================== | |
| TASK [Gathering Facts] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:1 | |
| 2020-06-25T06:26:54.677843 (delta: 0.025828) elapsed: 0.068425 ******** | |
| ok: [127.0.0.1] | |
| META: ran handlers | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:12 | |
| 2020-06-25T06:27:02.124833 (delta: 7.44697) elapsed: 7.515415 ********* | |
| included: /utils/fcm/create_testname.yml for 127.0.0.1 | |
| TASK [Record test instance/run ID] ********************************************* | |
| task path: /utils/fcm/create_testname.yml:3 | |
| 2020-06-25T06:27:02.193182 (delta: 0.068318) elapsed: 7.583764 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Construct testname appended with runID] ********************************** | |
| task path: /utils/fcm/create_testname.yml:7 | |
| 2020-06-25T06:27:02.243609 (delta: 0.050379) elapsed: 7.634191 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:15 | |
| 2020-06-25T06:27:02.296859 (delta: 0.053219) elapsed: 7.687441 ******** | |
| included: /utils/fcm/update_litmus_result_resource.yml for 127.0.0.1 | |
| TASK [Generate the litmus result CR to reflect SOT (Start of Test)] ************ | |
| task path: /utils/fcm/update_litmus_result_resource.yml:3 | |
| 2020-06-25T06:27:02.374467 (delta: 0.077575) elapsed: 7.765049 ******** | |
| changed: [127.0.0.1] => {"changed": true, "checksum": "cb23761ee0ecfea3a093f94c0443739c777b3007", "dest": "./litmus-result.yaml", "gid": 0, "group": "root", "md5sum": "0da5664e16958d4f3c263662ebe36b5c", "mode": "0644", "owner": "root", "size": 422, "src": "/root/.ansible/tmp/ansible-tmp-1593066422.41-35404301145742/source", "state": "file", "uid": 0} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:14 | |
| 2020-06-25T06:27:02.892199 (delta: 0.517704) elapsed: 8.282781 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat litmus-result.yaml", "delta": "0:00:00.776459", "end": "2020-06-25 06:27:03.908295", "rc": 0, "start": "2020-06-25 06:27:03.131836", "stderr": "", "stderr_lines": [], "stdout": "---\napiVersion: litmus.io/v1alpha1\nkind: LitmusResult\nmetadata:\n\n # name of the litmus testcase\n name: velero-backup-restore \nspec:\n\n # holds information on the testcase\n testMetadata:\n app: \n chaostype: \n\n # holds the state of testcase, manually updated by json merge patch\n # result is the useful value today, but anticipate phase use in future \n testStatus: \n phase: in-progress \n result: none ", "stdout_lines": ["---", "apiVersion: litmus.io/v1alpha1", "kind: LitmusResult", "metadata:", "", " # name of the litmus testcase", " name: velero-backup-restore ", "spec:", "", " # holds information on the testcase", " testMetadata:", " app: ", " chaostype: ", "", " # holds the state of testcase, manually updated by json merge patch", " # result is the useful value today, but anticipate phase use in future ", " testStatus: ", " phase: in-progress ", " result: none "]} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:17 | |
| 2020-06-25T06:27:03.958838 (delta: 1.066606) elapsed: 9.34942 ********* | |
| changed: [127.0.0.1] => {"changed": true, "failed_when_result": false, "method": "create", "result": {"apiVersion": "litmus.io/v1alpha1", "kind": "LitmusResult", "metadata": {"creationTimestamp": "2020-06-25T06:27:04Z", "generation": 1, "name": "velero-backup-restore", "resourceVersion": "270870", "selfLink": "/apis/litmus.io/v1alpha1/litmusresults/velero-backup-restore", "uid": "76cd180d-4057-43ae-9202-847be8bda1f2"}, "spec": {"testMetadata": {"app": null, "chaostype": null}, "testStatus": {"phase": "in-progress", "result": "none"}}}} | |
| TASK [Generate the litmus result CR to reflect EOT (End of Test)] ************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:27 | |
| 2020-06-25T06:27:04.791716 (delta: 0.832849) elapsed: 10.182298 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:38 | |
| 2020-06-25T06:27:04.837682 (delta: 0.045923) elapsed: 10.228264 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:41 | |
| 2020-06-25T06:27:04.884764 (delta: 0.047049) elapsed: 10.275346 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify that the AUT is running] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:19 | |
| 2020-06-25T06:27:04.927701 (delta: 0.042895) elapsed: 10.318283 ******* | |
| included: /utils/k8s/check_deployment_status.yml for 127.0.0.1 | |
| TASK [Check the pod status] **************************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:8 | |
| 2020-06-25T06:27:05.005795 (delta: 0.078046) elapsed: 10.396377 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:status.phase", "delta": "0:00:01.021615", "end": "2020-06-25 06:27:06.174018", "rc": 0, "start": "2020-06-25 06:27:05.152403", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [obtain the number of replicas.] ****************************************** | |
| task path: /utils/k8s/check_deployment_status.yml:22 | |
| 2020-06-25T06:27:06.221079 (delta: 1.215237) elapsed: 11.611661 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the ready replica count and compare with the replica count.] ****** | |
| task path: /utils/k8s/check_deployment_status.yml:29 | |
| 2020-06-25T06:27:06.269457 (delta: 0.048345) elapsed: 11.660039 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:22 | |
| 2020-06-25T06:27:06.318949 (delta: 0.049459) elapsed: 11.709531 ******* | |
| included: /experiments/functional/backup_and_restore/setup_dependency.yml for 127.0.0.1 | |
| TASK [Downloading velero binary] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:1 | |
| 2020-06-25T06:27:06.466656 (delta: 0.147675) elapsed: 11.857238 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "checksum_dest": null, "checksum_src": "c5fe9de752d3152b32326ff2dab02198f9274868", "dest": "./velero-v1.4.0-linux-amd64.tar.gz", "gid": 0, "group": "root", "md5sum": "acb7e7184de6c45f4b88d71333115c7d", "mode": "0644", "msg": "OK (23832176 bytes)", "owner": "root", "size": 23832176, "src": "/root/.ansible/tmp/ansible-tmp-1593066426.51-91520691137004/tmp4LWNOB", "state": "file", "status_code": 200, "uid": 0, "url": "https://github.com/vmware-tanzu/velero/releases/download/v1.4.0/velero-v1.4.0-linux-amd64.tar.gz"} | |
| TASK [Installing velero inside litmus container] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:11 | |
| 2020-06-25T06:27:12.970388 (delta: 6.503702) elapsed: 18.36097 ******** | |
| [WARNING]: Consider using the unarchive module rather than running tar. If | |
| you need to use command because unarchive is insufficient you can add | |
| warn=False to this command task or set command_warnings=False in ansible.cfg to | |
| get rid of this message. | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "tar -xvf velero-v1.4.0-linux-amd64.tar.gz\n mv velero-v1.4.0-linux-amd64/velero /usr/local/bin/", "delta": "0:00:01.147221", "end": "2020-06-25 06:27:14.273089", "rc": 0, "start": "2020-06-25 06:27:13.125868", "stderr": "", "stderr_lines": [], "stdout": "velero-v1.4.0-linux-amd64/LICENSE\nvelero-v1.4.0-linux-amd64/examples/README.md\nvelero-v1.4.0-linux-amd64/examples/minio\nvelero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app\nvelero-v1.4.0-linux-amd64/examples/nginx-app/README.md\nvelero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml\nvelero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml\nvelero-v1.4.0-linux-amd64/velero", "stdout_lines": ["velero-v1.4.0-linux-amd64/LICENSE", "velero-v1.4.0-linux-amd64/examples/README.md", "velero-v1.4.0-linux-amd64/examples/minio", "velero-v1.4.0-linux-amd64/examples/minio/00-minio-deployment.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app", "velero-v1.4.0-linux-amd64/examples/nginx-app/README.md", "velero-v1.4.0-linux-amd64/examples/nginx-app/base.yaml", "velero-v1.4.0-linux-amd64/examples/nginx-app/with-pv.yaml", "velero-v1.4.0-linux-amd64/velero"]} | |
| TASK [Checking the velero version] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:16 | |
| 2020-06-25T06:27:14.316697 (delta: 1.346277) elapsed: 19.707279 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero version", "delta": "0:00:00.730747", "end": "2020-06-25 06:27:15.208332", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:14.477585", "stderr": "", "stderr_lines": [], "stdout": "Client:\n\tVersion: v1.4.0\n\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392\n<error getting server version: namespaces \"velero\" not found>", "stdout_lines": ["Client:", "\tVersion: v1.4.0", "\tGit commit: 5963650c9d64643daaf510ef93ac4a36b6483392", "<error getting server version: namespaces \"velero\" not found>"]} | |
| TASK [Replacing Profile name in credential file] ******************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:21 | |
| 2020-06-25T06:27:15.264347 (delta: 0.947611) elapsed: 20.654929 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing minio s3-bucket] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:30 | |
| 2020-06-25T06:27:15.314786 (delta: 0.050377) elapsed: 20.705368 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for minio pod status] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:33 | |
| 2020-06-25T06:27:15.366090 (delta: 0.051256) elapsed: 20.756672 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for minio job to create bucket] ********************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:40 | |
| 2020-06-25T06:27:15.415489 (delta: 0.049366) elapsed: 20.806071 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching service account key.json from configmap] ************************ | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:51 | |
| 2020-06-25T06:27:15.462010 (delta: 0.046491) elapsed: 20.852592 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cm gcp-key -n litmus -o jsonpath='{.data.key\\.json}' > ./key.json", "delta": "0:00:00.749906", "end": "2020-06-25 06:27:16.361887", "rc": 0, "start": "2020-06-25 06:27:15.611981", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Authenticating using gcp service account] ******************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:54 | |
| 2020-06-25T06:27:16.405081 (delta: 0.943039) elapsed: 21.795663 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud auth activate-service-account --key-file key.json", "delta": "0:00:01.405389", "end": "2020-06-25 06:27:17.955478", "rc": 0, "start": "2020-06-25 06:27:16.550089", "stderr": "Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]", "stderr_lines": ["Activated service account credentials for: [mayastor@openebs-ci.iam.gserviceaccount.com]"], "stdout": "", "stdout_lines": []} | |
| TASK [Setting up the project ID] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:57 | |
| 2020-06-25T06:27:17.999600 (delta: 1.594482) elapsed: 23.390182 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gcloud config set project openebs-ci", "delta": "0:00:02.626419", "end": "2020-06-25 06:27:20.774683", "rc": 0, "start": "2020-06-25 06:27:18.148264", "stderr": "Updated property [core/project].", "stderr_lines": ["Updated property [core/project]."], "stdout": "", "stdout_lines": []} | |
| TASK [Deleting GCP bucket if exist] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:60 | |
| 2020-06-25T06:27:20.822552 (delta: 2.822894) elapsed: 26.213134 ******* | |
| fatal: [127.0.0.1]: FAILED! => {"changed": true, "cmd": "gsutil rm -r gs://e2e-gcp-bucket", "delta": "0:00:02.569143", "end": "2020-06-25 06:27:23.543148", "msg": "non-zero return code", "rc": 1, "start": "2020-06-25 06:27:20.974005", "stderr": "BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist.", "stderr_lines": ["BucketNotFoundException: 404 gs://e2e-gcp-bucket bucket does not exist."], "stdout": "", "stdout_lines": []} | |
| ...ignoring | |
| TASK [Creating gcp bucket] ***************************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:66 | |
| 2020-06-25T06:27:23.587756 (delta: 2.765161) elapsed: 28.978338 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gsutil mb gs://e2e-gcp-bucket/", "delta": "0:00:02.725371", "end": "2020-06-25 06:27:26.453327", "rc": 0, "start": "2020-06-25 06:27:23.727956", "stderr": "Creating gs://e2e-gcp-bucket/...", "stderr_lines": ["Creating gs://e2e-gcp-bucket/..."], "stdout": "", "stdout_lines": []} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:75 | |
| 2020-06-25T06:27:26.498168 (delta: 2.910369) elapsed: 31.88875 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:86 | |
| 2020-06-25T06:27:26.547529 (delta: 0.049329) elapsed: 31.938111 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:102 | |
| 2020-06-25T06:27:26.598274 (delta: 0.050713) elapsed: 31.988856 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:112 | |
| 2020-06-25T06:27:26.647864 (delta: 0.049556) elapsed: 32.038446 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:127 | |
| 2020-06-25T06:27:26.698422 (delta: 0.050527) elapsed: 32.089004 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Replacing Restic Image in patch.yml] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:136 | |
| 2020-06-25T06:27:26.750037 (delta: 0.051582) elapsed: 32.140619 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Patching restic demonset for privileged access] ************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:142 | |
| 2020-06-25T06:27:26.804908 (delta: 0.054821) elapsed: 32.19549 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the number of compute nodes] ************************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:149 | |
| 2020-06-25T06:27:26.856863 (delta: 0.051919) elapsed: 32.247445 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the status of restic demonset pods] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:153 | |
| 2020-06-25T06:27:26.907468 (delta: 0.050553) elapsed: 32.29805 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:166 | |
| 2020-06-25T06:27:26.957366 (delta: 0.049866) elapsed: 32.347948 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:176 | |
| 2020-06-25T06:27:27.017307 (delta: 0.059907) elapsed: 32.407889 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:191 | |
| 2020-06-25T06:27:27.073152 (delta: 0.055813) elapsed: 32.463734 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing velero server inside cluster] ********************************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:200 | |
| 2020-06-25T06:27:27.131408 (delta: 0.058206) elapsed: 32.52199 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero install --provider gcp --plugins velero/velero-plugin-for-gcp:v1.0.0 --bucket e2e-gcp-bucket --use-volume-snapshots=false --secret-file ./key.json", "delta": "0:00:02.461571", "end": "2020-06-25 06:27:29.744220", "rc": 0, "start": "2020-06-25 06:27:27.282649", "stderr": "", "stderr_lines": [], "stdout": "CustomResourceDefinition/backups.velero.io: attempting to create resource\nCustomResourceDefinition/backups.velero.io: already exists, proceeding\nCustomResourceDefinition/backups.velero.io: created\nCustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource\nCustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding\nCustomResourceDefinition/backupstoragelocations.velero.io: created\nCustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource\nCustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding\nCustomResourceDefinition/deletebackuprequests.velero.io: created\nCustomResourceDefinition/downloadrequests.velero.io: attempting to create resource\nCustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/downloadrequests.velero.io: created\nCustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumebackups.velero.io: created\nCustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource\nCustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding\nCustomResourceDefinition/podvolumerestores.velero.io: created\nCustomResourceDefinition/resticrepositories.velero.io: attempting to create resource\nCustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding\nCustomResourceDefinition/resticrepositories.velero.io: created\nCustomResourceDefinition/restores.velero.io: attempting to create resource\nCustomResourceDefinition/restores.velero.io: already exists, proceeding\nCustomResourceDefinition/restores.velero.io: created\nCustomResourceDefinition/schedules.velero.io: attempting to create resource\nCustomResourceDefinition/schedules.velero.io: already exists, proceeding\nCustomResourceDefinition/schedules.velero.io: created\nCustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource\nCustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding\nCustomResourceDefinition/serverstatusrequests.velero.io: created\nCustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource\nCustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding\nCustomResourceDefinition/volumesnapshotlocations.velero.io: created\nWaiting for resources to be ready in cluster...\nNamespace/velero: attempting to create resource\nNamespace/velero: created\nClusterRoleBinding/velero: attempting to create resource\nClusterRoleBinding/velero: created\nServiceAccount/velero: attempting to create resource\nServiceAccount/velero: created\nSecret/cloud-credentials: attempting to create resource\nSecret/cloud-credentials: created\nBackupStorageLocation/default: attempting to create resource\nBackupStorageLocation/default: created\nDeployment/velero: attempting to create resource\nDeployment/velero: created\nVelero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status.", "stdout_lines": ["CustomResourceDefinition/backups.velero.io: attempting to create resource", "CustomResourceDefinition/backups.velero.io: already exists, proceeding", "CustomResourceDefinition/backups.velero.io: created", "CustomResourceDefinition/backupstoragelocations.velero.io: attempting to create resource", "CustomResourceDefinition/backupstoragelocations.velero.io: already exists, proceeding", "CustomResourceDefinition/backupstoragelocations.velero.io: created", "CustomResourceDefinition/deletebackuprequests.velero.io: attempting to create resource", "CustomResourceDefinition/deletebackuprequests.velero.io: already exists, proceeding", "CustomResourceDefinition/deletebackuprequests.velero.io: created", "CustomResourceDefinition/downloadrequests.velero.io: attempting to create resource", "CustomResourceDefinition/downloadrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/downloadrequests.velero.io: created", "CustomResourceDefinition/podvolumebackups.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumebackups.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumebackups.velero.io: created", "CustomResourceDefinition/podvolumerestores.velero.io: attempting to create resource", "CustomResourceDefinition/podvolumerestores.velero.io: already exists, proceeding", "CustomResourceDefinition/podvolumerestores.velero.io: created", "CustomResourceDefinition/resticrepositories.velero.io: attempting to create resource", "CustomResourceDefinition/resticrepositories.velero.io: already exists, proceeding", "CustomResourceDefinition/resticrepositories.velero.io: created", "CustomResourceDefinition/restores.velero.io: attempting to create resource", "CustomResourceDefinition/restores.velero.io: already exists, proceeding", "CustomResourceDefinition/restores.velero.io: created", "CustomResourceDefinition/schedules.velero.io: attempting to create resource", "CustomResourceDefinition/schedules.velero.io: already exists, proceeding", "CustomResourceDefinition/schedules.velero.io: created", "CustomResourceDefinition/serverstatusrequests.velero.io: attempting to create resource", "CustomResourceDefinition/serverstatusrequests.velero.io: already exists, proceeding", "CustomResourceDefinition/serverstatusrequests.velero.io: created", "CustomResourceDefinition/volumesnapshotlocations.velero.io: attempting to create resource", "CustomResourceDefinition/volumesnapshotlocations.velero.io: already exists, proceeding", "CustomResourceDefinition/volumesnapshotlocations.velero.io: created", "Waiting for resources to be ready in cluster...", "Namespace/velero: attempting to create resource", "Namespace/velero: created", "ClusterRoleBinding/velero: attempting to create resource", "ClusterRoleBinding/velero: created", "ServiceAccount/velero: attempting to create resource", "ServiceAccount/velero: created", "Secret/cloud-credentials: attempting to create resource", "Secret/cloud-credentials: created", "BackupStorageLocation/default: attempting to create resource", "BackupStorageLocation/default: created", "Deployment/velero: attempting to create resource", "Deployment/velero: created", "Velero is installed! ? Use 'kubectl logs deployment/velero -n velero' to view the status."]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:214 | |
| 2020-06-25T06:27:29.791377 (delta: 2.659935) elapsed: 35.181959 ******* | |
| FAILED - RETRYING: Checking for velero server status (20 retries left). | |
| FAILED - RETRYING: Checking for velero server status (19 retries left). | |
| FAILED - RETRYING: Checking for velero server status (18 retries left). | |
| changed: [127.0.0.1] => {"attempts": 4, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.795918", "end": "2020-06-25 06:27:48.502162", "rc": 0, "start": "2020-06-25 06:27:47.706244", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Replacing profile spec in volumesnapshotlocation.yml] ******************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:223 | |
| 2020-06-25T06:27:48.554189 (delta: 18.762776) elapsed: 53.944771 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:230 | |
| 2020-06-25T06:27:48.610388 (delta: 0.056164) elapsed: 54.00097 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:236 | |
| 2020-06-25T06:27:48.665117 (delta: 0.054696) elapsed: 54.055699 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl apply -f gcp-volume-snapshot-location.yml", "delta": "0:00:00.972762", "end": "2020-06-25 06:27:49.787382", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:27:48.814620", "stderr": "", "stderr_lines": [], "stdout": "volumesnapshotlocation.velero.io/gcp-bucket created", "stdout_lines": ["volumesnapshotlocation.velero.io/gcp-bucket created"]} | |
| TASK [Creating volume snapshot location] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:242 | |
| 2020-06-25T06:27:49.840817 (delta: 1.175665) elapsed: 55.231399 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Installing development image of OpenEBS velero-plugin] ******************* | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:248 | |
| 2020-06-25T06:27:49.897878 (delta: 0.057028) elapsed: 55.28846 ******** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero plugin add openebs/velero-plugin:ci", "delta": "0:00:00.876597", "end": "2020-06-25 06:27:50.931150", "rc": 0, "start": "2020-06-25 06:27:50.054553", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Waiting for new velero server pod to come up] **************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:252 | |
| 2020-06-25T06:27:50.982054 (delta: 1.084143) elapsed: 56.372636 ******* | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (20 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (19 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (18 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (17 retries left). | |
| FAILED - RETRYING: Waiting for new velero server pod to come up (16 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod -n velero --no-headers -l deploy=velero | wc -l", "delta": "0:00:00.989954", "end": "2020-06-25 06:28:21.926413", "rc": 0, "start": "2020-06-25 06:28:20.936459", "stderr": "", "stderr_lines": [], "stdout": "1", "stdout_lines": ["1"]} | |
| TASK [Checking for velero server status] *************************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:261 | |
| 2020-06-25T06:28:21.983155 (delta: 31.00106) elapsed: 87.373737 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.phase}'", "delta": "0:00:00.934707", "end": "2020-06-25 06:28:23.056345", "rc": 0, "start": "2020-06-25 06:28:22.121638", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Checking for velero server container status] ***************************** | |
| task path: /experiments/functional/backup_and_restore/setup_dependency.yml:268 | |
| 2020-06-25T06:28:23.113763 (delta: 1.130558) elapsed: 88.504345 ******* | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pod -n velero -l component=velero -ojsonpath='{.items[0].status.containerStatuses[0].ready}'", "delta": "0:00:00.967407", "end": "2020-06-25 06:28:24.223946", "rc": 0, "start": "2020-06-25 06:28:23.256539", "stderr": "", "stderr_lines": [], "stdout": "true", "stdout_lines": ["true"]} | |
| TASK [Get Application pod details] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:24 | |
| 2020-06-25T06:28:24.277814 (delta: 1.163985) elapsed: 89.668396 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.794854", "end": "2020-06-25 06:28:25.217326", "rc": 0, "start": "2020-06-25 06:28:24.422472", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-vmn8l", "stdout_lines": ["percona-7c6969cf78-vmn8l"]} | |
| TASK [Create new database in the mysql] **************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:28 | |
| 2020-06-25T06:28:25.267296 (delta: 0.98945) elapsed: 90.657878 ******** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:28:25.383522 (delta: 0.116192) elapsed: 90.774104 ******* | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create database backup;'", "delta": "0:00:01.167503", "end": "2020-06-25 06:28:26.707218", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "rc": 0, "start": "2020-06-25 06:28:25.539715", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "delta": "0:00:01.286102", "end": "2020-06-25 06:28:28.129293", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "rc": 0, "start": "2020-06-25 06:28:26.843191", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-vmn8l -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "delta": "0:00:00.961560", "end": "2020-06-25 06:28:29.242626", "failed_when_result": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "rc": 0, "start": "2020-06-25 06:28:28.281066", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "", "stdout_lines": []} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:28:29.291844 (delta: 3.90829) elapsed: 94.682426 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:28:29.335031 (delta: 0.043148) elapsed: 94.725613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:28:29.378993 (delta: 0.043927) elapsed: 94.769575 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:28:29.421331 (delta: 0.042306) elapsed: 94.811913 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Get the container status of application.] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:51 | |
| 2020-06-25T06:28:29.465277 (delta: 0.043912) elapsed: 94.855859 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Check if db is ready for connections] ************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:61 | |
| 2020-06-25T06:28:29.506968 (delta: 0.041658) elapsed: 94.89755 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking for the Corrupted tables] *************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:68 | |
| 2020-06-25T06:28:29.551934 (delta: 0.044933) elapsed: 94.942516 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify mysql data persistence] ******************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:77 | |
| 2020-06-25T06:28:29.595600 (delta: 0.043615) elapsed: 94.986182 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Delete/drop MySQL database] ********************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:90 | |
| 2020-06-25T06:28:29.637299 (delta: 0.041665) elapsed: 95.027881 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify successful db delete] ********************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:98 | |
| 2020-06-25T06:28:29.681284 (delta: 0.043951) elapsed: 95.071866 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application mount point] ************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:40 | |
| 2020-06-25T06:28:29.723895 (delta: 0.042577) elapsed: 95.114477 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Writing data on application mount point] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:45 | |
| 2020-06-25T06:28:29.774516 (delta: 0.050586) elapsed: 95.165098 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the application deployment name] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:52 | |
| 2020-06-25T06:28:29.829231 (delta: 0.05468) elapsed: 95.219813 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Fetching the volume name of application] ********************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:56 | |
| 2020-06-25T06:28:29.877264 (delta: 0.047998) elapsed: 95.267846 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Annotating the application pod] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:61 | |
| 2020-06-25T06:28:29.927650 (delta: 0.05035) elapsed: 95.318232 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup for the provided application] **************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:66 | |
| 2020-06-25T06:28:29.975647 (delta: 0.047945) elapsed: 95.366229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:30.153731 (delta: 0.178049) elapsed: 95.544313 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:30.208755 (delta: 0.054997) elapsed: 95.599337 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero backup create percona-backup --include-namespaces=app-percona-csi --snapshot-volumes --volume-snapshot-locations=gcp-bucket", "delta": "0:00:00.762984", "end": "2020-06-25 06:28:31.123022", "rc": 0, "start": "2020-06-25 06:28:30.360038", "stderr": "", "stderr_lines": [], "stdout": "Backup request \"percona-backup\" submitted successfully.\nRun `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details.", "stdout_lines": ["Backup request \"percona-backup\" submitted successfully.", "Run `velero backup describe percona-backup` or `velero backup logs percona-backup` for more details."]} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:31.172031 (delta: 0.963226) elapsed: 96.562613 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:31.225986 (delta: 0.053811) elapsed: 96.616568 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:31.289287 (delta: 0.063264) elapsed: 96.679869 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:31.345350 (delta: 0.056006) elapsed: 96.735932 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:31.389658 (delta: 0.044267) elapsed: 96.78024 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:31.433499 (delta: 0.043805) elapsed: 96.824081 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:28:31.479518 (delta: 0.045983) elapsed: 96.8701 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:28:31.522464 (delta: 0.042912) elapsed: 96.913046 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:28:31.568668 (delta: 0.04617) elapsed: 96.95925 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:28:31.624925 (delta: 0.056222) elapsed: 97.015507 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:28:31.686480 (delta: 0.061515) elapsed: 97.077062 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:28:31.733581 (delta: 0.047046) elapsed: 97.124163 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:28:31.790562 (delta: 0.05694) elapsed: 97.181144 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:75 | |
| 2020-06-25T06:28:31.851578 (delta: 0.060963) elapsed: 97.24216 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the backup name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:79 | |
| 2020-06-25T06:28:31.906991 (delta: 0.055362) elapsed: 97.297573 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:83 | |
| 2020-06-25T06:28:31.957242 (delta: 0.050204) elapsed: 97.347824 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:90 | |
| 2020-06-25T06:28:32.007047 (delta: 0.049757) elapsed: 97.397629 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for completed backup] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:95 | |
| 2020-06-25T06:28:32.060182 (delta: 0.0531) elapsed: 97.450764 ********* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the base backup name] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:102 | |
| 2020-06-25T06:28:32.109735 (delta: 0.049515) elapsed: 97.500317 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of backup] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:108 | |
| 2020-06-25T06:28:32.161647 (delta: 0.051862) elapsed: 97.552229 ******* | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:28:32.290429 (delta: 0.128743) elapsed: 97.681011 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:28:32.333229 (delta: 0.042766) elapsed: 97.723811 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:28:32.378833 (delta: 0.045568) elapsed: 97.769415 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:28:32.422233 (delta: 0.043363) elapsed: 97.812815 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:28:32.464751 (delta: 0.042483) elapsed: 97.855333 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:28:32.513763 (delta: 0.048965) elapsed: 97.904345 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:28:32.558227 (delta: 0.044411) elapsed: 97.948809 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:28:32.604590 (delta: 0.04633) elapsed: 97.995172 ******** | |
| FAILED - RETRYING: Getting the state of Backup (100 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (99 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (98 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (97 retries left). | |
| FAILED - RETRYING: Getting the state of Backup (96 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get backup percona-backup -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.999175", "end": "2020-06-25 06:29:03.889667", "rc": 0, "start": "2020-06-25 06:29:02.890492", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:03.946478 (delta: 31.341852) elapsed: 129.33706 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:03.991455 (delta: 0.044942) elapsed: 129.382037 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:04.035862 (delta: 0.044373) elapsed: 129.426444 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:04.082631 (delta: 0.046736) elapsed: 129.473213 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:04.127378 (delta: 0.044713) elapsed: 129.51796 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:04.171571 (delta: 0.044156) elapsed: 129.562153 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:04.215981 (delta: 0.044365) elapsed: 129.606563 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verifying for local snaphot deletion] ************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:115 | |
| 2020-06-25T06:29:04.259414 (delta: 0.043394) elapsed: 129.649996 ****** | |
| included: /experiments/functional/backup_and_restore/additional_verification.yml for 127.0.0.1 | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:4 | |
| 2020-06-25T06:29:04.398569 (delta: 0.13912) elapsed: 129.789151 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.756255", "end": "2020-06-25 06:29:05.298383", "rc": 0, "start": "2020-06-25 06:29:04.542128", "stderr": "", "stderr_lines": [], "stdout": "pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor backup name] ******************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:8 | |
| 2020-06-25T06:29:05.344283 (delta: 0.945679) elapsed: 130.734865 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get cstorbackup -n app-percona-csi | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.717512", "end": "2020-06-25 06:29:06.206557", "rc": 0, "start": "2020-06-25 06:29:05.489045", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff", "stdout_lines": ["percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff"]} | |
| TASK [Getting the cstor pool UID] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:15 | |
| 2020-06-25T06:29:06.255406 (delta: 0.911087) elapsed: 131.645988 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cstorbackup percona-backup-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -n app-percona-csi -o jsonpath='{.metadata.labels.cstorpool\\.openebs\\.io/uid}'", "delta": "0:00:00.733727", "end": "2020-06-25 06:29:07.130608", "rc": 0, "start": "2020-06-25 06:29:06.396881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the CVR name from the corresponding pool uid] ******************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:19 | |
| 2020-06-25T06:29:07.184672 (delta: 0.92923) elapsed: 132.575254 ******* | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l cstorpool.openebs.io/uid=,cstorvolume.openebs.io/name=pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff -o jsonpath='{.items[*].metadata.name}'", "delta": "0:00:00.743689", "end": "2020-06-25 06:29:08.133069", "rc": 0, "start": "2020-06-25 06:29:07.389380", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the cstor pool label from cvr] *********************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:23 | |
| 2020-06-25T06:29:08.178094 (delta: 0.993386) elapsed: 133.568676 ****** | |
| TASK [Geting the pool pod name corresponding to the label] ********************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:29 | |
| 2020-06-25T06:29:08.223360 (delta: 0.045214) elapsed: 133.613942 ****** | |
| TASK [Deleting the cstor pool pod] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:37 | |
| 2020-06-25T06:29:08.270044 (delta: 0.046649) elapsed: 133.660626 ****** | |
| TASK [Verifying whether local snapshot is deleted] ***************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:48 | |
| 2020-06-25T06:29:08.320524 (delta: 0.050429) elapsed: 133.711106 ****** | |
| TASK [Getting maya-pai-server pod name] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:61 | |
| 2020-06-25T06:29:08.368566 (delta: 0.048007) elapsed: 133.759148 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting the maya-api-server pod] **************************************** | |
| task path: /experiments/functional/backup_and_restore/additional_verification.yml:65 | |
| 2020-06-25T06:29:08.415911 (delta: 0.047309) elapsed: 133.806493 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Deleting Application] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:124 | |
| 2020-06-25T06:29:08.463334 (delta: 0.047389) elapsed: 133.853916 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl delete pvc,deploy,svc --all -n app-percona-csi\n kubectl delete ns app-percona-csi", "delta": "0:00:18.673774", "end": "2020-06-25 06:29:27.323723", "rc": 0, "start": "2020-06-25 06:29:08.649949", "stderr": "", "stderr_lines": [], "stdout": "persistentvolumeclaim \"percona-mysql-claim\" deleted\ndeployment.extensions \"percona\" deleted\nservice \"percona-mysql\" deleted\nnamespace \"app-percona-csi\" deleted", "stdout_lines": ["persistentvolumeclaim \"percona-mysql-claim\" deleted", "deployment.extensions \"percona\" deleted", "service \"percona-mysql\" deleted", "namespace \"app-percona-csi\" deleted"]} | |
| TASK [Checking whether namespace is deleted] *********************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:129 | |
| 2020-06-25T06:29:27.367621 (delta: 18.904252) elapsed: 152.758203 ***** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get ns --no-headers -o custom-columns=:metadata.name", "delta": "0:00:00.757975", "end": "2020-06-25 06:29:28.274808", "rc": 0, "start": "2020-06-25 06:29:27.516833", "stderr": "", "stderr_lines": [], "stdout": "aman\ncert-manager\ndefault\nkommander\nkube-node-lease\nkube-public\nkube-system\nkubeaddons\nlitmus\nmaya-system\nopenebs\ntest\nvelero", "stdout_lines": ["aman", "cert-manager", "default", "kommander", "kube-node-lease", "kube-public", "kube-system", "kubeaddons", "litmus", "maya-system", "openebs", "test", "velero"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:146 | |
| 2020-06-25T06:29:28.326285 (delta: 0.958626) elapsed: 153.716867 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:28.424891 (delta: 0.09857) elapsed: 153.815473 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:28.475800 (delta: 0.050874) elapsed: 153.866382 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:28.527512 (delta: 0.051658) elapsed: 153.918094 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:28.595238 (delta: 0.067688) elapsed: 153.98582 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:28.654806 (delta: 0.05951) elapsed: 154.045388 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:28.706974 (delta: 0.05213) elapsed: 154.097556 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:28.763097 (delta: 0.056085) elapsed: 154.153679 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:28.813252 (delta: 0.050116) elapsed: 154.203834 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:28.869591 (delta: 0.056288) elapsed: 154.260173 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl create ns app-percona-csi", "delta": "0:00:00.921844", "end": "2020-06-25 06:29:29.953692", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:29:29.031848", "stderr": "", "stderr_lines": [], "stdout": "namespace/app-percona-csi created", "stdout_lines": ["namespace/app-percona-csi created"]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:30.003989 (delta: 1.134361) elapsed: 155.394571 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero restore create --from-backup percona-backup --restore-volumes=true", "delta": "0:00:00.742141", "end": "2020-06-25 06:29:30.905695", "rc": 0, "start": "2020-06-25 06:29:30.163554", "stderr": "", "stderr_lines": [], "stdout": "Restore request \"percona-backup-20200625062930\" submitted successfully.\nRun `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details.", "stdout_lines": ["Restore request \"percona-backup-20200625062930\" submitted successfully.", "Run `velero restore describe percona-backup-20200625062930` or `velero restore logs percona-backup-20200625062930` for more details."]} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:30.957816 (delta: 0.953795) elapsed: 156.348398 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.013633 (delta: 0.055776) elapsed: 156.404215 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:31.071681 (delta: 0.057998) elapsed: 156.462263 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:31.127733 (delta: 0.056011) elapsed: 156.518315 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:31.187804 (delta: 0.06001) elapsed: 156.578386 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:152 | |
| 2020-06-25T06:29:31.238816 (delta: 0.050976) elapsed: 156.629398 ****** | |
| included: /experiments/functional/backup_and_restore/backup-restore.yml for 127.0.0.1 | |
| TASK [Creating Backup using minio bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:6 | |
| 2020-06-25T06:29:31.344329 (delta: 0.105478) elapsed: 156.734911 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup using GCP bucket] **************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:13 | |
| 2020-06-25T06:29:31.398928 (delta: 0.054557) elapsed: 156.78951 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Local Backup] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:20 | |
| 2020-06-25T06:29:31.454105 (delta: 0.055131) elapsed: 156.844687 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:31 | |
| 2020-06-25T06:29:31.505860 (delta: 0.051716) elapsed: 156.896442 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating Backup] ********************************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:41 | |
| 2020-06-25T06:29:31.555513 (delta: 0.049619) elapsed: 156.946095 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using minio bucket] ************************************ | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:54 | |
| 2020-06-25T06:29:31.606027 (delta: 0.050479) elapsed: 156.996609 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating schedule using GCP bucket] ************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:58 | |
| 2020-06-25T06:29:31.658945 (delta: 0.052881) elapsed: 157.049527 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the state of Backup] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:66 | |
| 2020-06-25T06:29:31.720250 (delta: 0.0612) elapsed: 157.110832 ******** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:79 | |
| 2020-06-25T06:29:31.782094 (delta: 0.061792) elapsed: 157.172676 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:85 | |
| 2020-06-25T06:29:31.836390 (delta: 0.054256) elapsed: 157.226972 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:95 | |
| 2020-06-25T06:29:31.887438 (delta: 0.051008) elapsed: 157.27802 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Creating application namespace] ****************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:105 | |
| 2020-06-25T06:29:31.945602 (delta: 0.058112) elapsed: 157.336184 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Restoring application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:110 | |
| 2020-06-25T06:29:32.003396 (delta: 0.057743) elapsed: 157.393978 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting restore name] **************************************************** | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:122 | |
| 2020-06-25T06:29:32.055557 (delta: 0.052096) elapsed: 157.446139 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "velero get restore | grep percona-backup | awk '{print $1}'", "delta": "0:00:00.680082", "end": "2020-06-25 06:29:32.894615", "rc": 0, "start": "2020-06-25 06:29:32.214533", "stderr": "", "stderr_lines": [], "stdout": "percona-backup-20200625062930", "stdout_lines": ["percona-backup-20200625062930"]} | |
| TASK [Checking the restore status] ********************************************* | |
| task path: /experiments/functional/backup_and_restore/backup-restore.yml:126 | |
| 2020-06-25T06:29:32.940140 (delta: 0.884546) elapsed: 158.330722 ****** | |
| FAILED - RETRYING: Checking the restore status (60 retries left). | |
| FAILED - RETRYING: Checking the restore status (59 retries left). | |
| FAILED - RETRYING: Checking the restore status (58 retries left). | |
| FAILED - RETRYING: Checking the restore status (57 retries left). | |
| changed: [127.0.0.1] => {"attempts": 5, "changed": true, "cmd": "kubectl get restore percona-backup-20200625062930 -n velero -o jsonpath='{.status.phase}'", "delta": "0:00:00.786878", "end": "2020-06-25 06:29:57.867818", "rc": 0, "start": "2020-06-25 06:29:57.080940", "stderr": "", "stderr_lines": [], "stdout": "Completed", "stdout_lines": ["Completed"]} | |
| TASK [Restoring Application] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:162 | |
| 2020-06-25T06:29:57.926367 (delta: 24.986173) elapsed: 183.316949 ***** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting state of restore] ************************************************ | |
| task path: /experiments/functional/backup_and_restore/test.yml:168 | |
| 2020-06-25T06:29:57.987229 (delta: 0.060826) elapsed: 183.377811 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:180 | |
| 2020-06-25T06:29:58.048209 (delta: 0.060946) elapsed: 183.438791 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pvc percona-mysql-claim -n app-percona-csi -o jsonpath='{.spec.volumeName}'", "delta": "0:00:00.945068", "end": "2020-06-25 06:29:59.157534", "rc": 0, "start": "2020-06-25 06:29:58.212466", "stderr": "", "stderr_lines": [], "stdout": "pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "stdout_lines": ["pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"]} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:184 | |
| 2020-06-25T06:29:59.203070 (delta: 1.154825) elapsed: 184.593652 ****** | |
| included: /experiments/functional/backup_and_restore/cstor_post_restore.yml for 127.0.0.1 | |
| TASK [Getting the target IP] *************************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:2 | |
| 2020-06-25T06:29:59.315315 (delta: 0.112211) elapsed: 184.705897 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get svc -n openebs --no-headers -l openebs.io/persistent-volume=pvc-78e1a852-40c8-4489-bb95-0f0066398c2d -o jsonpath='{.items[0].spec.clusterIP}'", "delta": "0:00:00.775021", "end": "2020-06-25 06:30:00.248726", "rc": 0, "start": "2020-06-25 06:29:59.473705", "stderr": "", "stderr_lines": [], "stdout": "11.0.50.166", "stdout_lines": ["11.0.50.166"]} | |
| TASK [Getting the CVR name from the corresponding PV] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:11 | |
| 2020-06-25T06:30:00.301403 (delta: 0.986053) elapsed: 185.691985 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Geting the CSP name corresponding to CVR] ******************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:15 | |
| 2020-06-25T06:30:00.360648 (delta: 0.059207) elapsed: 185.75123 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the pool pod name] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:20 | |
| 2020-06-25T06:30:00.420531 (delta: 0.059847) elapsed: 185.811113 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the volume name inside cstor pool] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:25 | |
| 2020-06-25T06:30:00.479725 (delta: 0.059154) elapsed: 185.870307 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Assigning the cstor-pool volume name to variable] ************************ | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:30 | |
| 2020-06-25T06:30:00.542960 (delta: 0.063175) elapsed: 185.933542 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Setting target IP for volume inside cstor pool] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:34 | |
| 2020-06-25T06:30:00.602407 (delta: 0.05941) elapsed: 185.992989 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Getting the CVR name from the corresponding PV] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:44 | |
| 2020-06-25T06:30:00.662537 (delta: 0.060093) elapsed: 186.053119 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get cvr -n openebs -l openebs.io/persistent-volume=pvc-78e1a852-40c8-4489-bb95-0f0066398c2d -o jsonpath='{range.items[*]}{.metadata.labels.cstorpoolinstance\\.openebs\\.io/name}{\"\\n\"}{end}'", "delta": "0:00:00.772113", "end": "2020-06-25 06:30:01.599426", "rc": 0, "start": "2020-06-25 06:30:00.827313", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b\ncstor-cspc-disk-pool-8vvv\ncstor-cspc-disk-pool-cj5m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b", "cstor-cspc-disk-pool-8vvv", "cstor-cspc-disk-pool-cj5m"]} | |
| TASK [Geting the CSPI name corresponding to CVR] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:48 | |
| 2020-06-25T06:30:01.651403 (delta: 0.988829) elapsed: 187.041985 ****** | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-6n9b) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-6n9b -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.760993", "end": "2020-06-25 06:30:02.596045", "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:01.835052", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b", "stdout_lines": ["cstor-cspc-disk-pool-6n9b"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-8vvv) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-8vvv -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.933590", "end": "2020-06-25 06:30:03.687847", "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:02.754257", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv", "stdout_lines": ["cstor-cspc-disk-pool-8vvv"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-cj5m) => {"changed": true, "cmd": "kubectl get cspi cstor-cspc-disk-pool-cj5m -n openebs -o jsonpath='{.metadata.name}'", "delta": "0:00:00.857139", "end": "2020-06-25 06:30:04.699592", "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:03.842453", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m", "stdout_lines": ["cstor-cspc-disk-pool-cj5m"]} | |
| TASK [Getting the pool pod name] *********************************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:53 | |
| 2020-06-25T06:30:04.750022 (delta: 3.098579) elapsed: 190.140604 ****** | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-6n9b) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-8vvv) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]} | |
| changed: [127.0.0.1] => (item=cstor-cspc-disk-pool-cj5m) => {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]} | |
| TASK [Getting the volume name inside cstor pool] ******************************* | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:58 | |
| 2020-06-25T06:30:07.749874 (delta: 2.999814) elapsed: 193.140456 ****** | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m', '_ansible_item_result': True, u'delta': u'0:00:00.937403', 'stdout_lines': [u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m'], '_ansible_item_label': u'cstor-cspc-disk-pool-6n9b', u'end': u'2020-06-25 06:30:05.870226', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-6n9b', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:04.932823', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.229101", "end": "2020-06-25 06:30:09.162558", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]}, "rc": 0, "start": "2020-06-25 06:30:07.933457", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m', '_ansible_item_result': True, u'delta': u'0:00:00.702313', 'stdout_lines': [u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m'], '_ansible_item_label': u'cstor-cspc-disk-pool-8vvv', u'end': u'2020-06-25 06:30:06.726757', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-8vvv', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:06.024444', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.238007", "end": "2020-06-25 06:30:10.556976", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]}, "rc": 0, "start": "2020-06-25 06:30:09.318969", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item={'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45', '_ansible_item_result': True, u'delta': u'0:00:00.797214', 'stdout_lines': [u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45'], '_ansible_item_label': u'cstor-cspc-disk-pool-cj5m', u'end': u'2020-06-25 06:30:07.694743', '_ansible_no_log': False, 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-cj5m', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2020-06-25 06:30:06.897529', '_ansible_ignore_errors': None}) => {"changed": true, "cmd": "echo $(kubectl exec -it cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs -c cstor-pool -- zfs list | grep pvc-78e1a852-40c8-4489-bb95-0f0066398c2d | awk '{print $1}') >> cstor-vol", "delta": "0:00:01.001806", "end": "2020-06-25 06:30:11.732631", "item": {"changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]}, "rc": 0, "start": "2020-06-25 06:30:10.730825", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| TASK [Assigning the cstor-pool volume name to variable] ************************ | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:63 | |
| 2020-06-25T06:30:11.784506 (delta: 4.034584) elapsed: 197.175088 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat ./cstor-vol", "delta": "0:00:00.813204", "end": "2020-06-25 06:30:12.748013", "rc": 0, "start": "2020-06-25 06:30:11.934809", "stderr": "", "stderr_lines": [], "stdout": "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d\ncstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d\ncstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "stdout_lines": ["cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"]} | |
| TASK [Setting target IP for volume inside cstor pool] ************************** | |
| task path: /experiments/functional/backup_and_restore/cstor_post_restore.yml:67 | |
| 2020-06-25T06:30:12.797896 (delta: 1.013352) elapsed: 198.188478 ****** | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m', '_ansible_item_result': True, u'delta': u'0:00:00.937403', 'stdout_lines': [u'cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m'], '_ansible_item_label': u'cstor-cspc-disk-pool-6n9b', u'end': u'2020-06-25 06:30:05.870226', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:04.932823', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-6n9b', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.064015", "end": "2020-06-25 06:30:14.063360", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-6n9b", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "delta": "0:00:00.937403", "end": "2020-06-25 06:30:05.870226", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-6n9b | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-6n9b", "rc": 0, "start": "2020-06-25 06:30:04.932823", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m", "stdout_lines": ["cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:12.999345", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-6n9b-5bf66cbdc6-j2m7m -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m', '_ansible_item_result': True, u'delta': u'0:00:00.702313', 'stdout_lines': [u'cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m'], '_ansible_item_label': u'cstor-cspc-disk-pool-8vvv', u'end': u'2020-06-25 06:30:06.726757', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:06.024444', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-8vvv', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.007217", "end": "2020-06-25 06:30:15.233190", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-8vvv", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "delta": "0:00:00.702313", "end": "2020-06-25 06:30:06.726757", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-8vvv | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-8vvv", "rc": 0, "start": "2020-06-25 06:30:06.024444", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m", "stdout_lines": ["cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:14.225973", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-8vvv-6499546cd4-wbj9m -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| changed: [127.0.0.1] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'changed': True, u'stdout': u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45', '_ansible_item_result': True, u'delta': u'0:00:00.797214', 'stdout_lines': [u'cstor-cspc-disk-pool-cj5m-77f9b946b-mth45'], '_ansible_item_label': u'cstor-cspc-disk-pool-cj5m', u'end': u'2020-06-25 06:30:07.694743', '_ansible_no_log': False, u'start': u'2020-06-25 06:30:06.897529', 'failed': False, u'cmd': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", 'item': u'cstor-cspc-disk-pool-cj5m', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': True, u'_raw_params': u"kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", u'removes': None, u'argv': None, u'warn': True, u'chdir': None, u'stdin': None}}, '_ansible_ignore_errors': None}, u'cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d']) => {"changed": true, "cmd": "kubectl exec -it cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs -- zfs set io.openebs:targetip=11.0.50.166 cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d", "delta": "0:00:01.035342", "end": "2020-06-25 06:30:16.424346", "item": [{"_ansible_ignore_errors": null, "_ansible_item_label": "cstor-cspc-disk-pool-cj5m", "_ansible_item_result": true, "_ansible_no_log": false, "_ansible_parsed": true, "changed": true, "cmd": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "delta": "0:00:00.797214", "end": "2020-06-25 06:30:07.694743", "failed": false, "invocation": {"module_args": {"_raw_params": "kubectl get pod -n openebs | grep cstor-cspc-disk-pool-cj5m | awk '{print $1}'", "_uses_shell": true, "argv": null, "chdir": null, "creates": null, "executable": null, "removes": null, "stdin": null, "warn": true}}, "item": "cstor-cspc-disk-pool-cj5m", "rc": 0, "start": "2020-06-25 06:30:06.897529", "stderr": "", "stderr_lines": [], "stdout": "cstor-cspc-disk-pool-cj5m-77f9b946b-mth45", "stdout_lines": ["cstor-cspc-disk-pool-cj5m-77f9b946b-mth45"]}, "cstor-4e7859ee-9342-4266-a42f-d500b5156a59/pvc-78e1a852-40c8-4489-bb95-0f0066398c2d"], "rc": 0, "start": "2020-06-25 06:30:15.389004", "stderr": "Defaulting container name to cstor-pool-mgmt.\nUse 'kubectl describe pod/cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs' to see all of the containers in this pod.\nUnable to use a TTY - input is not a terminal or the right kind of file", "stderr_lines": ["Defaulting container name to cstor-pool-mgmt.", "Use 'kubectl describe pod/cstor-cspc-disk-pool-cj5m-77f9b946b-mth45 -n openebs' to see all of the containers in this pod.", "Unable to use a TTY - input is not a terminal or the right kind of file"], "stdout": "", "stdout_lines": []} | |
| TASK [Getting the volume name] ************************************************* | |
| task path: /experiments/functional/backup_and_restore/test.yml:193 | |
| 2020-06-25T06:30:16.480647 (delta: 3.682718) elapsed: 201.871229 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:197 | |
| 2020-06-25T06:30:16.538368 (delta: 0.057686) elapsed: 201.92895 ******* | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for application to be in running state] ************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:208 | |
| 2020-06-25T06:30:16.593237 (delta: 0.054835) elapsed: 201.983819 ****** | |
| FAILED - RETRYING: Waiting for application to be in running state (30 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (29 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (28 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (27 retries left). | |
| FAILED - RETRYING: Waiting for application to be in running state (26 retries left). | |
| changed: [127.0.0.1] => {"attempts": 6, "changed": true, "cmd": "kubectl get pod percona-7c6969cf78-vmn8l -n app-percona-csi -o jsonpath='{.status.phase}'", "delta": "0:00:00.755026", "end": "2020-06-25 06:30:47.382712", "rc": 0, "start": "2020-06-25 06:30:46.627686", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Verifying Data persistense] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:215 | |
| 2020-06-25T06:30:47.438523 (delta: 30.845234) elapsed: 232.829105 ***** | |
| included: /utils/scm/applications/mysql/mysql_data_persistence.yml for 127.0.0.1 | |
| TASK [Create some test data in the mysql database] ***************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:4 | |
| 2020-06-25T06:30:47.534411 (delta: 0.095852) elapsed: 232.924993 ****** | |
| skipping: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create database backup;') => {"changed": false, "item": "mysql -uroot -pk8sDem0 -e 'create database backup;'", "skip_reason": "Conditional result was False"} | |
| skipping: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup) => {"changed": false, "item": "mysql -uroot -pk8sDem0 -e 'create table ttbl (Data VARCHAR(20));' backup", "skip_reason": "Conditional result was False"} | |
| skipping: [127.0.0.1] => (item=mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES ("tdata");' backup) => {"changed": false, "item": "mysql -uroot -pk8sDem0 -e 'insert into ttbl (Data) VALUES (\"tdata\");' backup", "skip_reason": "Conditional result was False"} | |
| TASK [Kill the application pod] ************************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:21 | |
| 2020-06-25T06:30:47.617913 (delta: 0.083453) elapsed: 233.008495 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl delete pod percona-7c6969cf78-vmn8l -n app-percona-csi", "delta": "0:00:06.920902", "end": "2020-06-25 06:30:54.696798", "rc": 0, "start": "2020-06-25 06:30:47.775896", "stderr": "", "stderr_lines": [], "stdout": "pod \"percona-7c6969cf78-vmn8l\" deleted", "stdout_lines": ["pod \"percona-7c6969cf78-vmn8l\" deleted"]} | |
| TASK [Verify if the application pod is deleted] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:27 | |
| 2020-06-25T06:30:54.742820 (delta: 7.12487) elapsed: 240.133402 ******* | |
| [WARNING]: when statements should not include jinja2 templating delimiters | |
| such as {{ }} or {% %}. Found: "{{ pod_name }}" not in podstatus.stdout | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi", "delta": "0:00:00.716209", "end": "2020-06-25 06:30:55.672069", "rc": 0, "start": "2020-06-25 06:30:54.955860", "stderr": "", "stderr_lines": [], "stdout": "NAME READY STATUS RESTARTS AGE\npercona-7c6969cf78-ht7r7 0/1 ContainerCreating 0 7s", "stdout_lines": ["NAME READY STATUS RESTARTS AGE", "percona-7c6969cf78-ht7r7 0/1 ContainerCreating 0 7s"]} | |
| TASK [Obtain the newly created pod name for application] *********************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:37 | |
| 2020-06-25T06:30:55.728650 (delta: 0.985793) elapsed: 241.119232 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl get pods -n app-percona-csi -l name=percona -o jsonpath='{.items[].metadata.name}'", "delta": "0:00:00.882975", "end": "2020-06-25 06:30:56.769052", "rc": 0, "start": "2020-06-25 06:30:55.886077", "stderr": "", "stderr_lines": [], "stdout": "percona-7c6969cf78-ht7r7", "stdout_lines": ["percona-7c6969cf78-ht7r7"]} | |
| TASK [Checking application pod is in running state] **************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:44 | |
| 2020-06-25T06:30:56.816825 (delta: 1.088138) elapsed: 242.207407 ****** | |
| FAILED - RETRYING: Checking application pod is in running state (150 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (149 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (148 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (147 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (146 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (145 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (144 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (143 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (142 retries left). | |
| FAILED - RETRYING: Checking application pod is in running state (141 retries left). | |
| changed: [127.0.0.1] => {"attempts": 11, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -o jsonpath='{.items[?(@.metadata.name==\"percona-7c6969cf78-ht7r7\")].status.phase}'", "delta": "0:00:00.763295", "end": "2020-06-25 06:31:27.877104", "rc": 0, "start": "2020-06-25 06:31:27.113809", "stderr": "", "stderr_lines": [], "stdout": "Running", "stdout_lines": ["Running"]} | |
| TASK [Get the container status of application.] ******************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:51 | |
| 2020-06-25T06:31:27.945899 (delta: 31.129022) elapsed: 273.336481 ***** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl get pods -n app-percona-csi -o jsonpath='{.items[?(@.metadata.name==\"percona-7c6969cf78-ht7r7\")].status.containerStatuses[].state}' | grep running", "delta": "0:00:00.896645", "end": "2020-06-25 06:31:29.013195", "rc": 0, "start": "2020-06-25 06:31:28.116550", "stderr": "", "stderr_lines": [], "stdout": "map[running:map[startedAt:2020-06-25T06:31:25Z]]", "stdout_lines": ["map[running:map[startedAt:2020-06-25T06:31:25Z]]"]} | |
| TASK [Check if db is ready for connections] ************************************ | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:61 | |
| 2020-06-25T06:31:29.066880 (delta: 1.120954) elapsed: 274.457462 ****** | |
| changed: [127.0.0.1] => {"attempts": 1, "changed": true, "cmd": "kubectl logs percona-7c6969cf78-ht7r7 -n app-percona-csi | grep 'ready for connections'", "delta": "0:00:00.943565", "end": "2020-06-25 06:31:30.181835", "rc": 0, "start": "2020-06-25 06:31:29.238270", "stderr": "", "stderr_lines": [], "stdout": "2020-06-25T06:31:27.200436Z 0 [Note] mysqld: ready for connections.", "stdout_lines": ["2020-06-25T06:31:27.200436Z 0 [Note] mysqld: ready for connections."]} | |
| TASK [Checking for the Corrupted tables] *************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:68 | |
| 2020-06-25T06:31:30.231002 (delta: 1.164085) elapsed: 275.621584 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-ht7r7 -n app-percona-csi -- mysqlcheck -c backup -uroot -pk8sDem0", "delta": "0:00:01.075665", "end": "2020-06-25 06:31:31.460527", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:31:30.384862", "stderr": "mysqlcheck: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysqlcheck: [Warning] Using a password on the command line interface can be insecure."], "stdout": "backup.ttbl OK", "stdout_lines": ["backup.ttbl OK"]} | |
| TASK [Verify mysql data persistence] ******************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:77 | |
| 2020-06-25T06:31:31.512133 (delta: 1.281087) elapsed: 276.902715 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "kubectl exec percona-7c6969cf78-ht7r7 -n app-percona-csi -- mysql -uroot -pk8sDem0 -e 'select * from ttbl' backup;", "delta": "0:00:01.158049", "end": "2020-06-25 06:31:32.829312", "failed_when_result": false, "rc": 0, "start": "2020-06-25 06:31:31.671263", "stderr": "mysql: [Warning] Using a password on the command line interface can be insecure.", "stderr_lines": ["mysql: [Warning] Using a password on the command line interface can be insecure."], "stdout": "Data\ntdata", "stdout_lines": ["Data", "tdata"]} | |
| TASK [Delete/drop MySQL database] ********************************************** | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:90 | |
| 2020-06-25T06:31:32.879562 (delta: 1.367394) elapsed: 278.270144 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verify successful db delete] ********************************************* | |
| task path: /utils/scm/applications/mysql/mysql_data_persistence.yml:98 | |
| 2020-06-25T06:31:32.933495 (delta: 0.053898) elapsed: 278.324077 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Waiting for application to be in running state] ************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:230 | |
| 2020-06-25T06:31:32.985496 (delta: 0.051966) elapsed: 278.376078 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Verifying Data persistense] ********************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:237 | |
| 2020-06-25T06:31:33.033087 (delta: 0.047532) elapsed: 278.423669 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [set_fact] **************************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:251 | |
| 2020-06-25T06:31:33.088902 (delta: 0.055782) elapsed: 278.479484 ****** | |
| ok: [127.0.0.1] => {"ansible_facts": {"flag": "Pass"}, "changed": false} | |
| TASK [include_tasks] *********************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:259 | |
| 2020-06-25T06:31:33.152175 (delta: 0.063232) elapsed: 278.542757 ****** | |
| included: /utils/fcm/update_litmus_result_resource.yml for 127.0.0.1 | |
| TASK [Generate the litmus result CR to reflect SOT (Start of Test)] ************ | |
| task path: /utils/fcm/update_litmus_result_resource.yml:3 | |
| 2020-06-25T06:31:33.278755 (delta: 0.126542) elapsed: 278.669337 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:14 | |
| 2020-06-25T06:31:33.332400 (delta: 0.053594) elapsed: 278.722982 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:17 | |
| 2020-06-25T06:31:33.379579 (delta: 0.047139) elapsed: 278.770161 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| TASK [Generate the litmus result CR to reflect EOT (End of Test)] ************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:27 | |
| 2020-06-25T06:31:33.425340 (delta: 0.045723) elapsed: 278.815922 ****** | |
| changed: [127.0.0.1] => {"changed": true, "checksum": "218cc4cd06f4a20f4ce3c234b033d66800aa02b5", "dest": "./litmus-result.yaml", "gid": 0, "group": "root", "md5sum": "9f2161a292cb589ce3599bf99ea6818b", "mode": "0644", "owner": "root", "size": 420, "src": "/root/.ansible/tmp/ansible-tmp-1593066693.47-114256441725504/source", "state": "file", "uid": 0} | |
| TASK [Analyze the cr yaml] ***************************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:38 | |
| 2020-06-25T06:31:35.408027 (delta: 1.982653) elapsed: 280.798609 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "cat litmus-result.yaml", "delta": "0:00:00.762421", "end": "2020-06-25 06:31:36.320382", "rc": 0, "start": "2020-06-25 06:31:35.557961", "stderr": "", "stderr_lines": [], "stdout": "---\napiVersion: litmus.io/v1alpha1\nkind: LitmusResult\nmetadata:\n\n # name of the litmus testcase\n name: velero-backup-restore \nspec:\n\n # holds information on the testcase\n testMetadata:\n app: \n chaostype: \n\n # holds the state of testcase, manually updated by json merge patch\n # result is the useful value today, but anticipate phase use in future \n testStatus: \n phase: completed \n result: Pass ", "stdout_lines": ["---", "apiVersion: litmus.io/v1alpha1", "kind: LitmusResult", "metadata:", "", " # name of the litmus testcase", " name: velero-backup-restore ", "spec:", "", " # holds information on the testcase", " testMetadata:", " app: ", " chaostype: ", "", " # holds the state of testcase, manually updated by json merge patch", " # result is the useful value today, but anticipate phase use in future ", " testStatus: ", " phase: completed ", " result: Pass "]} | |
| TASK [Apply the litmus result CR] ********************************************** | |
| task path: /utils/fcm/update_litmus_result_resource.yml:41 | |
| 2020-06-25T06:31:36.366499 (delta: 0.958437) elapsed: 281.757081 ****** | |
| changed: [127.0.0.1] => {"changed": true, "failed_when_result": false, "method": "patch", "result": {"apiVersion": "litmus.io/v1alpha1", "kind": "LitmusResult", "metadata": {"creationTimestamp": "2020-06-25T06:27:04Z", "generation": 2, "name": "velero-backup-restore", "resourceVersion": "272824", "selfLink": "/apis/litmus.io/v1alpha1/litmusresults/velero-backup-restore", "uid": "76cd180d-4057-43ae-9202-847be8bda1f2"}, "spec": {"testMetadata": {}, "testStatus": {"phase": "completed", "result": "Pass"}}}} | |
| TASK [Deleting GCP bucket] ***************************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:263 | |
| 2020-06-25T06:31:37.076285 (delta: 0.709749) elapsed: 282.466867 ****** | |
| changed: [127.0.0.1] => {"changed": true, "cmd": "gsutil rm -r gs://e2e-gcp-bucket", "delta": "0:00:08.876842", "end": "2020-06-25 06:31:46.128822", "rc": 0, "start": "2020-06-25 06:31:37.251980", "stderr": "Removing gs://e2e-gcp-bucket/backups/percona-backup/-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff-percona-backup#1593066755904348...\n/ [1 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff-percona-backup.pvc#1593066736968555...\n/ [2 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-csi-volumesnapshotcontents.json.gz#1593066764427897...\n/ [3 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-csi-volumesnapshots.json.gz#1593066763933880...\n/ [4 objects] \r\n==> NOTE: You are performing a sequence of gsutil operations that may\nrun significantly faster if you instead use gsutil -m rm ... Please\nsee the -m section under \"gsutil help options\" for further information\nabout when gsutil -m can be advantageous.\n\nRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-logs.gz#1593066761372707...\n/ [5 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-podvolumebackups.json.gz#1593066762642452...\n/ [6 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-resource-list.json.gz#1593066763500867...\n/ [7 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-volumesnapshots.json.gz#1593066763078150...\n/ [8 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/percona-backup.tar.gz#1593066762215702...\n/ [9 objects] \rRemoving gs://e2e-gcp-bucket/backups/percona-backup/velero-backup.json#1593066761785052...\n/ [10 objects] \rRemoving gs://e2e-gcp-bucket/restores/percona-backup-20200625062930/restore-percona-backup-20200625062930-logs.gz#1593066815489477...\n/ [11 objects] \rRemoving gs://e2e-gcp-bucket/restores/percona-backup-20200625062930/restore-percona-backup-20200625062930-results.gz#1593066815907493...\n/ [12 objects] \r\nOperation completed over 12 objects. \nRemoving gs://e2e-gcp-bucket/...", "stderr_lines": ["Removing gs://e2e-gcp-bucket/backups/percona-backup/-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff-percona-backup#1593066755904348...", "/ [1 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/-pvc-bdb8ced0-5307-4fca-b44e-2d7a52270bff-percona-backup.pvc#1593066736968555...", "/ [2 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-csi-volumesnapshotcontents.json.gz#1593066764427897...", "/ [3 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-csi-volumesnapshots.json.gz#1593066763933880...", "/ [4 objects] ", "==> NOTE: You are performing a sequence of gsutil operations that may", "run significantly faster if you instead use gsutil -m rm ... Please", "see the -m section under \"gsutil help options\" for further information", "about when gsutil -m can be advantageous.", "", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-logs.gz#1593066761372707...", "/ [5 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-podvolumebackups.json.gz#1593066762642452...", "/ [6 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-resource-list.json.gz#1593066763500867...", "/ [7 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup-volumesnapshots.json.gz#1593066763078150...", "/ [8 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/percona-backup.tar.gz#1593066762215702...", "/ [9 objects] ", "Removing gs://e2e-gcp-bucket/backups/percona-backup/velero-backup.json#1593066761785052...", "/ [10 objects] ", "Removing gs://e2e-gcp-bucket/restores/percona-backup-20200625062930/restore-percona-backup-20200625062930-logs.gz#1593066815489477...", "/ [11 objects] ", "Removing gs://e2e-gcp-bucket/restores/percona-backup-20200625062930/restore-percona-backup-20200625062930-results.gz#1593066815907493...", "/ [12 objects] ", "Operation completed over 12 objects. ", "Removing gs://e2e-gcp-bucket/..."], "stdout": "", "stdout_lines": []} | |
| TASK [Deprovisioning Velero server] ******************************************** | |
| task path: /experiments/functional/backup_and_restore/test.yml:267 | |
| 2020-06-25T06:31:46.179282 (delta: 9.102961) elapsed: 291.569864 ****** | |
| skipping: [127.0.0.1] => {"changed": false, "skip_reason": "Conditional result was False"} | |
| META: ran handlers | |
| META: ran handlers | |
| PLAY RECAP ********************************************************************* | |
| 127.0.0.1 : ok=69 changed=54 unreachable=0 failed=0 | |
| 2020-06-25T06:31:46.211009 (delta: 0.031691) elapsed: 291.601591 ****** | |
| =============================================================================== |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment