run functional tests with delorean cli

readme.md

How to run test container in OpenShift cluster using Delorean CLI

1. Clone delorean

git clone git@github.com:integr8ly/delorean.git

2. Build the binary

make build/cli

3. In the same folder create test-config.yaml file with the content of the file in this gist
4. Update image field with the URL of your testing container image
5. Update regExpFilter field with the filter for the tests you want to run (otherwise delete the field or leave it empty to run all tests)
6. Log in to OpenShift cluster with RHOAM installed as kubeadmin
7. Run the tests with the following command:

./delorean pipeline product-tests --test-config test-config.yaml --output test-results --namespace test-functional

8. You can watch the test logs in real time by running the following command in another terminal window:

oc logs -f $(oc get pods -n test-functional -o name) -c test -n test-functional

9. After test container is finished, test results will be stored in ./test-results folder

test-config.yaml

---

tests:
- name: integreatly-operator-test
  image: quay.io/integreatly/integreatly-operator-test-harness:<TAG>
  regExpFilter: "(A01)|(B01)"
  timeout: 7200
  envVars:
  - name: DESTRUCTIVE
    value: 'false'
  - name: MULTIAZ
    value: 'false'
  - name: WATCH_NAMESPACE
    value: redhat-rhoam-operator
  - name: BYPASS_STORAGE_TYPE_CHECK
    value: 'true'