Skip to content

Instantly share code, notes, and snippets.

@ryw
Last active November 7, 2019 15:35
Show Gist options
  • Save ryw/8aa674f55a890c295edc111ef28f2cea to your computer and use it in GitHub Desktop.
Save ryw/8aa674f55a890c295edc111ef28f2cea to your computer and use it in GitHub Desktop.

Tillerless Astronomer on Openshift

Local dev setup

Install helm on your local machine, we will use it to generate YAML.

Tiller won't be installed on the cluster.

You'll be using the CLI only to generate YAML from a YAML template.

If you'd prefer to not fully avoid helm, you can hand-craft YAML or write your own generator scripts.

Cluster permissions

Depending on your installation configuration, you may need permission to create, modify and delete the following resources:

  • NetworkPolicy
  • Secret
  • Role
  • RoleBinding
  • ClusterRole
  • ClusterRoleBinding
  • ServiceAccount
  • ConfigMap
  • Service
  • DaemonSet
  • Deployment
  • StatefulSet
  • CronJob
  • Ingress

Installation

Follow https://www.astronomer.io/docs/ee-installation-openshift/ with the following exceptions:

  • Skip Create a Tiller Service Account and Deploy a Tiller Pod in step 4
  • Replace step 10 with the following commands
helm template -n <release-name> -f config.yaml . --namespace <my-namespace> > my_deployment.yaml

kubectl apply -f my_deployment.yaml -n <my-namespace>

Upgrade/modify platform + redeploy

TBD

Airflow Deployments

Create Airflow deployment

TBD

Modify Airflow deployment + redeploy

TBD

Deprovision Airflow deployment

TBD

DAG deployment

Deploy DAGs

TBD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment