Apache Airflow installation on Ubuntu Linux 18.x (GCP)

Apache-Airflow-installation-on-Ubuntu-Linux

Apache Airflow installation on Ubuntu 18.x (GCP)

https://www.anaconda.com/distribution/
Latest installable : https://repo.anaconda.com/archive/Anaconda3-2019.10-Linux-x86_64.sh

Create a GCP VM (Ubuntu 18x). Then proceed with the below commands on the ssh terminal

#Create install dirs
mkdir -p /app
sudo chown your_username -R /app
mkdir -p /app/installables

#Install Anaconda Python
cd /app/installables
wget https://repo.anaconda.com/archive/Anaconda3-2019.10-Linux-x86_64.sh
chmod +x Anaconda3-2019.10-Linux-x86_64.sh
echo "Guided installation starts. Provide anaconda path as : /app/anaconda"
bash archive/Anaconda3-2019.10-Linux-x86_64.sh
source ~/.bashrc

#Install gcc and pip
sudo apt install gcc
pip install -U pip

#Install Airflow
export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

#Install (optional) Airflow plugins
conda install -c conda-forge jpype1
pip install 'apache-airflow[jdbc]'
pip install 'apache-airflow[ssh]'
pip install 'apache-airflow[redis]'
pip install 'apache-airflow[oracle]'
pip install 'apache-airflow[ldap]'
pip install 'apache-airflow[github_enterprise]'
pip install 'apache-airflow[druid]'
pip install 'apache-airflow[crypto]'