Skip to content

Instantly share code, notes, and snippets.

Ozgur Gul ozgurgul

Block or report user

Report or block ozgurgul

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
@ozgurgul
ozgurgul / airflow-quick-start.sh
Created May 22, 2020 — forked from mmziyad/airflow-quick-start.sh
A really quick on-boarding for Apache airflow.
View airflow-quick-start.sh
# install
mkdir ~/airflow
cd ~/airflow
pip install airflow
# Have a look here if you need additional packages: https://airflow.incubator.apache.org/installation.html
# setup mysql backend as given here. The default SQLite is not adequate for some workloads.
# http://site.clairvoyantsoft.com/installing-and-configuring-apache-airflow/
# start services
View install_airflow.sh
https://airflow.readthedocs.io/en/latest/start.html
sudo apt-get install python3-pip
sudo apt-get install postgresql postgresql-contrib
sudo -u postgres createuser --interactive
name: airflow
superuser: yes
@ozgurgul
ozgurgul / airflow-python3.sh
Created Feb 25, 2020 — forked from zacgca/airflow-python3.sh
Installing Airflow with CeleryExcuter, using PostgreSQL as metadata database and Redis for Celery message broker
View airflow-python3.sh
# this script has been tested and worked in a freshly installed Ubuntu 16.04 and 16.10
# it assumes that you are running airflow in a private netowrk and no need to be worry about outside access
# if that's not the case, the lines for PostgreSQL and Redis in this script need to be updated accordingly
# run as root
sudo su
# initial system updates and installs
apt-get update && apt-get upgrade -y && apt-get autoremove && apt-get autoclean
apt-get -y install build-essential binutils gcc make git htop nethogs tmux
You can’t perform that action at this time.