Skip to content

Instantly share code, notes, and snippets.

Avatar

Sebastian Radloff sebradloff

View GitHub Profile
@sebradloff
sebradloff / Dockerfile-airflow
Created Apr 17, 2018
Airflow MesosExecutor dockerized workflow
View Dockerfile-airflow
# REFERENCES:
# - https://github.com/puckel/docker-airflow
# - https://github.com/ImDarrenG/mesos-framework-dev/blob/master/Dockerfile
# - https://github.com/Stibbons/docker-airflow-mesos
# Wherever you store your mesos image built from Dockerfile-mesos
FROM slicelife/mesos:1.4.0 as mesos
FROM ubuntu:16.04
# Never prompts the user for choices on installation/configuration of packages
ENV DEBIAN_FRONTEND noninteractive
@sebradloff
sebradloff / Dockerfile
Created Mar 3, 2018
Setup for remote logs s3, airflow 1.9.0
View Dockerfile
# Showing the necessary part of adding the logging config to the python path
COPY config/log_config.py config/log_config.py
COPY config/__init__.py config/__init__.py
RUN chown -R airflow: ${AIRFLOW_HOME}
ENV PYTHONPATH ${PYTHONPATH}:/usr/lib/python2.7/site-packages/:${AIRFLOW_HOME}/config/
View keybase.md

Keybase proof

I hereby claim:

  • I am sebradloff on github.
  • I am sebradloff (https://keybase.io/sebradloff) on keybase.
  • I have a public key ASBfGPkYzF8GS258yk3bBsNHjw6yKTwhdJu8e0qHKhRTnAo

To claim this, I am signing this object:

You can’t perform that action at this time.