Skip to content

Instantly share code, notes, and snippets.

@loverico

loverico/.env_local_airflow_for_gcp

Created November 24, 2020 06:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save loverico/f5fe0193be931d2ff33e7e91b27b2215 to your computer and use it in GitHub Desktop.
Save loverico/f5fe0193be931d2ff33e7e91b27b2215 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
.env_local_airflow_for_gcp
#主にdocker-composer.ymlで使われる環境変数たち
EXECUTOR=Local
LOAD_EX=n
# credentials ファイルのコンテナ内の場所
GOOGLE_APPLICATION_CREDENTIALS=/tmp/credentials/credentials.json
# variableファイルを別途作り、それを適用させたい場合は変更すること
AIRFLOW_VARIABLE_FILE_NAME=variables.json
PROJECT_ID=対象のプロジェクトID
# port8080を使っている時は変更すること
WEB_SERVER_PORT=8080
SERVICE_ACCOUNT=airflow-local@[対象のプロジェクトID].iam.gserviceaccount.com
#https://airflow.apache.org/docs/stable/howto/connection/index.html を参考のこと。 airflowでBQの接続や、そのほかGCPのAPIを接続するときに使う（URIエンコードすること)
AIRFLOW_CONN_BIGQUERY_DEFAULT=google-cloud-platform://?extra__google_cloud_platform__key_path=%2Ftmp%2Fcredentials%2Fcredentials.json&extra__google_cloud_platform__project=[対象のプロジェクトID]
AIRFLOW_CONN_GOOGLE_CLOUD_DEFAULT=google-cloud-platform://?extra__google_cloud_platform__key_path=%2Ftmp%2Fcredentials%2Fcredentials.json&extra__google_cloud_platform__project=[対象のプロジェクトID]
AIRFLOW__CORE__SQL_ALCHEMY_CONN=postgresql+psycopg2://airflow:airflow@postgres:5432/airflow
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment