Skip to content

Instantly share code, notes, and snippets.

@antoniocachuan

antoniocachuan/apache_beam_execution.sh

Created April 27, 2021 03:06
Show Gist options
  • Save antoniocachuan/4f9f7917e3fdee7457f5934656ae062f to your computer and use it in GitHub Desktop.
Save antoniocachuan/4f9f7917e3fdee7457f5934656ae062f to your computer and use it in GitHub Desktop.
Download ZIP
Execute locally Apache Beam pipeline
Raw
apache_beam_execution.sh
python3 \
pipeline_dataflow.py \
--project \
PROJECT_ID \
--runner DirectRunner \
--temp_location \
gs://PROJECT_ID/dataflow/tmp \
--job_name dataflow-covid \
--region us-central1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment