Skip to content

Instantly share code, notes, and snippets.

@iht

iht/dataflow_options_with_terraform.py

Last active January 25, 2021 17:38
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save iht/ada9d99e2d1c5e129c5d0f5bab8cff1c to your computer and use it in GitHub Desktop.
Save iht/ada9d99e2d1c5e129c5d0f5bab8cff1c to your computer and use it in GitHub Desktop.
Download ZIP
Set Dataflow options programatically
Raw
dataflow_options_with_terraform.py
def run_pipeline(argv):
opts: PipelineOptions = PipelineOptions(argv)
gcloud_opts: GoogleCloudOptions = opts.view_as(GoogleCloudOptions)
gcloud_opts.enable_streaming_engine = True
gcloud_opts.job_name = "Overwrite the name of your job"
...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment