Skip to content

Instantly share code, notes, and snippets.

@juri96

juri96/DataLoader.kt

Created November 15, 2019 13:45
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save juri96/ecbe25005cbba23ab39bfbf6eca0d93e to your computer and use it in GitHub Desktop.
Save juri96/ecbe25005cbba23ab39bfbf6eca0d93e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
DataLoader.kt
val options = PipelineOptionsFactory.`as`(DataflowPipelineOptions::class.java)
.apply {
project = "GCP_PROJECT_NAME"
stagingLocation = "gs://BUCKET_NAME/staging"
tempLocation = "gs://BUCKET_NAME/temp"
jobName = "etl-pipeline"
runner = DataflowRunner::class.java
}
val pipeline = Pipeline.create(options)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment