Skip to content

Instantly share code, notes, and snippets.

@boseoladipo
Last active August 24, 2020 08:17
Show Gist options
  • Save boseoladipo/59195616be23b97d9287cc7b5d434716 to your computer and use it in GitHub Desktop.
Save boseoladipo/59195616be23b97d9287cc7b5d434716 to your computer and use it in GitHub Desktop.
Deployment command for beam exponea pipeline
python main.py --project $PROJECT \
--staging_location gs://$BUCKET/staging_location \
--temp_location gs://$BUCKET/temp_location \
--template_location gs://$BUCKET/templates/load-exponea-events \
--region $REGION \
--runner DataflowRunner \
--subnetwork https://www.googleapis.com/compute/alpha/projects/$PROJECT/regions/$REGION/subnetworks/$SUBNET_NAME \
--service_account_email $SERVICE_ACCOUNT \
--num_workers 1 \
--max_num_workers 5 \
--network $NETWORK \
--disk_size_gb 30 \
--experiments=shuffle_mode=service
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment