Skip to content

Instantly share code, notes, and snippets.

@philsch
Last active January 28, 2019 20:48
Show Gist options
  • Save philsch/74e52772ff86f7cd813cd7a84526b8f5 to your computer and use it in GitHub Desktop.
Save philsch/74e52772ff86f7cd813cd7a84526b8f5 to your computer and use it in GitHub Desktop.
Blogpost: How to update row keys in Google Big Table
{
"name": "avro_transform",
"description": "Pipeline to transform Big Table exported avro files",
"parameters": [
{
"name": "input",
"label": "Input Cloud Storage File(s)",
"help_text": "Path of the file pattern glob to read from. For example gs://bucket/test-*.avro",
"regexes": [
"^gs:\/\/[^\n\r]+$"
],
"is_optional": false
},
{
"name": "output",
"label": "Output Cloud Storage File(s)",
"help_text": "Path of the file pattern glob to write to.",
"regexes": [
"^gs:\/\/[^\n\r]+$"
],
"is_optional": false
}
]
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment