Skip to content

Instantly share code, notes, and snippets.

@shawncao
Last active August 10, 2020 06:23
Show Gist options
  • Save shawncao/0e26f2ea8f5614c1c9004d54354ac77a to your computer and use it in GitHub Desktop.
Save shawncao/0e26f2ea8f5614c1c9004d54354ac77a to your computer and use it in GitHub Desktop.
user.events.2days:
max-mb: 40000
max-hr: 48
schema: "ROW<__time:long,app:tinyint,country:string,gender:tinyint,age:tinyint,value:int>"
data: s3
loader: Swap
source: <path>
backup: s3://nebula/n303/
format: json
columns:
app:
partition:
values: ["1", "2", "3", "4", "5", "6"]
chunk: 2
country:
partition:
values:
[
"ar",
"au",
"be",
"br",
"ca",
"cl",
"co",
"de",
"es",
"fr",
"gb",
"id",
"in",
"it",
"jp",
"mx",
"nl",
"ph",
"pl",
"ru",
"th",
"tr",
"ua",
"us",
"za",
"",
]
chunk: 5
gender:
partition:
values: ["0", "1", "2"]
chunk: 1
age:
partition:
values: ["0", "1", "2", "3", "4", "5", "6"]
chunk: 1
time:
type: column
column: __time
pattern: UNIXTIME_MS
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment