Skip to content

Instantly share code, notes, and snippets.

@andr83
Created February 1, 2018 22:53
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save andr83/ab839afcf0b85e05ed88c11bd9c90dbd to your computer and use it in GitHub Desktop.
Save andr83/ab839afcf0b85e05ed88c11bd9c90dbd to your computer and use it in GitHub Desktop.
How to work with Hive tables with a lot of partitions from Spark
CREATE TABLE events (
created TIMESTAMP,
user STRING,
time STRING,
request STRING,
status STRING,
size STRING,
referer STRING
) PARTITION BY (
year INT,
month INT,
day INT,
hour INT,
country STRING
)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment