Skip to content

Instantly share code, notes, and snippets.

@mythmon
Created September 21, 2017 21:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mythmon/749921b919663c5f5931b4abac7cb73f to your computer and use it in GitHub Desktop.
Save mythmon/749921b919663c5f5931b4abac7cb73f to your computer and use it in GitHub Desktop.
uptake 2
Display the source blob
Display the rendered blob
Raw
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
# coding: utf-8
# In[1]:
bucket = "telemetry-parquet"
prefix = "main_summary/v4"
s3path = "s3://{}/{}".format(bucket, prefix)
# In[2]:
get_ipython().magic(u'time df = spark.read.parquet(s3path)')
# In[3]:
df.printSchema()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment