Skip to content

Instantly share code, notes, and snippets.

@Arnonrgo

Arnonrgo/gist:b6d53e7740864d2d8b15

Created September 14, 2014 11:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Arnonrgo/b6d53e7740864d2d8b15 to your computer and use it in GitHub Desktop.
Save Arnonrgo/b6d53e7740864d2d8b15 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.scala
import sqlContext.createSchemaRDD
val weeklyAggregates = groupedWeekly.values.map(CalcAggregations(_))
weeklyAggregates.saveAsParquetFile("weekly.parquet")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment