Skip to content

Instantly share code, notes, and snippets.

@Arnonrgo
Created September 14, 2014 11:21
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Arnonrgo/b24b41a1576d8f61ba12 to your computer and use it in GitHub Desktop.
Save Arnonrgo/b24b41a1576d8f61ba12 to your computer and use it in GitHub Desktop.
ParquetOutputFormat.setWriteSupportClass(job,classOf[ProtoWriteSupport[Aggregate]])
ProtoParquetOutputFormat.setProtobufClass(job,classOf[Aggregate])
hourlyAggregates.saveAsNewAPIHadoopFile(outputDir,
classOf[Void],
classOf[Aggregate],
classOf[ParquetOutputFormat[Aggregate]],
job.getConfiguration)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment