Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save piercelamb/2bfc8856609ff12cf674e4125e4ae245 to your computer and use it in GitHub Desktop.
Save piercelamb/2bfc8856609ff12cf674e4125e4ae245 to your computer and use it in GitHub Desktop.
kafkaStream.map(_._2).foreachRDD(rdd => {
memSqlContext.createDataFrame(rowConverter.convert(rdd), schema)
.saveToMemSQL("adLogs", "adImpressions")
})
rowConverter does following conversion :
def convert(logRdd: RDD[AdImpressionLog]): RDD[Row]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment