Skip to content

Instantly share code, notes, and snippets.

@prassee
Created February 21, 2017 02:00
Show Gist options
  • Save prassee/39061a7286968173f85459ba757dacc5 to your computer and use it in GitHub Desktop.
Save prassee/39061a7286968173f85459ba757dacc5 to your computer and use it in GitHub Desktop.
read from parquet bare metal code
import com.ionos.adx.streaming.AdxEventProcessingConstants
object ReadParquet extends AdxEventProcessingConstants {
def main(args: Array[String]): Unit = {
val parquetPath = conf.get("spark.hdfs.url") + "/lrm/hourlyData/17205/24775980"
import sparkSession.implicits._
val data = sparkSession.read.parquet(parquetPath).toDF()
data.show(10)
}
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment