Skip to content

Instantly share code, notes, and snippets.

@lakshay-arora
Created November 3, 2019 13:02
Show Gist options
  • Save lakshay-arora/11436de7b57dedbf816b04f76a4a9c9e to your computer and use it in GitHub Desktop.
Save lakshay-arora/11436de7b57dedbf816b04f76a4a9c9e to your computer and use it in GitHub Desktop.
# read a csv file
my_data = spark.read.csv('ind-ban-comment.csv',header=True)
# see the default schema of the dataframe
my_data.printSchema()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment