Skip to content

Instantly share code, notes, and snippets.

@lakshay-arora

lakshay-arora/file_reading_1.py

Created November 3, 2019 13:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save lakshay-arora/11436de7b57dedbf816b04f76a4a9c9e to your computer and use it in GitHub Desktop.
Save lakshay-arora/11436de7b57dedbf816b04f76a4a9c9e to your computer and use it in GitHub Desktop.
Download ZIP
Raw
file_reading_1.py
# read a csv file
my_data = spark.read.csv('ind-ban-comment.csv',header=True)
# see the default schema of the dataframe
my_data.printSchema()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment