Skip to content

Instantly share code, notes, and snippets.

@ehborisov
ehborisov / Spark Dataframe Cheat Sheet.py
Last active October 12, 2020 07:01 — forked from AlessandroChecco/Spark Dataframe Cheat Sheet.py
Cheat sheet for Spark Dataframes (using Python)
# A simple cheat sheet of Spark Dataframe syntax
# Current for Spark 1.6.1
# import statements
#from pyspark.sql import SQLContext
#from pyspark.sql.types import *
#from pyspark.sql.functions import *
from pyspark.sql import functions as F
#SparkContext available as sc, HiveContext available as sqlContext.