Skip to content

Instantly share code, notes, and snippets.

@bh1995

bh1995/spark_session

Created January 13, 2021 17:49
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save bh1995/b27eb20a47c93f76e6781e21b8c63cc9 to your computer and use it in GitHub Desktop.
Save bh1995/b27eb20a47c93f76e6781e21b8c63cc9 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
spark_session
# create the Spark session
conf = SparkConf().set("spark.ui.port", "4050")
sc = pyspark.SparkContext(conf=conf)
spark = SparkSession.builder.getOrCreate()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment