Skip to content

Instantly share code, notes, and snippets.

View bala93kumar's full-sized avatar
💭
Works with data pipe lines

Balakumar Seetharaman bala93kumar

💭
Works with data pipe lines
View GitHub Profile
from pyspark.sql import SparkSession
from pyspark.sql.functions import col, lower
import sys
def main(argv):
spark = SparkSession.builder\
.appName('spark-movies-app')\
.getOrCreate()