Skip to content

Instantly share code, notes, and snippets.

@priyanlc
Last active Apr 30, 2020
Embed
What would you like to do?
df=spark.read.option("header","true").option("inferSchema","true) \
.csv(AWS_BUCKET_NAME +"/taxi_fare")
df.write.parquet(AWS_BUCKET_NAME +"/taxi_fare_parquet")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment