Skip to content

Instantly share code, notes, and snippets.

@nfarah86
Last active October 21, 2021 23:12
Show Gist options
  • Save nfarah86/b6c54c00eaece0804212a2b5896981cd to your computer and use it in GitHub Desktop.
Save nfarah86/b6c54c00eaece0804212a2b5896981cd to your computer and use it in GitHub Desktop.
def write_to_s3(rdata):
# write back to s3 after you've done transformations and such
rdata.write.format("csv").option("header","true").save("s3a://spark-rockset-public-nadine/OutputMovies.csv")
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment