Skip to content

Instantly share code, notes, and snippets.

@velotiotech
Created November 17, 2023 08:13
input_df = spark.read.format('csv').option('header', 'true').load("../Desktop/Data-Engineering/data-samples/input-data/organizations-11111.csv")
input_df.printSchema()
input_df.write.mode('append').format("delta").option("mergeSchema", "true").saveAsTable("orgs_data")
spark.sql("SELECT * FROM orgs_data").show()
spark.sql("DESCRIBE TABLE orgs_data").show()
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment