Skip to content

Instantly share code, notes, and snippets.

View mostafam's full-sized avatar

Mostafa Majidpour mostafam

View GitHub Profile
@mostafam
mostafam / create_sample_df.py
Last active June 3, 2020 01:28
Create sample Spark Dataframe
sample_df = spark.createDataFrame([(1, 33.704045, -157.754334),
(2, 45.019704, -118.014528),
(3, 21.306754,-119.159649)],
("id", "latitude","longitude"))
# +---+---------+-----------+
# | id| latitude| longitude|
# +---+---------+-----------+
# | 1|33.704045| -90.754334|
# | 2|45.019704|-123.014528|