Skip to content

Instantly share code, notes, and snippets.

@sabaelhilo

sabaelhilo/unique_id.py Secret

Created Jun 7, 2019
Embed
What would you like to do?
unique id demo
uuid_udf = udf(lambda: uuid_generator(), StringType())
df = skewed_df.withColumn("u_id", uuid_udf())\
.repartition(num_partitions, 'u_id')
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment