Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
dfRaw\
    .withColumn("product_id", explode(col("product_id_set")))\
    .withColumn("category_element", explode(col("category_set")))\
    .withColumn("category_code", element_at(col("category_element"), 1))\
    .withColumn("category_id", element_at(col("category_element"), 2))\
    .select("product_id", "category_code", "category_id")\
    .show(truncate=False)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment