Skip to content

Instantly share code, notes, and snippets.

@NeerajBhadani

NeerajBhadani/arr_flatten.scala

Last active May 25, 2020 10:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save NeerajBhadani/12a48cf07613419d686cdfcdb443b6a4 to your computer and use it in GitHub Desktop.
Save NeerajBhadani/12a48cf07613419d686cdfcdb443b6a4 to your computer and use it in GitHub Desktop.
Download ZIP
flatten
Raw
arr_flatten.scala
// Generate the nested array using the function "array_repeat".
val arr_repeat_df = df.withColumn("repeat", array_repeat($"array_col2", 2))
// flatten the nested array.
val arr_flat_df = arr_repeat_df
.withColumn("result", flatten($"repeat")).select("repeat", "result")
.select("repeat", "result")
arr_flat_df.show(truncate=false)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment