Skip to content

Instantly share code, notes, and snippets.

View gbroccolo's full-sized avatar

Giuseppe Broccolo gbroccolo

  • London, UK
View GitHub Profile
val inDF = glueContext.getSourceWithFormat(
connectionType = "s3",
options = JsonOptions(
Map(
"paths" -> Array(s"s3://path/to/s3/folder")
)
),
format = "parquet"
).getDynamicFrame()
.toDF()