Skip to content

Instantly share code, notes, and snippets.

@kywe665
Created July 14, 2022 07:28
Show Gist options
  • Select an option

  • Save kywe665/5d80a856b532fcb0ceeae13220ad3025 to your computer and use it in GitHub Desktop.

Select an option

Save kywe665/5d80a856b532fcb0ceeae13220ad3025 to your computer and use it in GitHub Desktop.
testupdate = spark. \
read. \
format("hudi"). \
option("as.of.instant", "20220624055125356"). \
load(basePath). \
where("_hoodie_record_key = '1526970901000000'")
display(testupdate.select("tipAmount"))
# you can travel back in time before the upsert and reproduce the original tipAmount
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment